=== RUN   TestDownloadOnly/v1.16.0/json-events

aaa_download_only_test.go:69: (dbg) Run:  out/minikube-darwin-arm64 start -o=json --download-only -p download-only-278000 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=docker --driver=qemu2 

aaa_download_only_test.go:69: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -o=json --download-only -p download-only-278000 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=docker --driver=qemu2 : exit status 40 (10.48511975s)

-- stdout --

	{"specversion":"1.0","id":"9d5543b0-2edb-446c-8a7a-a584336a3dcc","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[download-only-278000] minikube v1.31.2 on Darwin 14.0 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}

	{"specversion":"1.0","id":"3b154e03-d8c3-42e0-8e3d-5aab9e9d8328","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=17345"}}

	{"specversion":"1.0","id":"b828b7a8-d747-4ee6-8b86-a1c67981fe41","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/17345-986/kubeconfig"}}

	{"specversion":"1.0","id":"19329941-c925-4fe1-9a46-81e4c157a5b8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-arm64"}}

	{"specversion":"1.0","id":"66d012a9-624d-4954-8950-a2747556a2eb","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}

	{"specversion":"1.0","id":"546b9372-c1ee-4f81-b902-dcd31700c492","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/17345-986/.minikube"}}

	{"specversion":"1.0","id":"ff242dfe-a0f4-4de8-a71f-f0a0bdd9d61c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.warning","datacontenttype":"application/json","data":{"message":"minikube skips various validations when --force is supplied; this may lead to unexpected behavior"}}

	{"specversion":"1.0","id":"65c19a22-1cd9-4bfd-bcf2-f9e2be1424e3","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the qemu2 driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}

	{"specversion":"1.0","id":"b256091b-d956-4ea8-ae9f-1c1002595a89","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Automatically selected the socket_vmnet network"}}

	{"specversion":"1.0","id":"93117cd1-841c-4a3a-a34d-38cd0936cabf","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Downloading VM boot image ...","name":"Selecting Driver","totalsteps":"19"}}

	{"specversion":"1.0","id":"5906827e-3295-48f9-bfa7-ffceb5346494","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting control plane node download-only-278000 in cluster download-only-278000","name":"Starting Node","totalsteps":"19"}}

	{"specversion":"1.0","id":"8969913a-5379-4a98-8925-04f74f58ef2a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Downloading Kubernetes v1.16.0 preload ...","name":"Starting Node","totalsteps":"19"}}

	{"specversion":"1.0","id":"ffef25a4-7ea0-4ad7-98e6-8f729dfdfc83","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"40","issues":"","message":"Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl.sha1: getter: \u0026{Ctx:context.Background Src:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl.sha1 Dst:/Users/jenkins/minikube-integration/17345-986/.minikube/cache/darwin/arm64/v1.16.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x103c65880 0x103c65880 0x103c65880 0x103c65880 0x103c65880 0x103c65880 0x103c65880] Decompressors:map[bz2:0x14000677640 gz:0x14000677648 tar:0x14000677560 tar.bz2:0x140006775a0 tar.gz:0x140006775b0 tar.xz:0x140006775f0 tar.zst:0x14000677630 tbz2:0x140006775a0 tgz:0x1400067

75b0 txz:0x140006775f0 tzst:0x14000677630 xz:0x14000677650 zip:0x14000677670 zst:0x14000677658] Getters:map[file:0x140006f8900 http:0x1400017e7d0 https:0x1400017e870] Dir:false ProgressListener:\u003cnil\u003e Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404","name":"INET_CACHE_KUBECTL","url":""}}

	{"specversion":"1.0","id":"5ce26765-db16-4e6e-bc14-587847cdf960","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"╭───────────────────────────────────────────────────────────────────────────────────────────╮\n│                                                                                           │\n│    If the above advice does not help, please let us know:                                 │\n│    https://github.com/kubernetes/minikube/issues/new/choose                               │\n│                                                                                           │\n│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │\n│

│\n╰───────────────────────────────────────────────────────────────────────────────────────────╯"}}

-- /stdout --

** stderr ** 

	I1003 17:03:20.858615    1449 out.go:296] Setting OutFile to fd 1 ...

	I1003 17:03:20.858796    1449 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1003 17:03:20.858799    1449 out.go:309] Setting ErrFile to fd 2...

	I1003 17:03:20.858801    1449 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1003 17:03:20.858958    1449 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17345-986/.minikube/bin

	W1003 17:03:20.859020    1449 root.go:314] Error reading config file at /Users/jenkins/minikube-integration/17345-986/.minikube/config/config.json: open /Users/jenkins/minikube-integration/17345-986/.minikube/config/config.json: no such file or directory

	I1003 17:03:20.860141    1449 out.go:303] Setting JSON to true

	I1003 17:03:20.877628    1449 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":174,"bootTime":1696377626,"procs":443,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.0","kernelVersion":"23.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W1003 17:03:20.877705    1449 start.go:136] gopshost.Virtualization returned error: not implemented yet

	I1003 17:03:20.885159    1449 out.go:97] [download-only-278000] minikube v1.31.2 on Darwin 14.0 (arm64)

	I1003 17:03:20.889091    1449 out.go:169] MINIKUBE_LOCATION=17345

	I1003 17:03:20.885275    1449 notify.go:220] Checking for updates...

	W1003 17:03:20.885303    1449 preload.go:295] Failed to list preload files: open /Users/jenkins/minikube-integration/17345-986/.minikube/cache/preloaded-tarball: no such file or directory

	I1003 17:03:20.900972    1449 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/17345-986/kubeconfig

	I1003 17:03:20.905061    1449 out.go:169] MINIKUBE_BIN=out/minikube-darwin-arm64

	I1003 17:03:20.908145    1449 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1003 17:03:20.911073    1449 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/17345-986/.minikube

	W1003 17:03:20.917063    1449 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior

	I1003 17:03:20.917261    1449 driver.go:373] Setting default libvirt URI to qemu:///system

	I1003 17:03:20.923036    1449 out.go:97] Using the qemu2 driver based on user configuration

	I1003 17:03:20.923042    1449 start.go:298] selected driver: qemu2

	I1003 17:03:20.923056    1449 start.go:902] validating driver "qemu2" against <nil>

	I1003 17:03:20.923123    1449 start_flags.go:307] no existing cluster config was found, will generate one from the flags 

	I1003 17:03:20.927054    1449 out.go:169] Automatically selected the socket_vmnet network

	I1003 17:03:20.934034    1449 start_flags.go:384] Using suggested 4000MB memory alloc based on sys=16384MB, container=0MB

	I1003 17:03:20.934137    1449 start_flags.go:905] Wait components to verify : map[apiserver:true system_pods:true]

	I1003 17:03:20.934198    1449 cni.go:84] Creating CNI manager for ""

	I1003 17:03:20.934215    1449 cni.go:162] CNI unnecessary in this configuration, recommending no CNI

	I1003 17:03:20.934219    1449 start_flags.go:321] config:

	{Name:download-only-278000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-278000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRun

time:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I1003 17:03:20.940506    1449 iso.go:125] acquiring lock: {Name:mkcc00c41dbf3c669d3c57dcea55708ed569b7af Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1003 17:03:20.945030    1449 out.go:97] Downloading VM boot image ...

	I1003 17:03:20.945060    1449 download.go:107] Downloading: https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-arm64.iso?checksum=file:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-arm64.iso.sha256 -> /Users/jenkins/minikube-integration/17345-986/.minikube/cache/iso/arm64/minikube-v1.31.0-1695060926-17240-arm64.iso

	I1003 17:03:25.224536    1449 out.go:97] Starting control plane node download-only-278000 in cluster download-only-278000

	I1003 17:03:25.224554    1449 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker

	I1003 17:03:25.280363    1449 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4

	I1003 17:03:25.280384    1449 cache.go:57] Caching tarball of preloaded images

	I1003 17:03:25.280517    1449 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker

	I1003 17:03:25.284733    1449 out.go:97] Downloading Kubernetes v1.16.0 preload ...

	I1003 17:03:25.284739    1449 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...

	I1003 17:03:25.358847    1449 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4?checksum=md5:a000baffb0664b293d602f95ed25caa6 -> /Users/jenkins/minikube-integration/17345-986/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4

	I1003 17:03:30.398297    1449 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...

	I1003 17:03:30.398467    1449 preload.go:256] verifying checksum of /Users/jenkins/minikube-integration/17345-986/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...

	I1003 17:03:31.040587    1449 cache.go:60] Finished verifying existence of preloaded tar for  v1.16.0 on docker

	I1003 17:03:31.040782    1449 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/download-only-278000/config.json ...

	I1003 17:03:31.040798    1449 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/download-only-278000/config.json: {Name:mk5649223888d7fca3bc6155a452f90fb2c86f5b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:03:31.041029    1449 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker

	I1003 17:03:31.041176    1449 download.go:107] Downloading: https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl.sha1 -> /Users/jenkins/minikube-integration/17345-986/.minikube/cache/darwin/arm64/v1.16.0/kubectl

	I1003 17:03:31.274286    1449 out.go:169] 

	W1003 17:03:31.278536    1449 out_reason.go:110] Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl.sha1: getter: &{Ctx:context.Background Src:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl.sha1 Dst:/Users/jenkins/minikube-integration/17345-986/.minikube/cache/darwin/arm64/v1.16.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x103c65880 0x103c65880 0x103c65880 0x103c65880 0x103c65880 0x103c65880 0x103c65880] Decompressors:map[bz2:0x14000677640 gz:0x14000677648 tar:0x14000677560 tar.bz2:0x140006775a0 tar.gz:0x140006775b0 tar.xz:0x140006775f0 tar.zst:0x14000677630 tbz2:0x140006775a0 tgz:0x140006775b0 txz:0x140006775f0 tzst:0x14000677630 xz:0x14000677650 zip:0x14000677670 zst:0x14000677658] Getters:map[file:0x140006f8900 http:0x1400017e7d0 https:0x1400017e870] Dir:false ProgressListener:

<nil> Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404

	W1003 17:03:31.278565    1449 out_reason.go:110] 

	W1003 17:03:31.285624    1449 out.go:229] ╭───────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                           │

	│    If the above advice does not help, please let us know:                                 │

	│    https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                           │

	│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                           │

	╰───────────────────────────────────────────────────────────────────────────────────────────╯

	I1003 17:03:31.289414    1449 out.go:169] 

** /stderr **

aaa_download_only_test.go:71: failed to download only. args: ["start" "-o=json" "--download-only" "-p" "download-only-278000" "--force" "--alsologtostderr" "--kubernetes-version=v1.16.0" "--container-runtime=docker" "--driver=qemu2" ""] exit status 40

--- FAIL: TestDownloadOnly/v1.16.0/json-events (10.49s)

=== RUN   TestDownloadOnly/v1.16.0/kubectl

aaa_download_only_test.go:160: expected the file for binary exist at "/Users/jenkins/minikube-integration/17345-986/.minikube/cache/darwin/arm64/v1.16.0/kubectl" but got error stat /Users/jenkins/minikube-integration/17345-986/.minikube/cache/darwin/arm64/v1.16.0/kubectl: no such file or directory

--- FAIL: TestDownloadOnly/v1.16.0/kubectl (0.00s)

=== RUN   TestOffline

=== PAUSE TestOffline

=== CONT  TestOffline

aab_offline_test.go:55: (dbg) Run:  out/minikube-darwin-arm64 start -p offline-docker-974000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2 

aab_offline_test.go:55: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p offline-docker-974000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2 : exit status 80 (9.69255925s)

-- stdout --

	* [offline-docker-974000] minikube v1.31.2 on Darwin 14.0 (arm64)

	  - MINIKUBE_LOCATION=17345

	  - KUBECONFIG=/Users/jenkins/minikube-integration/17345-986/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17345-986/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting control plane node offline-docker-974000 in cluster offline-docker-974000

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "offline-docker-974000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I1003 17:34:32.555992    3729 out.go:296] Setting OutFile to fd 1 ...

	I1003 17:34:32.556152    3729 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1003 17:34:32.556155    3729 out.go:309] Setting ErrFile to fd 2...

	I1003 17:34:32.556159    3729 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1003 17:34:32.556293    3729 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17345-986/.minikube/bin

	I1003 17:34:32.557419    3729 out.go:303] Setting JSON to false

	I1003 17:34:32.575080    3729 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":2046,"bootTime":1696377626,"procs":456,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.0","kernelVersion":"23.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W1003 17:34:32.575155    3729 start.go:136] gopshost.Virtualization returned error: not implemented yet

	I1003 17:34:32.580029    3729 out.go:177] * [offline-docker-974000] minikube v1.31.2 on Darwin 14.0 (arm64)

	I1003 17:34:32.587153    3729 out.go:177]   - MINIKUBE_LOCATION=17345

	I1003 17:34:32.587286    3729 notify.go:220] Checking for updates...

	I1003 17:34:32.594039    3729 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17345-986/kubeconfig

	I1003 17:34:32.597108    3729 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I1003 17:34:32.600027    3729 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1003 17:34:32.603075    3729 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17345-986/.minikube

	I1003 17:34:32.606090    3729 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1003 17:34:32.609519    3729 config.go:182] Loaded profile config "multinode-609000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 17:34:32.609574    3729 driver.go:373] Setting default libvirt URI to qemu:///system

	I1003 17:34:32.612991    3729 out.go:177] * Using the qemu2 driver based on user configuration

	I1003 17:34:32.618962    3729 start.go:298] selected driver: qemu2

	I1003 17:34:32.618971    3729 start.go:902] validating driver "qemu2" against <nil>

	I1003 17:34:32.618978    3729 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1003 17:34:32.620942    3729 start_flags.go:307] no existing cluster config was found, will generate one from the flags 

	I1003 17:34:32.624003    3729 out.go:177] * Automatically selected the socket_vmnet network

	I1003 17:34:32.627217    3729 start_flags.go:923] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1003 17:34:32.627251    3729 cni.go:84] Creating CNI manager for ""

	I1003 17:34:32.627270    3729 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1003 17:34:32.627275    3729 start_flags.go:316] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I1003 17:34:32.627289    3729 start_flags.go:321] config:

	{Name:offline-docker-974000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.2 ClusterName:offline-docker-974000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerR

untime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthS

ock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I1003 17:34:32.631843    3729 iso.go:125] acquiring lock: {Name:mkcc00c41dbf3c669d3c57dcea55708ed569b7af Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1003 17:34:32.639001    3729 out.go:177] * Starting control plane node offline-docker-974000 in cluster offline-docker-974000

	I1003 17:34:32.642996    3729 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime docker

	I1003 17:34:32.643020    3729 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17345-986/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-arm64.tar.lz4

	I1003 17:34:32.643032    3729 cache.go:57] Caching tarball of preloaded images

	I1003 17:34:32.643097    3729 preload.go:174] Found /Users/jenkins/minikube-integration/17345-986/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I1003 17:34:32.643103    3729 cache.go:60] Finished verifying existence of preloaded tar for  v1.28.2 on docker

	I1003 17:34:32.643174    3729 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/offline-docker-974000/config.json ...

	I1003 17:34:32.643185    3729 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/offline-docker-974000/config.json: {Name:mkf3ecc70b417522915445cb805b6e2cd3d9e876 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:34:32.643429    3729 start.go:365] acquiring machines lock for offline-docker-974000: {Name:mk16657683bb2d197cbddad244cc8b10f1cb12f0 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1003 17:34:32.643458    3729 start.go:369] acquired machines lock for "offline-docker-974000" in 22.667µs

	I1003 17:34:32.643473    3729 start.go:93] Provisioning new machine with config: &{Name:offline-docker-974000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne

tesConfig:{KubernetesVersion:v1.28.2 ClusterName:offline-docker-974000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP

: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1003 17:34:32.643507    3729 start.go:125] createHost starting for "" (driver="qemu2")

	I1003 17:34:32.648050    3729 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I1003 17:34:32.662633    3729 start.go:159] libmachine.API.Create for "offline-docker-974000" (driver="qemu2")

	I1003 17:34:32.662660    3729 client.go:168] LocalClient.Create starting

	I1003 17:34:32.662723    3729 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem

	I1003 17:34:32.662751    3729 main.go:141] libmachine: Decoding PEM data...

	I1003 17:34:32.662764    3729 main.go:141] libmachine: Parsing certificate...

	I1003 17:34:32.662807    3729 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17345-986/.minikube/certs/cert.pem

	I1003 17:34:32.662825    3729 main.go:141] libmachine: Decoding PEM data...

	I1003 17:34:32.662833    3729 main.go:141] libmachine: Parsing certificate...

	I1003 17:34:32.663148    3729 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17345-986/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17345-986/.minikube/cache/iso/arm64/minikube-v1.31.0-1695060926-17240-arm64.iso...

	I1003 17:34:32.777599    3729 main.go:141] libmachine: Creating SSH key...

	I1003 17:34:32.857269    3729 main.go:141] libmachine: Creating Disk image...

	I1003 17:34:32.857281    3729 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I1003 17:34:32.857452    3729 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17345-986/.minikube/machines/offline-docker-974000/disk.qcow2.raw /Users/jenkins/minikube-integration/17345-986/.minikube/machines/offline-docker-974000/disk.qcow2

	I1003 17:34:32.866716    3729 main.go:141] libmachine: STDOUT: 

	I1003 17:34:32.866735    3729 main.go:141] libmachine: STDERR: 

	I1003 17:34:32.866794    3729 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17345-986/.minikube/machines/offline-docker-974000/disk.qcow2 +20000M

	I1003 17:34:32.875075    3729 main.go:141] libmachine: STDOUT: Image resized.

	I1003 17:34:32.875092    3729 main.go:141] libmachine: STDERR: 

	I1003 17:34:32.875114    3729 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17345-986/.minikube/machines/offline-docker-974000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17345-986/.minikube/machines/offline-docker-974000/disk.qcow2

	I1003 17:34:32.875125    3729 main.go:141] libmachine: Starting QEMU VM...

	I1003 17:34:32.875176    3729 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17345-986/.minikube/machines/offline-docker-974000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/offline-docker-974000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17345-986/.minikube/machines/offline-docker-974000/qemu.pid -device virtio-net-pci,netdev=net0,mac=46:67:20:2d:99:f3 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17345-986/.minikube/machines/offline-docker-974000/disk.qcow2

	I1003 17:34:32.877109    3729 main.go:141] libmachine: STDOUT: 

	I1003 17:34:32.877122    3729 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I1003 17:34:32.877139    3729 client.go:171] LocalClient.Create took 214.475583ms

	I1003 17:34:34.877971    3729 start.go:128] duration metric: createHost completed in 2.234499083s

	I1003 17:34:34.877991    3729 start.go:83] releasing machines lock for "offline-docker-974000", held for 2.234571083s

	W1003 17:34:34.878001    3729 start.go:688] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1003 17:34:34.883134    3729 out.go:177] * Deleting "offline-docker-974000" in qemu2 ...

	W1003 17:34:34.895427    3729 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1003 17:34:34.895434    3729 start.go:703] Will try again in 5 seconds ...

	I1003 17:34:39.897437    3729 start.go:365] acquiring machines lock for offline-docker-974000: {Name:mk16657683bb2d197cbddad244cc8b10f1cb12f0 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1003 17:34:39.897543    3729 start.go:369] acquired machines lock for "offline-docker-974000" in 85.916µs

	I1003 17:34:39.897570    3729 start.go:93] Provisioning new machine with config: &{Name:offline-docker-974000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne

tesConfig:{KubernetesVersion:v1.28.2 ClusterName:offline-docker-974000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP

: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1003 17:34:39.897614    3729 start.go:125] createHost starting for "" (driver="qemu2")

	I1003 17:34:39.910340    3729 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I1003 17:34:39.927700    3729 start.go:159] libmachine.API.Create for "offline-docker-974000" (driver="qemu2")

	I1003 17:34:39.927737    3729 client.go:168] LocalClient.Create starting

	I1003 17:34:39.927815    3729 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem

	I1003 17:34:39.927851    3729 main.go:141] libmachine: Decoding PEM data...

	I1003 17:34:39.927862    3729 main.go:141] libmachine: Parsing certificate...

	I1003 17:34:39.927902    3729 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17345-986/.minikube/certs/cert.pem

	I1003 17:34:39.927924    3729 main.go:141] libmachine: Decoding PEM data...

	I1003 17:34:39.927931    3729 main.go:141] libmachine: Parsing certificate...

	I1003 17:34:39.928641    3729 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17345-986/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17345-986/.minikube/cache/iso/arm64/minikube-v1.31.0-1695060926-17240-arm64.iso...

	I1003 17:34:40.045398    3729 main.go:141] libmachine: Creating SSH key...

	I1003 17:34:40.161546    3729 main.go:141] libmachine: Creating Disk image...

	I1003 17:34:40.161556    3729 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I1003 17:34:40.161733    3729 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17345-986/.minikube/machines/offline-docker-974000/disk.qcow2.raw /Users/jenkins/minikube-integration/17345-986/.minikube/machines/offline-docker-974000/disk.qcow2

	I1003 17:34:40.170974    3729 main.go:141] libmachine: STDOUT: 

	I1003 17:34:40.170991    3729 main.go:141] libmachine: STDERR: 

	I1003 17:34:40.171047    3729 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17345-986/.minikube/machines/offline-docker-974000/disk.qcow2 +20000M

	I1003 17:34:40.179000    3729 main.go:141] libmachine: STDOUT: Image resized.

	I1003 17:34:40.179024    3729 main.go:141] libmachine: STDERR: 

	I1003 17:34:40.179044    3729 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17345-986/.minikube/machines/offline-docker-974000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17345-986/.minikube/machines/offline-docker-974000/disk.qcow2

	I1003 17:34:40.179051    3729 main.go:141] libmachine: Starting QEMU VM...

	I1003 17:34:40.179085    3729 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17345-986/.minikube/machines/offline-docker-974000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/offline-docker-974000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17345-986/.minikube/machines/offline-docker-974000/qemu.pid -device virtio-net-pci,netdev=net0,mac=e2:84:45:18:eb:54 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17345-986/.minikube/machines/offline-docker-974000/disk.qcow2

	I1003 17:34:40.180835    3729 main.go:141] libmachine: STDOUT: 

	I1003 17:34:40.180849    3729 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I1003 17:34:40.180867    3729 client.go:171] LocalClient.Create took 253.1285ms

	I1003 17:34:42.182967    3729 start.go:128] duration metric: createHost completed in 2.28537875s

	I1003 17:34:42.183014    3729 start.go:83] releasing machines lock for "offline-docker-974000", held for 2.285508416s

	W1003 17:34:42.183175    3729 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p offline-docker-974000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p offline-docker-974000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1003 17:34:42.190733    3729 out.go:177] 

	W1003 17:34:42.194859    3729 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W1003 17:34:42.194896    3729 out.go:239] * 

	* 

	W1003 17:34:42.197249    3729 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I1003 17:34:42.207726    3729 out.go:177] 

** /stderr **

aab_offline_test.go:58: out/minikube-darwin-arm64 start -p offline-docker-974000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2  failed: exit status 80

panic.go:523: *** TestOffline FAILED at 2023-10-03 17:34:42.220873 -0700 PDT m=+1881.443586459

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p offline-docker-974000 -n offline-docker-974000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p offline-docker-974000 -n offline-docker-974000: exit status 7 (63.128125ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "offline-docker-974000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "offline-docker-974000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p offline-docker-974000

--- FAIL: TestOffline (9.85s)

=== RUN   TestAddons/parallel/Registry

=== PAUSE TestAddons/parallel/Registry

=== CONT  TestAddons/parallel/Registry

addons_test.go:306: failed waiting for registry replicacontroller to stabilize: timed out waiting for the condition

addons_test.go:308: registry stabilized in 6m0.001071s

addons_test.go:310: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...

addons_test.go:310: ***** TestAddons/parallel/Registry: pod "actual-registry=true" failed to start within 6m0s: context deadline exceeded ****

addons_test.go:310: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p addons-585000 -n addons-585000

addons_test.go:310: TestAddons/parallel/Registry: showing logs for failed pods as of 2023-10-03 17:22:24.67407 -0700 PDT m=+1143.882360668

addons_test.go:311: failed waiting for pod actual-registry: actual-registry=true within 6m0s: context deadline exceeded

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p addons-585000 -n addons-585000

helpers_test.go:244: <<< TestAddons/parallel/Registry FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/Registry]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p addons-585000 logs -n 25

helpers_test.go:252: TestAddons/parallel/Registry logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| Command |                                            Args                                             |       Profile        |  User   | Version |     Start Time      |      End Time       |

	|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| start   | -o=json --download-only                                                                     | download-only-278000 | jenkins | v1.31.2 | 03 Oct 23 17:03 PDT |                     |

	|         | -p download-only-278000                                                                     |                      |         |         |                     |                     |

	|         | --force --alsologtostderr                                                                   |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.16.0                                                                |                      |         |         |                     |                     |

	|         | --container-runtime=docker                                                                  |                      |         |         |                     |                     |

	|         | --driver=qemu2                                                                              |                      |         |         |                     |                     |

	| start   | -o=json --download-only                                                                     | download-only-278000 | jenkins | v1.31.2 | 03 Oct 23 17:03 PDT |                     |

	|         | -p download-only-278000                                                                     |                      |         |         |                     |                     |

	|         | --force --alsologtostderr                                                                   |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.28.2                                                                |                      |         |         |                     |                     |

	|         | --container-runtime=docker                                                                  |                      |         |         |                     |                     |

	|         | --driver=qemu2                                                                              |                      |         |         |                     |                     |

	| delete  | --all                                                                                       | minikube             | jenkins | v1.31.2 | 03 Oct 23 17:03 PDT | 03 Oct 23 17:03 PDT |

	| delete  | -p download-only-278000                                                                     | download-only-278000 | jenkins | v1.31.2 | 03 Oct 23 17:03 PDT | 03 Oct 23 17:03 PDT |

	| delete  | -p download-only-278000                                                                     | download-only-278000 | jenkins | v1.31.2 | 03 Oct 23 17:03 PDT | 03 Oct 23 17:03 PDT |

	| start   | --download-only -p                                                                          | binary-mirror-585000 | jenkins | v1.31.2 | 03 Oct 23 17:03 PDT |                     |

	|         | binary-mirror-585000                                                                        |                      |         |         |                     |                     |

	|         | --alsologtostderr                                                                           |                      |         |         |                     |                     |

	|         | --binary-mirror                                                                             |                      |         |         |                     |                     |

	|         | http://127.0.0.1:49316                                                                      |                      |         |         |                     |                     |

	|         | --driver=qemu2                                                                              |                      |         |         |                     |                     |

	| delete  | -p binary-mirror-585000                                                                     | binary-mirror-585000 | jenkins | v1.31.2 | 03 Oct 23 17:03 PDT | 03 Oct 23 17:03 PDT |

	| start   | -p addons-585000 --wait=true                                                                | addons-585000        | jenkins | v1.31.2 | 03 Oct 23 17:03 PDT | 03 Oct 23 17:10 PDT |

	|         | --memory=4000 --alsologtostderr                                                             |                      |         |         |                     |                     |

	|         | --addons=registry                                                                           |                      |         |         |                     |                     |

	|         | --addons=metrics-server                                                                     |                      |         |         |                     |                     |

	|         | --addons=volumesnapshots                                                                    |                      |         |         |                     |                     |

	|         | --addons=csi-hostpath-driver                                                                |                      |         |         |                     |                     |

	|         | --addons=gcp-auth                                                                           |                      |         |         |                     |                     |

	|         | --addons=cloud-spanner                                                                      |                      |         |         |                     |                     |

	|         | --addons=inspektor-gadget                                                                   |                      |         |         |                     |                     |

	|         | --addons=storage-provisioner-rancher                                                        |                      |         |         |                     |                     |

	|         | --driver=qemu2  --addons=ingress                                                            |                      |         |         |                     |                     |

	|         | --addons=ingress-dns                                                                        |                      |         |         |                     |                     |

	| ssh     | addons-585000 ssh cat                                                                       | addons-585000        | jenkins | v1.31.2 | 03 Oct 23 17:10 PDT | 03 Oct 23 17:10 PDT |

	|         | /opt/local-path-provisioner/pvc-320167fa-02d3-46e8-a116-8a91ec031e73_default_test-pvc/file1 |                      |         |         |                     |                     |

	| addons  | addons-585000 addons disable                                                                | addons-585000        | jenkins | v1.31.2 | 03 Oct 23 17:10 PDT | 03 Oct 23 17:11 PDT |

	|         | storage-provisioner-rancher                                                                 |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |

	| addons  | disable cloud-spanner -p                                                                    | addons-585000        | jenkins | v1.31.2 | 03 Oct 23 17:11 PDT | 03 Oct 23 17:11 PDT |

	|         | addons-585000                                                                               |                      |         |         |                     |                     |

	| addons  | enable headlamp                                                                             | addons-585000        | jenkins | v1.31.2 | 03 Oct 23 17:11 PDT | 03 Oct 23 17:11 PDT |

	|         | -p addons-585000                                                                            |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |

	| addons  | addons-585000 addons                                                                        | addons-585000        | jenkins | v1.31.2 | 03 Oct 23 17:12 PDT | 03 Oct 23 17:12 PDT |

	|         | disable csi-hostpath-driver                                                                 |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |

	| addons  | addons-585000 addons                                                                        | addons-585000        | jenkins | v1.31.2 | 03 Oct 23 17:12 PDT | 03 Oct 23 17:12 PDT |

	|         | disable volumesnapshots                                                                     |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |

	| addons  | addons-585000 addons                                                                        | addons-585000        | jenkins | v1.31.2 | 03 Oct 23 17:12 PDT | 03 Oct 23 17:12 PDT |

	|         | disable metrics-server                                                                      |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |

	|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2023/10/03 17:03:39

	Running on machine: MacOS-M1-Agent-2

	Binary: Built with gc go1.21.1 for darwin/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1003 17:03:39.158581    1527 out.go:296] Setting OutFile to fd 1 ...

	I1003 17:03:39.158729    1527 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1003 17:03:39.158732    1527 out.go:309] Setting ErrFile to fd 2...

	I1003 17:03:39.158735    1527 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1003 17:03:39.158883    1527 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17345-986/.minikube/bin

	I1003 17:03:39.159993    1527 out.go:303] Setting JSON to false

	I1003 17:03:39.176087    1527 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":193,"bootTime":1696377626,"procs":436,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.0","kernelVersion":"23.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W1003 17:03:39.176163    1527 start.go:136] gopshost.Virtualization returned error: not implemented yet

	I1003 17:03:39.181737    1527 out.go:177] * [addons-585000] minikube v1.31.2 on Darwin 14.0 (arm64)

	I1003 17:03:39.192759    1527 out.go:177]   - MINIKUBE_LOCATION=17345

	I1003 17:03:39.188852    1527 notify.go:220] Checking for updates...

	I1003 17:03:39.199748    1527 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17345-986/kubeconfig

	I1003 17:03:39.202788    1527 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I1003 17:03:39.205793    1527 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1003 17:03:39.208724    1527 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17345-986/.minikube

	I1003 17:03:39.211745    1527 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1003 17:03:39.214972    1527 driver.go:373] Setting default libvirt URI to qemu:///system

	I1003 17:03:39.217703    1527 out.go:177] * Using the qemu2 driver based on user configuration

	I1003 17:03:39.224760    1527 start.go:298] selected driver: qemu2

	I1003 17:03:39.224769    1527 start.go:902] validating driver "qemu2" against <nil>

	I1003 17:03:39.224776    1527 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1003 17:03:39.227233    1527 start_flags.go:307] no existing cluster config was found, will generate one from the flags 

	I1003 17:03:39.228551    1527 out.go:177] * Automatically selected the socket_vmnet network

	I1003 17:03:39.231862    1527 start_flags.go:923] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1003 17:03:39.231889    1527 cni.go:84] Creating CNI manager for ""

	I1003 17:03:39.231898    1527 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1003 17:03:39.231909    1527 start_flags.go:316] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I1003 17:03:39.231915    1527 start_flags.go:321] config:

	{Name:addons-585000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.2 ClusterName:addons-585000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CR

ISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID

:0 AutoPauseInterval:1m0s}

	I1003 17:03:39.236467    1527 iso.go:125] acquiring lock: {Name:mkcc00c41dbf3c669d3c57dcea55708ed569b7af Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1003 17:03:39.244723    1527 out.go:177] * Starting control plane node addons-585000 in cluster addons-585000

	I1003 17:03:39.248720    1527 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime docker

	I1003 17:03:39.248732    1527 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17345-986/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-arm64.tar.lz4

	I1003 17:03:39.248743    1527 cache.go:57] Caching tarball of preloaded images

	I1003 17:03:39.248794    1527 preload.go:174] Found /Users/jenkins/minikube-integration/17345-986/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I1003 17:03:39.248799    1527 cache.go:60] Finished verifying existence of preloaded tar for  v1.28.2 on docker

	I1003 17:03:39.249009    1527 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/config.json ...

	I1003 17:03:39.249019    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/config.json: {Name:mkd778f466258ed6668af8388431c37d54563e91 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:03:39.249218    1527 start.go:365] acquiring machines lock for addons-585000: {Name:mk16657683bb2d197cbddad244cc8b10f1cb12f0 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1003 17:03:39.249347    1527 start.go:369] acquired machines lock for "addons-585000" in 123.542µs

	I1003 17:03:39.249358    1527 start.go:93] Provisioning new machine with config: &{Name:addons-585000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi

g:{KubernetesVersion:v1.28.2 ClusterName:addons-585000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262

144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1003 17:03:39.249387    1527 start.go:125] createHost starting for "" (driver="qemu2")

	I1003 17:03:39.257735    1527 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	I1003 17:03:40.011044    1527 start.go:159] libmachine.API.Create for "addons-585000" (driver="qemu2")

	I1003 17:03:40.011102    1527 client.go:168] LocalClient.Create starting

	I1003 17:03:40.011343    1527 main.go:141] libmachine: Creating CA: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem

	I1003 17:03:40.143344    1527 main.go:141] libmachine: Creating client certificate: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/cert.pem

	I1003 17:03:40.289873    1527 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17345-986/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17345-986/.minikube/cache/iso/arm64/minikube-v1.31.0-1695060926-17240-arm64.iso...

	I1003 17:03:40.457885    1527 main.go:141] libmachine: Creating SSH key...

	I1003 17:03:40.594285    1527 main.go:141] libmachine: Creating Disk image...

	I1003 17:03:40.594296    1527 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I1003 17:03:40.594516    1527 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/disk.qcow2.raw /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/disk.qcow2

	I1003 17:03:40.676774    1527 main.go:141] libmachine: STDOUT: 

	I1003 17:03:40.676808    1527 main.go:141] libmachine: STDERR: 

	I1003 17:03:40.676887    1527 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/disk.qcow2 +20000M

	I1003 17:03:40.686768    1527 main.go:141] libmachine: STDOUT: Image resized.

	I1003 17:03:40.686791    1527 main.go:141] libmachine: STDERR: 

	I1003 17:03:40.686809    1527 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/disk.qcow2

	I1003 17:03:40.686818    1527 main.go:141] libmachine: Starting QEMU VM...

	I1003 17:03:40.686868    1527 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/qemu.pid -device virtio-net-pci,netdev=net0,mac=56:68:9c:60:58:22 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/disk.qcow2

	I1003 17:03:40.738577    1527 main.go:141] libmachine: STDOUT: 

	I1003 17:03:40.738615    1527 main.go:141] libmachine: STDERR: 

	I1003 17:03:40.738620    1527 main.go:141] libmachine: Attempt 0

	I1003 17:03:40.738639    1527 main.go:141] libmachine: Searching for 56:68:9c:60:58:22 in /var/db/dhcpd_leases ...

	I1003 17:03:42.739795    1527 main.go:141] libmachine: Attempt 1

	I1003 17:03:42.739877    1527 main.go:141] libmachine: Searching for 56:68:9c:60:58:22 in /var/db/dhcpd_leases ...

	I1003 17:03:44.740254    1527 main.go:141] libmachine: Attempt 2

	I1003 17:03:44.740355    1527 main.go:141] libmachine: Searching for 56:68:9c:60:58:22 in /var/db/dhcpd_leases ...

	I1003 17:03:46.741375    1527 main.go:141] libmachine: Attempt 3

	I1003 17:03:46.741387    1527 main.go:141] libmachine: Searching for 56:68:9c:60:58:22 in /var/db/dhcpd_leases ...

	I1003 17:03:48.742425    1527 main.go:141] libmachine: Attempt 4

	I1003 17:03:48.742472    1527 main.go:141] libmachine: Searching for 56:68:9c:60:58:22 in /var/db/dhcpd_leases ...

	I1003 17:03:50.743507    1527 main.go:141] libmachine: Attempt 5

	I1003 17:03:50.743527    1527 main.go:141] libmachine: Searching for 56:68:9c:60:58:22 in /var/db/dhcpd_leases ...

	I1003 17:03:52.744581    1527 main.go:141] libmachine: Attempt 6

	I1003 17:03:52.744624    1527 main.go:141] libmachine: Searching for 56:68:9c:60:58:22 in /var/db/dhcpd_leases ...

	I1003 17:03:52.744780    1527 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I1003 17:03:52.744831    1527 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:56:68:9c:60:58:22 ID:1,56:68:9c:60:58:22 Lease:0x651dfd67}

	I1003 17:03:52.744840    1527 main.go:141] libmachine: Found match: 56:68:9c:60:58:22

	I1003 17:03:52.744854    1527 main.go:141] libmachine: IP: 192.168.105.2

	I1003 17:03:52.744861    1527 main.go:141] libmachine: Waiting for VM to start (ssh -p 22 docker@192.168.105.2)...

	I1003 17:03:53.749773    1527 machine.go:88] provisioning docker machine ...

	I1003 17:03:53.749795    1527 buildroot.go:166] provisioning hostname "addons-585000"

	I1003 17:03:53.750715    1527 main.go:141] libmachine: Using SSH client type: native

	I1003 17:03:53.750982    1527 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10290de60] 0x1029105d0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I1003 17:03:53.750988    1527 main.go:141] libmachine: About to run SSH command:

	sudo hostname addons-585000 && echo "addons-585000" | sudo tee /etc/hostname

	I1003 17:03:53.772634    1527 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain

	I1003 17:03:56.876175    1527 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-585000

	I1003 17:03:56.876314    1527 main.go:141] libmachine: Using SSH client type: native

	I1003 17:03:56.876804    1527 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10290de60] 0x1029105d0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I1003 17:03:56.876820    1527 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-585000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-585000/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-585000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1003 17:03:56.953972    1527 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1003 17:03:56.953997    1527 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/17345-986/.minikube CaCertPath:/Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/17345-986/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/17345-986/.minikube}

	I1003 17:03:56.954022    1527 buildroot.go:174] setting up certificates

	I1003 17:03:56.954030    1527 provision.go:83] configureAuth start

	I1003 17:03:56.954037    1527 provision.go:138] copyHostCerts

	I1003 17:03:56.954176    1527 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/17345-986/.minikube/ca.pem (1082 bytes)

	I1003 17:03:56.954543    1527 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/17345-986/.minikube/cert.pem (1123 bytes)

	I1003 17:03:56.954713    1527 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/17345-986/.minikube/key.pem (1679 bytes)

	I1003 17:03:56.954859    1527 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/17345-986/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca-key.pem org=jenkins.addons-585000 san=[192.168.105.2 192.168.105.2 localhost 127.0.0.1 minikube addons-585000]

	I1003 17:03:57.033117    1527 provision.go:172] copyRemoteCerts

	I1003 17:03:57.033177    1527 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1003 17:03:57.033191    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:03:57.066294    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1003 17:03:57.072924    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)

	I1003 17:03:57.080102    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I1003 17:03:57.087350    1527 provision.go:86] duration metric: configureAuth took 133.318167ms

	I1003 17:03:57.087358    1527 buildroot.go:189] setting minikube options for container-runtime

	I1003 17:03:57.087453    1527 config.go:182] Loaded profile config "addons-585000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 17:03:57.087487    1527 main.go:141] libmachine: Using SSH client type: native

	I1003 17:03:57.087704    1527 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10290de60] 0x1029105d0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I1003 17:03:57.087709    1527 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1003 17:03:57.150120    1527 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I1003 17:03:57.150127    1527 buildroot.go:70] root file system type: tmpfs

	I1003 17:03:57.150191    1527 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I1003 17:03:57.150229    1527 main.go:141] libmachine: Using SSH client type: native

	I1003 17:03:57.150472    1527 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10290de60] 0x1029105d0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I1003 17:03:57.150508    1527 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1003 17:03:57.217705    1527 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I1003 17:03:57.217760    1527 main.go:141] libmachine: Using SSH client type: native

	I1003 17:03:57.218004    1527 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10290de60] 0x1029105d0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I1003 17:03:57.218015    1527 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1003 17:03:57.578682    1527 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I1003 17:03:57.578700    1527 machine.go:91] provisioned docker machine in 3.829016209s

	I1003 17:03:57.578705    1527 client.go:171] LocalClient.Create took 17.568053208s

	I1003 17:03:57.578718    1527 start.go:167] duration metric: libmachine.API.Create for "addons-585000" took 17.568154958s

	I1003 17:03:57.578727    1527 start.go:300] post-start starting for "addons-585000" (driver="qemu2")

	I1003 17:03:57.578734    1527 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1003 17:03:57.578804    1527 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1003 17:03:57.578814    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:03:57.611980    1527 ssh_runner.go:195] Run: cat /etc/os-release

	I1003 17:03:57.613271    1527 info.go:137] Remote host: Buildroot 2021.02.12

	I1003 17:03:57.613284    1527 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17345-986/.minikube/addons for local assets ...

	I1003 17:03:57.613351    1527 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17345-986/.minikube/files for local assets ...

	I1003 17:03:57.613375    1527 start.go:303] post-start completed in 34.643875ms

	I1003 17:03:57.613878    1527 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/config.json ...

	I1003 17:03:57.614052    1527 start.go:128] duration metric: createHost completed in 18.365139125s

	I1003 17:03:57.614072    1527 main.go:141] libmachine: Using SSH client type: native

	I1003 17:03:57.614285    1527 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10290de60] 0x1029105d0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I1003 17:03:57.614290    1527 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I1003 17:03:57.674033    1527 main.go:141] libmachine: SSH cmd err, output: <nil>: 1696377837.538666711

	I1003 17:03:57.674041    1527 fix.go:206] guest clock: 1696377837.538666711

	I1003 17:03:57.674045    1527 fix.go:219] Guest: 2023-10-03 17:03:57.538666711 -0700 PDT Remote: 2023-10-03 17:03:57.614055 -0700 PDT m=+18.473932959 (delta=-75.388289ms)

	I1003 17:03:57.674058    1527 fix.go:190] guest clock delta is within tolerance: -75.388289ms

	I1003 17:03:57.674061    1527 start.go:83] releasing machines lock for "addons-585000", held for 18.42518925s

	I1003 17:03:57.674383    1527 ssh_runner.go:195] Run: cat /version.json

	I1003 17:03:57.674394    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:03:57.674401    1527 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I1003 17:03:57.674438    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:03:57.752962    1527 ssh_runner.go:195] Run: systemctl --version

	I1003 17:03:57.755435    1527 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W1003 17:03:57.757647    1527 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I1003 17:03:57.757682    1527 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1003 17:03:57.763566    1527 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I1003 17:03:57.763573    1527 start.go:469] detecting cgroup driver to use...

	I1003 17:03:57.763688    1527 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1003 17:03:57.769448    1527 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I1003 17:03:57.772711    1527 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I1003 17:03:57.776091    1527 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...

	I1003 17:03:57.776116    1527 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I1003 17:03:57.779455    1527 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1003 17:03:57.782467    1527 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I1003 17:03:57.785325    1527 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1003 17:03:57.788823    1527 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1003 17:03:57.792297    1527 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I1003 17:03:57.795615    1527 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1003 17:03:57.798463    1527 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1003 17:03:57.801289    1527 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 17:03:57.870368    1527 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I1003 17:03:57.876293    1527 start.go:469] detecting cgroup driver to use...

	I1003 17:03:57.876338    1527 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1003 17:03:57.883607    1527 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1003 17:03:57.888285    1527 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I1003 17:03:57.899852    1527 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1003 17:03:57.904354    1527 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1003 17:03:57.909268    1527 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I1003 17:03:57.948483    1527 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1003 17:03:57.953584    1527 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1003 17:03:57.958727    1527 ssh_runner.go:195] Run: which cri-dockerd

	I1003 17:03:57.959920    1527 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I1003 17:03:57.962534    1527 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I1003 17:03:57.967042    1527 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I1003 17:03:58.045502    1527 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I1003 17:03:58.130551    1527 docker.go:554] configuring docker to use "cgroupfs" as cgroup driver...

	I1003 17:03:58.130610    1527 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I1003 17:03:58.135707    1527 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 17:03:58.217318    1527 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1003 17:03:59.375606    1527 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.158300667s)

	I1003 17:03:59.375671    1527 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I1003 17:03:59.450200    1527 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I1003 17:03:59.524947    1527 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I1003 17:03:59.593104    1527 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 17:03:59.661107    1527 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I1003 17:03:59.668567    1527 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 17:03:59.749258    1527 ssh_runner.go:195] Run: sudo systemctl restart cri-docker

	I1003 17:03:59.773399    1527 start.go:516] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I1003 17:03:59.773477    1527 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I1003 17:03:59.775487    1527 start.go:537] Will wait 60s for crictl version

	I1003 17:03:59.775515    1527 ssh_runner.go:195] Run: which crictl

	I1003 17:03:59.776779    1527 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I1003 17:03:59.798500    1527 start.go:553] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  24.0.6

	RuntimeApiVersion:  v1

	I1003 17:03:59.798566    1527 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1003 17:03:59.808398    1527 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1003 17:03:59.824846    1527 out.go:204] * Preparing Kubernetes v1.28.2 on Docker 24.0.6 ...

	I1003 17:03:59.824981    1527 ssh_runner.go:195] Run: grep 192.168.105.1	host.minikube.internal$ /etc/hosts

	I1003 17:03:59.826582    1527 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.105.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1003 17:03:59.830378    1527 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime docker

	I1003 17:03:59.830418    1527 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1003 17:03:59.836052    1527 docker.go:664] Got preloaded images: 

	I1003 17:03:59.836060    1527 docker.go:670] registry.k8s.io/kube-apiserver:v1.28.2 wasn't preloaded

	I1003 17:03:59.836097    1527 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I1003 17:03:59.839267    1527 ssh_runner.go:195] Run: which lz4

	I1003 17:03:59.840501    1527 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I1003 17:03:59.841889    1527 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I1003 17:03:59.841901    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (356993689 bytes)

	I1003 17:04:01.160665    1527 docker.go:628] Took 1.320191 seconds to copy over tarball

	I1003 17:04:01.160727    1527 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4

	I1003 17:04:02.196965    1527 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (1.036251292s)

	I1003 17:04:02.196980    1527 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I1003 17:04:02.212861    1527 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I1003 17:04:02.216574    1527 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2629 bytes)

	I1003 17:04:02.221618    1527 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 17:04:02.297119    1527 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1003 17:04:03.756211    1527 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.459112709s)

	I1003 17:04:03.756322    1527 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1003 17:04:03.768480    1527 docker.go:664] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.28.2

	registry.k8s.io/kube-controller-manager:v1.28.2

	registry.k8s.io/kube-scheduler:v1.28.2

	registry.k8s.io/kube-proxy:v1.28.2

	registry.k8s.io/etcd:3.5.9-0

	registry.k8s.io/coredns/coredns:v1.10.1

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I1003 17:04:03.768491    1527 cache_images.go:84] Images are preloaded, skipping loading

	I1003 17:04:03.768560    1527 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I1003 17:04:03.778188    1527 cni.go:84] Creating CNI manager for ""

	I1003 17:04:03.778197    1527 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1003 17:04:03.778215    1527 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I1003 17:04:03.778224    1527 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.105.2 APIServerPort:8443 KubernetesVersion:v1.28.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-585000 NodeName:addons-585000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.105.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.105.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/ku

bernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I1003 17:04:03.778291    1527 kubeadm.go:181] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.105.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "addons-585000"

	  kubeletExtraArgs:

	    node-ip: 192.168.105.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.105.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.28.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1003 17:04:03.778325    1527 kubeadm.go:976] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.28.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=addons-585000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.105.2

	[Install]

	 config:

	{KubernetesVersion:v1.28.2 ClusterName:addons-585000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I1003 17:04:03.778383    1527 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.2

	I1003 17:04:03.781266    1527 binaries.go:44] Found k8s binaries, skipping transfer

	I1003 17:04:03.781296    1527 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1003 17:04:03.784487    1527 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (375 bytes)

	I1003 17:04:03.789671    1527 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1003 17:04:03.794606    1527 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2099 bytes)

	I1003 17:04:03.799383    1527 ssh_runner.go:195] Run: grep 192.168.105.2	control-plane.minikube.internal$ /etc/hosts

	I1003 17:04:03.800642    1527 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.105.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1003 17:04:03.804557    1527 certs.go:56] Setting up /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000 for IP: 192.168.105.2

	I1003 17:04:03.804566    1527 certs.go:190] acquiring lock for shared ca certs: {Name:mk60f926c1ccb065a30406b60af36acc708e601e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:03.804722    1527 certs.go:204] generating minikubeCA CA: /Users/jenkins/minikube-integration/17345-986/.minikube/ca.key

	I1003 17:04:03.876701    1527 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/17345-986/.minikube/ca.crt ...

	I1003 17:04:03.876706    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/ca.crt: {Name:mk0cc174d1dbd071293e805ad6149c7ec4b142e4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:03.876904    1527 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/17345-986/.minikube/ca.key ...

	I1003 17:04:03.876908    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/ca.key: {Name:mk5b0f090e1e87c9db61f19ee029eeb4bf325f96 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:03.877012    1527 certs.go:204] generating proxyClientCA CA: /Users/jenkins/minikube-integration/17345-986/.minikube/proxy-client-ca.key

	I1003 17:04:03.972780    1527 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/17345-986/.minikube/proxy-client-ca.crt ...

	I1003 17:04:03.972784    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/proxy-client-ca.crt: {Name:mk86baa625f8f131b96564e73e4ff47f159af5b3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:03.972918    1527 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/17345-986/.minikube/proxy-client-ca.key ...

	I1003 17:04:03.972921    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/proxy-client-ca.key: {Name:mk9131c9bbe858f22b10b784ddbb510d37a1be7e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:03.973043    1527 certs.go:319] generating minikube-user signed cert: /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/client.key

	I1003 17:04:03.973049    1527 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/client.crt with IP's: []

	I1003 17:04:04.093588    1527 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/client.crt ...

	I1003 17:04:04.093595    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/client.crt: {Name:mka78906c9a5365a7e95b92135f4b70302d9ca1d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:04.093800    1527 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/client.key ...

	I1003 17:04:04.093804    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/client.key: {Name:mk6f93cb157b068e90dc54f48279212367ea5933 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:04.093915    1527 certs.go:319] generating minikube signed cert: /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.key.96055969

	I1003 17:04:04.093926    1527 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.crt.96055969 with IP's: [192.168.105.2 10.96.0.1 127.0.0.1 10.0.0.1]

	I1003 17:04:04.305627    1527 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.crt.96055969 ...

	I1003 17:04:04.305631    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.crt.96055969: {Name:mk46c7ebd409ecd36224a01eb936cac8f04632ae Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:04.305820    1527 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.key.96055969 ...

	I1003 17:04:04.305826    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.key.96055969: {Name:mk401a87dc7fd50281b18296e80430af94b0e1a8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:04.305953    1527 certs.go:337] copying /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.crt.96055969 -> /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.crt

	I1003 17:04:04.306054    1527 certs.go:341] copying /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.key.96055969 -> /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.key

	I1003 17:04:04.306143    1527 certs.go:319] generating aggregator signed cert: /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/proxy-client.key

	I1003 17:04:04.306160    1527 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/proxy-client.crt with IP's: []

	I1003 17:04:04.424122    1527 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/proxy-client.crt ...

	I1003 17:04:04.424130    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/proxy-client.crt: {Name:mkdf8b0eea5ab20c208335ea1ea4eff82b50060d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:04.424327    1527 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/proxy-client.key ...

	I1003 17:04:04.424330    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/proxy-client.key: {Name:mkfa742ebb9620853aeccd91e597f5c286ba74ed Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:04.424537    1527 certs.go:437] found cert: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca-key.pem (1679 bytes)

	I1003 17:04:04.424561    1527 certs.go:437] found cert: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem (1082 bytes)

	I1003 17:04:04.424578    1527 certs.go:437] found cert: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/Users/jenkins/minikube-integration/17345-986/.minikube/certs/cert.pem (1123 bytes)

	I1003 17:04:04.424595    1527 certs.go:437] found cert: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/Users/jenkins/minikube-integration/17345-986/.minikube/certs/key.pem (1679 bytes)

	I1003 17:04:04.424928    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I1003 17:04:04.432625    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I1003 17:04:04.440097    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1003 17:04:04.447625    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I1003 17:04:04.454640    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1003 17:04:04.461322    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I1003 17:04:04.468544    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1003 17:04:04.475781    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I1003 17:04:04.482585    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1003 17:04:04.489167    1527 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1003 17:04:04.495146    1527 ssh_runner.go:195] Run: openssl version

	I1003 17:04:04.497003    1527 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1003 17:04:04.500457    1527 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1003 17:04:04.502228    1527 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Oct  4 00:04 /usr/share/ca-certificates/minikubeCA.pem

	I1003 17:04:04.502254    1527 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1003 17:04:04.504052    1527 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1003 17:04:04.507353    1527 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd

	I1003 17:04:04.508658    1527 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory

	I1003 17:04:04.508694    1527 kubeadm.go:404] StartCluster: {Name:addons-585000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v

1.28.2 ClusterName:addons-585000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mount

Options:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I1003 17:04:04.508756    1527 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1003 17:04:04.518400    1527 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1003 17:04:04.521199    1527 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1003 17:04:04.524450    1527 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1003 17:04:04.527574    1527 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1003 17:04:04.527588    1527 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I1003 17:04:04.548358    1527 kubeadm.go:322] [init] Using Kubernetes version: v1.28.2

	I1003 17:04:04.548382    1527 kubeadm.go:322] [preflight] Running pre-flight checks

	I1003 17:04:04.607082    1527 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster

	I1003 17:04:04.607142    1527 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I1003 17:04:04.607188    1527 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I1003 17:04:04.714297    1527 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I1003 17:04:04.722481    1527 out.go:204]   - Generating certificates and keys ...

	I1003 17:04:04.722514    1527 kubeadm.go:322] [certs] Using existing ca certificate authority

	I1003 17:04:04.722542    1527 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk

	I1003 17:04:04.759296    1527 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key

	I1003 17:04:04.808856    1527 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key

	I1003 17:04:04.964910    1527 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key

	I1003 17:04:05.087030    1527 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key

	I1003 17:04:05.149596    1527 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key

	I1003 17:04:05.149646    1527 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [addons-585000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I1003 17:04:05.222012    1527 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key

	I1003 17:04:05.222068    1527 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [addons-585000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I1003 17:04:05.286742    1527 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key

	I1003 17:04:05.330145    1527 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key

	I1003 17:04:05.629678    1527 kubeadm.go:322] [certs] Generating "sa" key and public key

	I1003 17:04:05.629709    1527 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I1003 17:04:05.731900    1527 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file

	I1003 17:04:05.854397    1527 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I1003 17:04:05.983877    1527 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I1003 17:04:06.151732    1527 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I1003 17:04:06.152571    1527 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I1003 17:04:06.153646    1527 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I1003 17:04:06.157945    1527 out.go:204]   - Booting up control plane ...

	I1003 17:04:06.158024    1527 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I1003 17:04:06.158075    1527 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I1003 17:04:06.158108    1527 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I1003 17:04:06.161462    1527 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I1003 17:04:06.161792    1527 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I1003 17:04:06.161837    1527 kubeadm.go:322] [kubelet-start] Starting the kubelet

	I1003 17:04:06.249226    1527 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	I1003 17:04:09.750516    1527 kubeadm.go:322] [apiclient] All control plane components are healthy after 3.501291 seconds

	I1003 17:04:09.750582    1527 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I1003 17:04:09.756399    1527 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I1003 17:04:10.266794    1527 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs

	I1003 17:04:10.266918    1527 kubeadm.go:322] [mark-control-plane] Marking the node addons-585000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I1003 17:04:10.770745    1527 kubeadm.go:322] [bootstrap-token] Using token: uzkazy.ii0fjdqhazr4xlxp

	I1003 17:04:10.779414    1527 out.go:204]   - Configuring RBAC rules ...

	I1003 17:04:10.779490    1527 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I1003 17:04:10.779537    1527 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I1003 17:04:10.781300    1527 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I1003 17:04:10.782670    1527 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I1003 17:04:10.783591    1527 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I1003 17:04:10.784726    1527 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I1003 17:04:10.788735    1527 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I1003 17:04:10.960644    1527 kubeadm.go:322] [addons] Applied essential addon: CoreDNS

	I1003 17:04:11.179744    1527 kubeadm.go:322] [addons] Applied essential addon: kube-proxy

	I1003 17:04:11.180034    1527 kubeadm.go:322] 

	I1003 17:04:11.180066    1527 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!

	I1003 17:04:11.180069    1527 kubeadm.go:322] 

	I1003 17:04:11.180099    1527 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:

	I1003 17:04:11.180102    1527 kubeadm.go:322] 

	I1003 17:04:11.180113    1527 kubeadm.go:322]   mkdir -p $HOME/.kube

	I1003 17:04:11.180141    1527 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I1003 17:04:11.180162    1527 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I1003 17:04:11.180170    1527 kubeadm.go:322] 

	I1003 17:04:11.180201    1527 kubeadm.go:322] Alternatively, if you are the root user, you can run:

	I1003 17:04:11.180204    1527 kubeadm.go:322] 

	I1003 17:04:11.180235    1527 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I1003 17:04:11.180239    1527 kubeadm.go:322] 

	I1003 17:04:11.180270    1527 kubeadm.go:322] You should now deploy a pod network to the cluster.

	I1003 17:04:11.180305    1527 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I1003 17:04:11.180339    1527 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I1003 17:04:11.180343    1527 kubeadm.go:322] 

	I1003 17:04:11.180390    1527 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities

	I1003 17:04:11.180428    1527 kubeadm.go:322] and service account keys on each node and then running the following as root:

	I1003 17:04:11.180432    1527 kubeadm.go:322] 

	I1003 17:04:11.180481    1527 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token uzkazy.ii0fjdqhazr4xlxp \

	I1003 17:04:11.180530    1527 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:9490a7a2ce6f448c9720863afea1604779c0ef0543f588db367e732362807037 \

	I1003 17:04:11.180544    1527 kubeadm.go:322] 	--control-plane 

	I1003 17:04:11.180546    1527 kubeadm.go:322] 

	I1003 17:04:11.180583    1527 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:

	I1003 17:04:11.180585    1527 kubeadm.go:322] 

	I1003 17:04:11.180630    1527 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token uzkazy.ii0fjdqhazr4xlxp \

	I1003 17:04:11.180681    1527 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:9490a7a2ce6f448c9720863afea1604779c0ef0543f588db367e732362807037 

	I1003 17:04:11.180859    1527 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I1003 17:04:11.180869    1527 cni.go:84] Creating CNI manager for ""

	I1003 17:04:11.180879    1527 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1003 17:04:11.187987    1527 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I1003 17:04:11.191059    1527 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I1003 17:04:11.194034    1527 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)

	I1003 17:04:11.198752    1527 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I1003 17:04:11.198795    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:11.198820    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl label nodes minikube.k8s.io/version=v1.31.2 minikube.k8s.io/commit=d9526fa6c1a1bb1b20f95e15606f1308e308d84a minikube.k8s.io/name=addons-585000 minikube.k8s.io/updated_at=2023_10_03T17_04_11_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:11.257808    1527 ops.go:34] apiserver oom_adj: -16

	I1003 17:04:11.257825    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:11.294996    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:11.828345    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:12.328361    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:12.828330    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:13.328397    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:13.828294    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:14.328299    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:14.828282    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:15.328311    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:15.828265    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:16.328253    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:16.828279    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:17.328231    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:17.828247    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:18.328230    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:18.828192    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:19.328127    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:19.828168    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:20.328197    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:20.827992    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:21.327973    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:21.828182    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:22.328181    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:22.828070    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:23.328028    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:23.828030    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:24.327999    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:24.363217    1527 kubeadm.go:1081] duration metric: took 13.164797125s to wait for elevateKubeSystemPrivileges.

	I1003 17:04:24.363234    1527 kubeadm.go:406] StartCluster complete in 19.855065708s

	I1003 17:04:24.363243    1527 settings.go:142] acquiring lock: {Name:mkad5f21e92defa14247d9a0adf05a6e4272cec8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:24.363390    1527 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/17345-986/kubeconfig

	I1003 17:04:24.363569    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/kubeconfig: {Name:mke3e06a6a2057954076f4772b87ca4469721c09 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:24.363810    1527 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I1003 17:04:24.363870    1527 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volumesnapshots:true]

	I1003 17:04:24.363932    1527 addons.go:69] Setting volumesnapshots=true in profile "addons-585000"

	I1003 17:04:24.363942    1527 addons.go:231] Setting addon volumesnapshots=true in "addons-585000"

	I1003 17:04:24.363950    1527 config.go:182] Loaded profile config "addons-585000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 17:04:24.363971    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.363950    1527 addons.go:69] Setting ingress-dns=true in profile "addons-585000"

	I1003 17:04:24.364021    1527 addons.go:231] Setting addon ingress-dns=true in "addons-585000"

	I1003 17:04:24.364047    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.363981    1527 addons.go:69] Setting registry=true in profile "addons-585000"

	I1003 17:04:24.364069    1527 addons.go:231] Setting addon registry=true in "addons-585000"

	I1003 17:04:24.364086    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.363984    1527 addons.go:69] Setting inspektor-gadget=true in profile "addons-585000"

	I1003 17:04:24.364126    1527 addons.go:231] Setting addon inspektor-gadget=true in "addons-585000"

	I1003 17:04:24.364190    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.363986    1527 addons.go:69] Setting metrics-server=true in profile "addons-585000"

	I1003 17:04:24.364214    1527 addons.go:231] Setting addon metrics-server=true in "addons-585000"

	I1003 17:04:24.364247    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.363988    1527 addons.go:69] Setting gcp-auth=true in profile "addons-585000"

	I1003 17:04:24.364271    1527 mustload.go:65] Loading cluster: addons-585000

	W1003 17:04:24.364287    1527 host.go:54] host status for "addons-585000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/monitor: connect: connection refused

	W1003 17:04:24.364300    1527 addons.go:277] "addons-585000" is not running, setting ingress-dns=true and skipping enablement (err=<nil>)

	W1003 17:04:24.364313    1527 host.go:54] host status for "addons-585000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/monitor: connect: connection refused

	W1003 17:04:24.364319    1527 addons.go:277] "addons-585000" is not running, setting registry=true and skipping enablement (err=<nil>)

	I1003 17:04:24.364322    1527 addons.go:467] Verifying addon registry=true in "addons-585000"

	I1003 17:04:24.370457    1527 out.go:177] * Verifying registry addon...

	I1003 17:04:24.364356    1527 config.go:182] Loaded profile config "addons-585000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 17:04:24.363992    1527 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-585000"

	I1003 17:04:24.370476    1527 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-585000"

	I1003 17:04:24.363993    1527 addons.go:69] Setting ingress=true in profile "addons-585000"

	I1003 17:04:24.363995    1527 addons.go:69] Setting cloud-spanner=true in profile "addons-585000"

	I1003 17:04:24.370530    1527 addons.go:231] Setting addon cloud-spanner=true in "addons-585000"

	I1003 17:04:24.363994    1527 addons.go:69] Setting default-storageclass=true in profile "addons-585000"

	I1003 17:04:24.370529    1527 addons.go:231] Setting addon ingress=true in "addons-585000"

	I1003 17:04:24.370591    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.370597    1527 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-585000"

	I1003 17:04:24.363996    1527 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-585000"

	W1003 17:04:24.364679    1527 host.go:54] host status for "addons-585000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/monitor: connect: connection refused

	I1003 17:04:24.370563    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.363989    1527 addons.go:69] Setting storage-provisioner=true in profile "addons-585000"

	I1003 17:04:24.370642    1527 addons.go:231] Setting addon csi-hostpath-driver=true in "addons-585000"

	W1003 17:04:24.370646    1527 addons.go:277] "addons-585000" is not running, setting inspektor-gadget=true and skipping enablement (err=<nil>)

	W1003 17:04:24.370793    1527 host.go:54] host status for "addons-585000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/monitor: connect: connection refused

	W1003 17:04:24.370892    1527 host.go:54] host status for "addons-585000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/monitor: connect: connection refused

	I1003 17:04:24.371573    1527 addons.go:231] Setting addon default-storageclass=true in "addons-585000"

	I1003 17:04:24.371900    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.380387    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	I1003 17:04:24.383435    1527 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.6.4

	I1003 17:04:24.383459    1527 addons.go:231] Setting addon storage-provisioner=true in "addons-585000"

	W1003 17:04:24.383452    1527 addons.go:277] "addons-585000" is not running, setting ingress=true and skipping enablement (err=<nil>)

	W1003 17:04:24.383476    1527 addons_storage_classes.go:57] "addons-585000" is not running, writing storage-provisioner-rancher=true to disk and skipping enablement

	I1003 17:04:24.383496    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.383533    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.383999    1527 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...

	I1003 17:04:24.386486    1527 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml

	I1003 17:04:24.389459    1527 addons.go:423] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I1003 17:04:24.389462    1527 addons.go:231] Setting addon storage-provisioner-rancher=true in "addons-585000"

	I1003 17:04:24.389488    1527 addons.go:467] Verifying addon ingress=true in "addons-585000"

	I1003 17:04:24.389521    1527 host.go:66] Checking if "addons-585000" exists ...

	W1003 17:04:24.389784    1527 host.go:54] host status for "addons-585000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/monitor: connect: connection refused

	I1003 17:04:24.395446    1527 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.10

	I1003 17:04:24.395461    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.395467    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)

	I1003 17:04:24.395470    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)

	W1003 17:04:24.395486    1527 addons.go:277] "addons-585000" is not running, setting default-storageclass=true and skipping enablement (err=<nil>)

	I1003 17:04:24.398475    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0

	I1003 17:04:24.398484    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:04:24.398497    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:04:24.407159    1527 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=registry

	I1003 17:04:24.408397    1527 out.go:177] * Verifying ingress addon...

	I1003 17:04:24.414483    1527 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I1003 17:04:24.418517    1527 addons.go:423] installing /etc/kubernetes/addons/deployment.yaml

	I1003 17:04:24.421445    1527 out.go:177]   - Using image docker.io/busybox:stable

	I1003 17:04:24.423490    1527 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-585000" context rescaled to 1 replicas

	I1003 17:04:24.424496    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)

	I1003 17:04:24.427548    1527 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1003 17:04:24.427858    1527 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...

	I1003 17:04:24.430982    1527 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.105.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.28.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I1003 17:04:24.433444    1527 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I1003 17:04:24.439439    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0

	I1003 17:04:24.439555    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:04:24.442455    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I1003 17:04:24.442466    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:04:24.447401    1527 out.go:177] * Verifying Kubernetes components...

	I1003 17:04:24.451674    1527 kapi.go:86] Found 0 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I1003 17:04:24.453485    1527 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1003 17:04:24.457496    1527 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22

	I1003 17:04:24.467442    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0

	I1003 17:04:24.480410    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0

	I1003 17:04:24.476494    1527 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I1003 17:04:24.483451    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)

	I1003 17:04:24.486383    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0

	I1003 17:04:24.483462    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:04:24.485254    1527 addons.go:423] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I1003 17:04:24.489434    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)

	I1003 17:04:24.492499    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0

	I1003 17:04:24.499438    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0

	I1003 17:04:24.508438    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0

	I1003 17:04:24.512295    1527 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml

	I1003 17:04:24.512323    1527 addons.go:423] installing /etc/kubernetes/addons/rbac-external-attacher.yaml

	I1003 17:04:24.512325    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)

	I1003 17:04:24.512338    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)

	I1003 17:04:24.512347    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:04:24.558122    1527 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1003 17:04:24.567387    1527 addons.go:423] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I1003 17:04:24.567399    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)

	I1003 17:04:24.572776    1527 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/deployment.yaml

	I1003 17:04:24.599074    1527 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml

	I1003 17:04:24.599085    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)

	I1003 17:04:24.675063    1527 addons.go:423] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I1003 17:04:24.675075    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)

	I1003 17:04:24.676328    1527 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml

	I1003 17:04:24.676333    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)

	I1003 17:04:24.739366    1527 addons.go:423] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml

	I1003 17:04:24.739377    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)

	I1003 17:04:24.749052    1527 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I1003 17:04:24.770490    1527 addons.go:423] installing /etc/kubernetes/addons/rbac-hostpath.yaml

	I1003 17:04:24.770501    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)

	I1003 17:04:24.785371    1527 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I1003 17:04:24.881017    1527 addons.go:423] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I1003 17:04:24.881027    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)

	I1003 17:04:24.903016    1527 addons.go:423] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml

	I1003 17:04:24.903028    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)

	I1003 17:04:24.969674    1527 addons.go:423] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml

	I1003 17:04:24.969686    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)

	I1003 17:04:25.049120    1527 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I1003 17:04:25.150729    1527 addons.go:423] installing /etc/kubernetes/addons/rbac-external-resizer.yaml

	I1003 17:04:25.150740    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)

	I1003 17:04:25.240313    1527 addons.go:423] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml

	I1003 17:04:25.240326    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)

	I1003 17:04:25.371181    1527 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml

	I1003 17:04:25.371193    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)

	I1003 17:04:25.404463    1527 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml

	I1003 17:04:25.404477    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)

	I1003 17:04:25.434986    1527 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml

	I1003 17:04:25.434995    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)

	I1003 17:04:25.450155    1527 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.105.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.28.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (1.007696167s)

	I1003 17:04:25.450172    1527 start.go:923] {"host.minikube.internal": 192.168.105.1} host record injected into CoreDNS's ConfigMap

	I1003 17:04:25.450599    1527 node_ready.go:35] waiting up to 6m0s for node "addons-585000" to be "Ready" ...

	I1003 17:04:25.452207    1527 node_ready.go:49] node "addons-585000" has status "Ready":"True"

	I1003 17:04:25.452226    1527 node_ready.go:38] duration metric: took 1.601791ms waiting for node "addons-585000" to be "Ready" ...

	I1003 17:04:25.452231    1527 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1003 17:04:25.455004    1527 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace to be "Ready" ...

	I1003 17:04:25.474770    1527 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml

	I1003 17:04:25.474780    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)

	I1003 17:04:25.542278    1527 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I1003 17:04:25.542289    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)

	I1003 17:04:25.568058    1527 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I1003 17:04:25.900055    1527 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (1.327297041s)

	I1003 17:04:25.900073    1527 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (1.151039167s)

	I1003 17:04:25.900620    1527 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.342523s)

	I1003 17:04:26.031761    1527 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.246402458s)

	I1003 17:04:26.031779    1527 addons.go:467] Verifying addon metrics-server=true in "addons-585000"

	W1003 17:04:26.031811    1527 addons.go:449] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I1003 17:04:26.031889    1527 retry.go:31] will retry after 325.291799ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I1003 17:04:26.358314    1527 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I1003 17:04:27.197455    1527 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (1.629412791s)

	I1003 17:04:27.197475    1527 addons.go:467] Verifying addon csi-hostpath-driver=true in "addons-585000"

	I1003 17:04:27.203259    1527 out.go:177] * Verifying csi-hostpath-driver addon...

	I1003 17:04:27.212640    1527 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

	I1003 17:04:27.217488    1527 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I1003 17:04:27.217496    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:27.220905    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:27.463742    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:27.724717    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:28.224875    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:28.724679    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:28.978938    1527 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.620667959s)

	I1003 17:04:29.224602    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:29.725503    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:29.965298    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:30.225992    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:30.727405    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:30.990463    1527 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)

	I1003 17:04:30.990480    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:04:31.027829    1527 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)

	I1003 17:04:31.032721    1527 addons.go:231] Setting addon gcp-auth=true in "addons-585000"

	I1003 17:04:31.032748    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:31.033437    1527 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json

	I1003 17:04:31.033445    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:04:31.067911    1527 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230407

	I1003 17:04:31.071726    1527 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0

	I1003 17:04:31.074751    1527 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-ns.yaml

	I1003 17:04:31.074757    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)

	I1003 17:04:31.080083    1527 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-service.yaml

	I1003 17:04:31.080090    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)

	I1003 17:04:31.084923    1527 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I1003 17:04:31.084929    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5412 bytes)

	I1003 17:04:31.089910    1527 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I1003 17:04:31.227750    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:31.348093    1527 addons.go:467] Verifying addon gcp-auth=true in "addons-585000"

	I1003 17:04:31.351542    1527 out.go:177] * Verifying gcp-auth addon...

	I1003 17:04:31.357561    1527 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...

	I1003 17:04:31.360910    1527 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I1003 17:04:31.360918    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:31.363860    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:31.729484    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:31.868680    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:32.231013    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:32.368635    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:32.469496    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:32.731026    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:32.869106    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:33.231972    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:33.370303    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:33.732757    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:33.870865    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:34.233653    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:34.371764    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:34.734158    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:34.872420    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:34.973595    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:35.235439    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:35.373126    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:35.736125    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:35.873867    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:36.236732    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:36.377065    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:36.738038    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:36.875114    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:37.237689    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:37.375767    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:37.476370    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:37.738419    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:37.876233    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:38.238661    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:38.376555    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:38.739112    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:38.877451    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:39.239515    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:39.378140    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:39.479966    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:39.740793    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:39.878589    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:40.240762    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:40.379208    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:40.741780    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:40.879681    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:41.241996    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:41.380297    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:41.742785    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:41.880492    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:41.981384    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:42.243296    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:42.381074    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:42.743302    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:42.883349    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:43.244024    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:43.381895    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:43.744586    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:43.882405    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:44.244990    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:44.382844    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:44.483439    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:44.745332    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:44.884458    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:45.245668    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:45.383767    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:45.746153    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:45.884389    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:46.246346    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:46.384557    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:46.486038    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:46.746583    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:46.885125    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:47.247216    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:47.385576    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:47.747761    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:47.885573    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:48.247887    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:48.385997    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:48.748143    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:48.886329    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:48.987206    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:49.248369    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:49.386625    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:49.749134    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:49.886585    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:50.249103    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:50.386927    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:50.749495    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:50.887744    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:50.988394    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:51.249792    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:51.387776    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:51.749720    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:51.887719    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:52.249981    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:52.389544    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:52.751121    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:52.888557    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:53.250511    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:53.388659    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:53.490543    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:53.750650    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:53.888553    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:54.250803    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:54.389104    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:54.751294    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:54.889472    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:55.253309    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:55.389552    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:55.751715    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:55.889618    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:55.990684    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:56.251672    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:56.389851    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:56.752031    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:56.889910    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:57.252259    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:57.390082    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:57.752574    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:57.890363    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:57.991811    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:58.252678    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:58.390362    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:58.752590    1527 kapi.go:107] duration metric: took 31.511793709s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

	I1003 17:04:58.890958    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:59.391228    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:59.891535    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:00.391427    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:00.491918    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:05:00.891593    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:01.391491    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:01.891778    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:02.391830    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:02.492542    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:05:02.891986    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:03.393570    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:03.892644    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:04.392440    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:04.892576    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:04.992969    1527 pod_ready.go:92] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"True"

	I1003 17:05:04.992976    1527 pod_ready.go:81] duration metric: took 39.508226208s waiting for pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:04.992981    1527 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-r24k8" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:04.993883    1527 pod_ready.go:97] error getting pod "coredns-5dd5756b68-r24k8" in "kube-system" namespace (skipping!): pods "coredns-5dd5756b68-r24k8" not found

	I1003 17:05:04.993891    1527 pod_ready.go:81] duration metric: took 907.208µs waiting for pod "coredns-5dd5756b68-r24k8" in "kube-system" namespace to be "Ready" ...

	E1003 17:05:04.993895    1527 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-5dd5756b68-r24k8" in "kube-system" namespace (skipping!): pods "coredns-5dd5756b68-r24k8" not found

	I1003 17:05:04.993899    1527 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-585000" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:04.996401    1527 pod_ready.go:92] pod "etcd-addons-585000" in "kube-system" namespace has status "Ready":"True"

	I1003 17:05:04.996406    1527 pod_ready.go:81] duration metric: took 2.500458ms waiting for pod "etcd-addons-585000" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:04.996410    1527 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-585000" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:04.999071    1527 pod_ready.go:92] pod "kube-apiserver-addons-585000" in "kube-system" namespace has status "Ready":"True"

	I1003 17:05:04.999079    1527 pod_ready.go:81] duration metric: took 2.666208ms waiting for pod "kube-apiserver-addons-585000" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:04.999082    1527 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-585000" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:05.001717    1527 pod_ready.go:92] pod "kube-controller-manager-addons-585000" in "kube-system" namespace has status "Ready":"True"

	I1003 17:05:05.001725    1527 pod_ready.go:81] duration metric: took 2.637584ms waiting for pod "kube-controller-manager-addons-585000" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:05.001728    1527 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-4m9nm" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:05.193135    1527 pod_ready.go:92] pod "kube-proxy-4m9nm" in "kube-system" namespace has status "Ready":"True"

	I1003 17:05:05.193144    1527 pod_ready.go:81] duration metric: took 191.372792ms waiting for pod "kube-proxy-4m9nm" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:05.193148    1527 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-585000" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:05.392551    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:05.593390    1527 pod_ready.go:92] pod "kube-scheduler-addons-585000" in "kube-system" namespace has status "Ready":"True"

	I1003 17:05:05.593399    1527 pod_ready.go:81] duration metric: took 400.165917ms waiting for pod "kube-scheduler-addons-585000" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:05.593404    1527 pod_ready.go:38] duration metric: took 40.11130675s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1003 17:05:05.593416    1527 api_server.go:52] waiting for apiserver process to appear ...

	I1003 17:05:05.593483    1527 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1003 17:05:05.598747    1527 api_server.go:72] duration metric: took 41.126444291s to wait for apiserver process to appear ...

	I1003 17:05:05.598757    1527 api_server.go:88] waiting for apiserver healthz status ...

	I1003 17:05:05.598764    1527 api_server.go:253] Checking apiserver healthz at https://192.168.105.2:8443/healthz ...

	I1003 17:05:05.601839    1527 api_server.go:279] https://192.168.105.2:8443/healthz returned 200:

	ok

	I1003 17:05:05.602592    1527 api_server.go:141] control plane version: v1.28.2

	I1003 17:05:05.602598    1527 api_server.go:131] duration metric: took 3.8385ms to wait for apiserver health ...

	I1003 17:05:05.602602    1527 system_pods.go:43] waiting for kube-system pods to appear ...

	I1003 17:05:05.796281    1527 system_pods.go:59] 13 kube-system pods found

	I1003 17:05:05.796294    1527 system_pods.go:61] "coredns-5dd5756b68-khk2s" [c45559e9-de80-4305-942c-094315d94d47] Running

	I1003 17:05:05.796297    1527 system_pods.go:61] "csi-hostpath-attacher-0" [63177292-e73a-431c-a767-00cf3ce9bce0] Running

	I1003 17:05:05.796299    1527 system_pods.go:61] "csi-hostpath-resizer-0" [8f737860-0999-4db9-9f65-190d64a4cfb4] Running

	I1003 17:05:05.796301    1527 system_pods.go:61] "csi-hostpathplugin-8thxw" [4548034b-9d0c-4d9d-9f9f-839610935d97] Running

	I1003 17:05:05.796303    1527 system_pods.go:61] "etcd-addons-585000" [f1858d65-44e4-469b-8372-a4e1e0a14d48] Running

	I1003 17:05:05.796306    1527 system_pods.go:61] "kube-apiserver-addons-585000" [377e1779-3201-42b4-945b-e2195b3f0a9a] Running

	I1003 17:05:05.796308    1527 system_pods.go:61] "kube-controller-manager-addons-585000" [f9156947-57be-49f5-9a1c-aadaa5bddf0c] Running

	I1003 17:05:05.796310    1527 system_pods.go:61] "kube-proxy-4m9nm" [847e005d-c7e1-4128-9ac6-2fef6730e3e4] Running

	I1003 17:05:05.796312    1527 system_pods.go:61] "kube-scheduler-addons-585000" [5b3e2487-5781-451e-b566-814b86a4eb80] Running

	I1003 17:05:05.796315    1527 system_pods.go:61] "metrics-server-7c66d45ddc-bvd9d" [e70964ce-39c1-444c-bfcc-e672f6027857] Running

	I1003 17:05:05.796317    1527 system_pods.go:61] "snapshot-controller-58dbcc7b99-2gg5z" [3f9fa5f9-6948-4b90-9114-e5bdb6822c87] Running

	I1003 17:05:05.796319    1527 system_pods.go:61] "snapshot-controller-58dbcc7b99-t2wrg" [174abadb-36b9-4fab-b1e2-44fa5de2def5] Running

	I1003 17:05:05.796321    1527 system_pods.go:61] "storage-provisioner" [41c3bd79-1e45-45d3-a1d8-9f5a2c5c7da5] Running

	I1003 17:05:05.796324    1527 system_pods.go:74] duration metric: took 193.680291ms to wait for pod list to return data ...

	I1003 17:05:05.796329    1527 default_sa.go:34] waiting for default service account to be created ...

	I1003 17:05:05.892491    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:05.992623    1527 default_sa.go:45] found service account: "default"

	I1003 17:05:05.992632    1527 default_sa.go:55] duration metric: took 196.262458ms for default service account to be created ...

	I1003 17:05:05.992638    1527 system_pods.go:116] waiting for k8s-apps to be running ...

	I1003 17:05:06.196272    1527 system_pods.go:86] 13 kube-system pods found

	I1003 17:05:06.196281    1527 system_pods.go:89] "coredns-5dd5756b68-khk2s" [c45559e9-de80-4305-942c-094315d94d47] Running

	I1003 17:05:06.196284    1527 system_pods.go:89] "csi-hostpath-attacher-0" [63177292-e73a-431c-a767-00cf3ce9bce0] Running

	I1003 17:05:06.196286    1527 system_pods.go:89] "csi-hostpath-resizer-0" [8f737860-0999-4db9-9f65-190d64a4cfb4] Running

	I1003 17:05:06.196288    1527 system_pods.go:89] "csi-hostpathplugin-8thxw" [4548034b-9d0c-4d9d-9f9f-839610935d97] Running

	I1003 17:05:06.196290    1527 system_pods.go:89] "etcd-addons-585000" [f1858d65-44e4-469b-8372-a4e1e0a14d48] Running

	I1003 17:05:06.196292    1527 system_pods.go:89] "kube-apiserver-addons-585000" [377e1779-3201-42b4-945b-e2195b3f0a9a] Running

	I1003 17:05:06.196294    1527 system_pods.go:89] "kube-controller-manager-addons-585000" [f9156947-57be-49f5-9a1c-aadaa5bddf0c] Running

	I1003 17:05:06.196296    1527 system_pods.go:89] "kube-proxy-4m9nm" [847e005d-c7e1-4128-9ac6-2fef6730e3e4] Running

	I1003 17:05:06.196298    1527 system_pods.go:89] "kube-scheduler-addons-585000" [5b3e2487-5781-451e-b566-814b86a4eb80] Running

	I1003 17:05:06.196300    1527 system_pods.go:89] "metrics-server-7c66d45ddc-bvd9d" [e70964ce-39c1-444c-bfcc-e672f6027857] Running

	I1003 17:05:06.196302    1527 system_pods.go:89] "snapshot-controller-58dbcc7b99-2gg5z" [3f9fa5f9-6948-4b90-9114-e5bdb6822c87] Running

	I1003 17:05:06.196304    1527 system_pods.go:89] "snapshot-controller-58dbcc7b99-t2wrg" [174abadb-36b9-4fab-b1e2-44fa5de2def5] Running

	I1003 17:05:06.196306    1527 system_pods.go:89] "storage-provisioner" [41c3bd79-1e45-45d3-a1d8-9f5a2c5c7da5] Running

	I1003 17:05:06.196310    1527 system_pods.go:126] duration metric: took 203.63025ms to wait for k8s-apps to be running ...

	I1003 17:05:06.196313    1527 system_svc.go:44] waiting for kubelet service to be running ....

	I1003 17:05:06.196369    1527 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1003 17:05:06.201921    1527 system_svc.go:56] duration metric: took 5.604333ms WaitForService to wait for kubelet.

	I1003 17:05:06.201929    1527 kubeadm.go:581] duration metric: took 41.729511541s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I1003 17:05:06.201940    1527 node_conditions.go:102] verifying NodePressure condition ...

	I1003 17:05:06.392698    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:06.393051    1527 node_conditions.go:122] node storage ephemeral capacity is 17784760Ki

	I1003 17:05:06.393087    1527 node_conditions.go:123] node cpu capacity is 2

	I1003 17:05:06.393093    1527 node_conditions.go:105] duration metric: took 191.114375ms to run NodePressure ...

	I1003 17:05:06.393098    1527 start.go:228] waiting for startup goroutines ...

	I1003 17:05:06.892943    1527 kapi.go:107] duration metric: took 35.5093015s to wait for kubernetes.io/minikube-addons=gcp-auth ...

	I1003 17:05:06.897190    1527 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-585000 cluster.

	I1003 17:05:06.900088    1527 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	I1003 17:05:06.903114    1527 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	I1003 17:10:24.417571    1527 kapi.go:107] duration metric: took 6m0.007521708s to wait for kubernetes.io/minikube-addons=registry ...

	W1003 17:10:24.417687    1527 out.go:239] ! Enabling 'registry' returned an error: running callbacks: [waiting for kubernetes.io/minikube-addons=registry pods: context deadline exceeded]

	I1003 17:10:24.469744    1527 kapi.go:107] duration metric: took 6m0.015851042s to wait for app.kubernetes.io/name=ingress-nginx ...

	W1003 17:10:24.469781    1527 out.go:239] ! Enabling 'ingress' returned an error: running callbacks: [waiting for app.kubernetes.io/name=ingress-nginx pods: context deadline exceeded]

	I1003 17:10:24.476811    1527 out.go:177] * Enabled addons: ingress-dns, inspektor-gadget, default-storageclass, cloud-spanner, storage-provisioner-rancher, storage-provisioner, metrics-server, volumesnapshots, csi-hostpath-driver, gcp-auth

	I1003 17:10:24.483852    1527 addons.go:502] enable addons completed in 6m0.093974291s: enabled=[ingress-dns inspektor-gadget default-storageclass cloud-spanner storage-provisioner-rancher storage-provisioner metrics-server volumesnapshots csi-hostpath-driver gcp-auth]

	I1003 17:10:24.483865    1527 start.go:233] waiting for cluster config update ...

	I1003 17:10:24.483873    1527 start.go:242] writing updated cluster config ...

	I1003 17:10:24.484152    1527 ssh_runner.go:195] Run: rm -f paused

	I1003 17:10:24.580795    1527 start.go:600] kubectl: 1.27.2, cluster: 1.28.2 (minor skew: 1)

	I1003 17:10:24.588925    1527 out.go:177] * Done! kubectl is now configured to use "addons-585000" cluster and "default" namespace by default

	* 

	* ==> Docker <==

	* -- Journal begins at Wed 2023-10-04 00:03:51 UTC, ends at Wed 2023-10-04 00:22:24 UTC. --

	Oct 04 00:12:08 addons-585000 dockerd[1122]: time="2023-10-04T00:12:08.349007007Z" level=info msg="cleaning up dead shim" namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1115]: time="2023-10-04T00:12:14.240701963Z" level=info msg="ignoring event" container=5ff0bef51f286679f0f3e673886c6c3125c354cab0674eabec453da6975a6991 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.241579343Z" level=info msg="shim disconnected" id=5ff0bef51f286679f0f3e673886c6c3125c354cab0674eabec453da6975a6991 namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.241698010Z" level=warning msg="cleaning up after shim disconnected" id=5ff0bef51f286679f0f3e673886c6c3125c354cab0674eabec453da6975a6991 namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.241717594Z" level=info msg="cleaning up dead shim" namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1115]: time="2023-10-04T00:12:14.242239805Z" level=info msg="ignoring event" container=517d59bdac0d4789df6d0fe970fb5d29190888751abb5196cf7cdf1d701cec03 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.242324306Z" level=info msg="shim disconnected" id=517d59bdac0d4789df6d0fe970fb5d29190888751abb5196cf7cdf1d701cec03 namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.242883392Z" level=warning msg="cleaning up after shim disconnected" id=517d59bdac0d4789df6d0fe970fb5d29190888751abb5196cf7cdf1d701cec03 namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.242933309Z" level=info msg="cleaning up dead shim" namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.323347774Z" level=info msg="shim disconnected" id=4f4a827bdb5aaf43cabfbf9cb0a34b674a64751dd5011a061778c8476e531e8e namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.323376233Z" level=warning msg="cleaning up after shim disconnected" id=4f4a827bdb5aaf43cabfbf9cb0a34b674a64751dd5011a061778c8476e531e8e namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.323380274Z" level=info msg="cleaning up dead shim" namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1115]: time="2023-10-04T00:12:14.323530942Z" level=info msg="ignoring event" container=4f4a827bdb5aaf43cabfbf9cb0a34b674a64751dd5011a061778c8476e531e8e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Oct 04 00:12:14 addons-585000 dockerd[1115]: time="2023-10-04T00:12:14.329811145Z" level=info msg="ignoring event" container=c09f627f07f68d859d6bfdefb05a6e13d8c3efbab921fb36772c99b884785536 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.329912979Z" level=info msg="shim disconnected" id=c09f627f07f68d859d6bfdefb05a6e13d8c3efbab921fb36772c99b884785536 namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.329940521Z" level=warning msg="cleaning up after shim disconnected" id=c09f627f07f68d859d6bfdefb05a6e13d8c3efbab921fb36772c99b884785536 namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.329944687Z" level=info msg="cleaning up dead shim" namespace=moby

	Oct 04 00:12:20 addons-585000 dockerd[1115]: time="2023-10-04T00:12:20.574199852Z" level=info msg="ignoring event" container=ecef984296b3c318eabdfadfcfd794578d7d5b79b06b6d15401d400fa2c41351 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Oct 04 00:12:20 addons-585000 dockerd[1122]: time="2023-10-04T00:12:20.574490520Z" level=info msg="shim disconnected" id=ecef984296b3c318eabdfadfcfd794578d7d5b79b06b6d15401d400fa2c41351 namespace=moby

	Oct 04 00:12:20 addons-585000 dockerd[1122]: time="2023-10-04T00:12:20.574591896Z" level=warning msg="cleaning up after shim disconnected" id=ecef984296b3c318eabdfadfcfd794578d7d5b79b06b6d15401d400fa2c41351 namespace=moby

	Oct 04 00:12:20 addons-585000 dockerd[1122]: time="2023-10-04T00:12:20.574612355Z" level=info msg="cleaning up dead shim" namespace=moby

	Oct 04 00:12:20 addons-585000 dockerd[1115]: time="2023-10-04T00:12:20.629572097Z" level=info msg="ignoring event" container=7c628d57a23adad9e457875314fcdc47575df49afc2fd60f3e2f12f92707c23a module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Oct 04 00:12:20 addons-585000 dockerd[1122]: time="2023-10-04T00:12:20.629930724Z" level=info msg="shim disconnected" id=7c628d57a23adad9e457875314fcdc47575df49afc2fd60f3e2f12f92707c23a namespace=moby

	Oct 04 00:12:20 addons-585000 dockerd[1122]: time="2023-10-04T00:12:20.629958933Z" level=warning msg="cleaning up after shim disconnected" id=7c628d57a23adad9e457875314fcdc47575df49afc2fd60f3e2f12f92707c23a namespace=moby

	Oct 04 00:12:20 addons-585000 dockerd[1122]: time="2023-10-04T00:12:20.629963350Z" level=info msg="cleaning up dead shim" namespace=moby

	* 

	* ==> container status <==

	* CONTAINER           IMAGE                                                                                                          CREATED             STATE               NAME                      ATTEMPT             POD ID              POD

	7fe1ae4df5fc3       ghcr.io/headlamp-k8s/headlamp@sha256:bb15916c96306cd14f1c9c09c639d01d1d1fb854fd770bf99f3e7a9deb584753          10 minutes ago      Running             headlamp                  0                   ef032c077a9bb       headlamp-58b88cff49-pkdpk

	4999c3b7505c2       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf   17 minutes ago      Running             gcp-auth                  0                   0baad7da81cca       gcp-auth-d4c87556c-fbd9n

	59046ced6b465       ba04bb24b9575                                                                                                  17 minutes ago      Running             storage-provisioner       0                   422eeee32f3c7       storage-provisioner

	1cabeffdf46fd       97e04611ad434                                                                                                  18 minutes ago      Running             coredns                   0                   94eeb18b87283       coredns-5dd5756b68-khk2s

	1056d28082563       7da62c127fc0f                                                                                                  18 minutes ago      Running             kube-proxy                0                   af3e361d0b85e       kube-proxy-4m9nm

	92000aefe5383       9cdd6470f48c8                                                                                                  18 minutes ago      Running             etcd                      0                   95e83160dff6c       etcd-addons-585000

	a8e887332d59e       64fc40cee3716                                                                                                  18 minutes ago      Running             kube-scheduler            0                   61eb9114b1a5a       kube-scheduler-addons-585000

	0cc0200950b6e       30bb499447fe1                                                                                                  18 minutes ago      Running             kube-apiserver            0                   d88b38dfea206       kube-apiserver-addons-585000

	c400229c491d5       89d57b83c1786                                                                                                  18 minutes ago      Running             kube-controller-manager   0                   5520678c190ce       kube-controller-manager-addons-585000

	* 

	* ==> coredns [1cabeffdf46f] <==

	* [INFO] plugin/kubernetes: waiting for Kubernetes API before starting server

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server

	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server

	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server

	[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API

	.:53

	[INFO] plugin/reload: Running configuration SHA512 = 591cf328cccc12bc490481273e738df59329c62c0b729d94e8b61db9961c2fa5f046dd37f1cf888b953814040d180f52594972691cd6ff41be96639138a43908

	CoreDNS-1.10.1

	linux/arm64, go1.20, 055b2c3

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] Reloading

	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b

	[INFO] Reloading complete

	[INFO] 127.0.0.1:51045 - 1814 "HINFO IN 7601180359592532728.73972322534061862. udp 55 false 512" NXDOMAIN qr,rd,ra 130 0.004583475s

	[INFO] 10.244.0.13:48220 - 27508 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000122275s

	[INFO] 10.244.0.13:58104 - 55098 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000039883s

	[INFO] 10.244.0.13:58849 - 26333 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000042675s

	[INFO] 10.244.0.13:53313 - 23208 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000023463s

	[INFO] 10.244.0.13:34872 - 37616 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000023379s

	[INFO] 10.244.0.13:36929 - 11673 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000023963s

	[INFO] 10.244.0.13:46593 - 5724 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.001098011s

	[INFO] 10.244.0.13:48407 - 27925 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 572 0.001132685s

	* 

	* ==> describe nodes <==

	* Name:               addons-585000

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=addons-585000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=d9526fa6c1a1bb1b20f95e15606f1308e308d84a

	                    minikube.k8s.io/name=addons-585000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2023_10_03T17_04_11_0700

	                    minikube.k8s.io/version=v1.31.2

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	                    topology.hostpath.csi/node=addons-585000

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 04 Oct 2023 00:04:08 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  addons-585000

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 04 Oct 2023 00:22:22 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 04 Oct 2023 00:17:27 +0000   Wed, 04 Oct 2023 00:04:07 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 04 Oct 2023 00:17:27 +0000   Wed, 04 Oct 2023 00:04:07 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 04 Oct 2023 00:17:27 +0000   Wed, 04 Oct 2023 00:04:07 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 04 Oct 2023 00:17:27 +0000   Wed, 04 Oct 2023 00:04:14 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.105.2

	  Hostname:    addons-585000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17784760Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3905012Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17784760Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3905012Ki

	  pods:               110

	System Info:

	  Machine ID:                 0684753a9d5543b6bf7bf60f67ba1317

	  System UUID:                0684753a9d5543b6bf7bf60f67ba1317

	  Boot ID:                    b5c3b3eb-78df-44c0-a5f8-68774932e45d

	  Kernel Version:             5.10.57

	  OS Image:                   Buildroot 2021.02.12

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  docker://24.0.6

	  Kubelet Version:            v1.28.2

	  Kube-Proxy Version:         v1.28.2

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (9 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  gcp-auth                    gcp-auth-d4c87556c-fbd9n                 0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         17m

	  headlamp                    headlamp-58b88cff49-pkdpk                0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         11m

	  kube-system                 coredns-5dd5756b68-khk2s                 100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (1%!)(MISSING)        170Mi (4%!)(MISSING)     18m

	  kube-system                 etcd-addons-585000                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (2%!)(MISSING)       0 (0%!)(MISSING)         18m

	  kube-system                 kube-apiserver-addons-585000             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         18m

	  kube-system                 kube-controller-manager-addons-585000    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         18m

	  kube-system                 kube-proxy-4m9nm                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         18m

	  kube-system                 kube-scheduler-addons-585000             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         18m

	  kube-system                 storage-provisioner                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         18m

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  0 (0%!)(MISSING)

	  memory             170Mi (4%!)(MISSING)  170Mi (4%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                From             Message

	  ----    ------                   ----               ----             -------

	  Normal  Starting                 18m                kube-proxy       

	  Normal  Starting                 18m                kubelet          Starting kubelet.

	  Normal  NodeHasSufficientMemory  18m (x8 over 18m)  kubelet          Node addons-585000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    18m (x8 over 18m)  kubelet          Node addons-585000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     18m (x7 over 18m)  kubelet          Node addons-585000 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  18m                kubelet          Updated Node Allocatable limit across pods

	  Normal  Starting                 18m                kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  18m                kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  18m                kubelet          Node addons-585000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    18m                kubelet          Node addons-585000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     18m                kubelet          Node addons-585000 status is now: NodeHasSufficientPID

	  Normal  NodeReady                18m                kubelet          Node addons-585000 status is now: NodeReady

	  Normal  RegisteredNode           18m                node-controller  Node addons-585000 event: Registered Node addons-585000 in Controller

	* 

	* ==> dmesg <==

	* [  +0.495022] systemd-fstab-generator[117]: Ignoring "noauto" for root device

	[  +0.043117] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.

	[  +0.000788] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)

	[  +6.182267] systemd-fstab-generator[489]: Ignoring "noauto" for root device

	[  +0.079218] systemd-fstab-generator[500]: Ignoring "noauto" for root device

	[  +0.426961] systemd-fstab-generator[674]: Ignoring "noauto" for root device

	[  +0.177441] systemd-fstab-generator[742]: Ignoring "noauto" for root device

	[  +0.084046] systemd-fstab-generator[753]: Ignoring "noauto" for root device

	[  +0.086428] systemd-fstab-generator[766]: Ignoring "noauto" for root device

	[  +1.232741] systemd-fstab-generator[924]: Ignoring "noauto" for root device

	[  +0.076723] systemd-fstab-generator[935]: Ignoring "noauto" for root device

	[  +0.068940] systemd-fstab-generator[946]: Ignoring "noauto" for root device

	[  +0.067661] systemd-fstab-generator[957]: Ignoring "noauto" for root device

	[  +0.086560] systemd-fstab-generator[999]: Ignoring "noauto" for root device

	[Oct 4 00:04] systemd-fstab-generator[1108]: Ignoring "noauto" for root device

	[  +1.419313] kauditd_printk_skb: 53 callbacks suppressed

	[  +2.528330] systemd-fstab-generator[1477]: Ignoring "noauto" for root device

	[  +4.623780] systemd-fstab-generator[2363]: Ignoring "noauto" for root device

	[ +14.190759] kauditd_printk_skb: 41 callbacks suppressed

	[  +4.496510] TCP: eth0: Driver has suspect GRO implementation, TCP performance may be compromised.

	[  +0.762652] kauditd_printk_skb: 67 callbacks suppressed

	[ +18.036762] kauditd_printk_skb: 10 callbacks suppressed

	[Oct 4 00:10] kauditd_printk_skb: 4 callbacks suppressed

	[Oct 4 00:11] kauditd_printk_skb: 5 callbacks suppressed

	[Oct 4 00:12] kauditd_printk_skb: 12 callbacks suppressed

	* 

	* ==> etcd [92000aefe538] <==

	* {"level":"info","ts":"2023-10-04T00:04:07.332412Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"6e03e7863b4f9c54","local-member-id":"c46d288d2fcb0590","added-peer-id":"c46d288d2fcb0590","added-peer-peer-urls":["https://192.168.105.2:2380"]}

	{"level":"info","ts":"2023-10-04T00:04:07.779564Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 is starting a new election at term 1"}

	{"level":"info","ts":"2023-10-04T00:04:07.779655Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 became pre-candidate at term 1"}

	{"level":"info","ts":"2023-10-04T00:04:07.779697Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 received MsgPreVoteResp from c46d288d2fcb0590 at term 1"}

	{"level":"info","ts":"2023-10-04T00:04:07.779722Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 became candidate at term 2"}

	{"level":"info","ts":"2023-10-04T00:04:07.779739Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 received MsgVoteResp from c46d288d2fcb0590 at term 2"}

	{"level":"info","ts":"2023-10-04T00:04:07.779758Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 became leader at term 2"}

	{"level":"info","ts":"2023-10-04T00:04:07.779794Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: c46d288d2fcb0590 elected leader c46d288d2fcb0590 at term 2"}

	{"level":"info","ts":"2023-10-04T00:04:07.780671Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"c46d288d2fcb0590","local-member-attributes":"{Name:addons-585000 ClientURLs:[https://192.168.105.2:2379]}","request-path":"/0/members/c46d288d2fcb0590/attributes","cluster-id":"6e03e7863b4f9c54","publish-timeout":"7s"}

	{"level":"info","ts":"2023-10-04T00:04:07.780756Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-10-04T00:04:07.781263Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.2:2379"}

	{"level":"info","ts":"2023-10-04T00:04:07.781336Z","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}

	{"level":"info","ts":"2023-10-04T00:04:07.781426Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-10-04T00:04:07.781791Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"6e03e7863b4f9c54","local-member-id":"c46d288d2fcb0590","cluster-version":"3.5"}

	{"level":"info","ts":"2023-10-04T00:04:07.781849Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2023-10-04T00:04:07.781874Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}

	{"level":"info","ts":"2023-10-04T00:04:07.782126Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2023-10-04T00:04:07.782156Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2023-10-04T00:04:07.782572Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2023-10-04T00:14:07.794073Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1195}

	{"level":"info","ts":"2023-10-04T00:14:07.809078Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":1195,"took":"14.718788ms","hash":1561751362}

	{"level":"info","ts":"2023-10-04T00:14:07.809096Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":1561751362,"revision":1195,"compact-revision":-1}

	{"level":"info","ts":"2023-10-04T00:19:07.797282Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1852}

	{"level":"info","ts":"2023-10-04T00:19:07.80972Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":1852,"took":"12.234463ms","hash":1586820359}

	{"level":"info","ts":"2023-10-04T00:19:07.809734Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":1586820359,"revision":1852,"compact-revision":1195}

	* 

	* ==> gcp-auth [4999c3b7505c] <==

	* 2023/10/04 00:05:05 GCP Auth Webhook started!

	2023/10/04 00:10:24 Ready to marshal response ...

	2023/10/04 00:10:24 Ready to write response ...

	2023/10/04 00:10:24 Ready to marshal response ...

	2023/10/04 00:10:24 Ready to write response ...

	2023/10/04 00:10:34 Ready to marshal response ...

	2023/10/04 00:10:34 Ready to write response ...

	2023/10/04 00:11:22 Ready to marshal response ...

	2023/10/04 00:11:22 Ready to write response ...

	2023/10/04 00:11:22 Ready to marshal response ...

	2023/10/04 00:11:22 Ready to write response ...

	2023/10/04 00:11:22 Ready to marshal response ...

	2023/10/04 00:11:22 Ready to write response ...

	2023/10/04 00:11:37 Ready to marshal response ...

	2023/10/04 00:11:37 Ready to write response ...

	2023/10/04 00:11:58 Ready to marshal response ...

	2023/10/04 00:11:58 Ready to write response ...

	* 

	* ==> kernel <==

	*  00:22:25 up 18 min,  0 users,  load average: 0.34, 0.23, 0.19

	Linux addons-585000 5.10.57 #1 SMP PREEMPT Mon Sep 18 20:10:16 UTC 2023 aarch64 GNU/Linux

	PRETTY_NAME="Buildroot 2021.02.12"

	* 

	* ==> kube-apiserver [0cc0200950b6] <==

	* E1004 00:10:50.314788       1 authentication.go:70] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"local-path-provisioner-service-account\" not found]"

	I1004 00:11:08.313792       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager

	I1004 00:11:22.215599       1 alloc.go:330] "allocated clusterIPs" service="headlamp/headlamp" clusterIPs={"IPv4":"10.110.244.116"}

	I1004 00:11:47.633142       1 controller.go:624] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io

	I1004 00:12:08.316300       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager

	I1004 00:12:14.160595       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1004 00:12:14.160622       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1004 00:12:14.167272       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1004 00:12:14.167291       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1004 00:12:14.174430       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1004 00:12:14.174447       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1004 00:12:14.177283       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1004 00:12:14.177295       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1004 00:12:14.179264       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1004 00:12:14.179278       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1004 00:12:14.184100       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1004 00:12:14.184112       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1004 00:12:14.189220       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1004 00:12:14.189231       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1004 00:12:14.192620       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1004 00:12:14.192633       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	W1004 00:12:15.177382       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io

	W1004 00:12:15.185019       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io

	W1004 00:12:15.201033       1 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io

	I1004 00:12:35.289747       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Nothing (removed from the queue).

	* 

	* ==> kube-controller-manager [c400229c491d] <==

	* E1004 00:19:15.038894       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:19:17.102732       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:19:17.102747       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:19:36.954598       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:19:36.954615       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:20:05.388788       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:20:05.388811       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:20:10.923425       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:20:10.923443       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:20:13.934126       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:20:13.934249       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:20:56.955323       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:20:56.955340       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:20:57.535982       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:20:57.536056       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:21:09.237002       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:21:09.237024       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:21:41.888297       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:21:41.888319       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:21:46.877545       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:21:46.877569       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:21:53.441539       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:21:53.441621       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:22:24.444869       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:22:24.444891       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	* 

	* ==> kube-proxy [1056d2808256] <==

	* I1004 00:04:24.994967       1 server_others.go:69] "Using iptables proxy"

	I1004 00:04:25.008728       1 node.go:141] Successfully retrieved node IP: 192.168.105.2

	I1004 00:04:25.054070       1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"

	I1004 00:04:25.054092       1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I1004 00:04:25.054953       1 server_others.go:152] "Using iptables Proxier"

	I1004 00:04:25.054989       1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I1004 00:04:25.055146       1 server.go:846] "Version info" version="v1.28.2"

	I1004 00:04:25.055152       1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I1004 00:04:25.056159       1 config.go:188] "Starting service config controller"

	I1004 00:04:25.056167       1 shared_informer.go:311] Waiting for caches to sync for service config

	I1004 00:04:25.056185       1 config.go:97] "Starting endpoint slice config controller"

	I1004 00:04:25.056188       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config

	I1004 00:04:25.056455       1 config.go:315] "Starting node config controller"

	I1004 00:04:25.056459       1 shared_informer.go:311] Waiting for caches to sync for node config

	I1004 00:04:25.157056       1 shared_informer.go:318] Caches are synced for node config

	I1004 00:04:25.157076       1 shared_informer.go:318] Caches are synced for service config

	I1004 00:04:25.157088       1 shared_informer.go:318] Caches are synced for endpoint slice config

	* 

	* ==> kube-scheduler [a8e887332d59] <==

	* W1004 00:04:08.386414       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E1004 00:04:08.386433       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	W1004 00:04:08.386500       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1004 00:04:08.386521       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	W1004 00:04:08.386548       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E1004 00:04:08.386567       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	W1004 00:04:08.386603       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E1004 00:04:08.386625       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W1004 00:04:08.386669       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E1004 00:04:08.386696       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	W1004 00:04:08.386739       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E1004 00:04:08.386765       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	W1004 00:04:08.386786       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E1004 00:04:08.386793       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	W1004 00:04:08.386810       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E1004 00:04:08.386876       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	W1004 00:04:09.204848       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E1004 00:04:09.204864       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	W1004 00:04:09.297780       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E1004 00:04:09.297794       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W1004 00:04:09.358667       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E1004 00:04:09.358688       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	W1004 00:04:09.389038       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E1004 00:04:09.389085       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	I1004 00:04:09.875156       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	* 

	* ==> kubelet <==

	* -- Journal begins at Wed 2023-10-04 00:03:51 UTC, ends at Wed 2023-10-04 00:22:25 UTC. --

	Oct 04 00:17:10 addons-585000 kubelet[2369]: E1004 00:17:10.891861    2369 iptables.go:575] "Could not set up iptables canary" err=<

	Oct 04 00:17:10 addons-585000 kubelet[2369]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Oct 04 00:17:10 addons-585000 kubelet[2369]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Oct 04 00:17:10 addons-585000 kubelet[2369]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Oct 04 00:18:10 addons-585000 kubelet[2369]: E1004 00:18:10.892149    2369 iptables.go:575] "Could not set up iptables canary" err=<

	Oct 04 00:18:10 addons-585000 kubelet[2369]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Oct 04 00:18:10 addons-585000 kubelet[2369]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Oct 04 00:18:10 addons-585000 kubelet[2369]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Oct 04 00:19:10 addons-585000 kubelet[2369]: E1004 00:19:10.892588    2369 iptables.go:575] "Could not set up iptables canary" err=<

	Oct 04 00:19:10 addons-585000 kubelet[2369]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Oct 04 00:19:10 addons-585000 kubelet[2369]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Oct 04 00:19:10 addons-585000 kubelet[2369]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Oct 04 00:19:10 addons-585000 kubelet[2369]: W1004 00:19:10.906241    2369 machine.go:65] Cannot read vendor id correctly, set empty.

	Oct 04 00:20:10 addons-585000 kubelet[2369]: E1004 00:20:10.891904    2369 iptables.go:575] "Could not set up iptables canary" err=<

	Oct 04 00:20:10 addons-585000 kubelet[2369]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Oct 04 00:20:10 addons-585000 kubelet[2369]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Oct 04 00:20:10 addons-585000 kubelet[2369]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Oct 04 00:21:10 addons-585000 kubelet[2369]: E1004 00:21:10.891982    2369 iptables.go:575] "Could not set up iptables canary" err=<

	Oct 04 00:21:10 addons-585000 kubelet[2369]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Oct 04 00:21:10 addons-585000 kubelet[2369]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Oct 04 00:21:10 addons-585000 kubelet[2369]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Oct 04 00:22:10 addons-585000 kubelet[2369]: E1004 00:22:10.891863    2369 iptables.go:575] "Could not set up iptables canary" err=<

	Oct 04 00:22:10 addons-585000 kubelet[2369]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Oct 04 00:22:10 addons-585000 kubelet[2369]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Oct 04 00:22:10 addons-585000 kubelet[2369]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	* 

	* ==> storage-provisioner [59046ced6b46] <==

	* I1004 00:04:26.966816       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I1004 00:04:26.974630       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I1004 00:04:26.974651       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I1004 00:04:26.979059       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I1004 00:04:26.979221       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-585000_78b745e2-b305-4877-9367-ded1aea23542!

	I1004 00:04:26.979729       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"7fdf1027-c160-41cc-988a-74718f8f9c77", APIVersion:"v1", ResourceVersion:"562", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-585000_78b745e2-b305-4877-9367-ded1aea23542 became leader

	I1004 00:04:27.081357       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-585000_78b745e2-b305-4877-9367-ded1aea23542!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p addons-585000 -n addons-585000

helpers_test.go:261: (dbg) Run:  kubectl --context addons-585000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestAddons/parallel/Registry FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestAddons/parallel/Registry (720.86s)

=== RUN   TestAddons/parallel/Ingress

=== PAUSE TestAddons/parallel/Ingress

=== CONT  TestAddons/parallel/Ingress

addons_test.go:185: (dbg) Run:  kubectl --context addons-585000 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s

addons_test.go:185: (dbg) Non-zero exit: kubectl --context addons-585000 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s: exit status 1 (38.432333ms)

** stderr ** 

	error: no matching resources found

** /stderr **

addons_test.go:186: failed waiting for ingress-nginx-controller : exit status 1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p addons-585000 -n addons-585000

helpers_test.go:244: <<< TestAddons/parallel/Ingress FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/Ingress]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p addons-585000 logs -n 25

helpers_test.go:252: TestAddons/parallel/Ingress logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| Command |                                            Args                                             |       Profile        |  User   | Version |     Start Time      |      End Time       |

	|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| start   | -o=json --download-only                                                                     | download-only-278000 | jenkins | v1.31.2 | 03 Oct 23 17:03 PDT |                     |

	|         | -p download-only-278000                                                                     |                      |         |         |                     |                     |

	|         | --force --alsologtostderr                                                                   |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.16.0                                                                |                      |         |         |                     |                     |

	|         | --container-runtime=docker                                                                  |                      |         |         |                     |                     |

	|         | --driver=qemu2                                                                              |                      |         |         |                     |                     |

	| start   | -o=json --download-only                                                                     | download-only-278000 | jenkins | v1.31.2 | 03 Oct 23 17:03 PDT |                     |

	|         | -p download-only-278000                                                                     |                      |         |         |                     |                     |

	|         | --force --alsologtostderr                                                                   |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.28.2                                                                |                      |         |         |                     |                     |

	|         | --container-runtime=docker                                                                  |                      |         |         |                     |                     |

	|         | --driver=qemu2                                                                              |                      |         |         |                     |                     |

	| delete  | --all                                                                                       | minikube             | jenkins | v1.31.2 | 03 Oct 23 17:03 PDT | 03 Oct 23 17:03 PDT |

	| delete  | -p download-only-278000                                                                     | download-only-278000 | jenkins | v1.31.2 | 03 Oct 23 17:03 PDT | 03 Oct 23 17:03 PDT |

	| delete  | -p download-only-278000                                                                     | download-only-278000 | jenkins | v1.31.2 | 03 Oct 23 17:03 PDT | 03 Oct 23 17:03 PDT |

	| start   | --download-only -p                                                                          | binary-mirror-585000 | jenkins | v1.31.2 | 03 Oct 23 17:03 PDT |                     |

	|         | binary-mirror-585000                                                                        |                      |         |         |                     |                     |

	|         | --alsologtostderr                                                                           |                      |         |         |                     |                     |

	|         | --binary-mirror                                                                             |                      |         |         |                     |                     |

	|         | http://127.0.0.1:49316                                                                      |                      |         |         |                     |                     |

	|         | --driver=qemu2                                                                              |                      |         |         |                     |                     |

	| delete  | -p binary-mirror-585000                                                                     | binary-mirror-585000 | jenkins | v1.31.2 | 03 Oct 23 17:03 PDT | 03 Oct 23 17:03 PDT |

	| start   | -p addons-585000 --wait=true                                                                | addons-585000        | jenkins | v1.31.2 | 03 Oct 23 17:03 PDT | 03 Oct 23 17:10 PDT |

	|         | --memory=4000 --alsologtostderr                                                             |                      |         |         |                     |                     |

	|         | --addons=registry                                                                           |                      |         |         |                     |                     |

	|         | --addons=metrics-server                                                                     |                      |         |         |                     |                     |

	|         | --addons=volumesnapshots                                                                    |                      |         |         |                     |                     |

	|         | --addons=csi-hostpath-driver                                                                |                      |         |         |                     |                     |

	|         | --addons=gcp-auth                                                                           |                      |         |         |                     |                     |

	|         | --addons=cloud-spanner                                                                      |                      |         |         |                     |                     |

	|         | --addons=inspektor-gadget                                                                   |                      |         |         |                     |                     |

	|         | --addons=storage-provisioner-rancher                                                        |                      |         |         |                     |                     |

	|         | --driver=qemu2  --addons=ingress                                                            |                      |         |         |                     |                     |

	|         | --addons=ingress-dns                                                                        |                      |         |         |                     |                     |

	| ssh     | addons-585000 ssh cat                                                                       | addons-585000        | jenkins | v1.31.2 | 03 Oct 23 17:10 PDT | 03 Oct 23 17:10 PDT |

	|         | /opt/local-path-provisioner/pvc-320167fa-02d3-46e8-a116-8a91ec031e73_default_test-pvc/file1 |                      |         |         |                     |                     |

	| addons  | addons-585000 addons disable                                                                | addons-585000        | jenkins | v1.31.2 | 03 Oct 23 17:10 PDT | 03 Oct 23 17:11 PDT |

	|         | storage-provisioner-rancher                                                                 |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |

	| addons  | disable cloud-spanner -p                                                                    | addons-585000        | jenkins | v1.31.2 | 03 Oct 23 17:11 PDT | 03 Oct 23 17:11 PDT |

	|         | addons-585000                                                                               |                      |         |         |                     |                     |

	| addons  | enable headlamp                                                                             | addons-585000        | jenkins | v1.31.2 | 03 Oct 23 17:11 PDT | 03 Oct 23 17:11 PDT |

	|         | -p addons-585000                                                                            |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |

	| addons  | addons-585000 addons                                                                        | addons-585000        | jenkins | v1.31.2 | 03 Oct 23 17:12 PDT | 03 Oct 23 17:12 PDT |

	|         | disable csi-hostpath-driver                                                                 |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |

	| addons  | addons-585000 addons                                                                        | addons-585000        | jenkins | v1.31.2 | 03 Oct 23 17:12 PDT | 03 Oct 23 17:12 PDT |

	|         | disable volumesnapshots                                                                     |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |

	| addons  | addons-585000 addons                                                                        | addons-585000        | jenkins | v1.31.2 | 03 Oct 23 17:12 PDT | 03 Oct 23 17:12 PDT |

	|         | disable metrics-server                                                                      |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |

	|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2023/10/03 17:03:39

	Running on machine: MacOS-M1-Agent-2

	Binary: Built with gc go1.21.1 for darwin/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1003 17:03:39.158581    1527 out.go:296] Setting OutFile to fd 1 ...

	I1003 17:03:39.158729    1527 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1003 17:03:39.158732    1527 out.go:309] Setting ErrFile to fd 2...

	I1003 17:03:39.158735    1527 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1003 17:03:39.158883    1527 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17345-986/.minikube/bin

	I1003 17:03:39.159993    1527 out.go:303] Setting JSON to false

	I1003 17:03:39.176087    1527 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":193,"bootTime":1696377626,"procs":436,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.0","kernelVersion":"23.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W1003 17:03:39.176163    1527 start.go:136] gopshost.Virtualization returned error: not implemented yet

	I1003 17:03:39.181737    1527 out.go:177] * [addons-585000] minikube v1.31.2 on Darwin 14.0 (arm64)

	I1003 17:03:39.192759    1527 out.go:177]   - MINIKUBE_LOCATION=17345

	I1003 17:03:39.188852    1527 notify.go:220] Checking for updates...

	I1003 17:03:39.199748    1527 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17345-986/kubeconfig

	I1003 17:03:39.202788    1527 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I1003 17:03:39.205793    1527 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1003 17:03:39.208724    1527 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17345-986/.minikube

	I1003 17:03:39.211745    1527 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1003 17:03:39.214972    1527 driver.go:373] Setting default libvirt URI to qemu:///system

	I1003 17:03:39.217703    1527 out.go:177] * Using the qemu2 driver based on user configuration

	I1003 17:03:39.224760    1527 start.go:298] selected driver: qemu2

	I1003 17:03:39.224769    1527 start.go:902] validating driver "qemu2" against <nil>

	I1003 17:03:39.224776    1527 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1003 17:03:39.227233    1527 start_flags.go:307] no existing cluster config was found, will generate one from the flags 

	I1003 17:03:39.228551    1527 out.go:177] * Automatically selected the socket_vmnet network

	I1003 17:03:39.231862    1527 start_flags.go:923] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1003 17:03:39.231889    1527 cni.go:84] Creating CNI manager for ""

	I1003 17:03:39.231898    1527 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1003 17:03:39.231909    1527 start_flags.go:316] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I1003 17:03:39.231915    1527 start_flags.go:321] config:

	{Name:addons-585000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.2 ClusterName:addons-585000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CR

ISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID

:0 AutoPauseInterval:1m0s}

	I1003 17:03:39.236467    1527 iso.go:125] acquiring lock: {Name:mkcc00c41dbf3c669d3c57dcea55708ed569b7af Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1003 17:03:39.244723    1527 out.go:177] * Starting control plane node addons-585000 in cluster addons-585000

	I1003 17:03:39.248720    1527 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime docker

	I1003 17:03:39.248732    1527 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17345-986/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-arm64.tar.lz4

	I1003 17:03:39.248743    1527 cache.go:57] Caching tarball of preloaded images

	I1003 17:03:39.248794    1527 preload.go:174] Found /Users/jenkins/minikube-integration/17345-986/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I1003 17:03:39.248799    1527 cache.go:60] Finished verifying existence of preloaded tar for  v1.28.2 on docker

	I1003 17:03:39.249009    1527 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/config.json ...

	I1003 17:03:39.249019    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/config.json: {Name:mkd778f466258ed6668af8388431c37d54563e91 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:03:39.249218    1527 start.go:365] acquiring machines lock for addons-585000: {Name:mk16657683bb2d197cbddad244cc8b10f1cb12f0 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1003 17:03:39.249347    1527 start.go:369] acquired machines lock for "addons-585000" in 123.542µs

	I1003 17:03:39.249358    1527 start.go:93] Provisioning new machine with config: &{Name:addons-585000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi

g:{KubernetesVersion:v1.28.2 ClusterName:addons-585000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262

144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1003 17:03:39.249387    1527 start.go:125] createHost starting for "" (driver="qemu2")

	I1003 17:03:39.257735    1527 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	I1003 17:03:40.011044    1527 start.go:159] libmachine.API.Create for "addons-585000" (driver="qemu2")

	I1003 17:03:40.011102    1527 client.go:168] LocalClient.Create starting

	I1003 17:03:40.011343    1527 main.go:141] libmachine: Creating CA: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem

	I1003 17:03:40.143344    1527 main.go:141] libmachine: Creating client certificate: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/cert.pem

	I1003 17:03:40.289873    1527 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17345-986/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17345-986/.minikube/cache/iso/arm64/minikube-v1.31.0-1695060926-17240-arm64.iso...

	I1003 17:03:40.457885    1527 main.go:141] libmachine: Creating SSH key...

	I1003 17:03:40.594285    1527 main.go:141] libmachine: Creating Disk image...

	I1003 17:03:40.594296    1527 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I1003 17:03:40.594516    1527 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/disk.qcow2.raw /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/disk.qcow2

	I1003 17:03:40.676774    1527 main.go:141] libmachine: STDOUT: 

	I1003 17:03:40.676808    1527 main.go:141] libmachine: STDERR: 

	I1003 17:03:40.676887    1527 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/disk.qcow2 +20000M

	I1003 17:03:40.686768    1527 main.go:141] libmachine: STDOUT: Image resized.

	I1003 17:03:40.686791    1527 main.go:141] libmachine: STDERR: 

	I1003 17:03:40.686809    1527 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/disk.qcow2

	I1003 17:03:40.686818    1527 main.go:141] libmachine: Starting QEMU VM...

	I1003 17:03:40.686868    1527 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/qemu.pid -device virtio-net-pci,netdev=net0,mac=56:68:9c:60:58:22 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/disk.qcow2

	I1003 17:03:40.738577    1527 main.go:141] libmachine: STDOUT: 

	I1003 17:03:40.738615    1527 main.go:141] libmachine: STDERR: 

	I1003 17:03:40.738620    1527 main.go:141] libmachine: Attempt 0

	I1003 17:03:40.738639    1527 main.go:141] libmachine: Searching for 56:68:9c:60:58:22 in /var/db/dhcpd_leases ...

	I1003 17:03:42.739795    1527 main.go:141] libmachine: Attempt 1

	I1003 17:03:42.739877    1527 main.go:141] libmachine: Searching for 56:68:9c:60:58:22 in /var/db/dhcpd_leases ...

	I1003 17:03:44.740254    1527 main.go:141] libmachine: Attempt 2

	I1003 17:03:44.740355    1527 main.go:141] libmachine: Searching for 56:68:9c:60:58:22 in /var/db/dhcpd_leases ...

	I1003 17:03:46.741375    1527 main.go:141] libmachine: Attempt 3

	I1003 17:03:46.741387    1527 main.go:141] libmachine: Searching for 56:68:9c:60:58:22 in /var/db/dhcpd_leases ...

	I1003 17:03:48.742425    1527 main.go:141] libmachine: Attempt 4

	I1003 17:03:48.742472    1527 main.go:141] libmachine: Searching for 56:68:9c:60:58:22 in /var/db/dhcpd_leases ...

	I1003 17:03:50.743507    1527 main.go:141] libmachine: Attempt 5

	I1003 17:03:50.743527    1527 main.go:141] libmachine: Searching for 56:68:9c:60:58:22 in /var/db/dhcpd_leases ...

	I1003 17:03:52.744581    1527 main.go:141] libmachine: Attempt 6

	I1003 17:03:52.744624    1527 main.go:141] libmachine: Searching for 56:68:9c:60:58:22 in /var/db/dhcpd_leases ...

	I1003 17:03:52.744780    1527 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I1003 17:03:52.744831    1527 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:56:68:9c:60:58:22 ID:1,56:68:9c:60:58:22 Lease:0x651dfd67}

	I1003 17:03:52.744840    1527 main.go:141] libmachine: Found match: 56:68:9c:60:58:22

	I1003 17:03:52.744854    1527 main.go:141] libmachine: IP: 192.168.105.2

	I1003 17:03:52.744861    1527 main.go:141] libmachine: Waiting for VM to start (ssh -p 22 docker@192.168.105.2)...

	I1003 17:03:53.749773    1527 machine.go:88] provisioning docker machine ...

	I1003 17:03:53.749795    1527 buildroot.go:166] provisioning hostname "addons-585000"

	I1003 17:03:53.750715    1527 main.go:141] libmachine: Using SSH client type: native

	I1003 17:03:53.750982    1527 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10290de60] 0x1029105d0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I1003 17:03:53.750988    1527 main.go:141] libmachine: About to run SSH command:

	sudo hostname addons-585000 && echo "addons-585000" | sudo tee /etc/hostname

	I1003 17:03:53.772634    1527 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain

	I1003 17:03:56.876175    1527 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-585000

	I1003 17:03:56.876314    1527 main.go:141] libmachine: Using SSH client type: native

	I1003 17:03:56.876804    1527 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10290de60] 0x1029105d0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I1003 17:03:56.876820    1527 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-585000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-585000/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-585000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1003 17:03:56.953972    1527 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1003 17:03:56.953997    1527 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/17345-986/.minikube CaCertPath:/Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/17345-986/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/17345-986/.minikube}

	I1003 17:03:56.954022    1527 buildroot.go:174] setting up certificates

	I1003 17:03:56.954030    1527 provision.go:83] configureAuth start

	I1003 17:03:56.954037    1527 provision.go:138] copyHostCerts

	I1003 17:03:56.954176    1527 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/17345-986/.minikube/ca.pem (1082 bytes)

	I1003 17:03:56.954543    1527 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/17345-986/.minikube/cert.pem (1123 bytes)

	I1003 17:03:56.954713    1527 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/17345-986/.minikube/key.pem (1679 bytes)

	I1003 17:03:56.954859    1527 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/17345-986/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca-key.pem org=jenkins.addons-585000 san=[192.168.105.2 192.168.105.2 localhost 127.0.0.1 minikube addons-585000]

	I1003 17:03:57.033117    1527 provision.go:172] copyRemoteCerts

	I1003 17:03:57.033177    1527 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1003 17:03:57.033191    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:03:57.066294    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1003 17:03:57.072924    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)

	I1003 17:03:57.080102    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I1003 17:03:57.087350    1527 provision.go:86] duration metric: configureAuth took 133.318167ms

	I1003 17:03:57.087358    1527 buildroot.go:189] setting minikube options for container-runtime

	I1003 17:03:57.087453    1527 config.go:182] Loaded profile config "addons-585000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 17:03:57.087487    1527 main.go:141] libmachine: Using SSH client type: native

	I1003 17:03:57.087704    1527 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10290de60] 0x1029105d0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I1003 17:03:57.087709    1527 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1003 17:03:57.150120    1527 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I1003 17:03:57.150127    1527 buildroot.go:70] root file system type: tmpfs

	I1003 17:03:57.150191    1527 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I1003 17:03:57.150229    1527 main.go:141] libmachine: Using SSH client type: native

	I1003 17:03:57.150472    1527 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10290de60] 0x1029105d0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I1003 17:03:57.150508    1527 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1003 17:03:57.217705    1527 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I1003 17:03:57.217760    1527 main.go:141] libmachine: Using SSH client type: native

	I1003 17:03:57.218004    1527 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10290de60] 0x1029105d0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I1003 17:03:57.218015    1527 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1003 17:03:57.578682    1527 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I1003 17:03:57.578700    1527 machine.go:91] provisioned docker machine in 3.829016209s

	I1003 17:03:57.578705    1527 client.go:171] LocalClient.Create took 17.568053208s

	I1003 17:03:57.578718    1527 start.go:167] duration metric: libmachine.API.Create for "addons-585000" took 17.568154958s

	I1003 17:03:57.578727    1527 start.go:300] post-start starting for "addons-585000" (driver="qemu2")

	I1003 17:03:57.578734    1527 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1003 17:03:57.578804    1527 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1003 17:03:57.578814    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:03:57.611980    1527 ssh_runner.go:195] Run: cat /etc/os-release

	I1003 17:03:57.613271    1527 info.go:137] Remote host: Buildroot 2021.02.12

	I1003 17:03:57.613284    1527 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17345-986/.minikube/addons for local assets ...

	I1003 17:03:57.613351    1527 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17345-986/.minikube/files for local assets ...

	I1003 17:03:57.613375    1527 start.go:303] post-start completed in 34.643875ms

	I1003 17:03:57.613878    1527 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/config.json ...

	I1003 17:03:57.614052    1527 start.go:128] duration metric: createHost completed in 18.365139125s

	I1003 17:03:57.614072    1527 main.go:141] libmachine: Using SSH client type: native

	I1003 17:03:57.614285    1527 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10290de60] 0x1029105d0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I1003 17:03:57.614290    1527 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I1003 17:03:57.674033    1527 main.go:141] libmachine: SSH cmd err, output: <nil>: 1696377837.538666711

	I1003 17:03:57.674041    1527 fix.go:206] guest clock: 1696377837.538666711

	I1003 17:03:57.674045    1527 fix.go:219] Guest: 2023-10-03 17:03:57.538666711 -0700 PDT Remote: 2023-10-03 17:03:57.614055 -0700 PDT m=+18.473932959 (delta=-75.388289ms)

	I1003 17:03:57.674058    1527 fix.go:190] guest clock delta is within tolerance: -75.388289ms

	I1003 17:03:57.674061    1527 start.go:83] releasing machines lock for "addons-585000", held for 18.42518925s

	I1003 17:03:57.674383    1527 ssh_runner.go:195] Run: cat /version.json

	I1003 17:03:57.674394    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:03:57.674401    1527 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I1003 17:03:57.674438    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:03:57.752962    1527 ssh_runner.go:195] Run: systemctl --version

	I1003 17:03:57.755435    1527 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W1003 17:03:57.757647    1527 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I1003 17:03:57.757682    1527 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1003 17:03:57.763566    1527 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I1003 17:03:57.763573    1527 start.go:469] detecting cgroup driver to use...

	I1003 17:03:57.763688    1527 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1003 17:03:57.769448    1527 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I1003 17:03:57.772711    1527 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I1003 17:03:57.776091    1527 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...

	I1003 17:03:57.776116    1527 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I1003 17:03:57.779455    1527 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1003 17:03:57.782467    1527 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I1003 17:03:57.785325    1527 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1003 17:03:57.788823    1527 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1003 17:03:57.792297    1527 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I1003 17:03:57.795615    1527 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1003 17:03:57.798463    1527 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1003 17:03:57.801289    1527 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 17:03:57.870368    1527 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I1003 17:03:57.876293    1527 start.go:469] detecting cgroup driver to use...

	I1003 17:03:57.876338    1527 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1003 17:03:57.883607    1527 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1003 17:03:57.888285    1527 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I1003 17:03:57.899852    1527 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1003 17:03:57.904354    1527 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1003 17:03:57.909268    1527 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I1003 17:03:57.948483    1527 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1003 17:03:57.953584    1527 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1003 17:03:57.958727    1527 ssh_runner.go:195] Run: which cri-dockerd

	I1003 17:03:57.959920    1527 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I1003 17:03:57.962534    1527 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I1003 17:03:57.967042    1527 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I1003 17:03:58.045502    1527 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I1003 17:03:58.130551    1527 docker.go:554] configuring docker to use "cgroupfs" as cgroup driver...

	I1003 17:03:58.130610    1527 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I1003 17:03:58.135707    1527 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 17:03:58.217318    1527 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1003 17:03:59.375606    1527 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.158300667s)

	I1003 17:03:59.375671    1527 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I1003 17:03:59.450200    1527 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I1003 17:03:59.524947    1527 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I1003 17:03:59.593104    1527 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 17:03:59.661107    1527 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I1003 17:03:59.668567    1527 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 17:03:59.749258    1527 ssh_runner.go:195] Run: sudo systemctl restart cri-docker

	I1003 17:03:59.773399    1527 start.go:516] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I1003 17:03:59.773477    1527 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I1003 17:03:59.775487    1527 start.go:537] Will wait 60s for crictl version

	I1003 17:03:59.775515    1527 ssh_runner.go:195] Run: which crictl

	I1003 17:03:59.776779    1527 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I1003 17:03:59.798500    1527 start.go:553] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  24.0.6

	RuntimeApiVersion:  v1

	I1003 17:03:59.798566    1527 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1003 17:03:59.808398    1527 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1003 17:03:59.824846    1527 out.go:204] * Preparing Kubernetes v1.28.2 on Docker 24.0.6 ...

	I1003 17:03:59.824981    1527 ssh_runner.go:195] Run: grep 192.168.105.1	host.minikube.internal$ /etc/hosts

	I1003 17:03:59.826582    1527 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.105.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1003 17:03:59.830378    1527 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime docker

	I1003 17:03:59.830418    1527 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1003 17:03:59.836052    1527 docker.go:664] Got preloaded images: 

	I1003 17:03:59.836060    1527 docker.go:670] registry.k8s.io/kube-apiserver:v1.28.2 wasn't preloaded

	I1003 17:03:59.836097    1527 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I1003 17:03:59.839267    1527 ssh_runner.go:195] Run: which lz4

	I1003 17:03:59.840501    1527 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I1003 17:03:59.841889    1527 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I1003 17:03:59.841901    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (356993689 bytes)

	I1003 17:04:01.160665    1527 docker.go:628] Took 1.320191 seconds to copy over tarball

	I1003 17:04:01.160727    1527 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4

	I1003 17:04:02.196965    1527 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (1.036251292s)

	I1003 17:04:02.196980    1527 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I1003 17:04:02.212861    1527 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I1003 17:04:02.216574    1527 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2629 bytes)

	I1003 17:04:02.221618    1527 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 17:04:02.297119    1527 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1003 17:04:03.756211    1527 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.459112709s)

	I1003 17:04:03.756322    1527 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1003 17:04:03.768480    1527 docker.go:664] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.28.2

	registry.k8s.io/kube-controller-manager:v1.28.2

	registry.k8s.io/kube-scheduler:v1.28.2

	registry.k8s.io/kube-proxy:v1.28.2

	registry.k8s.io/etcd:3.5.9-0

	registry.k8s.io/coredns/coredns:v1.10.1

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I1003 17:04:03.768491    1527 cache_images.go:84] Images are preloaded, skipping loading

	I1003 17:04:03.768560    1527 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I1003 17:04:03.778188    1527 cni.go:84] Creating CNI manager for ""

	I1003 17:04:03.778197    1527 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1003 17:04:03.778215    1527 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I1003 17:04:03.778224    1527 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.105.2 APIServerPort:8443 KubernetesVersion:v1.28.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-585000 NodeName:addons-585000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.105.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.105.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/ku

bernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I1003 17:04:03.778291    1527 kubeadm.go:181] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.105.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "addons-585000"

	  kubeletExtraArgs:

	    node-ip: 192.168.105.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.105.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.28.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1003 17:04:03.778325    1527 kubeadm.go:976] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.28.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=addons-585000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.105.2

	[Install]

	 config:

	{KubernetesVersion:v1.28.2 ClusterName:addons-585000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I1003 17:04:03.778383    1527 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.2

	I1003 17:04:03.781266    1527 binaries.go:44] Found k8s binaries, skipping transfer

	I1003 17:04:03.781296    1527 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1003 17:04:03.784487    1527 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (375 bytes)

	I1003 17:04:03.789671    1527 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1003 17:04:03.794606    1527 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2099 bytes)

	I1003 17:04:03.799383    1527 ssh_runner.go:195] Run: grep 192.168.105.2	control-plane.minikube.internal$ /etc/hosts

	I1003 17:04:03.800642    1527 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.105.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1003 17:04:03.804557    1527 certs.go:56] Setting up /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000 for IP: 192.168.105.2

	I1003 17:04:03.804566    1527 certs.go:190] acquiring lock for shared ca certs: {Name:mk60f926c1ccb065a30406b60af36acc708e601e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:03.804722    1527 certs.go:204] generating minikubeCA CA: /Users/jenkins/minikube-integration/17345-986/.minikube/ca.key

	I1003 17:04:03.876701    1527 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/17345-986/.minikube/ca.crt ...

	I1003 17:04:03.876706    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/ca.crt: {Name:mk0cc174d1dbd071293e805ad6149c7ec4b142e4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:03.876904    1527 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/17345-986/.minikube/ca.key ...

	I1003 17:04:03.876908    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/ca.key: {Name:mk5b0f090e1e87c9db61f19ee029eeb4bf325f96 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:03.877012    1527 certs.go:204] generating proxyClientCA CA: /Users/jenkins/minikube-integration/17345-986/.minikube/proxy-client-ca.key

	I1003 17:04:03.972780    1527 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/17345-986/.minikube/proxy-client-ca.crt ...

	I1003 17:04:03.972784    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/proxy-client-ca.crt: {Name:mk86baa625f8f131b96564e73e4ff47f159af5b3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:03.972918    1527 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/17345-986/.minikube/proxy-client-ca.key ...

	I1003 17:04:03.972921    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/proxy-client-ca.key: {Name:mk9131c9bbe858f22b10b784ddbb510d37a1be7e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:03.973043    1527 certs.go:319] generating minikube-user signed cert: /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/client.key

	I1003 17:04:03.973049    1527 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/client.crt with IP's: []

	I1003 17:04:04.093588    1527 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/client.crt ...

	I1003 17:04:04.093595    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/client.crt: {Name:mka78906c9a5365a7e95b92135f4b70302d9ca1d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:04.093800    1527 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/client.key ...

	I1003 17:04:04.093804    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/client.key: {Name:mk6f93cb157b068e90dc54f48279212367ea5933 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:04.093915    1527 certs.go:319] generating minikube signed cert: /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.key.96055969

	I1003 17:04:04.093926    1527 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.crt.96055969 with IP's: [192.168.105.2 10.96.0.1 127.0.0.1 10.0.0.1]

	I1003 17:04:04.305627    1527 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.crt.96055969 ...

	I1003 17:04:04.305631    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.crt.96055969: {Name:mk46c7ebd409ecd36224a01eb936cac8f04632ae Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:04.305820    1527 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.key.96055969 ...

	I1003 17:04:04.305826    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.key.96055969: {Name:mk401a87dc7fd50281b18296e80430af94b0e1a8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:04.305953    1527 certs.go:337] copying /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.crt.96055969 -> /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.crt

	I1003 17:04:04.306054    1527 certs.go:341] copying /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.key.96055969 -> /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.key

	I1003 17:04:04.306143    1527 certs.go:319] generating aggregator signed cert: /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/proxy-client.key

	I1003 17:04:04.306160    1527 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/proxy-client.crt with IP's: []

	I1003 17:04:04.424122    1527 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/proxy-client.crt ...

	I1003 17:04:04.424130    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/proxy-client.crt: {Name:mkdf8b0eea5ab20c208335ea1ea4eff82b50060d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:04.424327    1527 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/proxy-client.key ...

	I1003 17:04:04.424330    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/proxy-client.key: {Name:mkfa742ebb9620853aeccd91e597f5c286ba74ed Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:04.424537    1527 certs.go:437] found cert: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca-key.pem (1679 bytes)

	I1003 17:04:04.424561    1527 certs.go:437] found cert: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem (1082 bytes)

	I1003 17:04:04.424578    1527 certs.go:437] found cert: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/Users/jenkins/minikube-integration/17345-986/.minikube/certs/cert.pem (1123 bytes)

	I1003 17:04:04.424595    1527 certs.go:437] found cert: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/Users/jenkins/minikube-integration/17345-986/.minikube/certs/key.pem (1679 bytes)

	I1003 17:04:04.424928    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I1003 17:04:04.432625    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I1003 17:04:04.440097    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1003 17:04:04.447625    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I1003 17:04:04.454640    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1003 17:04:04.461322    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I1003 17:04:04.468544    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1003 17:04:04.475781    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I1003 17:04:04.482585    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1003 17:04:04.489167    1527 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1003 17:04:04.495146    1527 ssh_runner.go:195] Run: openssl version

	I1003 17:04:04.497003    1527 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1003 17:04:04.500457    1527 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1003 17:04:04.502228    1527 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Oct  4 00:04 /usr/share/ca-certificates/minikubeCA.pem

	I1003 17:04:04.502254    1527 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1003 17:04:04.504052    1527 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1003 17:04:04.507353    1527 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd

	I1003 17:04:04.508658    1527 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory

	I1003 17:04:04.508694    1527 kubeadm.go:404] StartCluster: {Name:addons-585000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v

1.28.2 ClusterName:addons-585000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mount

Options:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I1003 17:04:04.508756    1527 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1003 17:04:04.518400    1527 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1003 17:04:04.521199    1527 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1003 17:04:04.524450    1527 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1003 17:04:04.527574    1527 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1003 17:04:04.527588    1527 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I1003 17:04:04.548358    1527 kubeadm.go:322] [init] Using Kubernetes version: v1.28.2

	I1003 17:04:04.548382    1527 kubeadm.go:322] [preflight] Running pre-flight checks

	I1003 17:04:04.607082    1527 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster

	I1003 17:04:04.607142    1527 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I1003 17:04:04.607188    1527 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I1003 17:04:04.714297    1527 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I1003 17:04:04.722481    1527 out.go:204]   - Generating certificates and keys ...

	I1003 17:04:04.722514    1527 kubeadm.go:322] [certs] Using existing ca certificate authority

	I1003 17:04:04.722542    1527 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk

	I1003 17:04:04.759296    1527 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key

	I1003 17:04:04.808856    1527 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key

	I1003 17:04:04.964910    1527 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key

	I1003 17:04:05.087030    1527 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key

	I1003 17:04:05.149596    1527 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key

	I1003 17:04:05.149646    1527 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [addons-585000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I1003 17:04:05.222012    1527 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key

	I1003 17:04:05.222068    1527 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [addons-585000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I1003 17:04:05.286742    1527 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key

	I1003 17:04:05.330145    1527 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key

	I1003 17:04:05.629678    1527 kubeadm.go:322] [certs] Generating "sa" key and public key

	I1003 17:04:05.629709    1527 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I1003 17:04:05.731900    1527 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file

	I1003 17:04:05.854397    1527 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I1003 17:04:05.983877    1527 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I1003 17:04:06.151732    1527 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I1003 17:04:06.152571    1527 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I1003 17:04:06.153646    1527 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I1003 17:04:06.157945    1527 out.go:204]   - Booting up control plane ...

	I1003 17:04:06.158024    1527 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I1003 17:04:06.158075    1527 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I1003 17:04:06.158108    1527 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I1003 17:04:06.161462    1527 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I1003 17:04:06.161792    1527 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I1003 17:04:06.161837    1527 kubeadm.go:322] [kubelet-start] Starting the kubelet

	I1003 17:04:06.249226    1527 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	I1003 17:04:09.750516    1527 kubeadm.go:322] [apiclient] All control plane components are healthy after 3.501291 seconds

	I1003 17:04:09.750582    1527 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I1003 17:04:09.756399    1527 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I1003 17:04:10.266794    1527 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs

	I1003 17:04:10.266918    1527 kubeadm.go:322] [mark-control-plane] Marking the node addons-585000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I1003 17:04:10.770745    1527 kubeadm.go:322] [bootstrap-token] Using token: uzkazy.ii0fjdqhazr4xlxp

	I1003 17:04:10.779414    1527 out.go:204]   - Configuring RBAC rules ...

	I1003 17:04:10.779490    1527 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I1003 17:04:10.779537    1527 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I1003 17:04:10.781300    1527 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I1003 17:04:10.782670    1527 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I1003 17:04:10.783591    1527 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I1003 17:04:10.784726    1527 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I1003 17:04:10.788735    1527 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I1003 17:04:10.960644    1527 kubeadm.go:322] [addons] Applied essential addon: CoreDNS

	I1003 17:04:11.179744    1527 kubeadm.go:322] [addons] Applied essential addon: kube-proxy

	I1003 17:04:11.180034    1527 kubeadm.go:322] 

	I1003 17:04:11.180066    1527 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!

	I1003 17:04:11.180069    1527 kubeadm.go:322] 

	I1003 17:04:11.180099    1527 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:

	I1003 17:04:11.180102    1527 kubeadm.go:322] 

	I1003 17:04:11.180113    1527 kubeadm.go:322]   mkdir -p $HOME/.kube

	I1003 17:04:11.180141    1527 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I1003 17:04:11.180162    1527 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I1003 17:04:11.180170    1527 kubeadm.go:322] 

	I1003 17:04:11.180201    1527 kubeadm.go:322] Alternatively, if you are the root user, you can run:

	I1003 17:04:11.180204    1527 kubeadm.go:322] 

	I1003 17:04:11.180235    1527 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I1003 17:04:11.180239    1527 kubeadm.go:322] 

	I1003 17:04:11.180270    1527 kubeadm.go:322] You should now deploy a pod network to the cluster.

	I1003 17:04:11.180305    1527 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I1003 17:04:11.180339    1527 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I1003 17:04:11.180343    1527 kubeadm.go:322] 

	I1003 17:04:11.180390    1527 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities

	I1003 17:04:11.180428    1527 kubeadm.go:322] and service account keys on each node and then running the following as root:

	I1003 17:04:11.180432    1527 kubeadm.go:322] 

	I1003 17:04:11.180481    1527 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token uzkazy.ii0fjdqhazr4xlxp \

	I1003 17:04:11.180530    1527 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:9490a7a2ce6f448c9720863afea1604779c0ef0543f588db367e732362807037 \

	I1003 17:04:11.180544    1527 kubeadm.go:322] 	--control-plane 

	I1003 17:04:11.180546    1527 kubeadm.go:322] 

	I1003 17:04:11.180583    1527 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:

	I1003 17:04:11.180585    1527 kubeadm.go:322] 

	I1003 17:04:11.180630    1527 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token uzkazy.ii0fjdqhazr4xlxp \

	I1003 17:04:11.180681    1527 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:9490a7a2ce6f448c9720863afea1604779c0ef0543f588db367e732362807037 

	I1003 17:04:11.180859    1527 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I1003 17:04:11.180869    1527 cni.go:84] Creating CNI manager for ""

	I1003 17:04:11.180879    1527 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1003 17:04:11.187987    1527 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I1003 17:04:11.191059    1527 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I1003 17:04:11.194034    1527 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)

	I1003 17:04:11.198752    1527 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I1003 17:04:11.198795    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:11.198820    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl label nodes minikube.k8s.io/version=v1.31.2 minikube.k8s.io/commit=d9526fa6c1a1bb1b20f95e15606f1308e308d84a minikube.k8s.io/name=addons-585000 minikube.k8s.io/updated_at=2023_10_03T17_04_11_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:11.257808    1527 ops.go:34] apiserver oom_adj: -16

	I1003 17:04:11.257825    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:11.294996    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:11.828345    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:12.328361    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:12.828330    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:13.328397    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:13.828294    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:14.328299    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:14.828282    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:15.328311    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:15.828265    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:16.328253    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:16.828279    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:17.328231    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:17.828247    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:18.328230    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:18.828192    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:19.328127    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:19.828168    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:20.328197    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:20.827992    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:21.327973    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:21.828182    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:22.328181    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:22.828070    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:23.328028    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:23.828030    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:24.327999    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:24.363217    1527 kubeadm.go:1081] duration metric: took 13.164797125s to wait for elevateKubeSystemPrivileges.

	I1003 17:04:24.363234    1527 kubeadm.go:406] StartCluster complete in 19.855065708s

	I1003 17:04:24.363243    1527 settings.go:142] acquiring lock: {Name:mkad5f21e92defa14247d9a0adf05a6e4272cec8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:24.363390    1527 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/17345-986/kubeconfig

	I1003 17:04:24.363569    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/kubeconfig: {Name:mke3e06a6a2057954076f4772b87ca4469721c09 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:24.363810    1527 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I1003 17:04:24.363870    1527 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volumesnapshots:true]

	I1003 17:04:24.363932    1527 addons.go:69] Setting volumesnapshots=true in profile "addons-585000"

	I1003 17:04:24.363942    1527 addons.go:231] Setting addon volumesnapshots=true in "addons-585000"

	I1003 17:04:24.363950    1527 config.go:182] Loaded profile config "addons-585000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 17:04:24.363971    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.363950    1527 addons.go:69] Setting ingress-dns=true in profile "addons-585000"

	I1003 17:04:24.364021    1527 addons.go:231] Setting addon ingress-dns=true in "addons-585000"

	I1003 17:04:24.364047    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.363981    1527 addons.go:69] Setting registry=true in profile "addons-585000"

	I1003 17:04:24.364069    1527 addons.go:231] Setting addon registry=true in "addons-585000"

	I1003 17:04:24.364086    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.363984    1527 addons.go:69] Setting inspektor-gadget=true in profile "addons-585000"

	I1003 17:04:24.364126    1527 addons.go:231] Setting addon inspektor-gadget=true in "addons-585000"

	I1003 17:04:24.364190    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.363986    1527 addons.go:69] Setting metrics-server=true in profile "addons-585000"

	I1003 17:04:24.364214    1527 addons.go:231] Setting addon metrics-server=true in "addons-585000"

	I1003 17:04:24.364247    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.363988    1527 addons.go:69] Setting gcp-auth=true in profile "addons-585000"

	I1003 17:04:24.364271    1527 mustload.go:65] Loading cluster: addons-585000

	W1003 17:04:24.364287    1527 host.go:54] host status for "addons-585000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/monitor: connect: connection refused

	W1003 17:04:24.364300    1527 addons.go:277] "addons-585000" is not running, setting ingress-dns=true and skipping enablement (err=<nil>)

	W1003 17:04:24.364313    1527 host.go:54] host status for "addons-585000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/monitor: connect: connection refused

	W1003 17:04:24.364319    1527 addons.go:277] "addons-585000" is not running, setting registry=true and skipping enablement (err=<nil>)

	I1003 17:04:24.364322    1527 addons.go:467] Verifying addon registry=true in "addons-585000"

	I1003 17:04:24.370457    1527 out.go:177] * Verifying registry addon...

	I1003 17:04:24.364356    1527 config.go:182] Loaded profile config "addons-585000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 17:04:24.363992    1527 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-585000"

	I1003 17:04:24.370476    1527 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-585000"

	I1003 17:04:24.363993    1527 addons.go:69] Setting ingress=true in profile "addons-585000"

	I1003 17:04:24.363995    1527 addons.go:69] Setting cloud-spanner=true in profile "addons-585000"

	I1003 17:04:24.370530    1527 addons.go:231] Setting addon cloud-spanner=true in "addons-585000"

	I1003 17:04:24.363994    1527 addons.go:69] Setting default-storageclass=true in profile "addons-585000"

	I1003 17:04:24.370529    1527 addons.go:231] Setting addon ingress=true in "addons-585000"

	I1003 17:04:24.370591    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.370597    1527 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-585000"

	I1003 17:04:24.363996    1527 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-585000"

	W1003 17:04:24.364679    1527 host.go:54] host status for "addons-585000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/monitor: connect: connection refused

	I1003 17:04:24.370563    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.363989    1527 addons.go:69] Setting storage-provisioner=true in profile "addons-585000"

	I1003 17:04:24.370642    1527 addons.go:231] Setting addon csi-hostpath-driver=true in "addons-585000"

	W1003 17:04:24.370646    1527 addons.go:277] "addons-585000" is not running, setting inspektor-gadget=true and skipping enablement (err=<nil>)

	W1003 17:04:24.370793    1527 host.go:54] host status for "addons-585000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/monitor: connect: connection refused

	W1003 17:04:24.370892    1527 host.go:54] host status for "addons-585000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/monitor: connect: connection refused

	I1003 17:04:24.371573    1527 addons.go:231] Setting addon default-storageclass=true in "addons-585000"

	I1003 17:04:24.371900    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.380387    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	I1003 17:04:24.383435    1527 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.6.4

	I1003 17:04:24.383459    1527 addons.go:231] Setting addon storage-provisioner=true in "addons-585000"

	W1003 17:04:24.383452    1527 addons.go:277] "addons-585000" is not running, setting ingress=true and skipping enablement (err=<nil>)

	W1003 17:04:24.383476    1527 addons_storage_classes.go:57] "addons-585000" is not running, writing storage-provisioner-rancher=true to disk and skipping enablement

	I1003 17:04:24.383496    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.383533    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.383999    1527 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...

	I1003 17:04:24.386486    1527 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml

	I1003 17:04:24.389459    1527 addons.go:423] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I1003 17:04:24.389462    1527 addons.go:231] Setting addon storage-provisioner-rancher=true in "addons-585000"

	I1003 17:04:24.389488    1527 addons.go:467] Verifying addon ingress=true in "addons-585000"

	I1003 17:04:24.389521    1527 host.go:66] Checking if "addons-585000" exists ...

	W1003 17:04:24.389784    1527 host.go:54] host status for "addons-585000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/monitor: connect: connection refused

	I1003 17:04:24.395446    1527 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.10

	I1003 17:04:24.395461    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.395467    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)

	I1003 17:04:24.395470    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)

	W1003 17:04:24.395486    1527 addons.go:277] "addons-585000" is not running, setting default-storageclass=true and skipping enablement (err=<nil>)

	I1003 17:04:24.398475    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0

	I1003 17:04:24.398484    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:04:24.398497    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:04:24.407159    1527 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=registry

	I1003 17:04:24.408397    1527 out.go:177] * Verifying ingress addon...

	I1003 17:04:24.414483    1527 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I1003 17:04:24.418517    1527 addons.go:423] installing /etc/kubernetes/addons/deployment.yaml

	I1003 17:04:24.421445    1527 out.go:177]   - Using image docker.io/busybox:stable

	I1003 17:04:24.423490    1527 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-585000" context rescaled to 1 replicas

	I1003 17:04:24.424496    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)

	I1003 17:04:24.427548    1527 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1003 17:04:24.427858    1527 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...

	I1003 17:04:24.430982    1527 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.105.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.28.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I1003 17:04:24.433444    1527 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I1003 17:04:24.439439    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0

	I1003 17:04:24.439555    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:04:24.442455    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I1003 17:04:24.442466    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:04:24.447401    1527 out.go:177] * Verifying Kubernetes components...

	I1003 17:04:24.451674    1527 kapi.go:86] Found 0 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I1003 17:04:24.453485    1527 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1003 17:04:24.457496    1527 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22

	I1003 17:04:24.467442    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0

	I1003 17:04:24.480410    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0

	I1003 17:04:24.476494    1527 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I1003 17:04:24.483451    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)

	I1003 17:04:24.486383    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0

	I1003 17:04:24.483462    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:04:24.485254    1527 addons.go:423] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I1003 17:04:24.489434    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)

	I1003 17:04:24.492499    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0

	I1003 17:04:24.499438    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0

	I1003 17:04:24.508438    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0

	I1003 17:04:24.512295    1527 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml

	I1003 17:04:24.512323    1527 addons.go:423] installing /etc/kubernetes/addons/rbac-external-attacher.yaml

	I1003 17:04:24.512325    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)

	I1003 17:04:24.512338    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)

	I1003 17:04:24.512347    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:04:24.558122    1527 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1003 17:04:24.567387    1527 addons.go:423] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I1003 17:04:24.567399    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)

	I1003 17:04:24.572776    1527 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/deployment.yaml

	I1003 17:04:24.599074    1527 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml

	I1003 17:04:24.599085    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)

	I1003 17:04:24.675063    1527 addons.go:423] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I1003 17:04:24.675075    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)

	I1003 17:04:24.676328    1527 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml

	I1003 17:04:24.676333    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)

	I1003 17:04:24.739366    1527 addons.go:423] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml

	I1003 17:04:24.739377    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)

	I1003 17:04:24.749052    1527 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I1003 17:04:24.770490    1527 addons.go:423] installing /etc/kubernetes/addons/rbac-hostpath.yaml

	I1003 17:04:24.770501    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)

	I1003 17:04:24.785371    1527 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I1003 17:04:24.881017    1527 addons.go:423] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I1003 17:04:24.881027    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)

	I1003 17:04:24.903016    1527 addons.go:423] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml

	I1003 17:04:24.903028    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)

	I1003 17:04:24.969674    1527 addons.go:423] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml

	I1003 17:04:24.969686    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)

	I1003 17:04:25.049120    1527 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I1003 17:04:25.150729    1527 addons.go:423] installing /etc/kubernetes/addons/rbac-external-resizer.yaml

	I1003 17:04:25.150740    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)

	I1003 17:04:25.240313    1527 addons.go:423] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml

	I1003 17:04:25.240326    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)

	I1003 17:04:25.371181    1527 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml

	I1003 17:04:25.371193    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)

	I1003 17:04:25.404463    1527 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml

	I1003 17:04:25.404477    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)

	I1003 17:04:25.434986    1527 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml

	I1003 17:04:25.434995    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)

	I1003 17:04:25.450155    1527 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.105.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.28.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (1.007696167s)

	I1003 17:04:25.450172    1527 start.go:923] {"host.minikube.internal": 192.168.105.1} host record injected into CoreDNS's ConfigMap

	I1003 17:04:25.450599    1527 node_ready.go:35] waiting up to 6m0s for node "addons-585000" to be "Ready" ...

	I1003 17:04:25.452207    1527 node_ready.go:49] node "addons-585000" has status "Ready":"True"

	I1003 17:04:25.452226    1527 node_ready.go:38] duration metric: took 1.601791ms waiting for node "addons-585000" to be "Ready" ...

	I1003 17:04:25.452231    1527 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1003 17:04:25.455004    1527 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace to be "Ready" ...

	I1003 17:04:25.474770    1527 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml

	I1003 17:04:25.474780    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)

	I1003 17:04:25.542278    1527 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I1003 17:04:25.542289    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)

	I1003 17:04:25.568058    1527 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I1003 17:04:25.900055    1527 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (1.327297041s)

	I1003 17:04:25.900073    1527 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (1.151039167s)

	I1003 17:04:25.900620    1527 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.342523s)

	I1003 17:04:26.031761    1527 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.246402458s)

	I1003 17:04:26.031779    1527 addons.go:467] Verifying addon metrics-server=true in "addons-585000"

	W1003 17:04:26.031811    1527 addons.go:449] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I1003 17:04:26.031889    1527 retry.go:31] will retry after 325.291799ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I1003 17:04:26.358314    1527 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I1003 17:04:27.197455    1527 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (1.629412791s)

	I1003 17:04:27.197475    1527 addons.go:467] Verifying addon csi-hostpath-driver=true in "addons-585000"

	I1003 17:04:27.203259    1527 out.go:177] * Verifying csi-hostpath-driver addon...

	I1003 17:04:27.212640    1527 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

	I1003 17:04:27.217488    1527 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I1003 17:04:27.217496    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:27.220905    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:27.463742    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:27.724717    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:28.224875    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:28.724679    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:28.978938    1527 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.620667959s)

	I1003 17:04:29.224602    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:29.725503    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:29.965298    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:30.225992    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:30.727405    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:30.990463    1527 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)

	I1003 17:04:30.990480    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:04:31.027829    1527 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)

	I1003 17:04:31.032721    1527 addons.go:231] Setting addon gcp-auth=true in "addons-585000"

	I1003 17:04:31.032748    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:31.033437    1527 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json

	I1003 17:04:31.033445    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:04:31.067911    1527 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230407

	I1003 17:04:31.071726    1527 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0

	I1003 17:04:31.074751    1527 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-ns.yaml

	I1003 17:04:31.074757    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)

	I1003 17:04:31.080083    1527 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-service.yaml

	I1003 17:04:31.080090    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)

	I1003 17:04:31.084923    1527 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I1003 17:04:31.084929    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5412 bytes)

	I1003 17:04:31.089910    1527 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I1003 17:04:31.227750    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:31.348093    1527 addons.go:467] Verifying addon gcp-auth=true in "addons-585000"

	I1003 17:04:31.351542    1527 out.go:177] * Verifying gcp-auth addon...

	I1003 17:04:31.357561    1527 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...

	I1003 17:04:31.360910    1527 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I1003 17:04:31.360918    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:31.363860    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:31.729484    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:31.868680    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:32.231013    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:32.368635    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:32.469496    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:32.731026    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:32.869106    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:33.231972    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:33.370303    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:33.732757    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:33.870865    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:34.233653    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:34.371764    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:34.734158    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:34.872420    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:34.973595    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:35.235439    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:35.373126    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:35.736125    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:35.873867    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:36.236732    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:36.377065    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:36.738038    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:36.875114    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:37.237689    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:37.375767    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:37.476370    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:37.738419    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:37.876233    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:38.238661    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:38.376555    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:38.739112    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:38.877451    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:39.239515    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:39.378140    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:39.479966    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:39.740793    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:39.878589    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:40.240762    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:40.379208    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:40.741780    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:40.879681    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:41.241996    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:41.380297    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:41.742785    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:41.880492    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:41.981384    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:42.243296    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:42.381074    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:42.743302    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:42.883349    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:43.244024    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:43.381895    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:43.744586    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:43.882405    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:44.244990    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:44.382844    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:44.483439    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:44.745332    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:44.884458    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:45.245668    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:45.383767    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:45.746153    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:45.884389    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:46.246346    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:46.384557    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:46.486038    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:46.746583    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:46.885125    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:47.247216    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:47.385576    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:47.747761    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:47.885573    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:48.247887    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:48.385997    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:48.748143    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:48.886329    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:48.987206    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:49.248369    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:49.386625    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:49.749134    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:49.886585    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:50.249103    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:50.386927    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:50.749495    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:50.887744    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:50.988394    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:51.249792    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:51.387776    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:51.749720    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:51.887719    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:52.249981    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:52.389544    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:52.751121    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:52.888557    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:53.250511    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:53.388659    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:53.490543    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:53.750650    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:53.888553    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:54.250803    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:54.389104    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:54.751294    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:54.889472    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:55.253309    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:55.389552    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:55.751715    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:55.889618    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:55.990684    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:56.251672    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:56.389851    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:56.752031    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:56.889910    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:57.252259    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:57.390082    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:57.752574    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:57.890363    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:57.991811    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:58.252678    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:58.390362    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:58.752590    1527 kapi.go:107] duration metric: took 31.511793709s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

	I1003 17:04:58.890958    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:59.391228    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:59.891535    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:00.391427    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:00.491918    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:05:00.891593    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:01.391491    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:01.891778    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:02.391830    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:02.492542    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:05:02.891986    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:03.393570    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:03.892644    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:04.392440    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:04.892576    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:04.992969    1527 pod_ready.go:92] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"True"

	I1003 17:05:04.992976    1527 pod_ready.go:81] duration metric: took 39.508226208s waiting for pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:04.992981    1527 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-r24k8" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:04.993883    1527 pod_ready.go:97] error getting pod "coredns-5dd5756b68-r24k8" in "kube-system" namespace (skipping!): pods "coredns-5dd5756b68-r24k8" not found

	I1003 17:05:04.993891    1527 pod_ready.go:81] duration metric: took 907.208µs waiting for pod "coredns-5dd5756b68-r24k8" in "kube-system" namespace to be "Ready" ...

	E1003 17:05:04.993895    1527 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-5dd5756b68-r24k8" in "kube-system" namespace (skipping!): pods "coredns-5dd5756b68-r24k8" not found

	I1003 17:05:04.993899    1527 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-585000" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:04.996401    1527 pod_ready.go:92] pod "etcd-addons-585000" in "kube-system" namespace has status "Ready":"True"

	I1003 17:05:04.996406    1527 pod_ready.go:81] duration metric: took 2.500458ms waiting for pod "etcd-addons-585000" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:04.996410    1527 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-585000" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:04.999071    1527 pod_ready.go:92] pod "kube-apiserver-addons-585000" in "kube-system" namespace has status "Ready":"True"

	I1003 17:05:04.999079    1527 pod_ready.go:81] duration metric: took 2.666208ms waiting for pod "kube-apiserver-addons-585000" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:04.999082    1527 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-585000" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:05.001717    1527 pod_ready.go:92] pod "kube-controller-manager-addons-585000" in "kube-system" namespace has status "Ready":"True"

	I1003 17:05:05.001725    1527 pod_ready.go:81] duration metric: took 2.637584ms waiting for pod "kube-controller-manager-addons-585000" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:05.001728    1527 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-4m9nm" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:05.193135    1527 pod_ready.go:92] pod "kube-proxy-4m9nm" in "kube-system" namespace has status "Ready":"True"

	I1003 17:05:05.193144    1527 pod_ready.go:81] duration metric: took 191.372792ms waiting for pod "kube-proxy-4m9nm" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:05.193148    1527 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-585000" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:05.392551    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:05.593390    1527 pod_ready.go:92] pod "kube-scheduler-addons-585000" in "kube-system" namespace has status "Ready":"True"

	I1003 17:05:05.593399    1527 pod_ready.go:81] duration metric: took 400.165917ms waiting for pod "kube-scheduler-addons-585000" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:05.593404    1527 pod_ready.go:38] duration metric: took 40.11130675s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1003 17:05:05.593416    1527 api_server.go:52] waiting for apiserver process to appear ...

	I1003 17:05:05.593483    1527 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1003 17:05:05.598747    1527 api_server.go:72] duration metric: took 41.126444291s to wait for apiserver process to appear ...

	I1003 17:05:05.598757    1527 api_server.go:88] waiting for apiserver healthz status ...

	I1003 17:05:05.598764    1527 api_server.go:253] Checking apiserver healthz at https://192.168.105.2:8443/healthz ...

	I1003 17:05:05.601839    1527 api_server.go:279] https://192.168.105.2:8443/healthz returned 200:

	ok

	I1003 17:05:05.602592    1527 api_server.go:141] control plane version: v1.28.2

	I1003 17:05:05.602598    1527 api_server.go:131] duration metric: took 3.8385ms to wait for apiserver health ...

	I1003 17:05:05.602602    1527 system_pods.go:43] waiting for kube-system pods to appear ...

	I1003 17:05:05.796281    1527 system_pods.go:59] 13 kube-system pods found

	I1003 17:05:05.796294    1527 system_pods.go:61] "coredns-5dd5756b68-khk2s" [c45559e9-de80-4305-942c-094315d94d47] Running

	I1003 17:05:05.796297    1527 system_pods.go:61] "csi-hostpath-attacher-0" [63177292-e73a-431c-a767-00cf3ce9bce0] Running

	I1003 17:05:05.796299    1527 system_pods.go:61] "csi-hostpath-resizer-0" [8f737860-0999-4db9-9f65-190d64a4cfb4] Running

	I1003 17:05:05.796301    1527 system_pods.go:61] "csi-hostpathplugin-8thxw" [4548034b-9d0c-4d9d-9f9f-839610935d97] Running

	I1003 17:05:05.796303    1527 system_pods.go:61] "etcd-addons-585000" [f1858d65-44e4-469b-8372-a4e1e0a14d48] Running

	I1003 17:05:05.796306    1527 system_pods.go:61] "kube-apiserver-addons-585000" [377e1779-3201-42b4-945b-e2195b3f0a9a] Running

	I1003 17:05:05.796308    1527 system_pods.go:61] "kube-controller-manager-addons-585000" [f9156947-57be-49f5-9a1c-aadaa5bddf0c] Running

	I1003 17:05:05.796310    1527 system_pods.go:61] "kube-proxy-4m9nm" [847e005d-c7e1-4128-9ac6-2fef6730e3e4] Running

	I1003 17:05:05.796312    1527 system_pods.go:61] "kube-scheduler-addons-585000" [5b3e2487-5781-451e-b566-814b86a4eb80] Running

	I1003 17:05:05.796315    1527 system_pods.go:61] "metrics-server-7c66d45ddc-bvd9d" [e70964ce-39c1-444c-bfcc-e672f6027857] Running

	I1003 17:05:05.796317    1527 system_pods.go:61] "snapshot-controller-58dbcc7b99-2gg5z" [3f9fa5f9-6948-4b90-9114-e5bdb6822c87] Running

	I1003 17:05:05.796319    1527 system_pods.go:61] "snapshot-controller-58dbcc7b99-t2wrg" [174abadb-36b9-4fab-b1e2-44fa5de2def5] Running

	I1003 17:05:05.796321    1527 system_pods.go:61] "storage-provisioner" [41c3bd79-1e45-45d3-a1d8-9f5a2c5c7da5] Running

	I1003 17:05:05.796324    1527 system_pods.go:74] duration metric: took 193.680291ms to wait for pod list to return data ...

	I1003 17:05:05.796329    1527 default_sa.go:34] waiting for default service account to be created ...

	I1003 17:05:05.892491    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:05.992623    1527 default_sa.go:45] found service account: "default"

	I1003 17:05:05.992632    1527 default_sa.go:55] duration metric: took 196.262458ms for default service account to be created ...

	I1003 17:05:05.992638    1527 system_pods.go:116] waiting for k8s-apps to be running ...

	I1003 17:05:06.196272    1527 system_pods.go:86] 13 kube-system pods found

	I1003 17:05:06.196281    1527 system_pods.go:89] "coredns-5dd5756b68-khk2s" [c45559e9-de80-4305-942c-094315d94d47] Running

	I1003 17:05:06.196284    1527 system_pods.go:89] "csi-hostpath-attacher-0" [63177292-e73a-431c-a767-00cf3ce9bce0] Running

	I1003 17:05:06.196286    1527 system_pods.go:89] "csi-hostpath-resizer-0" [8f737860-0999-4db9-9f65-190d64a4cfb4] Running

	I1003 17:05:06.196288    1527 system_pods.go:89] "csi-hostpathplugin-8thxw" [4548034b-9d0c-4d9d-9f9f-839610935d97] Running

	I1003 17:05:06.196290    1527 system_pods.go:89] "etcd-addons-585000" [f1858d65-44e4-469b-8372-a4e1e0a14d48] Running

	I1003 17:05:06.196292    1527 system_pods.go:89] "kube-apiserver-addons-585000" [377e1779-3201-42b4-945b-e2195b3f0a9a] Running

	I1003 17:05:06.196294    1527 system_pods.go:89] "kube-controller-manager-addons-585000" [f9156947-57be-49f5-9a1c-aadaa5bddf0c] Running

	I1003 17:05:06.196296    1527 system_pods.go:89] "kube-proxy-4m9nm" [847e005d-c7e1-4128-9ac6-2fef6730e3e4] Running

	I1003 17:05:06.196298    1527 system_pods.go:89] "kube-scheduler-addons-585000" [5b3e2487-5781-451e-b566-814b86a4eb80] Running

	I1003 17:05:06.196300    1527 system_pods.go:89] "metrics-server-7c66d45ddc-bvd9d" [e70964ce-39c1-444c-bfcc-e672f6027857] Running

	I1003 17:05:06.196302    1527 system_pods.go:89] "snapshot-controller-58dbcc7b99-2gg5z" [3f9fa5f9-6948-4b90-9114-e5bdb6822c87] Running

	I1003 17:05:06.196304    1527 system_pods.go:89] "snapshot-controller-58dbcc7b99-t2wrg" [174abadb-36b9-4fab-b1e2-44fa5de2def5] Running

	I1003 17:05:06.196306    1527 system_pods.go:89] "storage-provisioner" [41c3bd79-1e45-45d3-a1d8-9f5a2c5c7da5] Running

	I1003 17:05:06.196310    1527 system_pods.go:126] duration metric: took 203.63025ms to wait for k8s-apps to be running ...

	I1003 17:05:06.196313    1527 system_svc.go:44] waiting for kubelet service to be running ....

	I1003 17:05:06.196369    1527 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1003 17:05:06.201921    1527 system_svc.go:56] duration metric: took 5.604333ms WaitForService to wait for kubelet.

	I1003 17:05:06.201929    1527 kubeadm.go:581] duration metric: took 41.729511541s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I1003 17:05:06.201940    1527 node_conditions.go:102] verifying NodePressure condition ...

	I1003 17:05:06.392698    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:06.393051    1527 node_conditions.go:122] node storage ephemeral capacity is 17784760Ki

	I1003 17:05:06.393087    1527 node_conditions.go:123] node cpu capacity is 2

	I1003 17:05:06.393093    1527 node_conditions.go:105] duration metric: took 191.114375ms to run NodePressure ...

	I1003 17:05:06.393098    1527 start.go:228] waiting for startup goroutines ...

	I1003 17:05:06.892943    1527 kapi.go:107] duration metric: took 35.5093015s to wait for kubernetes.io/minikube-addons=gcp-auth ...

	I1003 17:05:06.897190    1527 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-585000 cluster.

	I1003 17:05:06.900088    1527 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	I1003 17:05:06.903114    1527 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	I1003 17:10:24.417571    1527 kapi.go:107] duration metric: took 6m0.007521708s to wait for kubernetes.io/minikube-addons=registry ...

	W1003 17:10:24.417687    1527 out.go:239] ! Enabling 'registry' returned an error: running callbacks: [waiting for kubernetes.io/minikube-addons=registry pods: context deadline exceeded]

	I1003 17:10:24.469744    1527 kapi.go:107] duration metric: took 6m0.015851042s to wait for app.kubernetes.io/name=ingress-nginx ...

	W1003 17:10:24.469781    1527 out.go:239] ! Enabling 'ingress' returned an error: running callbacks: [waiting for app.kubernetes.io/name=ingress-nginx pods: context deadline exceeded]

	I1003 17:10:24.476811    1527 out.go:177] * Enabled addons: ingress-dns, inspektor-gadget, default-storageclass, cloud-spanner, storage-provisioner-rancher, storage-provisioner, metrics-server, volumesnapshots, csi-hostpath-driver, gcp-auth

	I1003 17:10:24.483852    1527 addons.go:502] enable addons completed in 6m0.093974291s: enabled=[ingress-dns inspektor-gadget default-storageclass cloud-spanner storage-provisioner-rancher storage-provisioner metrics-server volumesnapshots csi-hostpath-driver gcp-auth]

	I1003 17:10:24.483865    1527 start.go:233] waiting for cluster config update ...

	I1003 17:10:24.483873    1527 start.go:242] writing updated cluster config ...

	I1003 17:10:24.484152    1527 ssh_runner.go:195] Run: rm -f paused

	I1003 17:10:24.580795    1527 start.go:600] kubectl: 1.27.2, cluster: 1.28.2 (minor skew: 1)

	I1003 17:10:24.588925    1527 out.go:177] * Done! kubectl is now configured to use "addons-585000" cluster and "default" namespace by default

	* 

	* ==> Docker <==

	* -- Journal begins at Wed 2023-10-04 00:03:51 UTC, ends at Wed 2023-10-04 00:20:20 UTC. --

	Oct 04 00:12:08 addons-585000 dockerd[1122]: time="2023-10-04T00:12:08.349007007Z" level=info msg="cleaning up dead shim" namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1115]: time="2023-10-04T00:12:14.240701963Z" level=info msg="ignoring event" container=5ff0bef51f286679f0f3e673886c6c3125c354cab0674eabec453da6975a6991 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.241579343Z" level=info msg="shim disconnected" id=5ff0bef51f286679f0f3e673886c6c3125c354cab0674eabec453da6975a6991 namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.241698010Z" level=warning msg="cleaning up after shim disconnected" id=5ff0bef51f286679f0f3e673886c6c3125c354cab0674eabec453da6975a6991 namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.241717594Z" level=info msg="cleaning up dead shim" namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1115]: time="2023-10-04T00:12:14.242239805Z" level=info msg="ignoring event" container=517d59bdac0d4789df6d0fe970fb5d29190888751abb5196cf7cdf1d701cec03 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.242324306Z" level=info msg="shim disconnected" id=517d59bdac0d4789df6d0fe970fb5d29190888751abb5196cf7cdf1d701cec03 namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.242883392Z" level=warning msg="cleaning up after shim disconnected" id=517d59bdac0d4789df6d0fe970fb5d29190888751abb5196cf7cdf1d701cec03 namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.242933309Z" level=info msg="cleaning up dead shim" namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.323347774Z" level=info msg="shim disconnected" id=4f4a827bdb5aaf43cabfbf9cb0a34b674a64751dd5011a061778c8476e531e8e namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.323376233Z" level=warning msg="cleaning up after shim disconnected" id=4f4a827bdb5aaf43cabfbf9cb0a34b674a64751dd5011a061778c8476e531e8e namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.323380274Z" level=info msg="cleaning up dead shim" namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1115]: time="2023-10-04T00:12:14.323530942Z" level=info msg="ignoring event" container=4f4a827bdb5aaf43cabfbf9cb0a34b674a64751dd5011a061778c8476e531e8e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Oct 04 00:12:14 addons-585000 dockerd[1115]: time="2023-10-04T00:12:14.329811145Z" level=info msg="ignoring event" container=c09f627f07f68d859d6bfdefb05a6e13d8c3efbab921fb36772c99b884785536 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.329912979Z" level=info msg="shim disconnected" id=c09f627f07f68d859d6bfdefb05a6e13d8c3efbab921fb36772c99b884785536 namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.329940521Z" level=warning msg="cleaning up after shim disconnected" id=c09f627f07f68d859d6bfdefb05a6e13d8c3efbab921fb36772c99b884785536 namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.329944687Z" level=info msg="cleaning up dead shim" namespace=moby

	Oct 04 00:12:20 addons-585000 dockerd[1115]: time="2023-10-04T00:12:20.574199852Z" level=info msg="ignoring event" container=ecef984296b3c318eabdfadfcfd794578d7d5b79b06b6d15401d400fa2c41351 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Oct 04 00:12:20 addons-585000 dockerd[1122]: time="2023-10-04T00:12:20.574490520Z" level=info msg="shim disconnected" id=ecef984296b3c318eabdfadfcfd794578d7d5b79b06b6d15401d400fa2c41351 namespace=moby

	Oct 04 00:12:20 addons-585000 dockerd[1122]: time="2023-10-04T00:12:20.574591896Z" level=warning msg="cleaning up after shim disconnected" id=ecef984296b3c318eabdfadfcfd794578d7d5b79b06b6d15401d400fa2c41351 namespace=moby

	Oct 04 00:12:20 addons-585000 dockerd[1122]: time="2023-10-04T00:12:20.574612355Z" level=info msg="cleaning up dead shim" namespace=moby

	Oct 04 00:12:20 addons-585000 dockerd[1115]: time="2023-10-04T00:12:20.629572097Z" level=info msg="ignoring event" container=7c628d57a23adad9e457875314fcdc47575df49afc2fd60f3e2f12f92707c23a module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Oct 04 00:12:20 addons-585000 dockerd[1122]: time="2023-10-04T00:12:20.629930724Z" level=info msg="shim disconnected" id=7c628d57a23adad9e457875314fcdc47575df49afc2fd60f3e2f12f92707c23a namespace=moby

	Oct 04 00:12:20 addons-585000 dockerd[1122]: time="2023-10-04T00:12:20.629958933Z" level=warning msg="cleaning up after shim disconnected" id=7c628d57a23adad9e457875314fcdc47575df49afc2fd60f3e2f12f92707c23a namespace=moby

	Oct 04 00:12:20 addons-585000 dockerd[1122]: time="2023-10-04T00:12:20.629963350Z" level=info msg="cleaning up dead shim" namespace=moby

	* 

	* ==> container status <==

	* CONTAINER           IMAGE                                                                                                          CREATED             STATE               NAME                      ATTEMPT             POD ID              POD

	7fe1ae4df5fc3       ghcr.io/headlamp-k8s/headlamp@sha256:bb15916c96306cd14f1c9c09c639d01d1d1fb854fd770bf99f3e7a9deb584753          8 minutes ago       Running             headlamp                  0                   ef032c077a9bb       headlamp-58b88cff49-pkdpk

	4999c3b7505c2       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf   15 minutes ago      Running             gcp-auth                  0                   0baad7da81cca       gcp-auth-d4c87556c-fbd9n

	59046ced6b465       ba04bb24b9575                                                                                                  15 minutes ago      Running             storage-provisioner       0                   422eeee32f3c7       storage-provisioner

	1cabeffdf46fd       97e04611ad434                                                                                                  15 minutes ago      Running             coredns                   0                   94eeb18b87283       coredns-5dd5756b68-khk2s

	1056d28082563       7da62c127fc0f                                                                                                  15 minutes ago      Running             kube-proxy                0                   af3e361d0b85e       kube-proxy-4m9nm

	92000aefe5383       9cdd6470f48c8                                                                                                  16 minutes ago      Running             etcd                      0                   95e83160dff6c       etcd-addons-585000

	a8e887332d59e       64fc40cee3716                                                                                                  16 minutes ago      Running             kube-scheduler            0                   61eb9114b1a5a       kube-scheduler-addons-585000

	0cc0200950b6e       30bb499447fe1                                                                                                  16 minutes ago      Running             kube-apiserver            0                   d88b38dfea206       kube-apiserver-addons-585000

	c400229c491d5       89d57b83c1786                                                                                                  16 minutes ago      Running             kube-controller-manager   0                   5520678c190ce       kube-controller-manager-addons-585000

	* 

	* ==> coredns [1cabeffdf46f] <==

	* [INFO] plugin/kubernetes: waiting for Kubernetes API before starting server

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server

	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server

	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server

	[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API

	.:53

	[INFO] plugin/reload: Running configuration SHA512 = 591cf328cccc12bc490481273e738df59329c62c0b729d94e8b61db9961c2fa5f046dd37f1cf888b953814040d180f52594972691cd6ff41be96639138a43908

	CoreDNS-1.10.1

	linux/arm64, go1.20, 055b2c3

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] Reloading

	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b

	[INFO] Reloading complete

	[INFO] 127.0.0.1:51045 - 1814 "HINFO IN 7601180359592532728.73972322534061862. udp 55 false 512" NXDOMAIN qr,rd,ra 130 0.004583475s

	[INFO] 10.244.0.13:48220 - 27508 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000122275s

	[INFO] 10.244.0.13:58104 - 55098 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000039883s

	[INFO] 10.244.0.13:58849 - 26333 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000042675s

	[INFO] 10.244.0.13:53313 - 23208 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000023463s

	[INFO] 10.244.0.13:34872 - 37616 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000023379s

	[INFO] 10.244.0.13:36929 - 11673 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000023963s

	[INFO] 10.244.0.13:46593 - 5724 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.001098011s

	[INFO] 10.244.0.13:48407 - 27925 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 572 0.001132685s

	* 

	* ==> describe nodes <==

	* Name:               addons-585000

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=addons-585000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=d9526fa6c1a1bb1b20f95e15606f1308e308d84a

	                    minikube.k8s.io/name=addons-585000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2023_10_03T17_04_11_0700

	                    minikube.k8s.io/version=v1.31.2

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	                    topology.hostpath.csi/node=addons-585000

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 04 Oct 2023 00:04:08 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  addons-585000

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 04 Oct 2023 00:20:10 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 04 Oct 2023 00:17:27 +0000   Wed, 04 Oct 2023 00:04:07 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 04 Oct 2023 00:17:27 +0000   Wed, 04 Oct 2023 00:04:07 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 04 Oct 2023 00:17:27 +0000   Wed, 04 Oct 2023 00:04:07 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 04 Oct 2023 00:17:27 +0000   Wed, 04 Oct 2023 00:04:14 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.105.2

	  Hostname:    addons-585000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17784760Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3905012Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17784760Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3905012Ki

	  pods:               110

	System Info:

	  Machine ID:                 0684753a9d5543b6bf7bf60f67ba1317

	  System UUID:                0684753a9d5543b6bf7bf60f67ba1317

	  Boot ID:                    b5c3b3eb-78df-44c0-a5f8-68774932e45d

	  Kernel Version:             5.10.57

	  OS Image:                   Buildroot 2021.02.12

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  docker://24.0.6

	  Kubelet Version:            v1.28.2

	  Kube-Proxy Version:         v1.28.2

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (9 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  gcp-auth                    gcp-auth-d4c87556c-fbd9n                 0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         15m

	  headlamp                    headlamp-58b88cff49-pkdpk                0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m58s

	  kube-system                 coredns-5dd5756b68-khk2s                 100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (1%!)(MISSING)        170Mi (4%!)(MISSING)     15m

	  kube-system                 etcd-addons-585000                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (2%!)(MISSING)       0 (0%!)(MISSING)         16m

	  kube-system                 kube-apiserver-addons-585000             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         16m

	  kube-system                 kube-controller-manager-addons-585000    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         16m

	  kube-system                 kube-proxy-4m9nm                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         15m

	  kube-system                 kube-scheduler-addons-585000             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         16m

	  kube-system                 storage-provisioner                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         15m

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  0 (0%!)(MISSING)

	  memory             170Mi (4%!)(MISSING)  170Mi (4%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                From             Message

	  ----    ------                   ----               ----             -------

	  Normal  Starting                 15m                kube-proxy       

	  Normal  Starting                 16m                kubelet          Starting kubelet.

	  Normal  NodeHasSufficientMemory  16m (x8 over 16m)  kubelet          Node addons-585000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    16m (x8 over 16m)  kubelet          Node addons-585000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     16m (x7 over 16m)  kubelet          Node addons-585000 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  16m                kubelet          Updated Node Allocatable limit across pods

	  Normal  Starting                 16m                kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  16m                kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  16m                kubelet          Node addons-585000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    16m                kubelet          Node addons-585000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     16m                kubelet          Node addons-585000 status is now: NodeHasSufficientPID

	  Normal  NodeReady                16m                kubelet          Node addons-585000 status is now: NodeReady

	  Normal  RegisteredNode           15m                node-controller  Node addons-585000 event: Registered Node addons-585000 in Controller

	* 

	* ==> dmesg <==

	* [  +0.495022] systemd-fstab-generator[117]: Ignoring "noauto" for root device

	[  +0.043117] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.

	[  +0.000788] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)

	[  +6.182267] systemd-fstab-generator[489]: Ignoring "noauto" for root device

	[  +0.079218] systemd-fstab-generator[500]: Ignoring "noauto" for root device

	[  +0.426961] systemd-fstab-generator[674]: Ignoring "noauto" for root device

	[  +0.177441] systemd-fstab-generator[742]: Ignoring "noauto" for root device

	[  +0.084046] systemd-fstab-generator[753]: Ignoring "noauto" for root device

	[  +0.086428] systemd-fstab-generator[766]: Ignoring "noauto" for root device

	[  +1.232741] systemd-fstab-generator[924]: Ignoring "noauto" for root device

	[  +0.076723] systemd-fstab-generator[935]: Ignoring "noauto" for root device

	[  +0.068940] systemd-fstab-generator[946]: Ignoring "noauto" for root device

	[  +0.067661] systemd-fstab-generator[957]: Ignoring "noauto" for root device

	[  +0.086560] systemd-fstab-generator[999]: Ignoring "noauto" for root device

	[Oct 4 00:04] systemd-fstab-generator[1108]: Ignoring "noauto" for root device

	[  +1.419313] kauditd_printk_skb: 53 callbacks suppressed

	[  +2.528330] systemd-fstab-generator[1477]: Ignoring "noauto" for root device

	[  +4.623780] systemd-fstab-generator[2363]: Ignoring "noauto" for root device

	[ +14.190759] kauditd_printk_skb: 41 callbacks suppressed

	[  +4.496510] TCP: eth0: Driver has suspect GRO implementation, TCP performance may be compromised.

	[  +0.762652] kauditd_printk_skb: 67 callbacks suppressed

	[ +18.036762] kauditd_printk_skb: 10 callbacks suppressed

	[Oct 4 00:10] kauditd_printk_skb: 4 callbacks suppressed

	[Oct 4 00:11] kauditd_printk_skb: 5 callbacks suppressed

	[Oct 4 00:12] kauditd_printk_skb: 12 callbacks suppressed

	* 

	* ==> etcd [92000aefe538] <==

	* {"level":"info","ts":"2023-10-04T00:04:07.332412Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"6e03e7863b4f9c54","local-member-id":"c46d288d2fcb0590","added-peer-id":"c46d288d2fcb0590","added-peer-peer-urls":["https://192.168.105.2:2380"]}

	{"level":"info","ts":"2023-10-04T00:04:07.779564Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 is starting a new election at term 1"}

	{"level":"info","ts":"2023-10-04T00:04:07.779655Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 became pre-candidate at term 1"}

	{"level":"info","ts":"2023-10-04T00:04:07.779697Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 received MsgPreVoteResp from c46d288d2fcb0590 at term 1"}

	{"level":"info","ts":"2023-10-04T00:04:07.779722Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 became candidate at term 2"}

	{"level":"info","ts":"2023-10-04T00:04:07.779739Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 received MsgVoteResp from c46d288d2fcb0590 at term 2"}

	{"level":"info","ts":"2023-10-04T00:04:07.779758Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 became leader at term 2"}

	{"level":"info","ts":"2023-10-04T00:04:07.779794Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: c46d288d2fcb0590 elected leader c46d288d2fcb0590 at term 2"}

	{"level":"info","ts":"2023-10-04T00:04:07.780671Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"c46d288d2fcb0590","local-member-attributes":"{Name:addons-585000 ClientURLs:[https://192.168.105.2:2379]}","request-path":"/0/members/c46d288d2fcb0590/attributes","cluster-id":"6e03e7863b4f9c54","publish-timeout":"7s"}

	{"level":"info","ts":"2023-10-04T00:04:07.780756Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-10-04T00:04:07.781263Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.2:2379"}

	{"level":"info","ts":"2023-10-04T00:04:07.781336Z","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}

	{"level":"info","ts":"2023-10-04T00:04:07.781426Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-10-04T00:04:07.781791Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"6e03e7863b4f9c54","local-member-id":"c46d288d2fcb0590","cluster-version":"3.5"}

	{"level":"info","ts":"2023-10-04T00:04:07.781849Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2023-10-04T00:04:07.781874Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}

	{"level":"info","ts":"2023-10-04T00:04:07.782126Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2023-10-04T00:04:07.782156Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2023-10-04T00:04:07.782572Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2023-10-04T00:14:07.794073Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1195}

	{"level":"info","ts":"2023-10-04T00:14:07.809078Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":1195,"took":"14.718788ms","hash":1561751362}

	{"level":"info","ts":"2023-10-04T00:14:07.809096Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":1561751362,"revision":1195,"compact-revision":-1}

	{"level":"info","ts":"2023-10-04T00:19:07.797282Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1852}

	{"level":"info","ts":"2023-10-04T00:19:07.80972Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":1852,"took":"12.234463ms","hash":1586820359}

	{"level":"info","ts":"2023-10-04T00:19:07.809734Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":1586820359,"revision":1852,"compact-revision":1195}

	* 

	* ==> gcp-auth [4999c3b7505c] <==

	* 2023/10/04 00:05:05 GCP Auth Webhook started!

	2023/10/04 00:10:24 Ready to marshal response ...

	2023/10/04 00:10:24 Ready to write response ...

	2023/10/04 00:10:24 Ready to marshal response ...

	2023/10/04 00:10:24 Ready to write response ...

	2023/10/04 00:10:34 Ready to marshal response ...

	2023/10/04 00:10:34 Ready to write response ...

	2023/10/04 00:11:22 Ready to marshal response ...

	2023/10/04 00:11:22 Ready to write response ...

	2023/10/04 00:11:22 Ready to marshal response ...

	2023/10/04 00:11:22 Ready to write response ...

	2023/10/04 00:11:22 Ready to marshal response ...

	2023/10/04 00:11:22 Ready to write response ...

	2023/10/04 00:11:37 Ready to marshal response ...

	2023/10/04 00:11:37 Ready to write response ...

	2023/10/04 00:11:58 Ready to marshal response ...

	2023/10/04 00:11:58 Ready to write response ...

	* 

	* ==> kernel <==

	*  00:20:20 up 16 min,  0 users,  load average: 0.15, 0.20, 0.18

	Linux addons-585000 5.10.57 #1 SMP PREEMPT Mon Sep 18 20:10:16 UTC 2023 aarch64 GNU/Linux

	PRETTY_NAME="Buildroot 2021.02.12"

	* 

	* ==> kube-apiserver [0cc0200950b6] <==

	* E1004 00:10:50.314788       1 authentication.go:70] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"local-path-provisioner-service-account\" not found]"

	I1004 00:11:08.313792       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager

	I1004 00:11:22.215599       1 alloc.go:330] "allocated clusterIPs" service="headlamp/headlamp" clusterIPs={"IPv4":"10.110.244.116"}

	I1004 00:11:47.633142       1 controller.go:624] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io

	I1004 00:12:08.316300       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager

	I1004 00:12:14.160595       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1004 00:12:14.160622       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1004 00:12:14.167272       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1004 00:12:14.167291       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1004 00:12:14.174430       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1004 00:12:14.174447       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1004 00:12:14.177283       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1004 00:12:14.177295       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1004 00:12:14.179264       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1004 00:12:14.179278       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1004 00:12:14.184100       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1004 00:12:14.184112       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1004 00:12:14.189220       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1004 00:12:14.189231       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1004 00:12:14.192620       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1004 00:12:14.192633       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	W1004 00:12:15.177382       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io

	W1004 00:12:15.185019       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io

	W1004 00:12:15.201033       1 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io

	I1004 00:12:35.289747       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Nothing (removed from the queue).

	* 

	* ==> kube-controller-manager [c400229c491d] <==

	* E1004 00:17:06.657567       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:17:30.734478       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:17:30.734496       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:17:43.686942       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:17:43.686957       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:17:47.974020       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:17:47.974036       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:18:20.227624       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:18:20.227649       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:18:22.080967       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:18:22.080986       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:18:42.876081       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:18:42.876101       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:19:15.038875       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:19:15.038894       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:19:17.102732       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:19:17.102747       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:19:36.954598       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:19:36.954615       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:20:05.388788       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:20:05.388811       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:20:10.923425       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:20:10.923443       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:20:13.934126       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:20:13.934249       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	* 

	* ==> kube-proxy [1056d2808256] <==

	* I1004 00:04:24.994967       1 server_others.go:69] "Using iptables proxy"

	I1004 00:04:25.008728       1 node.go:141] Successfully retrieved node IP: 192.168.105.2

	I1004 00:04:25.054070       1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"

	I1004 00:04:25.054092       1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I1004 00:04:25.054953       1 server_others.go:152] "Using iptables Proxier"

	I1004 00:04:25.054989       1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I1004 00:04:25.055146       1 server.go:846] "Version info" version="v1.28.2"

	I1004 00:04:25.055152       1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I1004 00:04:25.056159       1 config.go:188] "Starting service config controller"

	I1004 00:04:25.056167       1 shared_informer.go:311] Waiting for caches to sync for service config

	I1004 00:04:25.056185       1 config.go:97] "Starting endpoint slice config controller"

	I1004 00:04:25.056188       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config

	I1004 00:04:25.056455       1 config.go:315] "Starting node config controller"

	I1004 00:04:25.056459       1 shared_informer.go:311] Waiting for caches to sync for node config

	I1004 00:04:25.157056       1 shared_informer.go:318] Caches are synced for node config

	I1004 00:04:25.157076       1 shared_informer.go:318] Caches are synced for service config

	I1004 00:04:25.157088       1 shared_informer.go:318] Caches are synced for endpoint slice config

	* 

	* ==> kube-scheduler [a8e887332d59] <==

	* W1004 00:04:08.386414       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E1004 00:04:08.386433       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	W1004 00:04:08.386500       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1004 00:04:08.386521       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	W1004 00:04:08.386548       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E1004 00:04:08.386567       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	W1004 00:04:08.386603       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E1004 00:04:08.386625       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W1004 00:04:08.386669       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E1004 00:04:08.386696       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	W1004 00:04:08.386739       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E1004 00:04:08.386765       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	W1004 00:04:08.386786       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E1004 00:04:08.386793       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	W1004 00:04:08.386810       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E1004 00:04:08.386876       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	W1004 00:04:09.204848       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E1004 00:04:09.204864       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	W1004 00:04:09.297780       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E1004 00:04:09.297794       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W1004 00:04:09.358667       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E1004 00:04:09.358688       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	W1004 00:04:09.389038       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E1004 00:04:09.389085       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	I1004 00:04:09.875156       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	* 

	* ==> kubelet <==

	* -- Journal begins at Wed 2023-10-04 00:03:51 UTC, ends at Wed 2023-10-04 00:20:20 UTC. --

	Oct 04 00:15:10 addons-585000 kubelet[2369]: E1004 00:15:10.892515    2369 iptables.go:575] "Could not set up iptables canary" err=<

	Oct 04 00:15:10 addons-585000 kubelet[2369]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Oct 04 00:15:10 addons-585000 kubelet[2369]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Oct 04 00:15:10 addons-585000 kubelet[2369]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Oct 04 00:16:10 addons-585000 kubelet[2369]: E1004 00:16:10.892289    2369 iptables.go:575] "Could not set up iptables canary" err=<

	Oct 04 00:16:10 addons-585000 kubelet[2369]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Oct 04 00:16:10 addons-585000 kubelet[2369]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Oct 04 00:16:10 addons-585000 kubelet[2369]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Oct 04 00:17:10 addons-585000 kubelet[2369]: E1004 00:17:10.891861    2369 iptables.go:575] "Could not set up iptables canary" err=<

	Oct 04 00:17:10 addons-585000 kubelet[2369]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Oct 04 00:17:10 addons-585000 kubelet[2369]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Oct 04 00:17:10 addons-585000 kubelet[2369]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Oct 04 00:18:10 addons-585000 kubelet[2369]: E1004 00:18:10.892149    2369 iptables.go:575] "Could not set up iptables canary" err=<

	Oct 04 00:18:10 addons-585000 kubelet[2369]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Oct 04 00:18:10 addons-585000 kubelet[2369]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Oct 04 00:18:10 addons-585000 kubelet[2369]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Oct 04 00:19:10 addons-585000 kubelet[2369]: E1004 00:19:10.892588    2369 iptables.go:575] "Could not set up iptables canary" err=<

	Oct 04 00:19:10 addons-585000 kubelet[2369]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Oct 04 00:19:10 addons-585000 kubelet[2369]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Oct 04 00:19:10 addons-585000 kubelet[2369]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Oct 04 00:19:10 addons-585000 kubelet[2369]: W1004 00:19:10.906241    2369 machine.go:65] Cannot read vendor id correctly, set empty.

	Oct 04 00:20:10 addons-585000 kubelet[2369]: E1004 00:20:10.891904    2369 iptables.go:575] "Could not set up iptables canary" err=<

	Oct 04 00:20:10 addons-585000 kubelet[2369]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Oct 04 00:20:10 addons-585000 kubelet[2369]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Oct 04 00:20:10 addons-585000 kubelet[2369]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	* 

	* ==> storage-provisioner [59046ced6b46] <==

	* I1004 00:04:26.966816       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I1004 00:04:26.974630       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I1004 00:04:26.974651       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I1004 00:04:26.979059       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I1004 00:04:26.979221       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-585000_78b745e2-b305-4877-9367-ded1aea23542!

	I1004 00:04:26.979729       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"7fdf1027-c160-41cc-988a-74718f8f9c77", APIVersion:"v1", ResourceVersion:"562", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-585000_78b745e2-b305-4877-9367-ded1aea23542 became leader

	I1004 00:04:27.081357       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-585000_78b745e2-b305-4877-9367-ded1aea23542!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p addons-585000 -n addons-585000

helpers_test.go:261: (dbg) Run:  kubectl --context addons-585000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestAddons/parallel/Ingress FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestAddons/parallel/Ingress (0.81s)

=== RUN   TestAddons/parallel/InspektorGadget

=== PAUSE TestAddons/parallel/InspektorGadget

=== CONT  TestAddons/parallel/InspektorGadget

addons_test.go:816: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...

helpers_test.go:329: TestAddons/parallel/InspektorGadget: WARNING: pod list for "gadget" "k8s-app=gadget" returned: client rate limiter Wait returned an error: rate: Wait(n=1) would exceed context deadline

addons_test.go:816: ***** TestAddons/parallel/InspektorGadget: pod "k8s-app=gadget" failed to start within 8m0s: context deadline exceeded ****

addons_test.go:816: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p addons-585000 -n addons-585000

addons_test.go:816: TestAddons/parallel/InspektorGadget: showing logs for failed pods as of 2023-10-03 17:20:19.569699 -0700 PDT m=+1018.775554459

addons_test.go:817: failed waiting for inspektor-gadget pod: k8s-app=gadget within 8m0s: context deadline exceeded

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p addons-585000 -n addons-585000

helpers_test.go:244: <<< TestAddons/parallel/InspektorGadget FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/InspektorGadget]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p addons-585000 logs -n 25

helpers_test.go:252: TestAddons/parallel/InspektorGadget logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| Command |                                            Args                                             |       Profile        |  User   | Version |     Start Time      |      End Time       |

	|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| start   | -o=json --download-only                                                                     | download-only-278000 | jenkins | v1.31.2 | 03 Oct 23 17:03 PDT |                     |

	|         | -p download-only-278000                                                                     |                      |         |         |                     |                     |

	|         | --force --alsologtostderr                                                                   |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.16.0                                                                |                      |         |         |                     |                     |

	|         | --container-runtime=docker                                                                  |                      |         |         |                     |                     |

	|         | --driver=qemu2                                                                              |                      |         |         |                     |                     |

	| start   | -o=json --download-only                                                                     | download-only-278000 | jenkins | v1.31.2 | 03 Oct 23 17:03 PDT |                     |

	|         | -p download-only-278000                                                                     |                      |         |         |                     |                     |

	|         | --force --alsologtostderr                                                                   |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.28.2                                                                |                      |         |         |                     |                     |

	|         | --container-runtime=docker                                                                  |                      |         |         |                     |                     |

	|         | --driver=qemu2                                                                              |                      |         |         |                     |                     |

	| delete  | --all                                                                                       | minikube             | jenkins | v1.31.2 | 03 Oct 23 17:03 PDT | 03 Oct 23 17:03 PDT |

	| delete  | -p download-only-278000                                                                     | download-only-278000 | jenkins | v1.31.2 | 03 Oct 23 17:03 PDT | 03 Oct 23 17:03 PDT |

	| delete  | -p download-only-278000                                                                     | download-only-278000 | jenkins | v1.31.2 | 03 Oct 23 17:03 PDT | 03 Oct 23 17:03 PDT |

	| start   | --download-only -p                                                                          | binary-mirror-585000 | jenkins | v1.31.2 | 03 Oct 23 17:03 PDT |                     |

	|         | binary-mirror-585000                                                                        |                      |         |         |                     |                     |

	|         | --alsologtostderr                                                                           |                      |         |         |                     |                     |

	|         | --binary-mirror                                                                             |                      |         |         |                     |                     |

	|         | http://127.0.0.1:49316                                                                      |                      |         |         |                     |                     |

	|         | --driver=qemu2                                                                              |                      |         |         |                     |                     |

	| delete  | -p binary-mirror-585000                                                                     | binary-mirror-585000 | jenkins | v1.31.2 | 03 Oct 23 17:03 PDT | 03 Oct 23 17:03 PDT |

	| start   | -p addons-585000 --wait=true                                                                | addons-585000        | jenkins | v1.31.2 | 03 Oct 23 17:03 PDT | 03 Oct 23 17:10 PDT |

	|         | --memory=4000 --alsologtostderr                                                             |                      |         |         |                     |                     |

	|         | --addons=registry                                                                           |                      |         |         |                     |                     |

	|         | --addons=metrics-server                                                                     |                      |         |         |                     |                     |

	|         | --addons=volumesnapshots                                                                    |                      |         |         |                     |                     |

	|         | --addons=csi-hostpath-driver                                                                |                      |         |         |                     |                     |

	|         | --addons=gcp-auth                                                                           |                      |         |         |                     |                     |

	|         | --addons=cloud-spanner                                                                      |                      |         |         |                     |                     |

	|         | --addons=inspektor-gadget                                                                   |                      |         |         |                     |                     |

	|         | --addons=storage-provisioner-rancher                                                        |                      |         |         |                     |                     |

	|         | --driver=qemu2  --addons=ingress                                                            |                      |         |         |                     |                     |

	|         | --addons=ingress-dns                                                                        |                      |         |         |                     |                     |

	| ssh     | addons-585000 ssh cat                                                                       | addons-585000        | jenkins | v1.31.2 | 03 Oct 23 17:10 PDT | 03 Oct 23 17:10 PDT |

	|         | /opt/local-path-provisioner/pvc-320167fa-02d3-46e8-a116-8a91ec031e73_default_test-pvc/file1 |                      |         |         |                     |                     |

	| addons  | addons-585000 addons disable                                                                | addons-585000        | jenkins | v1.31.2 | 03 Oct 23 17:10 PDT | 03 Oct 23 17:11 PDT |

	|         | storage-provisioner-rancher                                                                 |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |

	| addons  | disable cloud-spanner -p                                                                    | addons-585000        | jenkins | v1.31.2 | 03 Oct 23 17:11 PDT | 03 Oct 23 17:11 PDT |

	|         | addons-585000                                                                               |                      |         |         |                     |                     |

	| addons  | enable headlamp                                                                             | addons-585000        | jenkins | v1.31.2 | 03 Oct 23 17:11 PDT | 03 Oct 23 17:11 PDT |

	|         | -p addons-585000                                                                            |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |

	| addons  | addons-585000 addons                                                                        | addons-585000        | jenkins | v1.31.2 | 03 Oct 23 17:12 PDT | 03 Oct 23 17:12 PDT |

	|         | disable csi-hostpath-driver                                                                 |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |

	| addons  | addons-585000 addons                                                                        | addons-585000        | jenkins | v1.31.2 | 03 Oct 23 17:12 PDT | 03 Oct 23 17:12 PDT |

	|         | disable volumesnapshots                                                                     |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |

	| addons  | addons-585000 addons                                                                        | addons-585000        | jenkins | v1.31.2 | 03 Oct 23 17:12 PDT | 03 Oct 23 17:12 PDT |

	|         | disable metrics-server                                                                      |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |

	|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2023/10/03 17:03:39

	Running on machine: MacOS-M1-Agent-2

	Binary: Built with gc go1.21.1 for darwin/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1003 17:03:39.158581    1527 out.go:296] Setting OutFile to fd 1 ...

	I1003 17:03:39.158729    1527 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1003 17:03:39.158732    1527 out.go:309] Setting ErrFile to fd 2...

	I1003 17:03:39.158735    1527 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1003 17:03:39.158883    1527 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17345-986/.minikube/bin

	I1003 17:03:39.159993    1527 out.go:303] Setting JSON to false

	I1003 17:03:39.176087    1527 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":193,"bootTime":1696377626,"procs":436,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.0","kernelVersion":"23.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W1003 17:03:39.176163    1527 start.go:136] gopshost.Virtualization returned error: not implemented yet

	I1003 17:03:39.181737    1527 out.go:177] * [addons-585000] minikube v1.31.2 on Darwin 14.0 (arm64)

	I1003 17:03:39.192759    1527 out.go:177]   - MINIKUBE_LOCATION=17345

	I1003 17:03:39.188852    1527 notify.go:220] Checking for updates...

	I1003 17:03:39.199748    1527 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17345-986/kubeconfig

	I1003 17:03:39.202788    1527 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I1003 17:03:39.205793    1527 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1003 17:03:39.208724    1527 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17345-986/.minikube

	I1003 17:03:39.211745    1527 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1003 17:03:39.214972    1527 driver.go:373] Setting default libvirt URI to qemu:///system

	I1003 17:03:39.217703    1527 out.go:177] * Using the qemu2 driver based on user configuration

	I1003 17:03:39.224760    1527 start.go:298] selected driver: qemu2

	I1003 17:03:39.224769    1527 start.go:902] validating driver "qemu2" against <nil>

	I1003 17:03:39.224776    1527 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1003 17:03:39.227233    1527 start_flags.go:307] no existing cluster config was found, will generate one from the flags 

	I1003 17:03:39.228551    1527 out.go:177] * Automatically selected the socket_vmnet network

	I1003 17:03:39.231862    1527 start_flags.go:923] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1003 17:03:39.231889    1527 cni.go:84] Creating CNI manager for ""

	I1003 17:03:39.231898    1527 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1003 17:03:39.231909    1527 start_flags.go:316] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I1003 17:03:39.231915    1527 start_flags.go:321] config:

	{Name:addons-585000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.2 ClusterName:addons-585000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CR

ISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID

:0 AutoPauseInterval:1m0s}

	I1003 17:03:39.236467    1527 iso.go:125] acquiring lock: {Name:mkcc00c41dbf3c669d3c57dcea55708ed569b7af Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1003 17:03:39.244723    1527 out.go:177] * Starting control plane node addons-585000 in cluster addons-585000

	I1003 17:03:39.248720    1527 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime docker

	I1003 17:03:39.248732    1527 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17345-986/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-arm64.tar.lz4

	I1003 17:03:39.248743    1527 cache.go:57] Caching tarball of preloaded images

	I1003 17:03:39.248794    1527 preload.go:174] Found /Users/jenkins/minikube-integration/17345-986/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I1003 17:03:39.248799    1527 cache.go:60] Finished verifying existence of preloaded tar for  v1.28.2 on docker

	I1003 17:03:39.249009    1527 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/config.json ...

	I1003 17:03:39.249019    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/config.json: {Name:mkd778f466258ed6668af8388431c37d54563e91 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:03:39.249218    1527 start.go:365] acquiring machines lock for addons-585000: {Name:mk16657683bb2d197cbddad244cc8b10f1cb12f0 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1003 17:03:39.249347    1527 start.go:369] acquired machines lock for "addons-585000" in 123.542µs

	I1003 17:03:39.249358    1527 start.go:93] Provisioning new machine with config: &{Name:addons-585000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi

g:{KubernetesVersion:v1.28.2 ClusterName:addons-585000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262

144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1003 17:03:39.249387    1527 start.go:125] createHost starting for "" (driver="qemu2")

	I1003 17:03:39.257735    1527 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	I1003 17:03:40.011044    1527 start.go:159] libmachine.API.Create for "addons-585000" (driver="qemu2")

	I1003 17:03:40.011102    1527 client.go:168] LocalClient.Create starting

	I1003 17:03:40.011343    1527 main.go:141] libmachine: Creating CA: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem

	I1003 17:03:40.143344    1527 main.go:141] libmachine: Creating client certificate: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/cert.pem

	I1003 17:03:40.289873    1527 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17345-986/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17345-986/.minikube/cache/iso/arm64/minikube-v1.31.0-1695060926-17240-arm64.iso...

	I1003 17:03:40.457885    1527 main.go:141] libmachine: Creating SSH key...

	I1003 17:03:40.594285    1527 main.go:141] libmachine: Creating Disk image...

	I1003 17:03:40.594296    1527 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I1003 17:03:40.594516    1527 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/disk.qcow2.raw /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/disk.qcow2

	I1003 17:03:40.676774    1527 main.go:141] libmachine: STDOUT: 

	I1003 17:03:40.676808    1527 main.go:141] libmachine: STDERR: 

	I1003 17:03:40.676887    1527 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/disk.qcow2 +20000M

	I1003 17:03:40.686768    1527 main.go:141] libmachine: STDOUT: Image resized.

	I1003 17:03:40.686791    1527 main.go:141] libmachine: STDERR: 

	I1003 17:03:40.686809    1527 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/disk.qcow2

	I1003 17:03:40.686818    1527 main.go:141] libmachine: Starting QEMU VM...

	I1003 17:03:40.686868    1527 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/qemu.pid -device virtio-net-pci,netdev=net0,mac=56:68:9c:60:58:22 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/disk.qcow2

	I1003 17:03:40.738577    1527 main.go:141] libmachine: STDOUT: 

	I1003 17:03:40.738615    1527 main.go:141] libmachine: STDERR: 

	I1003 17:03:40.738620    1527 main.go:141] libmachine: Attempt 0

	I1003 17:03:40.738639    1527 main.go:141] libmachine: Searching for 56:68:9c:60:58:22 in /var/db/dhcpd_leases ...

	I1003 17:03:42.739795    1527 main.go:141] libmachine: Attempt 1

	I1003 17:03:42.739877    1527 main.go:141] libmachine: Searching for 56:68:9c:60:58:22 in /var/db/dhcpd_leases ...

	I1003 17:03:44.740254    1527 main.go:141] libmachine: Attempt 2

	I1003 17:03:44.740355    1527 main.go:141] libmachine: Searching for 56:68:9c:60:58:22 in /var/db/dhcpd_leases ...

	I1003 17:03:46.741375    1527 main.go:141] libmachine: Attempt 3

	I1003 17:03:46.741387    1527 main.go:141] libmachine: Searching for 56:68:9c:60:58:22 in /var/db/dhcpd_leases ...

	I1003 17:03:48.742425    1527 main.go:141] libmachine: Attempt 4

	I1003 17:03:48.742472    1527 main.go:141] libmachine: Searching for 56:68:9c:60:58:22 in /var/db/dhcpd_leases ...

	I1003 17:03:50.743507    1527 main.go:141] libmachine: Attempt 5

	I1003 17:03:50.743527    1527 main.go:141] libmachine: Searching for 56:68:9c:60:58:22 in /var/db/dhcpd_leases ...

	I1003 17:03:52.744581    1527 main.go:141] libmachine: Attempt 6

	I1003 17:03:52.744624    1527 main.go:141] libmachine: Searching for 56:68:9c:60:58:22 in /var/db/dhcpd_leases ...

	I1003 17:03:52.744780    1527 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I1003 17:03:52.744831    1527 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:56:68:9c:60:58:22 ID:1,56:68:9c:60:58:22 Lease:0x651dfd67}

	I1003 17:03:52.744840    1527 main.go:141] libmachine: Found match: 56:68:9c:60:58:22

	I1003 17:03:52.744854    1527 main.go:141] libmachine: IP: 192.168.105.2

	I1003 17:03:52.744861    1527 main.go:141] libmachine: Waiting for VM to start (ssh -p 22 docker@192.168.105.2)...

	I1003 17:03:53.749773    1527 machine.go:88] provisioning docker machine ...

	I1003 17:03:53.749795    1527 buildroot.go:166] provisioning hostname "addons-585000"

	I1003 17:03:53.750715    1527 main.go:141] libmachine: Using SSH client type: native

	I1003 17:03:53.750982    1527 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10290de60] 0x1029105d0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I1003 17:03:53.750988    1527 main.go:141] libmachine: About to run SSH command:

	sudo hostname addons-585000 && echo "addons-585000" | sudo tee /etc/hostname

	I1003 17:03:53.772634    1527 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain

	I1003 17:03:56.876175    1527 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-585000

	I1003 17:03:56.876314    1527 main.go:141] libmachine: Using SSH client type: native

	I1003 17:03:56.876804    1527 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10290de60] 0x1029105d0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I1003 17:03:56.876820    1527 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-585000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-585000/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-585000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1003 17:03:56.953972    1527 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1003 17:03:56.953997    1527 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/17345-986/.minikube CaCertPath:/Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/17345-986/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/17345-986/.minikube}

	I1003 17:03:56.954022    1527 buildroot.go:174] setting up certificates

	I1003 17:03:56.954030    1527 provision.go:83] configureAuth start

	I1003 17:03:56.954037    1527 provision.go:138] copyHostCerts

	I1003 17:03:56.954176    1527 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/17345-986/.minikube/ca.pem (1082 bytes)

	I1003 17:03:56.954543    1527 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/17345-986/.minikube/cert.pem (1123 bytes)

	I1003 17:03:56.954713    1527 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/17345-986/.minikube/key.pem (1679 bytes)

	I1003 17:03:56.954859    1527 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/17345-986/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca-key.pem org=jenkins.addons-585000 san=[192.168.105.2 192.168.105.2 localhost 127.0.0.1 minikube addons-585000]

	I1003 17:03:57.033117    1527 provision.go:172] copyRemoteCerts

	I1003 17:03:57.033177    1527 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1003 17:03:57.033191    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:03:57.066294    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1003 17:03:57.072924    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)

	I1003 17:03:57.080102    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I1003 17:03:57.087350    1527 provision.go:86] duration metric: configureAuth took 133.318167ms

	I1003 17:03:57.087358    1527 buildroot.go:189] setting minikube options for container-runtime

	I1003 17:03:57.087453    1527 config.go:182] Loaded profile config "addons-585000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 17:03:57.087487    1527 main.go:141] libmachine: Using SSH client type: native

	I1003 17:03:57.087704    1527 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10290de60] 0x1029105d0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I1003 17:03:57.087709    1527 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1003 17:03:57.150120    1527 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I1003 17:03:57.150127    1527 buildroot.go:70] root file system type: tmpfs

	I1003 17:03:57.150191    1527 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I1003 17:03:57.150229    1527 main.go:141] libmachine: Using SSH client type: native

	I1003 17:03:57.150472    1527 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10290de60] 0x1029105d0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I1003 17:03:57.150508    1527 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1003 17:03:57.217705    1527 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I1003 17:03:57.217760    1527 main.go:141] libmachine: Using SSH client type: native

	I1003 17:03:57.218004    1527 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10290de60] 0x1029105d0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I1003 17:03:57.218015    1527 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1003 17:03:57.578682    1527 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I1003 17:03:57.578700    1527 machine.go:91] provisioned docker machine in 3.829016209s

	I1003 17:03:57.578705    1527 client.go:171] LocalClient.Create took 17.568053208s

	I1003 17:03:57.578718    1527 start.go:167] duration metric: libmachine.API.Create for "addons-585000" took 17.568154958s

	I1003 17:03:57.578727    1527 start.go:300] post-start starting for "addons-585000" (driver="qemu2")

	I1003 17:03:57.578734    1527 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1003 17:03:57.578804    1527 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1003 17:03:57.578814    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:03:57.611980    1527 ssh_runner.go:195] Run: cat /etc/os-release

	I1003 17:03:57.613271    1527 info.go:137] Remote host: Buildroot 2021.02.12

	I1003 17:03:57.613284    1527 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17345-986/.minikube/addons for local assets ...

	I1003 17:03:57.613351    1527 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17345-986/.minikube/files for local assets ...

	I1003 17:03:57.613375    1527 start.go:303] post-start completed in 34.643875ms

	I1003 17:03:57.613878    1527 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/config.json ...

	I1003 17:03:57.614052    1527 start.go:128] duration metric: createHost completed in 18.365139125s

	I1003 17:03:57.614072    1527 main.go:141] libmachine: Using SSH client type: native

	I1003 17:03:57.614285    1527 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10290de60] 0x1029105d0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I1003 17:03:57.614290    1527 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I1003 17:03:57.674033    1527 main.go:141] libmachine: SSH cmd err, output: <nil>: 1696377837.538666711

	I1003 17:03:57.674041    1527 fix.go:206] guest clock: 1696377837.538666711

	I1003 17:03:57.674045    1527 fix.go:219] Guest: 2023-10-03 17:03:57.538666711 -0700 PDT Remote: 2023-10-03 17:03:57.614055 -0700 PDT m=+18.473932959 (delta=-75.388289ms)

	I1003 17:03:57.674058    1527 fix.go:190] guest clock delta is within tolerance: -75.388289ms

	I1003 17:03:57.674061    1527 start.go:83] releasing machines lock for "addons-585000", held for 18.42518925s

	I1003 17:03:57.674383    1527 ssh_runner.go:195] Run: cat /version.json

	I1003 17:03:57.674394    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:03:57.674401    1527 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I1003 17:03:57.674438    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:03:57.752962    1527 ssh_runner.go:195] Run: systemctl --version

	I1003 17:03:57.755435    1527 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W1003 17:03:57.757647    1527 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I1003 17:03:57.757682    1527 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1003 17:03:57.763566    1527 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I1003 17:03:57.763573    1527 start.go:469] detecting cgroup driver to use...

	I1003 17:03:57.763688    1527 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1003 17:03:57.769448    1527 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I1003 17:03:57.772711    1527 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I1003 17:03:57.776091    1527 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...

	I1003 17:03:57.776116    1527 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I1003 17:03:57.779455    1527 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1003 17:03:57.782467    1527 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I1003 17:03:57.785325    1527 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1003 17:03:57.788823    1527 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1003 17:03:57.792297    1527 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I1003 17:03:57.795615    1527 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1003 17:03:57.798463    1527 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1003 17:03:57.801289    1527 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 17:03:57.870368    1527 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I1003 17:03:57.876293    1527 start.go:469] detecting cgroup driver to use...

	I1003 17:03:57.876338    1527 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1003 17:03:57.883607    1527 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1003 17:03:57.888285    1527 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I1003 17:03:57.899852    1527 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1003 17:03:57.904354    1527 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1003 17:03:57.909268    1527 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I1003 17:03:57.948483    1527 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1003 17:03:57.953584    1527 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1003 17:03:57.958727    1527 ssh_runner.go:195] Run: which cri-dockerd

	I1003 17:03:57.959920    1527 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I1003 17:03:57.962534    1527 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I1003 17:03:57.967042    1527 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I1003 17:03:58.045502    1527 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I1003 17:03:58.130551    1527 docker.go:554] configuring docker to use "cgroupfs" as cgroup driver...

	I1003 17:03:58.130610    1527 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I1003 17:03:58.135707    1527 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 17:03:58.217318    1527 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1003 17:03:59.375606    1527 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.158300667s)

	I1003 17:03:59.375671    1527 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I1003 17:03:59.450200    1527 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I1003 17:03:59.524947    1527 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I1003 17:03:59.593104    1527 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 17:03:59.661107    1527 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I1003 17:03:59.668567    1527 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 17:03:59.749258    1527 ssh_runner.go:195] Run: sudo systemctl restart cri-docker

	I1003 17:03:59.773399    1527 start.go:516] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I1003 17:03:59.773477    1527 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I1003 17:03:59.775487    1527 start.go:537] Will wait 60s for crictl version

	I1003 17:03:59.775515    1527 ssh_runner.go:195] Run: which crictl

	I1003 17:03:59.776779    1527 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I1003 17:03:59.798500    1527 start.go:553] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  24.0.6

	RuntimeApiVersion:  v1

	I1003 17:03:59.798566    1527 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1003 17:03:59.808398    1527 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1003 17:03:59.824846    1527 out.go:204] * Preparing Kubernetes v1.28.2 on Docker 24.0.6 ...

	I1003 17:03:59.824981    1527 ssh_runner.go:195] Run: grep 192.168.105.1	host.minikube.internal$ /etc/hosts

	I1003 17:03:59.826582    1527 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.105.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1003 17:03:59.830378    1527 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime docker

	I1003 17:03:59.830418    1527 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1003 17:03:59.836052    1527 docker.go:664] Got preloaded images: 

	I1003 17:03:59.836060    1527 docker.go:670] registry.k8s.io/kube-apiserver:v1.28.2 wasn't preloaded

	I1003 17:03:59.836097    1527 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I1003 17:03:59.839267    1527 ssh_runner.go:195] Run: which lz4

	I1003 17:03:59.840501    1527 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I1003 17:03:59.841889    1527 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I1003 17:03:59.841901    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (356993689 bytes)

	I1003 17:04:01.160665    1527 docker.go:628] Took 1.320191 seconds to copy over tarball

	I1003 17:04:01.160727    1527 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4

	I1003 17:04:02.196965    1527 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (1.036251292s)

	I1003 17:04:02.196980    1527 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I1003 17:04:02.212861    1527 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I1003 17:04:02.216574    1527 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2629 bytes)

	I1003 17:04:02.221618    1527 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 17:04:02.297119    1527 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1003 17:04:03.756211    1527 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.459112709s)

	I1003 17:04:03.756322    1527 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1003 17:04:03.768480    1527 docker.go:664] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.28.2

	registry.k8s.io/kube-controller-manager:v1.28.2

	registry.k8s.io/kube-scheduler:v1.28.2

	registry.k8s.io/kube-proxy:v1.28.2

	registry.k8s.io/etcd:3.5.9-0

	registry.k8s.io/coredns/coredns:v1.10.1

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I1003 17:04:03.768491    1527 cache_images.go:84] Images are preloaded, skipping loading

	I1003 17:04:03.768560    1527 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I1003 17:04:03.778188    1527 cni.go:84] Creating CNI manager for ""

	I1003 17:04:03.778197    1527 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1003 17:04:03.778215    1527 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I1003 17:04:03.778224    1527 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.105.2 APIServerPort:8443 KubernetesVersion:v1.28.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-585000 NodeName:addons-585000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.105.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.105.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/ku

bernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I1003 17:04:03.778291    1527 kubeadm.go:181] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.105.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "addons-585000"

	  kubeletExtraArgs:

	    node-ip: 192.168.105.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.105.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.28.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1003 17:04:03.778325    1527 kubeadm.go:976] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.28.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=addons-585000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.105.2

	[Install]

	 config:

	{KubernetesVersion:v1.28.2 ClusterName:addons-585000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I1003 17:04:03.778383    1527 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.2

	I1003 17:04:03.781266    1527 binaries.go:44] Found k8s binaries, skipping transfer

	I1003 17:04:03.781296    1527 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1003 17:04:03.784487    1527 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (375 bytes)

	I1003 17:04:03.789671    1527 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1003 17:04:03.794606    1527 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2099 bytes)

	I1003 17:04:03.799383    1527 ssh_runner.go:195] Run: grep 192.168.105.2	control-plane.minikube.internal$ /etc/hosts

	I1003 17:04:03.800642    1527 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.105.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1003 17:04:03.804557    1527 certs.go:56] Setting up /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000 for IP: 192.168.105.2

	I1003 17:04:03.804566    1527 certs.go:190] acquiring lock for shared ca certs: {Name:mk60f926c1ccb065a30406b60af36acc708e601e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:03.804722    1527 certs.go:204] generating minikubeCA CA: /Users/jenkins/minikube-integration/17345-986/.minikube/ca.key

	I1003 17:04:03.876701    1527 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/17345-986/.minikube/ca.crt ...

	I1003 17:04:03.876706    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/ca.crt: {Name:mk0cc174d1dbd071293e805ad6149c7ec4b142e4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:03.876904    1527 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/17345-986/.minikube/ca.key ...

	I1003 17:04:03.876908    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/ca.key: {Name:mk5b0f090e1e87c9db61f19ee029eeb4bf325f96 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:03.877012    1527 certs.go:204] generating proxyClientCA CA: /Users/jenkins/minikube-integration/17345-986/.minikube/proxy-client-ca.key

	I1003 17:04:03.972780    1527 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/17345-986/.minikube/proxy-client-ca.crt ...

	I1003 17:04:03.972784    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/proxy-client-ca.crt: {Name:mk86baa625f8f131b96564e73e4ff47f159af5b3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:03.972918    1527 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/17345-986/.minikube/proxy-client-ca.key ...

	I1003 17:04:03.972921    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/proxy-client-ca.key: {Name:mk9131c9bbe858f22b10b784ddbb510d37a1be7e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:03.973043    1527 certs.go:319] generating minikube-user signed cert: /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/client.key

	I1003 17:04:03.973049    1527 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/client.crt with IP's: []

	I1003 17:04:04.093588    1527 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/client.crt ...

	I1003 17:04:04.093595    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/client.crt: {Name:mka78906c9a5365a7e95b92135f4b70302d9ca1d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:04.093800    1527 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/client.key ...

	I1003 17:04:04.093804    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/client.key: {Name:mk6f93cb157b068e90dc54f48279212367ea5933 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:04.093915    1527 certs.go:319] generating minikube signed cert: /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.key.96055969

	I1003 17:04:04.093926    1527 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.crt.96055969 with IP's: [192.168.105.2 10.96.0.1 127.0.0.1 10.0.0.1]

	I1003 17:04:04.305627    1527 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.crt.96055969 ...

	I1003 17:04:04.305631    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.crt.96055969: {Name:mk46c7ebd409ecd36224a01eb936cac8f04632ae Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:04.305820    1527 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.key.96055969 ...

	I1003 17:04:04.305826    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.key.96055969: {Name:mk401a87dc7fd50281b18296e80430af94b0e1a8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:04.305953    1527 certs.go:337] copying /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.crt.96055969 -> /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.crt

	I1003 17:04:04.306054    1527 certs.go:341] copying /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.key.96055969 -> /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.key

	I1003 17:04:04.306143    1527 certs.go:319] generating aggregator signed cert: /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/proxy-client.key

	I1003 17:04:04.306160    1527 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/proxy-client.crt with IP's: []

	I1003 17:04:04.424122    1527 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/proxy-client.crt ...

	I1003 17:04:04.424130    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/proxy-client.crt: {Name:mkdf8b0eea5ab20c208335ea1ea4eff82b50060d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:04.424327    1527 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/proxy-client.key ...

	I1003 17:04:04.424330    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/proxy-client.key: {Name:mkfa742ebb9620853aeccd91e597f5c286ba74ed Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:04.424537    1527 certs.go:437] found cert: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca-key.pem (1679 bytes)

	I1003 17:04:04.424561    1527 certs.go:437] found cert: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem (1082 bytes)

	I1003 17:04:04.424578    1527 certs.go:437] found cert: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/Users/jenkins/minikube-integration/17345-986/.minikube/certs/cert.pem (1123 bytes)

	I1003 17:04:04.424595    1527 certs.go:437] found cert: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/Users/jenkins/minikube-integration/17345-986/.minikube/certs/key.pem (1679 bytes)

	I1003 17:04:04.424928    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I1003 17:04:04.432625    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I1003 17:04:04.440097    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1003 17:04:04.447625    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I1003 17:04:04.454640    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1003 17:04:04.461322    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I1003 17:04:04.468544    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1003 17:04:04.475781    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I1003 17:04:04.482585    1527 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1003 17:04:04.489167    1527 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1003 17:04:04.495146    1527 ssh_runner.go:195] Run: openssl version

	I1003 17:04:04.497003    1527 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1003 17:04:04.500457    1527 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1003 17:04:04.502228    1527 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Oct  4 00:04 /usr/share/ca-certificates/minikubeCA.pem

	I1003 17:04:04.502254    1527 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1003 17:04:04.504052    1527 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1003 17:04:04.507353    1527 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd

	I1003 17:04:04.508658    1527 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory

	I1003 17:04:04.508694    1527 kubeadm.go:404] StartCluster: {Name:addons-585000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v

1.28.2 ClusterName:addons-585000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mount

Options:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I1003 17:04:04.508756    1527 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1003 17:04:04.518400    1527 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1003 17:04:04.521199    1527 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1003 17:04:04.524450    1527 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1003 17:04:04.527574    1527 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1003 17:04:04.527588    1527 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I1003 17:04:04.548358    1527 kubeadm.go:322] [init] Using Kubernetes version: v1.28.2

	I1003 17:04:04.548382    1527 kubeadm.go:322] [preflight] Running pre-flight checks

	I1003 17:04:04.607082    1527 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster

	I1003 17:04:04.607142    1527 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I1003 17:04:04.607188    1527 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I1003 17:04:04.714297    1527 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I1003 17:04:04.722481    1527 out.go:204]   - Generating certificates and keys ...

	I1003 17:04:04.722514    1527 kubeadm.go:322] [certs] Using existing ca certificate authority

	I1003 17:04:04.722542    1527 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk

	I1003 17:04:04.759296    1527 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key

	I1003 17:04:04.808856    1527 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key

	I1003 17:04:04.964910    1527 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key

	I1003 17:04:05.087030    1527 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key

	I1003 17:04:05.149596    1527 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key

	I1003 17:04:05.149646    1527 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [addons-585000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I1003 17:04:05.222012    1527 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key

	I1003 17:04:05.222068    1527 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [addons-585000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I1003 17:04:05.286742    1527 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key

	I1003 17:04:05.330145    1527 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key

	I1003 17:04:05.629678    1527 kubeadm.go:322] [certs] Generating "sa" key and public key

	I1003 17:04:05.629709    1527 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I1003 17:04:05.731900    1527 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file

	I1003 17:04:05.854397    1527 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I1003 17:04:05.983877    1527 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I1003 17:04:06.151732    1527 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I1003 17:04:06.152571    1527 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I1003 17:04:06.153646    1527 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I1003 17:04:06.157945    1527 out.go:204]   - Booting up control plane ...

	I1003 17:04:06.158024    1527 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I1003 17:04:06.158075    1527 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I1003 17:04:06.158108    1527 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I1003 17:04:06.161462    1527 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I1003 17:04:06.161792    1527 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I1003 17:04:06.161837    1527 kubeadm.go:322] [kubelet-start] Starting the kubelet

	I1003 17:04:06.249226    1527 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	I1003 17:04:09.750516    1527 kubeadm.go:322] [apiclient] All control plane components are healthy after 3.501291 seconds

	I1003 17:04:09.750582    1527 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I1003 17:04:09.756399    1527 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I1003 17:04:10.266794    1527 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs

	I1003 17:04:10.266918    1527 kubeadm.go:322] [mark-control-plane] Marking the node addons-585000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I1003 17:04:10.770745    1527 kubeadm.go:322] [bootstrap-token] Using token: uzkazy.ii0fjdqhazr4xlxp

	I1003 17:04:10.779414    1527 out.go:204]   - Configuring RBAC rules ...

	I1003 17:04:10.779490    1527 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I1003 17:04:10.779537    1527 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I1003 17:04:10.781300    1527 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I1003 17:04:10.782670    1527 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I1003 17:04:10.783591    1527 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I1003 17:04:10.784726    1527 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I1003 17:04:10.788735    1527 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I1003 17:04:10.960644    1527 kubeadm.go:322] [addons] Applied essential addon: CoreDNS

	I1003 17:04:11.179744    1527 kubeadm.go:322] [addons] Applied essential addon: kube-proxy

	I1003 17:04:11.180034    1527 kubeadm.go:322] 

	I1003 17:04:11.180066    1527 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!

	I1003 17:04:11.180069    1527 kubeadm.go:322] 

	I1003 17:04:11.180099    1527 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:

	I1003 17:04:11.180102    1527 kubeadm.go:322] 

	I1003 17:04:11.180113    1527 kubeadm.go:322]   mkdir -p $HOME/.kube

	I1003 17:04:11.180141    1527 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I1003 17:04:11.180162    1527 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I1003 17:04:11.180170    1527 kubeadm.go:322] 

	I1003 17:04:11.180201    1527 kubeadm.go:322] Alternatively, if you are the root user, you can run:

	I1003 17:04:11.180204    1527 kubeadm.go:322] 

	I1003 17:04:11.180235    1527 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I1003 17:04:11.180239    1527 kubeadm.go:322] 

	I1003 17:04:11.180270    1527 kubeadm.go:322] You should now deploy a pod network to the cluster.

	I1003 17:04:11.180305    1527 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I1003 17:04:11.180339    1527 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I1003 17:04:11.180343    1527 kubeadm.go:322] 

	I1003 17:04:11.180390    1527 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities

	I1003 17:04:11.180428    1527 kubeadm.go:322] and service account keys on each node and then running the following as root:

	I1003 17:04:11.180432    1527 kubeadm.go:322] 

	I1003 17:04:11.180481    1527 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token uzkazy.ii0fjdqhazr4xlxp \

	I1003 17:04:11.180530    1527 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:9490a7a2ce6f448c9720863afea1604779c0ef0543f588db367e732362807037 \

	I1003 17:04:11.180544    1527 kubeadm.go:322] 	--control-plane 

	I1003 17:04:11.180546    1527 kubeadm.go:322] 

	I1003 17:04:11.180583    1527 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:

	I1003 17:04:11.180585    1527 kubeadm.go:322] 

	I1003 17:04:11.180630    1527 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token uzkazy.ii0fjdqhazr4xlxp \

	I1003 17:04:11.180681    1527 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:9490a7a2ce6f448c9720863afea1604779c0ef0543f588db367e732362807037 

	I1003 17:04:11.180859    1527 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I1003 17:04:11.180869    1527 cni.go:84] Creating CNI manager for ""

	I1003 17:04:11.180879    1527 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1003 17:04:11.187987    1527 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I1003 17:04:11.191059    1527 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I1003 17:04:11.194034    1527 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)

	I1003 17:04:11.198752    1527 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I1003 17:04:11.198795    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:11.198820    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl label nodes minikube.k8s.io/version=v1.31.2 minikube.k8s.io/commit=d9526fa6c1a1bb1b20f95e15606f1308e308d84a minikube.k8s.io/name=addons-585000 minikube.k8s.io/updated_at=2023_10_03T17_04_11_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:11.257808    1527 ops.go:34] apiserver oom_adj: -16

	I1003 17:04:11.257825    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:11.294996    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:11.828345    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:12.328361    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:12.828330    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:13.328397    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:13.828294    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:14.328299    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:14.828282    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:15.328311    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:15.828265    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:16.328253    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:16.828279    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:17.328231    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:17.828247    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:18.328230    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:18.828192    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:19.328127    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:19.828168    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:20.328197    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:20.827992    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:21.327973    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:21.828182    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:22.328181    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:22.828070    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:23.328028    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:23.828030    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:24.327999    1527 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:04:24.363217    1527 kubeadm.go:1081] duration metric: took 13.164797125s to wait for elevateKubeSystemPrivileges.

	I1003 17:04:24.363234    1527 kubeadm.go:406] StartCluster complete in 19.855065708s

	I1003 17:04:24.363243    1527 settings.go:142] acquiring lock: {Name:mkad5f21e92defa14247d9a0adf05a6e4272cec8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:24.363390    1527 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/17345-986/kubeconfig

	I1003 17:04:24.363569    1527 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/kubeconfig: {Name:mke3e06a6a2057954076f4772b87ca4469721c09 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:04:24.363810    1527 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I1003 17:04:24.363870    1527 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volumesnapshots:true]

	I1003 17:04:24.363932    1527 addons.go:69] Setting volumesnapshots=true in profile "addons-585000"

	I1003 17:04:24.363942    1527 addons.go:231] Setting addon volumesnapshots=true in "addons-585000"

	I1003 17:04:24.363950    1527 config.go:182] Loaded profile config "addons-585000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 17:04:24.363971    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.363950    1527 addons.go:69] Setting ingress-dns=true in profile "addons-585000"

	I1003 17:04:24.364021    1527 addons.go:231] Setting addon ingress-dns=true in "addons-585000"

	I1003 17:04:24.364047    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.363981    1527 addons.go:69] Setting registry=true in profile "addons-585000"

	I1003 17:04:24.364069    1527 addons.go:231] Setting addon registry=true in "addons-585000"

	I1003 17:04:24.364086    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.363984    1527 addons.go:69] Setting inspektor-gadget=true in profile "addons-585000"

	I1003 17:04:24.364126    1527 addons.go:231] Setting addon inspektor-gadget=true in "addons-585000"

	I1003 17:04:24.364190    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.363986    1527 addons.go:69] Setting metrics-server=true in profile "addons-585000"

	I1003 17:04:24.364214    1527 addons.go:231] Setting addon metrics-server=true in "addons-585000"

	I1003 17:04:24.364247    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.363988    1527 addons.go:69] Setting gcp-auth=true in profile "addons-585000"

	I1003 17:04:24.364271    1527 mustload.go:65] Loading cluster: addons-585000

	W1003 17:04:24.364287    1527 host.go:54] host status for "addons-585000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/monitor: connect: connection refused

	W1003 17:04:24.364300    1527 addons.go:277] "addons-585000" is not running, setting ingress-dns=true and skipping enablement (err=<nil>)

	W1003 17:04:24.364313    1527 host.go:54] host status for "addons-585000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/monitor: connect: connection refused

	W1003 17:04:24.364319    1527 addons.go:277] "addons-585000" is not running, setting registry=true and skipping enablement (err=<nil>)

	I1003 17:04:24.364322    1527 addons.go:467] Verifying addon registry=true in "addons-585000"

	I1003 17:04:24.370457    1527 out.go:177] * Verifying registry addon...

	I1003 17:04:24.364356    1527 config.go:182] Loaded profile config "addons-585000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 17:04:24.363992    1527 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-585000"

	I1003 17:04:24.370476    1527 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-585000"

	I1003 17:04:24.363993    1527 addons.go:69] Setting ingress=true in profile "addons-585000"

	I1003 17:04:24.363995    1527 addons.go:69] Setting cloud-spanner=true in profile "addons-585000"

	I1003 17:04:24.370530    1527 addons.go:231] Setting addon cloud-spanner=true in "addons-585000"

	I1003 17:04:24.363994    1527 addons.go:69] Setting default-storageclass=true in profile "addons-585000"

	I1003 17:04:24.370529    1527 addons.go:231] Setting addon ingress=true in "addons-585000"

	I1003 17:04:24.370591    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.370597    1527 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-585000"

	I1003 17:04:24.363996    1527 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-585000"

	W1003 17:04:24.364679    1527 host.go:54] host status for "addons-585000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/monitor: connect: connection refused

	I1003 17:04:24.370563    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.363989    1527 addons.go:69] Setting storage-provisioner=true in profile "addons-585000"

	I1003 17:04:24.370642    1527 addons.go:231] Setting addon csi-hostpath-driver=true in "addons-585000"

	W1003 17:04:24.370646    1527 addons.go:277] "addons-585000" is not running, setting inspektor-gadget=true and skipping enablement (err=<nil>)

	W1003 17:04:24.370793    1527 host.go:54] host status for "addons-585000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/monitor: connect: connection refused

	W1003 17:04:24.370892    1527 host.go:54] host status for "addons-585000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/monitor: connect: connection refused

	I1003 17:04:24.371573    1527 addons.go:231] Setting addon default-storageclass=true in "addons-585000"

	I1003 17:04:24.371900    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.380387    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	I1003 17:04:24.383435    1527 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.6.4

	I1003 17:04:24.383459    1527 addons.go:231] Setting addon storage-provisioner=true in "addons-585000"

	W1003 17:04:24.383452    1527 addons.go:277] "addons-585000" is not running, setting ingress=true and skipping enablement (err=<nil>)

	W1003 17:04:24.383476    1527 addons_storage_classes.go:57] "addons-585000" is not running, writing storage-provisioner-rancher=true to disk and skipping enablement

	I1003 17:04:24.383496    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.383533    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.383999    1527 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...

	I1003 17:04:24.386486    1527 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml

	I1003 17:04:24.389459    1527 addons.go:423] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I1003 17:04:24.389462    1527 addons.go:231] Setting addon storage-provisioner-rancher=true in "addons-585000"

	I1003 17:04:24.389488    1527 addons.go:467] Verifying addon ingress=true in "addons-585000"

	I1003 17:04:24.389521    1527 host.go:66] Checking if "addons-585000" exists ...

	W1003 17:04:24.389784    1527 host.go:54] host status for "addons-585000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/monitor: connect: connection refused

	I1003 17:04:24.395446    1527 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.10

	I1003 17:04:24.395461    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:24.395467    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)

	I1003 17:04:24.395470    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)

	W1003 17:04:24.395486    1527 addons.go:277] "addons-585000" is not running, setting default-storageclass=true and skipping enablement (err=<nil>)

	I1003 17:04:24.398475    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0

	I1003 17:04:24.398484    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:04:24.398497    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:04:24.407159    1527 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=registry

	I1003 17:04:24.408397    1527 out.go:177] * Verifying ingress addon...

	I1003 17:04:24.414483    1527 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I1003 17:04:24.418517    1527 addons.go:423] installing /etc/kubernetes/addons/deployment.yaml

	I1003 17:04:24.421445    1527 out.go:177]   - Using image docker.io/busybox:stable

	I1003 17:04:24.423490    1527 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-585000" context rescaled to 1 replicas

	I1003 17:04:24.424496    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)

	I1003 17:04:24.427548    1527 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1003 17:04:24.427858    1527 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...

	I1003 17:04:24.430982    1527 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.105.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.28.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I1003 17:04:24.433444    1527 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I1003 17:04:24.439439    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0

	I1003 17:04:24.439555    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:04:24.442455    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I1003 17:04:24.442466    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:04:24.447401    1527 out.go:177] * Verifying Kubernetes components...

	I1003 17:04:24.451674    1527 kapi.go:86] Found 0 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I1003 17:04:24.453485    1527 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1003 17:04:24.457496    1527 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22

	I1003 17:04:24.467442    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0

	I1003 17:04:24.480410    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0

	I1003 17:04:24.476494    1527 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I1003 17:04:24.483451    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)

	I1003 17:04:24.486383    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0

	I1003 17:04:24.483462    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:04:24.485254    1527 addons.go:423] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I1003 17:04:24.489434    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)

	I1003 17:04:24.492499    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0

	I1003 17:04:24.499438    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0

	I1003 17:04:24.508438    1527 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0

	I1003 17:04:24.512295    1527 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml

	I1003 17:04:24.512323    1527 addons.go:423] installing /etc/kubernetes/addons/rbac-external-attacher.yaml

	I1003 17:04:24.512325    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)

	I1003 17:04:24.512338    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)

	I1003 17:04:24.512347    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:04:24.558122    1527 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1003 17:04:24.567387    1527 addons.go:423] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I1003 17:04:24.567399    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)

	I1003 17:04:24.572776    1527 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/deployment.yaml

	I1003 17:04:24.599074    1527 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml

	I1003 17:04:24.599085    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)

	I1003 17:04:24.675063    1527 addons.go:423] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I1003 17:04:24.675075    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)

	I1003 17:04:24.676328    1527 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml

	I1003 17:04:24.676333    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)

	I1003 17:04:24.739366    1527 addons.go:423] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml

	I1003 17:04:24.739377    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)

	I1003 17:04:24.749052    1527 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I1003 17:04:24.770490    1527 addons.go:423] installing /etc/kubernetes/addons/rbac-hostpath.yaml

	I1003 17:04:24.770501    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)

	I1003 17:04:24.785371    1527 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I1003 17:04:24.881017    1527 addons.go:423] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I1003 17:04:24.881027    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)

	I1003 17:04:24.903016    1527 addons.go:423] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml

	I1003 17:04:24.903028    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)

	I1003 17:04:24.969674    1527 addons.go:423] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml

	I1003 17:04:24.969686    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)

	I1003 17:04:25.049120    1527 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I1003 17:04:25.150729    1527 addons.go:423] installing /etc/kubernetes/addons/rbac-external-resizer.yaml

	I1003 17:04:25.150740    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)

	I1003 17:04:25.240313    1527 addons.go:423] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml

	I1003 17:04:25.240326    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)

	I1003 17:04:25.371181    1527 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml

	I1003 17:04:25.371193    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)

	I1003 17:04:25.404463    1527 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml

	I1003 17:04:25.404477    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)

	I1003 17:04:25.434986    1527 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml

	I1003 17:04:25.434995    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)

	I1003 17:04:25.450155    1527 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.105.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.28.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (1.007696167s)

	I1003 17:04:25.450172    1527 start.go:923] {"host.minikube.internal": 192.168.105.1} host record injected into CoreDNS's ConfigMap

	I1003 17:04:25.450599    1527 node_ready.go:35] waiting up to 6m0s for node "addons-585000" to be "Ready" ...

	I1003 17:04:25.452207    1527 node_ready.go:49] node "addons-585000" has status "Ready":"True"

	I1003 17:04:25.452226    1527 node_ready.go:38] duration metric: took 1.601791ms waiting for node "addons-585000" to be "Ready" ...

	I1003 17:04:25.452231    1527 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1003 17:04:25.455004    1527 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace to be "Ready" ...

	I1003 17:04:25.474770    1527 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml

	I1003 17:04:25.474780    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)

	I1003 17:04:25.542278    1527 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I1003 17:04:25.542289    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)

	I1003 17:04:25.568058    1527 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I1003 17:04:25.900055    1527 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (1.327297041s)

	I1003 17:04:25.900073    1527 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (1.151039167s)

	I1003 17:04:25.900620    1527 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.342523s)

	I1003 17:04:26.031761    1527 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.246402458s)

	I1003 17:04:26.031779    1527 addons.go:467] Verifying addon metrics-server=true in "addons-585000"

	W1003 17:04:26.031811    1527 addons.go:449] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I1003 17:04:26.031889    1527 retry.go:31] will retry after 325.291799ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I1003 17:04:26.358314    1527 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I1003 17:04:27.197455    1527 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (1.629412791s)

	I1003 17:04:27.197475    1527 addons.go:467] Verifying addon csi-hostpath-driver=true in "addons-585000"

	I1003 17:04:27.203259    1527 out.go:177] * Verifying csi-hostpath-driver addon...

	I1003 17:04:27.212640    1527 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

	I1003 17:04:27.217488    1527 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I1003 17:04:27.217496    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:27.220905    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:27.463742    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:27.724717    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:28.224875    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:28.724679    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:28.978938    1527 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.620667959s)

	I1003 17:04:29.224602    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:29.725503    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:29.965298    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:30.225992    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:30.727405    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:30.990463    1527 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)

	I1003 17:04:30.990480    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:04:31.027829    1527 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)

	I1003 17:04:31.032721    1527 addons.go:231] Setting addon gcp-auth=true in "addons-585000"

	I1003 17:04:31.032748    1527 host.go:66] Checking if "addons-585000" exists ...

	I1003 17:04:31.033437    1527 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json

	I1003 17:04:31.033445    1527 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/addons-585000/id_rsa Username:docker}

	I1003 17:04:31.067911    1527 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230407

	I1003 17:04:31.071726    1527 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0

	I1003 17:04:31.074751    1527 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-ns.yaml

	I1003 17:04:31.074757    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)

	I1003 17:04:31.080083    1527 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-service.yaml

	I1003 17:04:31.080090    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)

	I1003 17:04:31.084923    1527 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I1003 17:04:31.084929    1527 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5412 bytes)

	I1003 17:04:31.089910    1527 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I1003 17:04:31.227750    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:31.348093    1527 addons.go:467] Verifying addon gcp-auth=true in "addons-585000"

	I1003 17:04:31.351542    1527 out.go:177] * Verifying gcp-auth addon...

	I1003 17:04:31.357561    1527 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...

	I1003 17:04:31.360910    1527 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I1003 17:04:31.360918    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:31.363860    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:31.729484    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:31.868680    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:32.231013    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:32.368635    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:32.469496    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:32.731026    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:32.869106    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:33.231972    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:33.370303    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:33.732757    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:33.870865    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:34.233653    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:34.371764    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:34.734158    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:34.872420    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:34.973595    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:35.235439    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:35.373126    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:35.736125    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:35.873867    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:36.236732    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:36.377065    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:36.738038    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:36.875114    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:37.237689    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:37.375767    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:37.476370    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:37.738419    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:37.876233    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:38.238661    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:38.376555    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:38.739112    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:38.877451    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:39.239515    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:39.378140    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:39.479966    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:39.740793    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:39.878589    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:40.240762    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:40.379208    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:40.741780    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:40.879681    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:41.241996    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:41.380297    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:41.742785    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:41.880492    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:41.981384    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:42.243296    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:42.381074    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:42.743302    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:42.883349    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:43.244024    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:43.381895    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:43.744586    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:43.882405    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:44.244990    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:44.382844    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:44.483439    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:44.745332    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:44.884458    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:45.245668    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:45.383767    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:45.746153    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:45.884389    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:46.246346    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:46.384557    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:46.486038    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:46.746583    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:46.885125    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:47.247216    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:47.385576    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:47.747761    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:47.885573    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:48.247887    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:48.385997    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:48.748143    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:48.886329    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:48.987206    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:49.248369    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:49.386625    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:49.749134    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:49.886585    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:50.249103    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:50.386927    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:50.749495    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:50.887744    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:50.988394    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:51.249792    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:51.387776    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:51.749720    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:51.887719    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:52.249981    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:52.389544    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:52.751121    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:52.888557    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:53.250511    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:53.388659    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:53.490543    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:53.750650    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:53.888553    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:54.250803    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:54.389104    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:54.751294    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:54.889472    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:55.253309    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:55.389552    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:55.751715    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:55.889618    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:55.990684    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:56.251672    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:56.389851    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:56.752031    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:56.889910    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:57.252259    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:57.390082    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:57.752574    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:57.890363    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:57.991811    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:04:58.252678    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1003 17:04:58.390362    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:58.752590    1527 kapi.go:107] duration metric: took 31.511793709s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

	I1003 17:04:58.890958    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:59.391228    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:04:59.891535    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:00.391427    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:00.491918    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:05:00.891593    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:01.391491    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:01.891778    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:02.391830    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:02.492542    1527 pod_ready.go:102] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"False"

	I1003 17:05:02.891986    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:03.393570    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:03.892644    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:04.392440    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:04.892576    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:04.992969    1527 pod_ready.go:92] pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace has status "Ready":"True"

	I1003 17:05:04.992976    1527 pod_ready.go:81] duration metric: took 39.508226208s waiting for pod "coredns-5dd5756b68-khk2s" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:04.992981    1527 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-r24k8" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:04.993883    1527 pod_ready.go:97] error getting pod "coredns-5dd5756b68-r24k8" in "kube-system" namespace (skipping!): pods "coredns-5dd5756b68-r24k8" not found

	I1003 17:05:04.993891    1527 pod_ready.go:81] duration metric: took 907.208µs waiting for pod "coredns-5dd5756b68-r24k8" in "kube-system" namespace to be "Ready" ...

	E1003 17:05:04.993895    1527 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-5dd5756b68-r24k8" in "kube-system" namespace (skipping!): pods "coredns-5dd5756b68-r24k8" not found

	I1003 17:05:04.993899    1527 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-585000" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:04.996401    1527 pod_ready.go:92] pod "etcd-addons-585000" in "kube-system" namespace has status "Ready":"True"

	I1003 17:05:04.996406    1527 pod_ready.go:81] duration metric: took 2.500458ms waiting for pod "etcd-addons-585000" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:04.996410    1527 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-585000" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:04.999071    1527 pod_ready.go:92] pod "kube-apiserver-addons-585000" in "kube-system" namespace has status "Ready":"True"

	I1003 17:05:04.999079    1527 pod_ready.go:81] duration metric: took 2.666208ms waiting for pod "kube-apiserver-addons-585000" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:04.999082    1527 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-585000" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:05.001717    1527 pod_ready.go:92] pod "kube-controller-manager-addons-585000" in "kube-system" namespace has status "Ready":"True"

	I1003 17:05:05.001725    1527 pod_ready.go:81] duration metric: took 2.637584ms waiting for pod "kube-controller-manager-addons-585000" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:05.001728    1527 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-4m9nm" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:05.193135    1527 pod_ready.go:92] pod "kube-proxy-4m9nm" in "kube-system" namespace has status "Ready":"True"

	I1003 17:05:05.193144    1527 pod_ready.go:81] duration metric: took 191.372792ms waiting for pod "kube-proxy-4m9nm" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:05.193148    1527 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-585000" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:05.392551    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:05.593390    1527 pod_ready.go:92] pod "kube-scheduler-addons-585000" in "kube-system" namespace has status "Ready":"True"

	I1003 17:05:05.593399    1527 pod_ready.go:81] duration metric: took 400.165917ms waiting for pod "kube-scheduler-addons-585000" in "kube-system" namespace to be "Ready" ...

	I1003 17:05:05.593404    1527 pod_ready.go:38] duration metric: took 40.11130675s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1003 17:05:05.593416    1527 api_server.go:52] waiting for apiserver process to appear ...

	I1003 17:05:05.593483    1527 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1003 17:05:05.598747    1527 api_server.go:72] duration metric: took 41.126444291s to wait for apiserver process to appear ...

	I1003 17:05:05.598757    1527 api_server.go:88] waiting for apiserver healthz status ...

	I1003 17:05:05.598764    1527 api_server.go:253] Checking apiserver healthz at https://192.168.105.2:8443/healthz ...

	I1003 17:05:05.601839    1527 api_server.go:279] https://192.168.105.2:8443/healthz returned 200:

	ok

	I1003 17:05:05.602592    1527 api_server.go:141] control plane version: v1.28.2

	I1003 17:05:05.602598    1527 api_server.go:131] duration metric: took 3.8385ms to wait for apiserver health ...

	I1003 17:05:05.602602    1527 system_pods.go:43] waiting for kube-system pods to appear ...

	I1003 17:05:05.796281    1527 system_pods.go:59] 13 kube-system pods found

	I1003 17:05:05.796294    1527 system_pods.go:61] "coredns-5dd5756b68-khk2s" [c45559e9-de80-4305-942c-094315d94d47] Running

	I1003 17:05:05.796297    1527 system_pods.go:61] "csi-hostpath-attacher-0" [63177292-e73a-431c-a767-00cf3ce9bce0] Running

	I1003 17:05:05.796299    1527 system_pods.go:61] "csi-hostpath-resizer-0" [8f737860-0999-4db9-9f65-190d64a4cfb4] Running

	I1003 17:05:05.796301    1527 system_pods.go:61] "csi-hostpathplugin-8thxw" [4548034b-9d0c-4d9d-9f9f-839610935d97] Running

	I1003 17:05:05.796303    1527 system_pods.go:61] "etcd-addons-585000" [f1858d65-44e4-469b-8372-a4e1e0a14d48] Running

	I1003 17:05:05.796306    1527 system_pods.go:61] "kube-apiserver-addons-585000" [377e1779-3201-42b4-945b-e2195b3f0a9a] Running

	I1003 17:05:05.796308    1527 system_pods.go:61] "kube-controller-manager-addons-585000" [f9156947-57be-49f5-9a1c-aadaa5bddf0c] Running

	I1003 17:05:05.796310    1527 system_pods.go:61] "kube-proxy-4m9nm" [847e005d-c7e1-4128-9ac6-2fef6730e3e4] Running

	I1003 17:05:05.796312    1527 system_pods.go:61] "kube-scheduler-addons-585000" [5b3e2487-5781-451e-b566-814b86a4eb80] Running

	I1003 17:05:05.796315    1527 system_pods.go:61] "metrics-server-7c66d45ddc-bvd9d" [e70964ce-39c1-444c-bfcc-e672f6027857] Running

	I1003 17:05:05.796317    1527 system_pods.go:61] "snapshot-controller-58dbcc7b99-2gg5z" [3f9fa5f9-6948-4b90-9114-e5bdb6822c87] Running

	I1003 17:05:05.796319    1527 system_pods.go:61] "snapshot-controller-58dbcc7b99-t2wrg" [174abadb-36b9-4fab-b1e2-44fa5de2def5] Running

	I1003 17:05:05.796321    1527 system_pods.go:61] "storage-provisioner" [41c3bd79-1e45-45d3-a1d8-9f5a2c5c7da5] Running

	I1003 17:05:05.796324    1527 system_pods.go:74] duration metric: took 193.680291ms to wait for pod list to return data ...

	I1003 17:05:05.796329    1527 default_sa.go:34] waiting for default service account to be created ...

	I1003 17:05:05.892491    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:05.992623    1527 default_sa.go:45] found service account: "default"

	I1003 17:05:05.992632    1527 default_sa.go:55] duration metric: took 196.262458ms for default service account to be created ...

	I1003 17:05:05.992638    1527 system_pods.go:116] waiting for k8s-apps to be running ...

	I1003 17:05:06.196272    1527 system_pods.go:86] 13 kube-system pods found

	I1003 17:05:06.196281    1527 system_pods.go:89] "coredns-5dd5756b68-khk2s" [c45559e9-de80-4305-942c-094315d94d47] Running

	I1003 17:05:06.196284    1527 system_pods.go:89] "csi-hostpath-attacher-0" [63177292-e73a-431c-a767-00cf3ce9bce0] Running

	I1003 17:05:06.196286    1527 system_pods.go:89] "csi-hostpath-resizer-0" [8f737860-0999-4db9-9f65-190d64a4cfb4] Running

	I1003 17:05:06.196288    1527 system_pods.go:89] "csi-hostpathplugin-8thxw" [4548034b-9d0c-4d9d-9f9f-839610935d97] Running

	I1003 17:05:06.196290    1527 system_pods.go:89] "etcd-addons-585000" [f1858d65-44e4-469b-8372-a4e1e0a14d48] Running

	I1003 17:05:06.196292    1527 system_pods.go:89] "kube-apiserver-addons-585000" [377e1779-3201-42b4-945b-e2195b3f0a9a] Running

	I1003 17:05:06.196294    1527 system_pods.go:89] "kube-controller-manager-addons-585000" [f9156947-57be-49f5-9a1c-aadaa5bddf0c] Running

	I1003 17:05:06.196296    1527 system_pods.go:89] "kube-proxy-4m9nm" [847e005d-c7e1-4128-9ac6-2fef6730e3e4] Running

	I1003 17:05:06.196298    1527 system_pods.go:89] "kube-scheduler-addons-585000" [5b3e2487-5781-451e-b566-814b86a4eb80] Running

	I1003 17:05:06.196300    1527 system_pods.go:89] "metrics-server-7c66d45ddc-bvd9d" [e70964ce-39c1-444c-bfcc-e672f6027857] Running

	I1003 17:05:06.196302    1527 system_pods.go:89] "snapshot-controller-58dbcc7b99-2gg5z" [3f9fa5f9-6948-4b90-9114-e5bdb6822c87] Running

	I1003 17:05:06.196304    1527 system_pods.go:89] "snapshot-controller-58dbcc7b99-t2wrg" [174abadb-36b9-4fab-b1e2-44fa5de2def5] Running

	I1003 17:05:06.196306    1527 system_pods.go:89] "storage-provisioner" [41c3bd79-1e45-45d3-a1d8-9f5a2c5c7da5] Running

	I1003 17:05:06.196310    1527 system_pods.go:126] duration metric: took 203.63025ms to wait for k8s-apps to be running ...

	I1003 17:05:06.196313    1527 system_svc.go:44] waiting for kubelet service to be running ....

	I1003 17:05:06.196369    1527 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1003 17:05:06.201921    1527 system_svc.go:56] duration metric: took 5.604333ms WaitForService to wait for kubelet.

	I1003 17:05:06.201929    1527 kubeadm.go:581] duration metric: took 41.729511541s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I1003 17:05:06.201940    1527 node_conditions.go:102] verifying NodePressure condition ...

	I1003 17:05:06.392698    1527 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1003 17:05:06.393051    1527 node_conditions.go:122] node storage ephemeral capacity is 17784760Ki

	I1003 17:05:06.393087    1527 node_conditions.go:123] node cpu capacity is 2

	I1003 17:05:06.393093    1527 node_conditions.go:105] duration metric: took 191.114375ms to run NodePressure ...

	I1003 17:05:06.393098    1527 start.go:228] waiting for startup goroutines ...

	I1003 17:05:06.892943    1527 kapi.go:107] duration metric: took 35.5093015s to wait for kubernetes.io/minikube-addons=gcp-auth ...

	I1003 17:05:06.897190    1527 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-585000 cluster.

	I1003 17:05:06.900088    1527 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	I1003 17:05:06.903114    1527 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	I1003 17:10:24.417571    1527 kapi.go:107] duration metric: took 6m0.007521708s to wait for kubernetes.io/minikube-addons=registry ...

	W1003 17:10:24.417687    1527 out.go:239] ! Enabling 'registry' returned an error: running callbacks: [waiting for kubernetes.io/minikube-addons=registry pods: context deadline exceeded]

	I1003 17:10:24.469744    1527 kapi.go:107] duration metric: took 6m0.015851042s to wait for app.kubernetes.io/name=ingress-nginx ...

	W1003 17:10:24.469781    1527 out.go:239] ! Enabling 'ingress' returned an error: running callbacks: [waiting for app.kubernetes.io/name=ingress-nginx pods: context deadline exceeded]

	I1003 17:10:24.476811    1527 out.go:177] * Enabled addons: ingress-dns, inspektor-gadget, default-storageclass, cloud-spanner, storage-provisioner-rancher, storage-provisioner, metrics-server, volumesnapshots, csi-hostpath-driver, gcp-auth

	I1003 17:10:24.483852    1527 addons.go:502] enable addons completed in 6m0.093974291s: enabled=[ingress-dns inspektor-gadget default-storageclass cloud-spanner storage-provisioner-rancher storage-provisioner metrics-server volumesnapshots csi-hostpath-driver gcp-auth]

	I1003 17:10:24.483865    1527 start.go:233] waiting for cluster config update ...

	I1003 17:10:24.483873    1527 start.go:242] writing updated cluster config ...

	I1003 17:10:24.484152    1527 ssh_runner.go:195] Run: rm -f paused

	I1003 17:10:24.580795    1527 start.go:600] kubectl: 1.27.2, cluster: 1.28.2 (minor skew: 1)

	I1003 17:10:24.588925    1527 out.go:177] * Done! kubectl is now configured to use "addons-585000" cluster and "default" namespace by default

	* 

	* ==> Docker <==

	* -- Journal begins at Wed 2023-10-04 00:03:51 UTC, ends at Wed 2023-10-04 00:20:19 UTC. --

	Oct 04 00:12:08 addons-585000 dockerd[1122]: time="2023-10-04T00:12:08.349007007Z" level=info msg="cleaning up dead shim" namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1115]: time="2023-10-04T00:12:14.240701963Z" level=info msg="ignoring event" container=5ff0bef51f286679f0f3e673886c6c3125c354cab0674eabec453da6975a6991 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.241579343Z" level=info msg="shim disconnected" id=5ff0bef51f286679f0f3e673886c6c3125c354cab0674eabec453da6975a6991 namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.241698010Z" level=warning msg="cleaning up after shim disconnected" id=5ff0bef51f286679f0f3e673886c6c3125c354cab0674eabec453da6975a6991 namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.241717594Z" level=info msg="cleaning up dead shim" namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1115]: time="2023-10-04T00:12:14.242239805Z" level=info msg="ignoring event" container=517d59bdac0d4789df6d0fe970fb5d29190888751abb5196cf7cdf1d701cec03 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.242324306Z" level=info msg="shim disconnected" id=517d59bdac0d4789df6d0fe970fb5d29190888751abb5196cf7cdf1d701cec03 namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.242883392Z" level=warning msg="cleaning up after shim disconnected" id=517d59bdac0d4789df6d0fe970fb5d29190888751abb5196cf7cdf1d701cec03 namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.242933309Z" level=info msg="cleaning up dead shim" namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.323347774Z" level=info msg="shim disconnected" id=4f4a827bdb5aaf43cabfbf9cb0a34b674a64751dd5011a061778c8476e531e8e namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.323376233Z" level=warning msg="cleaning up after shim disconnected" id=4f4a827bdb5aaf43cabfbf9cb0a34b674a64751dd5011a061778c8476e531e8e namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.323380274Z" level=info msg="cleaning up dead shim" namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1115]: time="2023-10-04T00:12:14.323530942Z" level=info msg="ignoring event" container=4f4a827bdb5aaf43cabfbf9cb0a34b674a64751dd5011a061778c8476e531e8e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Oct 04 00:12:14 addons-585000 dockerd[1115]: time="2023-10-04T00:12:14.329811145Z" level=info msg="ignoring event" container=c09f627f07f68d859d6bfdefb05a6e13d8c3efbab921fb36772c99b884785536 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.329912979Z" level=info msg="shim disconnected" id=c09f627f07f68d859d6bfdefb05a6e13d8c3efbab921fb36772c99b884785536 namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.329940521Z" level=warning msg="cleaning up after shim disconnected" id=c09f627f07f68d859d6bfdefb05a6e13d8c3efbab921fb36772c99b884785536 namespace=moby

	Oct 04 00:12:14 addons-585000 dockerd[1122]: time="2023-10-04T00:12:14.329944687Z" level=info msg="cleaning up dead shim" namespace=moby

	Oct 04 00:12:20 addons-585000 dockerd[1115]: time="2023-10-04T00:12:20.574199852Z" level=info msg="ignoring event" container=ecef984296b3c318eabdfadfcfd794578d7d5b79b06b6d15401d400fa2c41351 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Oct 04 00:12:20 addons-585000 dockerd[1122]: time="2023-10-04T00:12:20.574490520Z" level=info msg="shim disconnected" id=ecef984296b3c318eabdfadfcfd794578d7d5b79b06b6d15401d400fa2c41351 namespace=moby

	Oct 04 00:12:20 addons-585000 dockerd[1122]: time="2023-10-04T00:12:20.574591896Z" level=warning msg="cleaning up after shim disconnected" id=ecef984296b3c318eabdfadfcfd794578d7d5b79b06b6d15401d400fa2c41351 namespace=moby

	Oct 04 00:12:20 addons-585000 dockerd[1122]: time="2023-10-04T00:12:20.574612355Z" level=info msg="cleaning up dead shim" namespace=moby

	Oct 04 00:12:20 addons-585000 dockerd[1115]: time="2023-10-04T00:12:20.629572097Z" level=info msg="ignoring event" container=7c628d57a23adad9e457875314fcdc47575df49afc2fd60f3e2f12f92707c23a module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Oct 04 00:12:20 addons-585000 dockerd[1122]: time="2023-10-04T00:12:20.629930724Z" level=info msg="shim disconnected" id=7c628d57a23adad9e457875314fcdc47575df49afc2fd60f3e2f12f92707c23a namespace=moby

	Oct 04 00:12:20 addons-585000 dockerd[1122]: time="2023-10-04T00:12:20.629958933Z" level=warning msg="cleaning up after shim disconnected" id=7c628d57a23adad9e457875314fcdc47575df49afc2fd60f3e2f12f92707c23a namespace=moby

	Oct 04 00:12:20 addons-585000 dockerd[1122]: time="2023-10-04T00:12:20.629963350Z" level=info msg="cleaning up dead shim" namespace=moby

	* 

	* ==> container status <==

	* CONTAINER           IMAGE                                                                                                          CREATED             STATE               NAME                      ATTEMPT             POD ID              POD

	7fe1ae4df5fc3       ghcr.io/headlamp-k8s/headlamp@sha256:bb15916c96306cd14f1c9c09c639d01d1d1fb854fd770bf99f3e7a9deb584753          8 minutes ago       Running             headlamp                  0                   ef032c077a9bb       headlamp-58b88cff49-pkdpk

	4999c3b7505c2       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf   15 minutes ago      Running             gcp-auth                  0                   0baad7da81cca       gcp-auth-d4c87556c-fbd9n

	59046ced6b465       ba04bb24b9575                                                                                                  15 minutes ago      Running             storage-provisioner       0                   422eeee32f3c7       storage-provisioner

	1cabeffdf46fd       97e04611ad434                                                                                                  15 minutes ago      Running             coredns                   0                   94eeb18b87283       coredns-5dd5756b68-khk2s

	1056d28082563       7da62c127fc0f                                                                                                  15 minutes ago      Running             kube-proxy                0                   af3e361d0b85e       kube-proxy-4m9nm

	92000aefe5383       9cdd6470f48c8                                                                                                  16 minutes ago      Running             etcd                      0                   95e83160dff6c       etcd-addons-585000

	a8e887332d59e       64fc40cee3716                                                                                                  16 minutes ago      Running             kube-scheduler            0                   61eb9114b1a5a       kube-scheduler-addons-585000

	0cc0200950b6e       30bb499447fe1                                                                                                  16 minutes ago      Running             kube-apiserver            0                   d88b38dfea206       kube-apiserver-addons-585000

	c400229c491d5       89d57b83c1786                                                                                                  16 minutes ago      Running             kube-controller-manager   0                   5520678c190ce       kube-controller-manager-addons-585000

	* 

	* ==> coredns [1cabeffdf46f] <==

	* [INFO] plugin/kubernetes: waiting for Kubernetes API before starting server

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server

	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server

	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server

	[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API

	.:53

	[INFO] plugin/reload: Running configuration SHA512 = 591cf328cccc12bc490481273e738df59329c62c0b729d94e8b61db9961c2fa5f046dd37f1cf888b953814040d180f52594972691cd6ff41be96639138a43908

	CoreDNS-1.10.1

	linux/arm64, go1.20, 055b2c3

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] Reloading

	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b

	[INFO] Reloading complete

	[INFO] 127.0.0.1:51045 - 1814 "HINFO IN 7601180359592532728.73972322534061862. udp 55 false 512" NXDOMAIN qr,rd,ra 130 0.004583475s

	[INFO] 10.244.0.13:48220 - 27508 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000122275s

	[INFO] 10.244.0.13:58104 - 55098 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000039883s

	[INFO] 10.244.0.13:58849 - 26333 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000042675s

	[INFO] 10.244.0.13:53313 - 23208 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000023463s

	[INFO] 10.244.0.13:34872 - 37616 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000023379s

	[INFO] 10.244.0.13:36929 - 11673 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000023963s

	[INFO] 10.244.0.13:46593 - 5724 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.001098011s

	[INFO] 10.244.0.13:48407 - 27925 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 572 0.001132685s

	* 

	* ==> describe nodes <==

	* Name:               addons-585000

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=addons-585000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=d9526fa6c1a1bb1b20f95e15606f1308e308d84a

	                    minikube.k8s.io/name=addons-585000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2023_10_03T17_04_11_0700

	                    minikube.k8s.io/version=v1.31.2

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	                    topology.hostpath.csi/node=addons-585000

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 04 Oct 2023 00:04:08 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  addons-585000

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 04 Oct 2023 00:20:10 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 04 Oct 2023 00:17:27 +0000   Wed, 04 Oct 2023 00:04:07 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 04 Oct 2023 00:17:27 +0000   Wed, 04 Oct 2023 00:04:07 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 04 Oct 2023 00:17:27 +0000   Wed, 04 Oct 2023 00:04:07 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 04 Oct 2023 00:17:27 +0000   Wed, 04 Oct 2023 00:04:14 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.105.2

	  Hostname:    addons-585000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17784760Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3905012Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17784760Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3905012Ki

	  pods:               110

	System Info:

	  Machine ID:                 0684753a9d5543b6bf7bf60f67ba1317

	  System UUID:                0684753a9d5543b6bf7bf60f67ba1317

	  Boot ID:                    b5c3b3eb-78df-44c0-a5f8-68774932e45d

	  Kernel Version:             5.10.57

	  OS Image:                   Buildroot 2021.02.12

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  docker://24.0.6

	  Kubelet Version:            v1.28.2

	  Kube-Proxy Version:         v1.28.2

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (9 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  gcp-auth                    gcp-auth-d4c87556c-fbd9n                 0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         15m

	  headlamp                    headlamp-58b88cff49-pkdpk                0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m57s

	  kube-system                 coredns-5dd5756b68-khk2s                 100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (1%!)(MISSING)        170Mi (4%!)(MISSING)     15m

	  kube-system                 etcd-addons-585000                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (2%!)(MISSING)       0 (0%!)(MISSING)         16m

	  kube-system                 kube-apiserver-addons-585000             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         16m

	  kube-system                 kube-controller-manager-addons-585000    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         16m

	  kube-system                 kube-proxy-4m9nm                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         15m

	  kube-system                 kube-scheduler-addons-585000             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         16m

	  kube-system                 storage-provisioner                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         15m

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  0 (0%!)(MISSING)

	  memory             170Mi (4%!)(MISSING)  170Mi (4%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                From             Message

	  ----    ------                   ----               ----             -------

	  Normal  Starting                 15m                kube-proxy       

	  Normal  Starting                 16m                kubelet          Starting kubelet.

	  Normal  NodeHasSufficientMemory  16m (x8 over 16m)  kubelet          Node addons-585000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    16m (x8 over 16m)  kubelet          Node addons-585000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     16m (x7 over 16m)  kubelet          Node addons-585000 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  16m                kubelet          Updated Node Allocatable limit across pods

	  Normal  Starting                 16m                kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  16m                kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  16m                kubelet          Node addons-585000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    16m                kubelet          Node addons-585000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     16m                kubelet          Node addons-585000 status is now: NodeHasSufficientPID

	  Normal  NodeReady                16m                kubelet          Node addons-585000 status is now: NodeReady

	  Normal  RegisteredNode           15m                node-controller  Node addons-585000 event: Registered Node addons-585000 in Controller

	* 

	* ==> dmesg <==

	* [  +0.495022] systemd-fstab-generator[117]: Ignoring "noauto" for root device

	[  +0.043117] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.

	[  +0.000788] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)

	[  +6.182267] systemd-fstab-generator[489]: Ignoring "noauto" for root device

	[  +0.079218] systemd-fstab-generator[500]: Ignoring "noauto" for root device

	[  +0.426961] systemd-fstab-generator[674]: Ignoring "noauto" for root device

	[  +0.177441] systemd-fstab-generator[742]: Ignoring "noauto" for root device

	[  +0.084046] systemd-fstab-generator[753]: Ignoring "noauto" for root device

	[  +0.086428] systemd-fstab-generator[766]: Ignoring "noauto" for root device

	[  +1.232741] systemd-fstab-generator[924]: Ignoring "noauto" for root device

	[  +0.076723] systemd-fstab-generator[935]: Ignoring "noauto" for root device

	[  +0.068940] systemd-fstab-generator[946]: Ignoring "noauto" for root device

	[  +0.067661] systemd-fstab-generator[957]: Ignoring "noauto" for root device

	[  +0.086560] systemd-fstab-generator[999]: Ignoring "noauto" for root device

	[Oct 4 00:04] systemd-fstab-generator[1108]: Ignoring "noauto" for root device

	[  +1.419313] kauditd_printk_skb: 53 callbacks suppressed

	[  +2.528330] systemd-fstab-generator[1477]: Ignoring "noauto" for root device

	[  +4.623780] systemd-fstab-generator[2363]: Ignoring "noauto" for root device

	[ +14.190759] kauditd_printk_skb: 41 callbacks suppressed

	[  +4.496510] TCP: eth0: Driver has suspect GRO implementation, TCP performance may be compromised.

	[  +0.762652] kauditd_printk_skb: 67 callbacks suppressed

	[ +18.036762] kauditd_printk_skb: 10 callbacks suppressed

	[Oct 4 00:10] kauditd_printk_skb: 4 callbacks suppressed

	[Oct 4 00:11] kauditd_printk_skb: 5 callbacks suppressed

	[Oct 4 00:12] kauditd_printk_skb: 12 callbacks suppressed

	* 

	* ==> etcd [92000aefe538] <==

	* {"level":"info","ts":"2023-10-04T00:04:07.332412Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"6e03e7863b4f9c54","local-member-id":"c46d288d2fcb0590","added-peer-id":"c46d288d2fcb0590","added-peer-peer-urls":["https://192.168.105.2:2380"]}

	{"level":"info","ts":"2023-10-04T00:04:07.779564Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 is starting a new election at term 1"}

	{"level":"info","ts":"2023-10-04T00:04:07.779655Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 became pre-candidate at term 1"}

	{"level":"info","ts":"2023-10-04T00:04:07.779697Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 received MsgPreVoteResp from c46d288d2fcb0590 at term 1"}

	{"level":"info","ts":"2023-10-04T00:04:07.779722Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 became candidate at term 2"}

	{"level":"info","ts":"2023-10-04T00:04:07.779739Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 received MsgVoteResp from c46d288d2fcb0590 at term 2"}

	{"level":"info","ts":"2023-10-04T00:04:07.779758Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 became leader at term 2"}

	{"level":"info","ts":"2023-10-04T00:04:07.779794Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: c46d288d2fcb0590 elected leader c46d288d2fcb0590 at term 2"}

	{"level":"info","ts":"2023-10-04T00:04:07.780671Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"c46d288d2fcb0590","local-member-attributes":"{Name:addons-585000 ClientURLs:[https://192.168.105.2:2379]}","request-path":"/0/members/c46d288d2fcb0590/attributes","cluster-id":"6e03e7863b4f9c54","publish-timeout":"7s"}

	{"level":"info","ts":"2023-10-04T00:04:07.780756Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-10-04T00:04:07.781263Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.2:2379"}

	{"level":"info","ts":"2023-10-04T00:04:07.781336Z","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}

	{"level":"info","ts":"2023-10-04T00:04:07.781426Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-10-04T00:04:07.781791Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"6e03e7863b4f9c54","local-member-id":"c46d288d2fcb0590","cluster-version":"3.5"}

	{"level":"info","ts":"2023-10-04T00:04:07.781849Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2023-10-04T00:04:07.781874Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}

	{"level":"info","ts":"2023-10-04T00:04:07.782126Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2023-10-04T00:04:07.782156Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2023-10-04T00:04:07.782572Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2023-10-04T00:14:07.794073Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1195}

	{"level":"info","ts":"2023-10-04T00:14:07.809078Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":1195,"took":"14.718788ms","hash":1561751362}

	{"level":"info","ts":"2023-10-04T00:14:07.809096Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":1561751362,"revision":1195,"compact-revision":-1}

	{"level":"info","ts":"2023-10-04T00:19:07.797282Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1852}

	{"level":"info","ts":"2023-10-04T00:19:07.80972Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":1852,"took":"12.234463ms","hash":1586820359}

	{"level":"info","ts":"2023-10-04T00:19:07.809734Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":1586820359,"revision":1852,"compact-revision":1195}

	* 

	* ==> gcp-auth [4999c3b7505c] <==

	* 2023/10/04 00:05:05 GCP Auth Webhook started!

	2023/10/04 00:10:24 Ready to marshal response ...

	2023/10/04 00:10:24 Ready to write response ...

	2023/10/04 00:10:24 Ready to marshal response ...

	2023/10/04 00:10:24 Ready to write response ...

	2023/10/04 00:10:34 Ready to marshal response ...

	2023/10/04 00:10:34 Ready to write response ...

	2023/10/04 00:11:22 Ready to marshal response ...

	2023/10/04 00:11:22 Ready to write response ...

	2023/10/04 00:11:22 Ready to marshal response ...

	2023/10/04 00:11:22 Ready to write response ...

	2023/10/04 00:11:22 Ready to marshal response ...

	2023/10/04 00:11:22 Ready to write response ...

	2023/10/04 00:11:37 Ready to marshal response ...

	2023/10/04 00:11:37 Ready to write response ...

	2023/10/04 00:11:58 Ready to marshal response ...

	2023/10/04 00:11:58 Ready to write response ...

	* 

	* ==> kernel <==

	*  00:20:20 up 16 min,  0 users,  load average: 0.16, 0.20, 0.18

	Linux addons-585000 5.10.57 #1 SMP PREEMPT Mon Sep 18 20:10:16 UTC 2023 aarch64 GNU/Linux

	PRETTY_NAME="Buildroot 2021.02.12"

	* 

	* ==> kube-apiserver [0cc0200950b6] <==

	* E1004 00:10:50.314788       1 authentication.go:70] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"local-path-provisioner-service-account\" not found]"

	I1004 00:11:08.313792       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager

	I1004 00:11:22.215599       1 alloc.go:330] "allocated clusterIPs" service="headlamp/headlamp" clusterIPs={"IPv4":"10.110.244.116"}

	I1004 00:11:47.633142       1 controller.go:624] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io

	I1004 00:12:08.316300       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager

	I1004 00:12:14.160595       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1004 00:12:14.160622       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1004 00:12:14.167272       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1004 00:12:14.167291       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1004 00:12:14.174430       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1004 00:12:14.174447       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1004 00:12:14.177283       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1004 00:12:14.177295       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1004 00:12:14.179264       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1004 00:12:14.179278       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1004 00:12:14.184100       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1004 00:12:14.184112       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1004 00:12:14.189220       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1004 00:12:14.189231       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1004 00:12:14.192620       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1004 00:12:14.192633       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	W1004 00:12:15.177382       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io

	W1004 00:12:15.185019       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io

	W1004 00:12:15.201033       1 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io

	I1004 00:12:35.289747       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Nothing (removed from the queue).

	* 

	* ==> kube-controller-manager [c400229c491d] <==

	* E1004 00:17:06.657567       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:17:30.734478       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:17:30.734496       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:17:43.686942       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:17:43.686957       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:17:47.974020       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:17:47.974036       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:18:20.227624       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:18:20.227649       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:18:22.080967       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:18:22.080986       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:18:42.876081       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:18:42.876101       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:19:15.038875       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:19:15.038894       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:19:17.102732       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:19:17.102747       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:19:36.954598       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:19:36.954615       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:20:05.388788       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:20:05.388811       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:20:10.923425       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:20:10.923443       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1004 00:20:13.934126       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1004 00:20:13.934249       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	* 

	* ==> kube-proxy [1056d2808256] <==

	* I1004 00:04:24.994967       1 server_others.go:69] "Using iptables proxy"

	I1004 00:04:25.008728       1 node.go:141] Successfully retrieved node IP: 192.168.105.2

	I1004 00:04:25.054070       1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"

	I1004 00:04:25.054092       1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I1004 00:04:25.054953       1 server_others.go:152] "Using iptables Proxier"

	I1004 00:04:25.054989       1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I1004 00:04:25.055146       1 server.go:846] "Version info" version="v1.28.2"

	I1004 00:04:25.055152       1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I1004 00:04:25.056159       1 config.go:188] "Starting service config controller"

	I1004 00:04:25.056167       1 shared_informer.go:311] Waiting for caches to sync for service config

	I1004 00:04:25.056185       1 config.go:97] "Starting endpoint slice config controller"

	I1004 00:04:25.056188       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config

	I1004 00:04:25.056455       1 config.go:315] "Starting node config controller"

	I1004 00:04:25.056459       1 shared_informer.go:311] Waiting for caches to sync for node config

	I1004 00:04:25.157056       1 shared_informer.go:318] Caches are synced for node config

	I1004 00:04:25.157076       1 shared_informer.go:318] Caches are synced for service config

	I1004 00:04:25.157088       1 shared_informer.go:318] Caches are synced for endpoint slice config

	* 

	* ==> kube-scheduler [a8e887332d59] <==

	* W1004 00:04:08.386414       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E1004 00:04:08.386433       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	W1004 00:04:08.386500       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1004 00:04:08.386521       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	W1004 00:04:08.386548       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E1004 00:04:08.386567       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	W1004 00:04:08.386603       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E1004 00:04:08.386625       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W1004 00:04:08.386669       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E1004 00:04:08.386696       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	W1004 00:04:08.386739       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E1004 00:04:08.386765       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	W1004 00:04:08.386786       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E1004 00:04:08.386793       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	W1004 00:04:08.386810       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E1004 00:04:08.386876       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	W1004 00:04:09.204848       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E1004 00:04:09.204864       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	W1004 00:04:09.297780       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E1004 00:04:09.297794       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W1004 00:04:09.358667       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E1004 00:04:09.358688       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	W1004 00:04:09.389038       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E1004 00:04:09.389085       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	I1004 00:04:09.875156       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	* 

	* ==> kubelet <==

	* -- Journal begins at Wed 2023-10-04 00:03:51 UTC, ends at Wed 2023-10-04 00:20:20 UTC. --

	Oct 04 00:15:10 addons-585000 kubelet[2369]: E1004 00:15:10.892515    2369 iptables.go:575] "Could not set up iptables canary" err=<

	Oct 04 00:15:10 addons-585000 kubelet[2369]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Oct 04 00:15:10 addons-585000 kubelet[2369]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Oct 04 00:15:10 addons-585000 kubelet[2369]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Oct 04 00:16:10 addons-585000 kubelet[2369]: E1004 00:16:10.892289    2369 iptables.go:575] "Could not set up iptables canary" err=<

	Oct 04 00:16:10 addons-585000 kubelet[2369]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Oct 04 00:16:10 addons-585000 kubelet[2369]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Oct 04 00:16:10 addons-585000 kubelet[2369]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Oct 04 00:17:10 addons-585000 kubelet[2369]: E1004 00:17:10.891861    2369 iptables.go:575] "Could not set up iptables canary" err=<

	Oct 04 00:17:10 addons-585000 kubelet[2369]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Oct 04 00:17:10 addons-585000 kubelet[2369]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Oct 04 00:17:10 addons-585000 kubelet[2369]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Oct 04 00:18:10 addons-585000 kubelet[2369]: E1004 00:18:10.892149    2369 iptables.go:575] "Could not set up iptables canary" err=<

	Oct 04 00:18:10 addons-585000 kubelet[2369]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Oct 04 00:18:10 addons-585000 kubelet[2369]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Oct 04 00:18:10 addons-585000 kubelet[2369]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Oct 04 00:19:10 addons-585000 kubelet[2369]: E1004 00:19:10.892588    2369 iptables.go:575] "Could not set up iptables canary" err=<

	Oct 04 00:19:10 addons-585000 kubelet[2369]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Oct 04 00:19:10 addons-585000 kubelet[2369]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Oct 04 00:19:10 addons-585000 kubelet[2369]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Oct 04 00:19:10 addons-585000 kubelet[2369]: W1004 00:19:10.906241    2369 machine.go:65] Cannot read vendor id correctly, set empty.

	Oct 04 00:20:10 addons-585000 kubelet[2369]: E1004 00:20:10.891904    2369 iptables.go:575] "Could not set up iptables canary" err=<

	Oct 04 00:20:10 addons-585000 kubelet[2369]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Oct 04 00:20:10 addons-585000 kubelet[2369]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Oct 04 00:20:10 addons-585000 kubelet[2369]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	* 

	* ==> storage-provisioner [59046ced6b46] <==

	* I1004 00:04:26.966816       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I1004 00:04:26.974630       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I1004 00:04:26.974651       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I1004 00:04:26.979059       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I1004 00:04:26.979221       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-585000_78b745e2-b305-4877-9367-ded1aea23542!

	I1004 00:04:26.979729       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"7fdf1027-c160-41cc-988a-74718f8f9c77", APIVersion:"v1", ResourceVersion:"562", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-585000_78b745e2-b305-4877-9367-ded1aea23542 became leader

	I1004 00:04:27.081357       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-585000_78b745e2-b305-4877-9367-ded1aea23542!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p addons-585000 -n addons-585000

helpers_test.go:261: (dbg) Run:  kubectl --context addons-585000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestAddons/parallel/InspektorGadget FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestAddons/parallel/InspektorGadget (480.86s)

=== RUN   TestCertOptions

=== PAUSE TestCertOptions

=== CONT  TestCertOptions

cert_options_test.go:49: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-options-032000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 

E1003 17:35:05.731222    1447 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/ingress-addon-legacy-830000/client.crt: no such file or directory

cert_options_test.go:49: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-options-032000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 : exit status 80 (9.924108625s)

-- stdout --

	* [cert-options-032000] minikube v1.31.2 on Darwin 14.0 (arm64)

	  - MINIKUBE_LOCATION=17345

	  - KUBECONFIG=/Users/jenkins/minikube-integration/17345-986/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17345-986/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting control plane node cert-options-032000 in cluster cert-options-032000

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "cert-options-032000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-options-032000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:51: failed to start minikube with args: "out/minikube-darwin-arm64 start -p cert-options-032000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 " : exit status 80

cert_options_test.go:60: (dbg) Run:  out/minikube-darwin-arm64 -p cert-options-032000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"

cert_options_test.go:60: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p cert-options-032000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt": exit status 89 (75.184958ms)

-- stdout --

	* The control plane node must be running for this command

	  To start a cluster, run: "minikube start -p cert-options-032000"

-- /stdout --

cert_options_test.go:62: failed to read apiserver cert inside minikube. args "out/minikube-darwin-arm64 -p cert-options-032000 ssh \"openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt\"": exit status 89

cert_options_test.go:69: apiserver cert does not include 127.0.0.1 in SAN.

cert_options_test.go:69: apiserver cert does not include 192.168.15.15 in SAN.

cert_options_test.go:69: apiserver cert does not include localhost in SAN.

cert_options_test.go:69: apiserver cert does not include www.google.com in SAN.

cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-032000 config view

cert_options_test.go:93: Kubeconfig apiserver server port incorrect. Output of 

'kubectl config view' = "\n-- stdout --\n\tapiVersion: v1\n\tclusters: null\n\tcontexts: null\n\tcurrent-context: \"\"\n\tkind: Config\n\tpreferences: {}\n\tusers: null\n\n-- /stdout --"

cert_options_test.go:100: (dbg) Run:  out/minikube-darwin-arm64 ssh -p cert-options-032000 -- "sudo cat /etc/kubernetes/admin.conf"

cert_options_test.go:100: (dbg) Non-zero exit: out/minikube-darwin-arm64 ssh -p cert-options-032000 -- "sudo cat /etc/kubernetes/admin.conf": exit status 89 (38.719209ms)

-- stdout --

	* The control plane node must be running for this command

	  To start a cluster, run: "minikube start -p cert-options-032000"

-- /stdout --

cert_options_test.go:102: failed to SSH to minikube with args: "out/minikube-darwin-arm64 ssh -p cert-options-032000 -- \"sudo cat /etc/kubernetes/admin.conf\"" : exit status 89

cert_options_test.go:106: Internal minikube kubeconfig (admin.conf) does not contains the right api port. 

-- stdout --

	* The control plane node must be running for this command

	  To start a cluster, run: "minikube start -p cert-options-032000"

-- /stdout --

cert_options_test.go:109: *** TestCertOptions FAILED at 2023-10-03 17:35:12.994004 -0700 PDT m=+1912.217314209

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p cert-options-032000 -n cert-options-032000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p cert-options-032000 -n cert-options-032000: exit status 7 (28.6965ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "cert-options-032000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "cert-options-032000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p cert-options-032000

--- FAIL: TestCertOptions (10.20s)

=== RUN   TestCertExpiration

=== PAUSE TestCertExpiration

=== CONT  TestCertExpiration

cert_options_test.go:123: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-expiration-876000 --memory=2048 --cert-expiration=3m --driver=qemu2 

cert_options_test.go:123: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-expiration-876000 --memory=2048 --cert-expiration=3m --driver=qemu2 : exit status 80 (9.842070542s)

-- stdout --

	* [cert-expiration-876000] minikube v1.31.2 on Darwin 14.0 (arm64)

	  - MINIKUBE_LOCATION=17345

	  - KUBECONFIG=/Users/jenkins/minikube-integration/17345-986/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17345-986/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting control plane node cert-expiration-876000 in cluster cert-expiration-876000

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "cert-expiration-876000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-876000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:125: failed to start minikube with args: "out/minikube-darwin-arm64 start -p cert-expiration-876000 --memory=2048 --cert-expiration=3m --driver=qemu2 " : exit status 80

cert_options_test.go:131: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-expiration-876000 --memory=2048 --cert-expiration=8760h --driver=qemu2 

cert_options_test.go:131: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-expiration-876000 --memory=2048 --cert-expiration=8760h --driver=qemu2 : exit status 80 (5.286385834s)

-- stdout --

	* [cert-expiration-876000] minikube v1.31.2 on Darwin 14.0 (arm64)

	  - MINIKUBE_LOCATION=17345

	  - KUBECONFIG=/Users/jenkins/minikube-integration/17345-986/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17345-986/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting control plane node cert-expiration-876000 in cluster cert-expiration-876000

	* Restarting existing qemu2 VM for "cert-expiration-876000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "cert-expiration-876000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-876000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:133: failed to start minikube after cert expiration: "out/minikube-darwin-arm64 start -p cert-expiration-876000 --memory=2048 --cert-expiration=8760h --driver=qemu2 " : exit status 80

cert_options_test.go:136: minikube start output did not warn about expired certs: 

-- stdout --

	* [cert-expiration-876000] minikube v1.31.2 on Darwin 14.0 (arm64)

	  - MINIKUBE_LOCATION=17345

	  - KUBECONFIG=/Users/jenkins/minikube-integration/17345-986/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17345-986/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting control plane node cert-expiration-876000 in cluster cert-expiration-876000

	* Restarting existing qemu2 VM for "cert-expiration-876000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "cert-expiration-876000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-876000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:138: *** TestCertExpiration FAILED at 2023-10-03 17:38:13.057139 -0700 PDT m=+2092.283968168

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p cert-expiration-876000 -n cert-expiration-876000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p cert-expiration-876000 -n cert-expiration-876000: exit status 7 (50.859542ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "cert-expiration-876000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "cert-expiration-876000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p cert-expiration-876000

--- FAIL: TestCertExpiration (195.33s)

=== RUN   TestDockerFlags

=== PAUSE TestDockerFlags

=== CONT  TestDockerFlags

docker_test.go:51: (dbg) Run:  out/minikube-darwin-arm64 start -p docker-flags-105000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 

docker_test.go:51: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p docker-flags-105000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (9.676390208s)

-- stdout --

	* [docker-flags-105000] minikube v1.31.2 on Darwin 14.0 (arm64)

	  - MINIKUBE_LOCATION=17345

	  - KUBECONFIG=/Users/jenkins/minikube-integration/17345-986/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17345-986/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting control plane node docker-flags-105000 in cluster docker-flags-105000

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "docker-flags-105000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I1003 17:34:53.028951    3934 out.go:296] Setting OutFile to fd 1 ...

	I1003 17:34:53.029100    3934 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1003 17:34:53.029103    3934 out.go:309] Setting ErrFile to fd 2...

	I1003 17:34:53.029106    3934 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1003 17:34:53.029247    3934 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17345-986/.minikube/bin

	I1003 17:34:53.030305    3934 out.go:303] Setting JSON to false

	I1003 17:34:53.046355    3934 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":2067,"bootTime":1696377626,"procs":457,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.0","kernelVersion":"23.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W1003 17:34:53.046450    3934 start.go:136] gopshost.Virtualization returned error: not implemented yet

	I1003 17:34:53.052420    3934 out.go:177] * [docker-flags-105000] minikube v1.31.2 on Darwin 14.0 (arm64)

	I1003 17:34:53.060346    3934 out.go:177]   - MINIKUBE_LOCATION=17345

	I1003 17:34:53.060414    3934 notify.go:220] Checking for updates...

	I1003 17:34:53.065322    3934 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17345-986/kubeconfig

	I1003 17:34:53.068306    3934 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I1003 17:34:53.071397    3934 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1003 17:34:53.074315    3934 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17345-986/.minikube

	I1003 17:34:53.077232    3934 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1003 17:34:53.080683    3934 config.go:182] Loaded profile config "force-systemd-flag-616000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 17:34:53.080746    3934 config.go:182] Loaded profile config "multinode-609000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 17:34:53.080799    3934 driver.go:373] Setting default libvirt URI to qemu:///system

	I1003 17:34:53.085363    3934 out.go:177] * Using the qemu2 driver based on user configuration

	I1003 17:34:53.092289    3934 start.go:298] selected driver: qemu2

	I1003 17:34:53.092297    3934 start.go:902] validating driver "qemu2" against <nil>

	I1003 17:34:53.092303    3934 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1003 17:34:53.094601    3934 start_flags.go:307] no existing cluster config was found, will generate one from the flags 

	I1003 17:34:53.097327    3934 out.go:177] * Automatically selected the socket_vmnet network

	I1003 17:34:53.100299    3934 start_flags.go:918] Waiting for no components: map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false]

	I1003 17:34:53.100324    3934 cni.go:84] Creating CNI manager for ""

	I1003 17:34:53.100333    3934 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1003 17:34:53.100338    3934 start_flags.go:316] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I1003 17:34:53.100344    3934 start_flags.go:321] config:

	{Name:docker-flags-105000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.2 ClusterName:docker-flags-105000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain

:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/ru

n/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I1003 17:34:53.104823    3934 iso.go:125] acquiring lock: {Name:mkcc00c41dbf3c669d3c57dcea55708ed569b7af Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1003 17:34:53.112328    3934 out.go:177] * Starting control plane node docker-flags-105000 in cluster docker-flags-105000

	I1003 17:34:53.116302    3934 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime docker

	I1003 17:34:53.116316    3934 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17345-986/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-arm64.tar.lz4

	I1003 17:34:53.116328    3934 cache.go:57] Caching tarball of preloaded images

	I1003 17:34:53.116393    3934 preload.go:174] Found /Users/jenkins/minikube-integration/17345-986/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I1003 17:34:53.116399    3934 cache.go:60] Finished verifying existence of preloaded tar for  v1.28.2 on docker

	I1003 17:34:53.116473    3934 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/docker-flags-105000/config.json ...

	I1003 17:34:53.116486    3934 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/docker-flags-105000/config.json: {Name:mk0f7c969eae1e8e42d18537b63610415b7e137c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:34:53.116714    3934 start.go:365] acquiring machines lock for docker-flags-105000: {Name:mk16657683bb2d197cbddad244cc8b10f1cb12f0 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1003 17:34:53.116745    3934 start.go:369] acquired machines lock for "docker-flags-105000" in 25.166µs

	I1003 17:34:53.116756    3934 start.go:93] Provisioning new machine with config: &{Name:docker-flags-105000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root

SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.2 ClusterName:docker-flags-105000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion

:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1003 17:34:53.116792    3934 start.go:125] createHost starting for "" (driver="qemu2")

	I1003 17:34:53.125261    3934 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I1003 17:34:53.142256    3934 start.go:159] libmachine.API.Create for "docker-flags-105000" (driver="qemu2")

	I1003 17:34:53.142282    3934 client.go:168] LocalClient.Create starting

	I1003 17:34:53.142341    3934 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem

	I1003 17:34:53.142372    3934 main.go:141] libmachine: Decoding PEM data...

	I1003 17:34:53.142385    3934 main.go:141] libmachine: Parsing certificate...

	I1003 17:34:53.142425    3934 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17345-986/.minikube/certs/cert.pem

	I1003 17:34:53.142446    3934 main.go:141] libmachine: Decoding PEM data...

	I1003 17:34:53.142454    3934 main.go:141] libmachine: Parsing certificate...

	I1003 17:34:53.142803    3934 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17345-986/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17345-986/.minikube/cache/iso/arm64/minikube-v1.31.0-1695060926-17240-arm64.iso...

	I1003 17:34:53.253802    3934 main.go:141] libmachine: Creating SSH key...

	I1003 17:34:53.309126    3934 main.go:141] libmachine: Creating Disk image...

	I1003 17:34:53.309132    3934 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I1003 17:34:53.309276    3934 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17345-986/.minikube/machines/docker-flags-105000/disk.qcow2.raw /Users/jenkins/minikube-integration/17345-986/.minikube/machines/docker-flags-105000/disk.qcow2

	I1003 17:34:53.317959    3934 main.go:141] libmachine: STDOUT: 

	I1003 17:34:53.317978    3934 main.go:141] libmachine: STDERR: 

	I1003 17:34:53.318029    3934 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17345-986/.minikube/machines/docker-flags-105000/disk.qcow2 +20000M

	I1003 17:34:53.325427    3934 main.go:141] libmachine: STDOUT: Image resized.

	I1003 17:34:53.325445    3934 main.go:141] libmachine: STDERR: 

	I1003 17:34:53.325464    3934 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17345-986/.minikube/machines/docker-flags-105000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17345-986/.minikube/machines/docker-flags-105000/disk.qcow2

	I1003 17:34:53.325470    3934 main.go:141] libmachine: Starting QEMU VM...

	I1003 17:34:53.325507    3934 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17345-986/.minikube/machines/docker-flags-105000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/docker-flags-105000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17345-986/.minikube/machines/docker-flags-105000/qemu.pid -device virtio-net-pci,netdev=net0,mac=2e:30:c8:2e:76:10 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17345-986/.minikube/machines/docker-flags-105000/disk.qcow2

	I1003 17:34:53.327131    3934 main.go:141] libmachine: STDOUT: 

	I1003 17:34:53.327145    3934 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I1003 17:34:53.327170    3934 client.go:171] LocalClient.Create took 184.886042ms

	I1003 17:34:55.329348    3934 start.go:128] duration metric: createHost completed in 2.212575208s

	I1003 17:34:55.329440    3934 start.go:83] releasing machines lock for "docker-flags-105000", held for 2.212698333s

	W1003 17:34:55.329507    3934 start.go:688] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1003 17:34:55.342655    3934 out.go:177] * Deleting "docker-flags-105000" in qemu2 ...

	W1003 17:34:55.362851    3934 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1003 17:34:55.362880    3934 start.go:703] Will try again in 5 seconds ...

	I1003 17:35:00.364966    3934 start.go:365] acquiring machines lock for docker-flags-105000: {Name:mk16657683bb2d197cbddad244cc8b10f1cb12f0 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1003 17:35:00.365383    3934 start.go:369] acquired machines lock for "docker-flags-105000" in 311.5µs

	I1003 17:35:00.365494    3934 start.go:93] Provisioning new machine with config: &{Name:docker-flags-105000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root

SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.2 ClusterName:docker-flags-105000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion

:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1003 17:35:00.365778    3934 start.go:125] createHost starting for "" (driver="qemu2")

	I1003 17:35:00.375050    3934 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I1003 17:35:00.424565    3934 start.go:159] libmachine.API.Create for "docker-flags-105000" (driver="qemu2")

	I1003 17:35:00.424661    3934 client.go:168] LocalClient.Create starting

	I1003 17:35:00.424939    3934 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem

	I1003 17:35:00.425029    3934 main.go:141] libmachine: Decoding PEM data...

	I1003 17:35:00.425060    3934 main.go:141] libmachine: Parsing certificate...

	I1003 17:35:00.425177    3934 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17345-986/.minikube/certs/cert.pem

	I1003 17:35:00.425227    3934 main.go:141] libmachine: Decoding PEM data...

	I1003 17:35:00.425255    3934 main.go:141] libmachine: Parsing certificate...

	I1003 17:35:00.426214    3934 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17345-986/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17345-986/.minikube/cache/iso/arm64/minikube-v1.31.0-1695060926-17240-arm64.iso...

	I1003 17:35:00.549073    3934 main.go:141] libmachine: Creating SSH key...

	I1003 17:35:00.617420    3934 main.go:141] libmachine: Creating Disk image...

	I1003 17:35:00.617427    3934 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I1003 17:35:00.617576    3934 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17345-986/.minikube/machines/docker-flags-105000/disk.qcow2.raw /Users/jenkins/minikube-integration/17345-986/.minikube/machines/docker-flags-105000/disk.qcow2

	I1003 17:35:00.626552    3934 main.go:141] libmachine: STDOUT: 

	I1003 17:35:00.626576    3934 main.go:141] libmachine: STDERR: 

	I1003 17:35:00.626646    3934 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17345-986/.minikube/machines/docker-flags-105000/disk.qcow2 +20000M

	I1003 17:35:00.634390    3934 main.go:141] libmachine: STDOUT: Image resized.

	I1003 17:35:00.634403    3934 main.go:141] libmachine: STDERR: 

	I1003 17:35:00.634417    3934 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17345-986/.minikube/machines/docker-flags-105000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17345-986/.minikube/machines/docker-flags-105000/disk.qcow2

	I1003 17:35:00.634425    3934 main.go:141] libmachine: Starting QEMU VM...

	I1003 17:35:00.634468    3934 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17345-986/.minikube/machines/docker-flags-105000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/docker-flags-105000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17345-986/.minikube/machines/docker-flags-105000/qemu.pid -device virtio-net-pci,netdev=net0,mac=96:7a:f7:7f:36:1e -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17345-986/.minikube/machines/docker-flags-105000/disk.qcow2

	I1003 17:35:00.636124    3934 main.go:141] libmachine: STDOUT: 

	I1003 17:35:00.636140    3934 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I1003 17:35:00.636156    3934 client.go:171] LocalClient.Create took 211.49225ms

	I1003 17:35:02.638336    3934 start.go:128] duration metric: createHost completed in 2.272562042s

	I1003 17:35:02.638430    3934 start.go:83] releasing machines lock for "docker-flags-105000", held for 2.273065583s

	W1003 17:35:02.638977    3934 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p docker-flags-105000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p docker-flags-105000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1003 17:35:02.648666    3934 out.go:177] 

	W1003 17:35:02.652767    3934 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W1003 17:35:02.652809    3934 out.go:239] * 

	* 

	W1003 17:35:02.655515    3934 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I1003 17:35:02.665628    3934 out.go:177] 

** /stderr **

docker_test.go:53: failed to start minikube with args: "out/minikube-darwin-arm64 start -p docker-flags-105000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 " : exit status 80

docker_test.go:56: (dbg) Run:  out/minikube-darwin-arm64 -p docker-flags-105000 ssh "sudo systemctl show docker --property=Environment --no-pager"

docker_test.go:56: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p docker-flags-105000 ssh "sudo systemctl show docker --property=Environment --no-pager": exit status 89 (75.102375ms)

-- stdout --

	* The control plane node must be running for this command

	  To start a cluster, run: "minikube start -p docker-flags-105000"

-- /stdout --

docker_test.go:58: failed to 'systemctl show docker' inside minikube. args "out/minikube-darwin-arm64 -p docker-flags-105000 ssh \"sudo systemctl show docker --property=Environment --no-pager\"": exit status 89

docker_test.go:63: expected env key/value "FOO=BAR" to be passed to minikube's docker and be included in: *"* The control plane node must be running for this command\n  To start a cluster, run: \"minikube start -p docker-flags-105000\"\n"*.

docker_test.go:63: expected env key/value "BAZ=BAT" to be passed to minikube's docker and be included in: *"* The control plane node must be running for this command\n  To start a cluster, run: \"minikube start -p docker-flags-105000\"\n"*.

docker_test.go:67: (dbg) Run:  out/minikube-darwin-arm64 -p docker-flags-105000 ssh "sudo systemctl show docker --property=ExecStart --no-pager"

docker_test.go:67: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p docker-flags-105000 ssh "sudo systemctl show docker --property=ExecStart --no-pager": exit status 89 (43.723792ms)

-- stdout --

	* The control plane node must be running for this command

	  To start a cluster, run: "minikube start -p docker-flags-105000"

-- /stdout --

docker_test.go:69: failed on the second 'systemctl show docker' inside minikube. args "out/minikube-darwin-arm64 -p docker-flags-105000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"": exit status 89

docker_test.go:73: expected "out/minikube-darwin-arm64 -p docker-flags-105000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"" output to have include *--debug* . output: "* The control plane node must be running for this command\n  To start a cluster, run: \"minikube start -p docker-flags-105000\"\n"

panic.go:523: *** TestDockerFlags FAILED at 2023-10-03 17:35:02.799997 -0700 PDT m=+1902.023108251

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p docker-flags-105000 -n docker-flags-105000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p docker-flags-105000 -n docker-flags-105000: exit status 7 (27.638792ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "docker-flags-105000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "docker-flags-105000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p docker-flags-105000

--- FAIL: TestDockerFlags (9.92s)

=== RUN   TestForceSystemdFlag

=== PAUSE TestForceSystemdFlag

=== CONT  TestForceSystemdFlag

docker_test.go:91: (dbg) Run:  out/minikube-darwin-arm64 start -p force-systemd-flag-616000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 

docker_test.go:91: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p force-systemd-flag-616000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (9.798370875s)

-- stdout --

	* [force-systemd-flag-616000] minikube v1.31.2 on Darwin 14.0 (arm64)

	  - MINIKUBE_LOCATION=17345

	  - KUBECONFIG=/Users/jenkins/minikube-integration/17345-986/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17345-986/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting control plane node force-systemd-flag-616000 in cluster force-systemd-flag-616000

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "force-systemd-flag-616000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I1003 17:34:47.948168    3911 out.go:296] Setting OutFile to fd 1 ...

	I1003 17:34:47.948330    3911 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1003 17:34:47.948332    3911 out.go:309] Setting ErrFile to fd 2...

	I1003 17:34:47.948335    3911 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1003 17:34:47.948475    3911 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17345-986/.minikube/bin

	I1003 17:34:47.949505    3911 out.go:303] Setting JSON to false

	I1003 17:34:47.965413    3911 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":2061,"bootTime":1696377626,"procs":457,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.0","kernelVersion":"23.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W1003 17:34:47.965508    3911 start.go:136] gopshost.Virtualization returned error: not implemented yet

	I1003 17:34:47.971463    3911 out.go:177] * [force-systemd-flag-616000] minikube v1.31.2 on Darwin 14.0 (arm64)

	I1003 17:34:47.978515    3911 out.go:177]   - MINIKUBE_LOCATION=17345

	I1003 17:34:47.981424    3911 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17345-986/kubeconfig

	I1003 17:34:47.978571    3911 notify.go:220] Checking for updates...

	I1003 17:34:47.987352    3911 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I1003 17:34:47.990482    3911 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1003 17:34:47.993418    3911 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17345-986/.minikube

	I1003 17:34:47.996378    3911 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1003 17:34:47.999775    3911 config.go:182] Loaded profile config "force-systemd-env-769000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 17:34:47.999841    3911 config.go:182] Loaded profile config "multinode-609000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 17:34:47.999886    3911 driver.go:373] Setting default libvirt URI to qemu:///system

	I1003 17:34:48.004473    3911 out.go:177] * Using the qemu2 driver based on user configuration

	I1003 17:34:48.011446    3911 start.go:298] selected driver: qemu2

	I1003 17:34:48.011452    3911 start.go:902] validating driver "qemu2" against <nil>

	I1003 17:34:48.011458    3911 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1003 17:34:48.013691    3911 start_flags.go:307] no existing cluster config was found, will generate one from the flags 

	I1003 17:34:48.017453    3911 out.go:177] * Automatically selected the socket_vmnet network

	I1003 17:34:48.021441    3911 start_flags.go:905] Wait components to verify : map[apiserver:true system_pods:true]

	I1003 17:34:48.021469    3911 cni.go:84] Creating CNI manager for ""

	I1003 17:34:48.021477    3911 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1003 17:34:48.021482    3911 start_flags.go:316] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I1003 17:34:48.021491    3911 start_flags.go:321] config:

	{Name:force-systemd-flag-616000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.2 ClusterName:force-systemd-flag-616000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Co

ntainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I1003 17:34:48.025971    3911 iso.go:125] acquiring lock: {Name:mkcc00c41dbf3c669d3c57dcea55708ed569b7af Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1003 17:34:48.033364    3911 out.go:177] * Starting control plane node force-systemd-flag-616000 in cluster force-systemd-flag-616000

	I1003 17:34:48.037383    3911 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime docker

	I1003 17:34:48.037398    3911 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17345-986/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-arm64.tar.lz4

	I1003 17:34:48.037404    3911 cache.go:57] Caching tarball of preloaded images

	I1003 17:34:48.037453    3911 preload.go:174] Found /Users/jenkins/minikube-integration/17345-986/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I1003 17:34:48.037459    3911 cache.go:60] Finished verifying existence of preloaded tar for  v1.28.2 on docker

	I1003 17:34:48.037511    3911 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/force-systemd-flag-616000/config.json ...

	I1003 17:34:48.037522    3911 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/force-systemd-flag-616000/config.json: {Name:mkcb9dac14ce2ed453648457a4f7cf63bf377d90 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:34:48.037805    3911 start.go:365] acquiring machines lock for force-systemd-flag-616000: {Name:mk16657683bb2d197cbddad244cc8b10f1cb12f0 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1003 17:34:48.037837    3911 start.go:369] acquired machines lock for "force-systemd-flag-616000" in 22.791µs

	I1003 17:34:48.037848    3911 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-616000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kub

ernetesConfig:{KubernetesVersion:v1.28.2 ClusterName:force-systemd-flag-616000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p Mount

UID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1003 17:34:48.037879    3911 start.go:125] createHost starting for "" (driver="qemu2")

	I1003 17:34:48.046439    3911 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I1003 17:34:48.062785    3911 start.go:159] libmachine.API.Create for "force-systemd-flag-616000" (driver="qemu2")

	I1003 17:34:48.062810    3911 client.go:168] LocalClient.Create starting

	I1003 17:34:48.062870    3911 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem

	I1003 17:34:48.062893    3911 main.go:141] libmachine: Decoding PEM data...

	I1003 17:34:48.062903    3911 main.go:141] libmachine: Parsing certificate...

	I1003 17:34:48.062934    3911 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17345-986/.minikube/certs/cert.pem

	I1003 17:34:48.062951    3911 main.go:141] libmachine: Decoding PEM data...

	I1003 17:34:48.062959    3911 main.go:141] libmachine: Parsing certificate...

	I1003 17:34:48.063257    3911 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17345-986/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17345-986/.minikube/cache/iso/arm64/minikube-v1.31.0-1695060926-17240-arm64.iso...

	I1003 17:34:48.174411    3911 main.go:141] libmachine: Creating SSH key...

	I1003 17:34:48.335617    3911 main.go:141] libmachine: Creating Disk image...

	I1003 17:34:48.335627    3911 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I1003 17:34:48.335804    3911 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-flag-616000/disk.qcow2.raw /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-flag-616000/disk.qcow2

	I1003 17:34:48.344865    3911 main.go:141] libmachine: STDOUT: 

	I1003 17:34:48.344889    3911 main.go:141] libmachine: STDERR: 

	I1003 17:34:48.344940    3911 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-flag-616000/disk.qcow2 +20000M

	I1003 17:34:48.352511    3911 main.go:141] libmachine: STDOUT: Image resized.

	I1003 17:34:48.352525    3911 main.go:141] libmachine: STDERR: 

	I1003 17:34:48.352542    3911 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-flag-616000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-flag-616000/disk.qcow2

	I1003 17:34:48.352548    3911 main.go:141] libmachine: Starting QEMU VM...

	I1003 17:34:48.352589    3911 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-flag-616000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-flag-616000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-flag-616000/qemu.pid -device virtio-net-pci,netdev=net0,mac=e2:e9:0c:19:0e:90 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-flag-616000/disk.qcow2

	I1003 17:34:48.354196    3911 main.go:141] libmachine: STDOUT: 

	I1003 17:34:48.354211    3911 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I1003 17:34:48.354231    3911 client.go:171] LocalClient.Create took 291.421333ms

	I1003 17:34:50.356432    3911 start.go:128] duration metric: createHost completed in 2.31858125s

	I1003 17:34:50.356491    3911 start.go:83] releasing machines lock for "force-systemd-flag-616000", held for 2.318689042s

	W1003 17:34:50.356542    3911 start.go:688] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1003 17:34:50.376570    3911 out.go:177] * Deleting "force-systemd-flag-616000" in qemu2 ...

	W1003 17:34:50.391686    3911 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1003 17:34:50.391745    3911 start.go:703] Will try again in 5 seconds ...

	I1003 17:34:55.393874    3911 start.go:365] acquiring machines lock for force-systemd-flag-616000: {Name:mk16657683bb2d197cbddad244cc8b10f1cb12f0 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1003 17:34:55.394240    3911 start.go:369] acquired machines lock for "force-systemd-flag-616000" in 247.917µs

	I1003 17:34:55.394354    3911 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-616000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kub

ernetesConfig:{KubernetesVersion:v1.28.2 ClusterName:force-systemd-flag-616000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p Mount

UID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1003 17:34:55.394613    3911 start.go:125] createHost starting for "" (driver="qemu2")

	I1003 17:34:55.403566    3911 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I1003 17:34:55.451562    3911 start.go:159] libmachine.API.Create for "force-systemd-flag-616000" (driver="qemu2")

	I1003 17:34:55.451596    3911 client.go:168] LocalClient.Create starting

	I1003 17:34:55.451714    3911 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem

	I1003 17:34:55.451764    3911 main.go:141] libmachine: Decoding PEM data...

	I1003 17:34:55.451784    3911 main.go:141] libmachine: Parsing certificate...

	I1003 17:34:55.451851    3911 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17345-986/.minikube/certs/cert.pem

	I1003 17:34:55.451885    3911 main.go:141] libmachine: Decoding PEM data...

	I1003 17:34:55.451901    3911 main.go:141] libmachine: Parsing certificate...

	I1003 17:34:55.452519    3911 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17345-986/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17345-986/.minikube/cache/iso/arm64/minikube-v1.31.0-1695060926-17240-arm64.iso...

	I1003 17:34:55.575860    3911 main.go:141] libmachine: Creating SSH key...

	I1003 17:34:55.658361    3911 main.go:141] libmachine: Creating Disk image...

	I1003 17:34:55.658367    3911 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I1003 17:34:55.658527    3911 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-flag-616000/disk.qcow2.raw /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-flag-616000/disk.qcow2

	I1003 17:34:55.667293    3911 main.go:141] libmachine: STDOUT: 

	I1003 17:34:55.667310    3911 main.go:141] libmachine: STDERR: 

	I1003 17:34:55.667366    3911 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-flag-616000/disk.qcow2 +20000M

	I1003 17:34:55.674877    3911 main.go:141] libmachine: STDOUT: Image resized.

	I1003 17:34:55.674897    3911 main.go:141] libmachine: STDERR: 

	I1003 17:34:55.674911    3911 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-flag-616000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-flag-616000/disk.qcow2

	I1003 17:34:55.674917    3911 main.go:141] libmachine: Starting QEMU VM...

	I1003 17:34:55.674961    3911 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-flag-616000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-flag-616000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-flag-616000/qemu.pid -device virtio-net-pci,netdev=net0,mac=7a:48:bb:ea:98:52 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-flag-616000/disk.qcow2

	I1003 17:34:55.676619    3911 main.go:141] libmachine: STDOUT: 

	I1003 17:34:55.676631    3911 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I1003 17:34:55.676643    3911 client.go:171] LocalClient.Create took 225.046583ms

	I1003 17:34:57.678785    3911 start.go:128] duration metric: createHost completed in 2.284163208s

	I1003 17:34:57.678855    3911 start.go:83] releasing machines lock for "force-systemd-flag-616000", held for 2.284634542s

	W1003 17:34:57.679345    3911 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p force-systemd-flag-616000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p force-systemd-flag-616000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1003 17:34:57.687956    3911 out.go:177] 

	W1003 17:34:57.693240    3911 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W1003 17:34:57.693281    3911 out.go:239] * 

	* 

	W1003 17:34:57.695918    3911 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I1003 17:34:57.706932    3911 out.go:177] 

** /stderr **

docker_test.go:93: failed to start minikube with args: "out/minikube-darwin-arm64 start -p force-systemd-flag-616000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 " : exit status 80

docker_test.go:110: (dbg) Run:  out/minikube-darwin-arm64 -p force-systemd-flag-616000 ssh "docker info --format {{.CgroupDriver}}"

docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p force-systemd-flag-616000 ssh "docker info --format {{.CgroupDriver}}": exit status 89 (74.861125ms)

-- stdout --

	* The control plane node must be running for this command

	  To start a cluster, run: "minikube start -p force-systemd-flag-616000"

-- /stdout --

docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-arm64 -p force-systemd-flag-616000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 89

docker_test.go:106: *** TestForceSystemdFlag FAILED at 2023-10-03 17:34:57.798046 -0700 PDT m=+1897.021060334

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-flag-616000 -n force-systemd-flag-616000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-flag-616000 -n force-systemd-flag-616000: exit status 7 (33.506792ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "force-systemd-flag-616000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "force-systemd-flag-616000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p force-systemd-flag-616000

--- FAIL: TestForceSystemdFlag (10.01s)

=== RUN   TestForceSystemdEnv

=== PAUSE TestForceSystemdEnv

=== CONT  TestForceSystemdEnv

docker_test.go:155: (dbg) Run:  out/minikube-darwin-arm64 start -p force-systemd-env-769000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 

docker_test.go:155: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p force-systemd-env-769000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (10.41308775s)

-- stdout --

	* [force-systemd-env-769000] minikube v1.31.2 on Darwin 14.0 (arm64)

	  - MINIKUBE_LOCATION=17345

	  - KUBECONFIG=/Users/jenkins/minikube-integration/17345-986/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17345-986/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=true

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting control plane node force-systemd-env-769000 in cluster force-systemd-env-769000

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "force-systemd-env-769000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I1003 17:34:42.410185    3876 out.go:296] Setting OutFile to fd 1 ...

	I1003 17:34:42.410404    3876 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1003 17:34:42.410407    3876 out.go:309] Setting ErrFile to fd 2...

	I1003 17:34:42.410410    3876 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1003 17:34:42.410539    3876 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17345-986/.minikube/bin

	I1003 17:34:42.411532    3876 out.go:303] Setting JSON to false

	I1003 17:34:42.427586    3876 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":2056,"bootTime":1696377626,"procs":456,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.0","kernelVersion":"23.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W1003 17:34:42.427674    3876 start.go:136] gopshost.Virtualization returned error: not implemented yet

	I1003 17:34:42.432132    3876 out.go:177] * [force-systemd-env-769000] minikube v1.31.2 on Darwin 14.0 (arm64)

	I1003 17:34:42.440116    3876 out.go:177]   - MINIKUBE_LOCATION=17345

	I1003 17:34:42.445043    3876 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17345-986/kubeconfig

	I1003 17:34:42.440209    3876 notify.go:220] Checking for updates...

	I1003 17:34:42.450062    3876 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I1003 17:34:42.453156    3876 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1003 17:34:42.456097    3876 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17345-986/.minikube

	I1003 17:34:42.459032    3876 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=true

	I1003 17:34:42.462485    3876 config.go:182] Loaded profile config "multinode-609000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 17:34:42.462528    3876 driver.go:373] Setting default libvirt URI to qemu:///system

	I1003 17:34:42.467054    3876 out.go:177] * Using the qemu2 driver based on user configuration

	I1003 17:34:42.474114    3876 start.go:298] selected driver: qemu2

	I1003 17:34:42.474123    3876 start.go:902] validating driver "qemu2" against <nil>

	I1003 17:34:42.474129    3876 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1003 17:34:42.476519    3876 start_flags.go:307] no existing cluster config was found, will generate one from the flags 

	I1003 17:34:42.479097    3876 out.go:177] * Automatically selected the socket_vmnet network

	I1003 17:34:42.482126    3876 start_flags.go:905] Wait components to verify : map[apiserver:true system_pods:true]

	I1003 17:34:42.482148    3876 cni.go:84] Creating CNI manager for ""

	I1003 17:34:42.482159    3876 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1003 17:34:42.482163    3876 start_flags.go:316] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I1003 17:34:42.482179    3876 start_flags.go:321] config:

	{Name:force-systemd-env-769000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.2 ClusterName:force-systemd-env-769000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Cont

ainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I1003 17:34:42.486771    3876 iso.go:125] acquiring lock: {Name:mkcc00c41dbf3c669d3c57dcea55708ed569b7af Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1003 17:34:42.493938    3876 out.go:177] * Starting control plane node force-systemd-env-769000 in cluster force-systemd-env-769000

	I1003 17:34:42.498110    3876 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime docker

	I1003 17:34:42.498126    3876 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17345-986/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-arm64.tar.lz4

	I1003 17:34:42.498143    3876 cache.go:57] Caching tarball of preloaded images

	I1003 17:34:42.498197    3876 preload.go:174] Found /Users/jenkins/minikube-integration/17345-986/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I1003 17:34:42.498202    3876 cache.go:60] Finished verifying existence of preloaded tar for  v1.28.2 on docker

	I1003 17:34:42.498274    3876 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/force-systemd-env-769000/config.json ...

	I1003 17:34:42.498285    3876 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/force-systemd-env-769000/config.json: {Name:mk7a2b2b7922d05a5478f209501d88a691907f32 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:34:42.498493    3876 start.go:365] acquiring machines lock for force-systemd-env-769000: {Name:mk16657683bb2d197cbddad244cc8b10f1cb12f0 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1003 17:34:42.498527    3876 start.go:369] acquired machines lock for "force-systemd-env-769000" in 26.917µs

	I1003 17:34:42.498538    3876 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-769000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kube

rnetesConfig:{KubernetesVersion:v1.28.2 ClusterName:force-systemd-env-769000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUI

D:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1003 17:34:42.498563    3876 start.go:125] createHost starting for "" (driver="qemu2")

	I1003 17:34:42.500603    3876 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I1003 17:34:42.515958    3876 start.go:159] libmachine.API.Create for "force-systemd-env-769000" (driver="qemu2")

	I1003 17:34:42.515983    3876 client.go:168] LocalClient.Create starting

	I1003 17:34:42.516038    3876 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem

	I1003 17:34:42.516064    3876 main.go:141] libmachine: Decoding PEM data...

	I1003 17:34:42.516075    3876 main.go:141] libmachine: Parsing certificate...

	I1003 17:34:42.516110    3876 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17345-986/.minikube/certs/cert.pem

	I1003 17:34:42.516127    3876 main.go:141] libmachine: Decoding PEM data...

	I1003 17:34:42.516135    3876 main.go:141] libmachine: Parsing certificate...

	I1003 17:34:42.516445    3876 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17345-986/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17345-986/.minikube/cache/iso/arm64/minikube-v1.31.0-1695060926-17240-arm64.iso...

	I1003 17:34:42.628317    3876 main.go:141] libmachine: Creating SSH key...

	I1003 17:34:42.697819    3876 main.go:141] libmachine: Creating Disk image...

	I1003 17:34:42.697825    3876 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I1003 17:34:42.697990    3876 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-env-769000/disk.qcow2.raw /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-env-769000/disk.qcow2

	I1003 17:34:42.706632    3876 main.go:141] libmachine: STDOUT: 

	I1003 17:34:42.706647    3876 main.go:141] libmachine: STDERR: 

	I1003 17:34:42.706709    3876 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-env-769000/disk.qcow2 +20000M

	I1003 17:34:42.714103    3876 main.go:141] libmachine: STDOUT: Image resized.

	I1003 17:34:42.714119    3876 main.go:141] libmachine: STDERR: 

	I1003 17:34:42.714318    3876 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-env-769000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-env-769000/disk.qcow2

	I1003 17:34:42.714328    3876 main.go:141] libmachine: Starting QEMU VM...

	I1003 17:34:42.715014    3876 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-env-769000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-env-769000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-env-769000/qemu.pid -device virtio-net-pci,netdev=net0,mac=92:e5:62:4c:92:4e -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-env-769000/disk.qcow2

	I1003 17:34:42.716992    3876 main.go:141] libmachine: STDOUT: 

	I1003 17:34:42.717013    3876 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I1003 17:34:42.717033    3876 client.go:171] LocalClient.Create took 201.049333ms

	I1003 17:34:44.719077    3876 start.go:128] duration metric: createHost completed in 2.220548s

	I1003 17:34:44.719096    3876 start.go:83] releasing machines lock for "force-systemd-env-769000", held for 2.220607917s

	W1003 17:34:44.719111    3876 start.go:688] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1003 17:34:44.727677    3876 out.go:177] * Deleting "force-systemd-env-769000" in qemu2 ...

	W1003 17:34:44.735784    3876 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1003 17:34:44.735797    3876 start.go:703] Will try again in 5 seconds ...

	I1003 17:34:49.738000    3876 start.go:365] acquiring machines lock for force-systemd-env-769000: {Name:mk16657683bb2d197cbddad244cc8b10f1cb12f0 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1003 17:34:50.356625    3876 start.go:369] acquired machines lock for "force-systemd-env-769000" in 618.532584ms

	I1003 17:34:50.356802    3876 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-769000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kube

rnetesConfig:{KubernetesVersion:v1.28.2 ClusterName:force-systemd-env-769000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUI

D:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1003 17:34:50.357031    3876 start.go:125] createHost starting for "" (driver="qemu2")

	I1003 17:34:50.368509    3876 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I1003 17:34:50.414674    3876 start.go:159] libmachine.API.Create for "force-systemd-env-769000" (driver="qemu2")

	I1003 17:34:50.414717    3876 client.go:168] LocalClient.Create starting

	I1003 17:34:50.414849    3876 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem

	I1003 17:34:50.414894    3876 main.go:141] libmachine: Decoding PEM data...

	I1003 17:34:50.414918    3876 main.go:141] libmachine: Parsing certificate...

	I1003 17:34:50.414978    3876 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17345-986/.minikube/certs/cert.pem

	I1003 17:34:50.415012    3876 main.go:141] libmachine: Decoding PEM data...

	I1003 17:34:50.415030    3876 main.go:141] libmachine: Parsing certificate...

	I1003 17:34:50.415541    3876 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17345-986/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17345-986/.minikube/cache/iso/arm64/minikube-v1.31.0-1695060926-17240-arm64.iso...

	I1003 17:34:50.537779    3876 main.go:141] libmachine: Creating SSH key...

	I1003 17:34:50.730728    3876 main.go:141] libmachine: Creating Disk image...

	I1003 17:34:50.730735    3876 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I1003 17:34:50.730925    3876 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-env-769000/disk.qcow2.raw /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-env-769000/disk.qcow2

	I1003 17:34:50.740053    3876 main.go:141] libmachine: STDOUT: 

	I1003 17:34:50.740067    3876 main.go:141] libmachine: STDERR: 

	I1003 17:34:50.740141    3876 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-env-769000/disk.qcow2 +20000M

	I1003 17:34:50.747603    3876 main.go:141] libmachine: STDOUT: Image resized.

	I1003 17:34:50.747615    3876 main.go:141] libmachine: STDERR: 

	I1003 17:34:50.747630    3876 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-env-769000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-env-769000/disk.qcow2

	I1003 17:34:50.747636    3876 main.go:141] libmachine: Starting QEMU VM...

	I1003 17:34:50.747677    3876 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-env-769000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-env-769000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-env-769000/qemu.pid -device virtio-net-pci,netdev=net0,mac=e6:15:07:7d:b9:4b -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17345-986/.minikube/machines/force-systemd-env-769000/disk.qcow2

	I1003 17:34:50.749253    3876 main.go:141] libmachine: STDOUT: 

	I1003 17:34:50.749267    3876 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I1003 17:34:50.749278    3876 client.go:171] LocalClient.Create took 334.561459ms

	I1003 17:34:52.751447    3876 start.go:128] duration metric: createHost completed in 2.394422292s

	I1003 17:34:52.751533    3876 start.go:83] releasing machines lock for "force-systemd-env-769000", held for 2.394912208s

	W1003 17:34:52.751919    3876 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p force-systemd-env-769000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p force-systemd-env-769000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1003 17:34:52.760551    3876 out.go:177] 

	W1003 17:34:52.764635    3876 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W1003 17:34:52.764693    3876 out.go:239] * 

	* 

	W1003 17:34:52.767494    3876 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I1003 17:34:52.780491    3876 out.go:177] 

** /stderr **

docker_test.go:157: failed to start minikube with args: "out/minikube-darwin-arm64 start -p force-systemd-env-769000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 " : exit status 80

docker_test.go:110: (dbg) Run:  out/minikube-darwin-arm64 -p force-systemd-env-769000 ssh "docker info --format {{.CgroupDriver}}"

docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p force-systemd-env-769000 ssh "docker info --format {{.CgroupDriver}}": exit status 89 (79.913583ms)

-- stdout --

	* The control plane node must be running for this command

	  To start a cluster, run: "minikube start -p force-systemd-env-769000"

-- /stdout --

docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-arm64 -p force-systemd-env-769000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 89

docker_test.go:166: *** TestForceSystemdEnv FAILED at 2023-10-03 17:34:52.877289 -0700 PDT m=+1892.100208084

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-env-769000 -n force-systemd-env-769000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-env-769000 -n force-systemd-env-769000: exit status 7 (33.781167ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "force-systemd-env-769000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "force-systemd-env-769000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p force-systemd-env-769000

--- FAIL: TestForceSystemdEnv (10.62s)

=== RUN   TestFunctional/parallel/ServiceCmdConnect

=== PAUSE TestFunctional/parallel/ServiceCmdConnect

=== CONT  TestFunctional/parallel/ServiceCmdConnect

functional_test.go:1626: (dbg) Run:  kubectl --context functional-488000 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8

functional_test.go:1634: (dbg) Run:  kubectl --context functional-488000 expose deployment hello-node-connect --type=NodePort --port=8080

functional_test.go:1639: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...

helpers_test.go:344: "hello-node-connect-7799dfb7c6-nzszr" [edc365f6-d551-4665-af2f-225bc6837e9e] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])

helpers_test.go:344: "hello-node-connect-7799dfb7c6-nzszr" [edc365f6-d551-4665-af2f-225bc6837e9e] Running / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])

functional_test.go:1639: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 12.008402875s

functional_test.go:1648: (dbg) Run:  out/minikube-darwin-arm64 -p functional-488000 service hello-node-connect --url

functional_test.go:1654: found endpoint for hello-node-connect: http://192.168.105.4:30271

functional_test.go:1660: error fetching http://192.168.105.4:30271: Get "http://192.168.105.4:30271": dial tcp 192.168.105.4:30271: connect: connection refused

functional_test.go:1660: error fetching http://192.168.105.4:30271: Get "http://192.168.105.4:30271": dial tcp 192.168.105.4:30271: connect: connection refused

functional_test.go:1660: error fetching http://192.168.105.4:30271: Get "http://192.168.105.4:30271": dial tcp 192.168.105.4:30271: connect: connection refused

functional_test.go:1660: error fetching http://192.168.105.4:30271: Get "http://192.168.105.4:30271": dial tcp 192.168.105.4:30271: connect: connection refused

E1003 17:26:05.563399    1447 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/addons-585000/client.crt: no such file or directory

functional_test.go:1660: error fetching http://192.168.105.4:30271: Get "http://192.168.105.4:30271": dial tcp 192.168.105.4:30271: connect: connection refused

functional_test.go:1660: error fetching http://192.168.105.4:30271: Get "http://192.168.105.4:30271": dial tcp 192.168.105.4:30271: connect: connection refused

functional_test.go:1660: error fetching http://192.168.105.4:30271: Get "http://192.168.105.4:30271": dial tcp 192.168.105.4:30271: connect: connection refused

functional_test.go:1660: error fetching http://192.168.105.4:30271: Get "http://192.168.105.4:30271": dial tcp 192.168.105.4:30271: connect: connection refused

functional_test.go:1680: failed to fetch http://192.168.105.4:30271: Get "http://192.168.105.4:30271": dial tcp 192.168.105.4:30271: connect: connection refused

functional_test.go:1597: service test failed - dumping debug information

functional_test.go:1598: -----------------------service failure post-mortem--------------------------------

functional_test.go:1601: (dbg) Run:  kubectl --context functional-488000 describe po hello-node-connect

functional_test.go:1605: hello-node pod describe:

Name:             hello-node-connect-7799dfb7c6-nzszr

Namespace:        default

Priority:         0

Service Account:  default

Node:             functional-488000/192.168.105.4

Start Time:       Tue, 03 Oct 2023 17:25:48 -0700

Labels:           app=hello-node-connect

pod-template-hash=7799dfb7c6

Annotations:      <none>

Status:           Running

IP:               10.244.0.8

IPs:

IP:           10.244.0.8

Controlled By:  ReplicaSet/hello-node-connect-7799dfb7c6

Containers:

echoserver-arm:

Container ID:   docker://eee59ec12de82005d72b576162cfd1555f6e7abd6052bbe8055ade7b753afe53

Image:          registry.k8s.io/echoserver-arm:1.8

Image ID:       docker-pullable://registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5

Port:           <none>

Host Port:      <none>

State:          Waiting

Reason:       CrashLoopBackOff

Last State:     Terminated

Reason:       Error

Exit Code:    1

Started:      Tue, 03 Oct 2023 17:26:10 -0700

Finished:     Tue, 03 Oct 2023 17:26:10 -0700

Ready:          False

Restart Count:  2

Environment:    <none>

Mounts:

/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-5xbnd (ro)

Conditions:

Type              Status

Initialized       True 

Ready             False 

ContainersReady   False 

PodScheduled      True 

Volumes:

kube-api-access-5xbnd:

Type:                    Projected (a volume that contains injected data from multiple sources)

TokenExpirationSeconds:  3607

ConfigMapName:           kube-root-ca.crt

ConfigMapOptional:       <nil>

DownwardAPI:             true

QoS Class:                   BestEffort

Node-Selectors:              <none>

Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

Events:

Type     Reason     Age                From               Message

----     ------     ----               ----               -------

Normal   Scheduled  40s                default-scheduler  Successfully assigned default/hello-node-connect-7799dfb7c6-nzszr to functional-488000

Normal   Pulling    40s                kubelet            Pulling image "registry.k8s.io/echoserver-arm:1.8"

Normal   Pulled     36s                kubelet            Successfully pulled image "registry.k8s.io/echoserver-arm:1.8" in 4.289s (4.289s including waiting)

Normal   Created    18s (x3 over 35s)  kubelet            Created container echoserver-arm

Normal   Started    18s (x3 over 35s)  kubelet            Started container echoserver-arm

Normal   Pulled     18s (x2 over 35s)  kubelet            Container image "registry.k8s.io/echoserver-arm:1.8" already present on machine

Warning  BackOff    7s (x4 over 34s)   kubelet            Back-off restarting failed container echoserver-arm in pod hello-node-connect-7799dfb7c6-nzszr_default(edc365f6-d551-4665-af2f-225bc6837e9e)

functional_test.go:1607: (dbg) Run:  kubectl --context functional-488000 logs -l app=hello-node-connect

functional_test.go:1611: hello-node logs:

exec /usr/sbin/nginx: exec format error

functional_test.go:1613: (dbg) Run:  kubectl --context functional-488000 describe svc hello-node-connect

functional_test.go:1617: hello-node svc describe:

Name:                     hello-node-connect

Namespace:                default

Labels:                   app=hello-node-connect

Annotations:              <none>

Selector:                 app=hello-node-connect

Type:                     NodePort

IP Family Policy:         SingleStack

IP Families:              IPv4

IP:                       10.103.206.87

IPs:                      10.103.206.87

Port:                     <unset>  8080/TCP

TargetPort:               8080/TCP

NodePort:                 <unset>  30271/TCP

Endpoints:                

Session Affinity:         None

External Traffic Policy:  Cluster

Events:                   <none>

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p functional-488000 -n functional-488000

helpers_test.go:244: <<< TestFunctional/parallel/ServiceCmdConnect FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestFunctional/parallel/ServiceCmdConnect]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p functional-488000 logs -n 25

helpers_test.go:252: TestFunctional/parallel/ServiceCmdConnect logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |-----------|----------------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	|  Command  |                                                         Args                                                         |      Profile      |  User   | Version |     Start Time      |      End Time       |

	|-----------|----------------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	| ssh       | functional-488000 ssh findmnt                                                                                        | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT |                     |

	|           | -T /mount-9p | grep 9p                                                                                               |                   |         |         |                     |                     |

	| mount     | -p functional-488000                                                                                                 | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT |                     |

	|           | /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdspecific-port2794950848/001:/mount-9p |                   |         |         |                     |                     |

	|           | --alsologtostderr -v=1 --port 46464                                                                                  |                   |         |         |                     |                     |

	| ssh       | functional-488000 ssh findmnt                                                                                        | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT | 03 Oct 23 17:26 PDT |

	|           | -T /mount-9p | grep 9p                                                                                               |                   |         |         |                     |                     |

	| ssh       | functional-488000 ssh -- ls                                                                                          | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT | 03 Oct 23 17:26 PDT |

	|           | -la /mount-9p                                                                                                        |                   |         |         |                     |                     |

	| ssh       | functional-488000 ssh sudo                                                                                           | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT |                     |

	|           | umount -f /mount-9p                                                                                                  |                   |         |         |                     |                     |

	| mount     | -p functional-488000                                                                                                 | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT |                     |

	|           | /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2409114035/001:/mount1   |                   |         |         |                     |                     |

	|           | --alsologtostderr -v=1                                                                                               |                   |         |         |                     |                     |

	| mount     | -p functional-488000                                                                                                 | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT |                     |

	|           | /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2409114035/001:/mount3   |                   |         |         |                     |                     |

	|           | --alsologtostderr -v=1                                                                                               |                   |         |         |                     |                     |

	| mount     | -p functional-488000                                                                                                 | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT |                     |

	|           | /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2409114035/001:/mount2   |                   |         |         |                     |                     |

	|           | --alsologtostderr -v=1                                                                                               |                   |         |         |                     |                     |

	| ssh       | functional-488000 ssh findmnt                                                                                        | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT |                     |

	|           | -T /mount1                                                                                                           |                   |         |         |                     |                     |

	| ssh       | functional-488000 ssh findmnt                                                                                        | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT | 03 Oct 23 17:26 PDT |

	|           | -T /mount1                                                                                                           |                   |         |         |                     |                     |

	| ssh       | functional-488000 ssh findmnt                                                                                        | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT |                     |

	|           | -T /mount2                                                                                                           |                   |         |         |                     |                     |

	| ssh       | functional-488000 ssh findmnt                                                                                        | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT | 03 Oct 23 17:26 PDT |

	|           | -T /mount1                                                                                                           |                   |         |         |                     |                     |

	| ssh       | functional-488000 ssh findmnt                                                                                        | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT |                     |

	|           | -T /mount2                                                                                                           |                   |         |         |                     |                     |

	| ssh       | functional-488000 ssh findmnt                                                                                        | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT | 03 Oct 23 17:26 PDT |

	|           | -T /mount1                                                                                                           |                   |         |         |                     |                     |

	| ssh       | functional-488000 ssh findmnt                                                                                        | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT |                     |

	|           | -T /mount2                                                                                                           |                   |         |         |                     |                     |

	| ssh       | functional-488000 ssh findmnt                                                                                        | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT | 03 Oct 23 17:26 PDT |

	|           | -T /mount1                                                                                                           |                   |         |         |                     |                     |

	| ssh       | functional-488000 ssh findmnt                                                                                        | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT |                     |

	|           | -T /mount2                                                                                                           |                   |         |         |                     |                     |

	| ssh       | functional-488000 ssh findmnt                                                                                        | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT | 03 Oct 23 17:26 PDT |

	|           | -T /mount1                                                                                                           |                   |         |         |                     |                     |

	| ssh       | functional-488000 ssh findmnt                                                                                        | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT |                     |

	|           | -T /mount2                                                                                                           |                   |         |         |                     |                     |

	| ssh       | functional-488000 ssh findmnt                                                                                        | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT | 03 Oct 23 17:26 PDT |

	|           | -T /mount1                                                                                                           |                   |         |         |                     |                     |

	| ssh       | functional-488000 ssh findmnt                                                                                        | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT |                     |

	|           | -T /mount2                                                                                                           |                   |         |         |                     |                     |

	| start     | -p functional-488000                                                                                                 | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT |                     |

	|           | --dry-run --memory                                                                                                   |                   |         |         |                     |                     |

	|           | 250MB --alsologtostderr                                                                                              |                   |         |         |                     |                     |

	|           | --driver=qemu2                                                                                                       |                   |         |         |                     |                     |

	| start     | -p functional-488000                                                                                                 | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT |                     |

	|           | --dry-run --memory                                                                                                   |                   |         |         |                     |                     |

	|           | 250MB --alsologtostderr                                                                                              |                   |         |         |                     |                     |

	|           | --driver=qemu2                                                                                                       |                   |         |         |                     |                     |

	| start     | -p functional-488000 --dry-run                                                                                       | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT |                     |

	|           | --alsologtostderr -v=1                                                                                               |                   |         |         |                     |                     |

	|           | --driver=qemu2                                                                                                       |                   |         |         |                     |                     |

	| dashboard | --url --port 36195                                                                                                   | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT |                     |

	|           | -p functional-488000                                                                                                 |                   |         |         |                     |                     |

	|           | --alsologtostderr -v=1                                                                                               |                   |         |         |                     |                     |

	|-----------|----------------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2023/10/03 17:26:25

	Running on machine: MacOS-M1-Agent-2

	Binary: Built with gc go1.21.1 for darwin/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1003 17:26:25.616653    2628 out.go:296] Setting OutFile to fd 1 ...

	I1003 17:26:25.616783    2628 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1003 17:26:25.616786    2628 out.go:309] Setting ErrFile to fd 2...

	I1003 17:26:25.616789    2628 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1003 17:26:25.616921    2628 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17345-986/.minikube/bin

	I1003 17:26:25.617991    2628 out.go:303] Setting JSON to false

	I1003 17:26:25.634203    2628 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":1559,"bootTime":1696377626,"procs":454,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.0","kernelVersion":"23.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W1003 17:26:25.634275    2628 start.go:136] gopshost.Virtualization returned error: not implemented yet

	I1003 17:26:25.637920    2628 out.go:177] * [functional-488000] minikube v1.31.2 on Darwin 14.0 (arm64)

	I1003 17:26:25.644986    2628 out.go:177]   - MINIKUBE_LOCATION=17345

	I1003 17:26:25.647888    2628 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17345-986/kubeconfig

	I1003 17:26:25.645096    2628 notify.go:220] Checking for updates...

	I1003 17:26:25.653981    2628 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I1003 17:26:25.655323    2628 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1003 17:26:25.657998    2628 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17345-986/.minikube

	I1003 17:26:25.660979    2628 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1003 17:26:25.664319    2628 config.go:182] Loaded profile config "functional-488000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 17:26:25.664559    2628 driver.go:373] Setting default libvirt URI to qemu:///system

	I1003 17:26:25.668949    2628 out.go:177] * Using the qemu2 driver based on existing profile

	I1003 17:26:25.675767    2628 start.go:298] selected driver: qemu2

	I1003 17:26:25.675773    2628 start.go:902] validating driver "qemu2" against &{Name:functional-488000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf

ig:{KubernetesVersion:v1.28.2 ClusterName:functional-488000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false E

xtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I1003 17:26:25.675821    2628 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1003 17:26:25.677953    2628 cni.go:84] Creating CNI manager for ""

	I1003 17:26:25.677966    2628 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1003 17:26:25.677970    2628 start_flags.go:321] config:

	{Name:functional-488000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.2 ClusterName:functional-488000 Namespace:default A

PIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-

host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I1003 17:26:25.688985    2628 out.go:177] * dry-run validation complete!

	* 

	* ==> Docker <==

	* -- Journal begins at Wed 2023-10-04 00:23:39 UTC, ends at Wed 2023-10-04 00:26:28 UTC. --

	Oct 04 00:26:12 functional-488000 dockerd[6665]: time="2023-10-04T00:26:12.377169528Z" level=warning msg="cleaning up after shim disconnected" id=ac4df190eca9d6a9e5c4eb9d887697137f8cb5f92f96435de54a3a48b02cf519 namespace=moby

	Oct 04 00:26:12 functional-488000 dockerd[6665]: time="2023-10-04T00:26:12.377173861Z" level=info msg="cleaning up dead shim" namespace=moby

	Oct 04 00:26:13 functional-488000 dockerd[6659]: time="2023-10-04T00:26:13.542103498Z" level=info msg="ignoring event" container=085501f08b95a945940acc7351b2bbd367d5741bb8d69ac0810163844a8ee2cb module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Oct 04 00:26:13 functional-488000 dockerd[6665]: time="2023-10-04T00:26:13.542570073Z" level=info msg="shim disconnected" id=085501f08b95a945940acc7351b2bbd367d5741bb8d69ac0810163844a8ee2cb namespace=moby

	Oct 04 00:26:13 functional-488000 dockerd[6665]: time="2023-10-04T00:26:13.542596364Z" level=warning msg="cleaning up after shim disconnected" id=085501f08b95a945940acc7351b2bbd367d5741bb8d69ac0810163844a8ee2cb namespace=moby

	Oct 04 00:26:13 functional-488000 dockerd[6665]: time="2023-10-04T00:26:13.542600364Z" level=info msg="cleaning up dead shim" namespace=moby

	Oct 04 00:26:18 functional-488000 dockerd[6665]: time="2023-10-04T00:26:18.067437770Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Oct 04 00:26:18 functional-488000 dockerd[6665]: time="2023-10-04T00:26:18.067470853Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 04 00:26:18 functional-488000 dockerd[6665]: time="2023-10-04T00:26:18.067482645Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Oct 04 00:26:18 functional-488000 dockerd[6665]: time="2023-10-04T00:26:18.067488936Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 04 00:26:18 functional-488000 dockerd[6665]: time="2023-10-04T00:26:18.093080806Z" level=info msg="shim disconnected" id=6d29eb0846b0dc90b4fb3db1528deabd56c6f69e8d7e8f0afc20536b92d974c1 namespace=moby

	Oct 04 00:26:18 functional-488000 dockerd[6665]: time="2023-10-04T00:26:18.093108681Z" level=warning msg="cleaning up after shim disconnected" id=6d29eb0846b0dc90b4fb3db1528deabd56c6f69e8d7e8f0afc20536b92d974c1 namespace=moby

	Oct 04 00:26:18 functional-488000 dockerd[6665]: time="2023-10-04T00:26:18.093113514Z" level=info msg="cleaning up dead shim" namespace=moby

	Oct 04 00:26:18 functional-488000 dockerd[6659]: time="2023-10-04T00:26:18.093188263Z" level=info msg="ignoring event" container=6d29eb0846b0dc90b4fb3db1528deabd56c6f69e8d7e8f0afc20536b92d974c1 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Oct 04 00:26:26 functional-488000 dockerd[6665]: time="2023-10-04T00:26:26.586220880Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Oct 04 00:26:26 functional-488000 dockerd[6665]: time="2023-10-04T00:26:26.586470877Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 04 00:26:26 functional-488000 dockerd[6665]: time="2023-10-04T00:26:26.586522001Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Oct 04 00:26:26 functional-488000 dockerd[6665]: time="2023-10-04T00:26:26.586547626Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 04 00:26:26 functional-488000 dockerd[6665]: time="2023-10-04T00:26:26.602215879Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Oct 04 00:26:26 functional-488000 dockerd[6665]: time="2023-10-04T00:26:26.602297420Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 04 00:26:26 functional-488000 dockerd[6665]: time="2023-10-04T00:26:26.602326211Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Oct 04 00:26:26 functional-488000 dockerd[6665]: time="2023-10-04T00:26:26.602349002Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 04 00:26:26 functional-488000 cri-dockerd[6925]: time="2023-10-04T00:26:26Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/28a8488d7901b995dec27a37e4cdc0a23484ab2753a96d08821e0d47bb26ffad/resolv.conf as [nameserver 10.96.0.10 search kubernetes-dashboard.svc.cluster.local svc.cluster.local cluster.local options ndots:5]"

	Oct 04 00:26:26 functional-488000 cri-dockerd[6925]: time="2023-10-04T00:26:26Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/37609cf9038b9952b46acd601efc071dff86b5d871c936d5a27b0adf6d0c3895/resolv.conf as [nameserver 10.96.0.10 search kubernetes-dashboard.svc.cluster.local svc.cluster.local cluster.local options ndots:5]"

	Oct 04 00:26:26 functional-488000 dockerd[6659]: time="2023-10-04T00:26:26.957223514Z" level=warning msg="reference for unknown type: " digest="sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93" remote="docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93"

	* 

	* ==> container status <==

	* CONTAINER           IMAGE                                                                                                 CREATED              STATE               NAME                      ATTEMPT             POD ID              POD

	6d29eb0846b0d       72565bf5bbedf                                                                                         10 seconds ago       Exited              echoserver-arm            2                   54ebc8bc55b9c       hello-node-759d89bdcc-w8tqc

	ac4df190eca9d       gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e   16 seconds ago       Exited              mount-munger              0                   085501f08b95a       busybox-mount

	eee59ec12de82       72565bf5bbedf                                                                                         18 seconds ago       Exited              echoserver-arm            2                   84b91255fa197       hello-node-connect-7799dfb7c6-nzszr

	9c731dc7edee9       nginx@sha256:32da30332506740a2f7c34d5dc70467b7f14ec67d912703568daff790ab3f755                         33 seconds ago       Running             myfrontend                0                   030555e4c8df3       sp-pod

	49edc58270796       nginx@sha256:4c93a3bd8bf95412889dd84213570102176b6052d88bb828eaf449c56aca55ef                         47 seconds ago       Running             nginx                     0                   30740eb316856       nginx-svc

	330498b12539f       97e04611ad434                                                                                         About a minute ago   Running             coredns                   2                   9d03114393694       coredns-5dd5756b68-hb78x

	2893cf6a6b373       ba04bb24b9575                                                                                         About a minute ago   Running             storage-provisioner       1                   8c4e9408f4961       storage-provisioner

	9f05e1e6df36d       7da62c127fc0f                                                                                         About a minute ago   Running             kube-proxy                2                   427bc8904deba       kube-proxy-9zqjs

	6f0962fc282a5       64fc40cee3716                                                                                         About a minute ago   Running             kube-scheduler            2                   de7a9a2c639d8       kube-scheduler-functional-488000

	0a51a1e9907b9       9cdd6470f48c8                                                                                         About a minute ago   Running             etcd                      2                   8d379c382e38f       etcd-functional-488000

	684a676839726       89d57b83c1786                                                                                         About a minute ago   Running             kube-controller-manager   2                   48988aff410d5       kube-controller-manager-functional-488000

	46a3c60ab8b36       30bb499447fe1                                                                                         About a minute ago   Running             kube-apiserver            0                   7e52353c3129c       kube-apiserver-functional-488000

	15cf0e45db248       ba04bb24b9575                                                                                         About a minute ago   Exited              storage-provisioner       0                   a9700eae13bff       storage-provisioner

	6821a487dcbfb       97e04611ad434                                                                                         About a minute ago   Exited              coredns                   1                   1bfdb3ce9ffb4       coredns-5dd5756b68-hb78x

	f552969b825a2       64fc40cee3716                                                                                         2 minutes ago        Exited              kube-scheduler            1                   825f8d926a22d       kube-scheduler-functional-488000

	b15e1c0913c9b       7da62c127fc0f                                                                                         2 minutes ago        Exited              kube-proxy                1                   aef5f912d5476       kube-proxy-9zqjs

	6e23bee0f3942       9cdd6470f48c8                                                                                         2 minutes ago        Exited              etcd                      1                   2756fbccad3ec       etcd-functional-488000

	8a0becd5aeb11       89d57b83c1786                                                                                         2 minutes ago        Exited              kube-controller-manager   1                   77e6fde40619a       kube-controller-manager-functional-488000

	* 

	* ==> coredns [330498b12539] <==

	* .:53

	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b

	CoreDNS-1.10.1

	linux/arm64, go1.20, 055b2c3

	[INFO] 127.0.0.1:47766 - 56091 "HINFO IN 9101944474436276597.2269558655315545093. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.005079164s

	[INFO] 10.244.0.1:5889 - 53710 "A IN nginx-svc.default.svc.cluster.local. udp 64 false 4096" NOERROR qr,aa,rd 104 0.000103246s

	[INFO] 10.244.0.1:51820 - 48994 "AAAA IN nginx-svc.default.svc.cluster.local. udp 53 false 512" NOERROR qr,aa,rd 146 0.000096121s

	[INFO] 10.244.0.1:4099 - 50323 "SVCB IN _dns.resolver.arpa. udp 36 false 512" NXDOMAIN qr,rd,ra 116 0.001018291s

	[INFO] 10.244.0.1:40983 - 2650 "A IN nginx-svc.default.svc.cluster.local. udp 53 false 512" NOERROR qr,aa,rd 104 0.000128537s

	[INFO] 10.244.0.1:14401 - 12803 "A IN nginx-svc.default.svc.cluster.local. udp 64 false 1232" NOERROR qr,aa,rd 104 0.000065122s

	[INFO] 10.244.0.1:5849 - 10276 "AAAA IN nginx-svc.default.svc.cluster.local. udp 64 false 1232" NOERROR qr,aa,rd 146 0.000088538s

	* 

	* ==> coredns [6821a487dcbf] <==

	* [INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server

	.:53

	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b

	CoreDNS-1.10.1

	linux/arm64, go1.20, 055b2c3

	[INFO] 127.0.0.1:33693 - 10144 "HINFO IN 4777986893150462222.2507666859569676209. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.004221019s

	[INFO] SIGTERM: Shutting down servers then terminating

	[INFO] plugin/health: Going into lameduck mode for 5s

	* 

	* ==> describe nodes <==

	* Name:               functional-488000

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=functional-488000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=d9526fa6c1a1bb1b20f95e15606f1308e308d84a

	                    minikube.k8s.io/name=functional-488000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2023_10_03T17_23_56_0700

	                    minikube.k8s.io/version=v1.31.2

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 04 Oct 2023 00:23:53 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  functional-488000

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 04 Oct 2023 00:26:23 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 04 Oct 2023 00:26:13 +0000   Wed, 04 Oct 2023 00:23:53 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 04 Oct 2023 00:26:13 +0000   Wed, 04 Oct 2023 00:23:53 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 04 Oct 2023 00:26:13 +0000   Wed, 04 Oct 2023 00:23:53 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 04 Oct 2023 00:26:13 +0000   Wed, 04 Oct 2023 00:24:00 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.105.4

	  Hostname:    functional-488000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17784760Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3905012Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17784760Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3905012Ki

	  pods:               110

	System Info:

	  Machine ID:                 83731bd4c6d145e2ae495e64303694d6

	  System UUID:                83731bd4c6d145e2ae495e64303694d6

	  Boot ID:                    05a53b02-4e4e-4789-aec0-a891727ae8e2

	  Kernel Version:             5.10.57

	  OS Image:                   Buildroot 2021.02.12

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  docker://24.0.6

	  Kubelet Version:            v1.28.2

	  Kube-Proxy Version:         v1.28.2

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (13 in total)

	  Namespace                   Name                                          CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                          ------------  ----------  ---------------  -------------  ---

	  default                     hello-node-759d89bdcc-w8tqc                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         26s

	  default                     hello-node-connect-7799dfb7c6-nzszr           0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         40s

	  default                     nginx-svc                                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         51s

	  default                     sp-pod                                        0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         34s

	  kube-system                 coredns-5dd5756b68-hb78x                      100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (1%!)(MISSING)        170Mi (4%!)(MISSING)     2m19s

	  kube-system                 etcd-functional-488000                        100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (2%!)(MISSING)       0 (0%!)(MISSING)         2m32s

	  kube-system                 kube-apiserver-functional-488000              250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         76s

	  kube-system                 kube-controller-manager-functional-488000     200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m32s

	  kube-system                 kube-proxy-9zqjs                              0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m19s

	  kube-system                 kube-scheduler-functional-488000              100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m32s

	  kube-system                 storage-provisioner                           0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         116s

	  kubernetes-dashboard        dashboard-metrics-scraper-7fd5cb4ddc-fms84    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2s

	  kubernetes-dashboard        kubernetes-dashboard-8694d4445c-45lvq         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  0 (0%!)(MISSING)

	  memory             170Mi (4%!)(MISSING)  170Mi (4%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                From             Message

	  ----    ------                   ----               ----             -------

	  Normal  Starting                 2m18s              kube-proxy       

	  Normal  Starting                 76s                kube-proxy       

	  Normal  Starting                 116s               kube-proxy       

	  Normal  Starting                 2m32s              kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  2m32s              kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  2m32s              kubelet          Node functional-488000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    2m32s              kubelet          Node functional-488000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     2m32s              kubelet          Node functional-488000 status is now: NodeHasSufficientPID

	  Normal  NodeReady                2m28s              kubelet          Node functional-488000 status is now: NodeReady

	  Normal  RegisteredNode           2m20s              node-controller  Node functional-488000 event: Registered Node functional-488000 in Controller

	  Normal  RegisteredNode           105s               node-controller  Node functional-488000 event: Registered Node functional-488000 in Controller

	  Normal  Starting                 80s                kubelet          Starting kubelet.

	  Normal  NodeHasSufficientMemory  79s (x8 over 79s)  kubelet          Node functional-488000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    79s (x8 over 79s)  kubelet          Node functional-488000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     79s (x7 over 79s)  kubelet          Node functional-488000 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  79s                kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           64s                node-controller  Node functional-488000 event: Registered Node functional-488000 in Controller

	* 

	* ==> dmesg <==

	* [  +0.131866] systemd-fstab-generator[3736]: Ignoring "noauto" for root device

	[  +0.086160] systemd-fstab-generator[3747]: Ignoring "noauto" for root device

	[  +0.086763] systemd-fstab-generator[3760]: Ignoring "noauto" for root device

	[  +5.233037] kauditd_printk_skb: 21 callbacks suppressed

	[  +6.312022] systemd-fstab-generator[4260]: Ignoring "noauto" for root device

	[  +0.063103] systemd-fstab-generator[4271]: Ignoring "noauto" for root device

	[  +0.065520] systemd-fstab-generator[4282]: Ignoring "noauto" for root device

	[  +0.077770] systemd-fstab-generator[4342]: Ignoring "noauto" for root device

	[  +0.073448] systemd-fstab-generator[4374]: Ignoring "noauto" for root device

	[  +4.668218] kauditd_printk_skb: 29 callbacks suppressed

	[ +26.474257] systemd-fstab-generator[6199]: Ignoring "noauto" for root device

	[  +0.124398] systemd-fstab-generator[6231]: Ignoring "noauto" for root device

	[  +0.079412] systemd-fstab-generator[6242]: Ignoring "noauto" for root device

	[  +0.088904] systemd-fstab-generator[6255]: Ignoring "noauto" for root device

	[Oct 4 00:25] systemd-fstab-generator[6811]: Ignoring "noauto" for root device

	[  +0.062853] systemd-fstab-generator[6822]: Ignoring "noauto" for root device

	[  +0.070776] systemd-fstab-generator[6833]: Ignoring "noauto" for root device

	[  +0.068457] systemd-fstab-generator[6844]: Ignoring "noauto" for root device

	[  +0.083860] systemd-fstab-generator[6918]: Ignoring "noauto" for root device

	[  +1.285375] systemd-fstab-generator[7172]: Ignoring "noauto" for root device

	[  +3.570291] kauditd_printk_skb: 29 callbacks suppressed

	[ +25.780359] kauditd_printk_skb: 11 callbacks suppressed

	[  +5.006395] kauditd_printk_skb: 1 callbacks suppressed

	[  +5.849986] TCP: eth0: Driver has suspect GRO implementation, TCP performance may be compromised.

	[Oct 4 00:26] kauditd_printk_skb: 1 callbacks suppressed

	* 

	* ==> etcd [0a51a1e9907b] <==

	* {"level":"info","ts":"2023-10-04T00:25:09.912964Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap","max":5,"interval":"30s"}

	{"level":"info","ts":"2023-10-04T00:25:09.912989Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/wal","suffix":"wal","max":5,"interval":"30s"}

	{"level":"info","ts":"2023-10-04T00:25:09.913064Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 switched to configuration voters=(527499358918876438)"}

	{"level":"info","ts":"2023-10-04T00:25:09.913134Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"80e92d98c466b02f","local-member-id":"7520ddf439b1d16","added-peer-id":"7520ddf439b1d16","added-peer-peer-urls":["https://192.168.105.4:2380"]}

	{"level":"info","ts":"2023-10-04T00:25:09.913194Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"80e92d98c466b02f","local-member-id":"7520ddf439b1d16","cluster-version":"3.5"}

	{"level":"info","ts":"2023-10-04T00:25:09.913229Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2023-10-04T00:25:09.913765Z","caller":"embed/etcd.go:726","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}

	{"level":"info","ts":"2023-10-04T00:25:09.926007Z","caller":"embed/etcd.go:597","msg":"serving peer traffic","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2023-10-04T00:25:09.926061Z","caller":"embed/etcd.go:569","msg":"cmux::serve","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2023-10-04T00:25:09.926433Z","caller":"embed/etcd.go:278","msg":"now serving peer/client/metrics","local-member-id":"7520ddf439b1d16","initial-advertise-peer-urls":["https://192.168.105.4:2380"],"listen-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.105.4:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}

	{"level":"info","ts":"2023-10-04T00:25:09.926479Z","caller":"embed/etcd.go:855","msg":"serving metrics","address":"http://127.0.0.1:2381"}

	{"level":"info","ts":"2023-10-04T00:25:11.277462Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 is starting a new election at term 3"}

	{"level":"info","ts":"2023-10-04T00:25:11.277595Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became pre-candidate at term 3"}

	{"level":"info","ts":"2023-10-04T00:25:11.277666Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgPreVoteResp from 7520ddf439b1d16 at term 3"}

	{"level":"info","ts":"2023-10-04T00:25:11.277702Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became candidate at term 4"}

	{"level":"info","ts":"2023-10-04T00:25:11.277723Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgVoteResp from 7520ddf439b1d16 at term 4"}

	{"level":"info","ts":"2023-10-04T00:25:11.277748Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became leader at term 4"}

	{"level":"info","ts":"2023-10-04T00:25:11.277785Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 7520ddf439b1d16 elected leader 7520ddf439b1d16 at term 4"}

	{"level":"info","ts":"2023-10-04T00:25:11.280878Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"7520ddf439b1d16","local-member-attributes":"{Name:functional-488000 ClientURLs:[https://192.168.105.4:2379]}","request-path":"/0/members/7520ddf439b1d16/attributes","cluster-id":"80e92d98c466b02f","publish-timeout":"7s"}

	{"level":"info","ts":"2023-10-04T00:25:11.28093Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-10-04T00:25:11.280882Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-10-04T00:25:11.283214Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.4:2379"}

	{"level":"info","ts":"2023-10-04T00:25:11.283297Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2023-10-04T00:25:11.308624Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2023-10-04T00:25:11.308787Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	* 

	* ==> etcd [6e23bee0f394] <==

	* {"level":"info","ts":"2023-10-04T00:24:29.225487Z","caller":"embed/etcd.go:855","msg":"serving metrics","address":"http://127.0.0.1:2381"}

	{"level":"info","ts":"2023-10-04T00:24:30.30284Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 is starting a new election at term 2"}

	{"level":"info","ts":"2023-10-04T00:24:30.302983Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became pre-candidate at term 2"}

	{"level":"info","ts":"2023-10-04T00:24:30.303032Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgPreVoteResp from 7520ddf439b1d16 at term 2"}

	{"level":"info","ts":"2023-10-04T00:24:30.30307Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became candidate at term 3"}

	{"level":"info","ts":"2023-10-04T00:24:30.303088Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgVoteResp from 7520ddf439b1d16 at term 3"}

	{"level":"info","ts":"2023-10-04T00:24:30.303134Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became leader at term 3"}

	{"level":"info","ts":"2023-10-04T00:24:30.303183Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 7520ddf439b1d16 elected leader 7520ddf439b1d16 at term 3"}

	{"level":"info","ts":"2023-10-04T00:24:30.308893Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"7520ddf439b1d16","local-member-attributes":"{Name:functional-488000 ClientURLs:[https://192.168.105.4:2379]}","request-path":"/0/members/7520ddf439b1d16/attributes","cluster-id":"80e92d98c466b02f","publish-timeout":"7s"}

	{"level":"info","ts":"2023-10-04T00:24:30.309375Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-10-04T00:24:30.309696Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-10-04T00:24:30.312267Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2023-10-04T00:24:30.312337Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.4:2379"}

	{"level":"info","ts":"2023-10-04T00:24:30.312458Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2023-10-04T00:24:30.312482Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2023-10-04T00:24:55.983466Z","caller":"osutil/interrupt_unix.go:64","msg":"received signal; shutting down","signal":"terminated"}

	{"level":"info","ts":"2023-10-04T00:24:55.983497Z","caller":"embed/etcd.go:376","msg":"closing etcd server","name":"functional-488000","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"]}

	{"level":"warn","ts":"2023-10-04T00:24:55.983532Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}

	{"level":"warn","ts":"2023-10-04T00:24:55.983572Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}

	{"level":"warn","ts":"2023-10-04T00:24:55.992057Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 192.168.105.4:2379: use of closed network connection"}

	{"level":"warn","ts":"2023-10-04T00:24:55.992074Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 192.168.105.4:2379: use of closed network connection"}

	{"level":"info","ts":"2023-10-04T00:24:55.992095Z","caller":"etcdserver/server.go:1465","msg":"skipped leadership transfer for single voting member cluster","local-member-id":"7520ddf439b1d16","current-leader-member-id":"7520ddf439b1d16"}

	{"level":"info","ts":"2023-10-04T00:24:55.993313Z","caller":"embed/etcd.go:579","msg":"stopping serving peer traffic","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2023-10-04T00:24:55.993348Z","caller":"embed/etcd.go:584","msg":"stopped serving peer traffic","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2023-10-04T00:24:55.993357Z","caller":"embed/etcd.go:378","msg":"closed etcd server","name":"functional-488000","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"]}

	* 

	* ==> kernel <==

	*  00:26:28 up 2 min,  0 users,  load average: 0.62, 0.32, 0.12

	Linux functional-488000 5.10.57 #1 SMP PREEMPT Mon Sep 18 20:10:16 UTC 2023 aarch64 GNU/Linux

	PRETTY_NAME="Buildroot 2021.02.12"

	* 

	* ==> kube-apiserver [46a3c60ab8b3] <==

	* I1004 00:25:11.960537       1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller

	I1004 00:25:11.960547       1 shared_informer.go:318] Caches are synced for configmaps

	I1004 00:25:11.960559       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller

	E1004 00:25:11.962429       1 controller.go:97] Error removing old endpoints from kubernetes service: no API server IP addresses were listed in storage, refusing to erase all endpoints for the kubernetes Service

	I1004 00:25:11.968530       1 shared_informer.go:318] Caches are synced for crd-autoregister

	I1004 00:25:11.968543       1 aggregator.go:166] initial CRD sync complete...

	I1004 00:25:11.968546       1 autoregister_controller.go:141] Starting autoregister controller

	I1004 00:25:11.968574       1 cache.go:32] Waiting for caches to sync for autoregister controller

	I1004 00:25:11.968580       1 cache.go:39] Caches are synced for autoregister controller

	I1004 00:25:12.861122       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.

	I1004 00:25:12.990647       1 controller.go:624] quota admission added evaluator for: serviceaccounts

	I1004 00:25:12.994154       1 controller.go:624] quota admission added evaluator for: deployments.apps

	I1004 00:25:13.005064       1 controller.go:624] quota admission added evaluator for: daemonsets.apps

	I1004 00:25:13.012364       1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I1004 00:25:13.014492       1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	I1004 00:25:24.118554       1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I1004 00:25:24.127863       1 controller.go:624] quota admission added evaluator for: endpoints

	I1004 00:25:32.950191       1 alloc.go:330] "allocated clusterIPs" service="default/invalid-svc" clusterIPs={"IPv4":"10.101.236.25"}

	I1004 00:25:37.816856       1 alloc.go:330] "allocated clusterIPs" service="default/nginx-svc" clusterIPs={"IPv4":"10.106.176.75"}

	I1004 00:25:48.203609       1 controller.go:624] quota admission added evaluator for: replicasets.apps

	I1004 00:25:48.245457       1 alloc.go:330] "allocated clusterIPs" service="default/hello-node-connect" clusterIPs={"IPv4":"10.103.206.87"}

	I1004 00:26:02.608743       1 alloc.go:330] "allocated clusterIPs" service="default/hello-node" clusterIPs={"IPv4":"10.99.192.134"}

	I1004 00:26:26.138340       1 controller.go:624] quota admission added evaluator for: namespaces

	I1004 00:26:26.229368       1 alloc.go:330] "allocated clusterIPs" service="kubernetes-dashboard/kubernetes-dashboard" clusterIPs={"IPv4":"10.100.200.101"}

	I1004 00:26:26.238002       1 alloc.go:330] "allocated clusterIPs" service="kubernetes-dashboard/dashboard-metrics-scraper" clusterIPs={"IPv4":"10.100.124.72"}

	* 

	* ==> kube-controller-manager [684a67683972] <==

	* E1004 00:26:26.200487       1 replica_set.go:557] sync "kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc" failed with pods "dashboard-metrics-scraper-7fd5cb4ddc-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I1004 00:26:26.200581       1 event.go:307] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"kubernetes-dashboard-8694d4445c-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	I1004 00:26:26.200596       1 event.go:307] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"dashboard-metrics-scraper-7fd5cb4ddc-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	I1004 00:26:26.205509       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" duration="11.916802ms"

	E1004 00:26:26.205524       1 replica_set.go:557] sync "kubernetes-dashboard/kubernetes-dashboard-8694d4445c" failed with pods "kubernetes-dashboard-8694d4445c-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I1004 00:26:26.208406       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc" duration="7.905272ms"

	E1004 00:26:26.208481       1 replica_set.go:557] sync "kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc" failed with pods "dashboard-metrics-scraper-7fd5cb4ddc-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I1004 00:26:26.208416       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" duration="2.879296ms"

	E1004 00:26:26.208674       1 replica_set.go:557] sync "kubernetes-dashboard/kubernetes-dashboard-8694d4445c" failed with pods "kubernetes-dashboard-8694d4445c-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I1004 00:26:26.208429       1 event.go:307] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"kubernetes-dashboard-8694d4445c-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	I1004 00:26:26.208694       1 event.go:307] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"dashboard-metrics-scraper-7fd5cb4ddc-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	I1004 00:26:26.213785       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" duration="2.126389ms"

	E1004 00:26:26.213800       1 replica_set.go:557] sync "kubernetes-dashboard/kubernetes-dashboard-8694d4445c" failed with pods "kubernetes-dashboard-8694d4445c-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I1004 00:26:26.213880       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc" duration="2.32647ms"

	E1004 00:26:26.213888       1 replica_set.go:557] sync "kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc" failed with pods "dashboard-metrics-scraper-7fd5cb4ddc-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I1004 00:26:26.214003       1 event.go:307] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"kubernetes-dashboard-8694d4445c-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	I1004 00:26:26.214016       1 event.go:307] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"dashboard-metrics-scraper-7fd5cb4ddc-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	I1004 00:26:26.237803       1 event.go:307] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kubernetes-dashboard-8694d4445c-45lvq"

	I1004 00:26:26.255874       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" duration="21.053807ms"

	I1004 00:26:26.263064       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" duration="7.164406ms"

	I1004 00:26:26.263101       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" duration="17.042µs"

	I1004 00:26:26.263782       1 event.go:307] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: dashboard-metrics-scraper-7fd5cb4ddc-fms84"

	I1004 00:26:26.274993       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc" duration="19.017251ms"

	I1004 00:26:26.289345       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc" duration="14.312146ms"

	I1004 00:26:26.289468       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc" duration="32.541µs"

	* 

	* ==> kube-controller-manager [8a0becd5aeb1] <==

	* I1004 00:24:43.356061       1 node_lifecycle_controller.go:1071] "Controller detected that zone is now in new state" zone="" newState="Normal"

	I1004 00:24:43.355986       1 taint_manager.go:206] "Starting NoExecuteTaintManager"

	I1004 00:24:43.356041       1 event.go:307] "Event occurred" object="functional-488000" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node functional-488000 event: Registered Node functional-488000 in Controller"

	I1004 00:24:43.356300       1 taint_manager.go:211] "Sending events to api server"

	I1004 00:24:43.359500       1 shared_informer.go:318] Caches are synced for ReplicaSet

	I1004 00:24:43.359652       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="55.085µs"

	I1004 00:24:43.359707       1 shared_informer.go:318] Caches are synced for crt configmap

	I1004 00:24:43.359758       1 shared_informer.go:318] Caches are synced for endpoint

	I1004 00:24:43.359797       1 shared_informer.go:318] Caches are synced for GC

	I1004 00:24:43.359963       1 shared_informer.go:318] Caches are synced for endpoint_slice_mirroring

	I1004 00:24:43.364988       1 shared_informer.go:318] Caches are synced for daemon sets

	I1004 00:24:43.371196       1 shared_informer.go:318] Caches are synced for HPA

	I1004 00:24:43.372304       1 shared_informer.go:318] Caches are synced for cronjob

	I1004 00:24:43.373395       1 shared_informer.go:318] Caches are synced for certificate-csrsigning-kubelet-client

	I1004 00:24:43.373412       1 shared_informer.go:318] Caches are synced for certificate-csrsigning-kubelet-serving

	I1004 00:24:43.374508       1 shared_informer.go:318] Caches are synced for certificate-csrsigning-legacy-unknown

	I1004 00:24:43.374518       1 shared_informer.go:318] Caches are synced for certificate-csrsigning-kube-apiserver-client

	I1004 00:24:43.376668       1 shared_informer.go:318] Caches are synced for ReplicationController

	I1004 00:24:43.396968       1 shared_informer.go:318] Caches are synced for certificate-csrapproving

	I1004 00:24:43.449551       1 shared_informer.go:318] Caches are synced for resource quota

	I1004 00:24:43.499824       1 shared_informer.go:318] Caches are synced for resource quota

	I1004 00:24:43.551194       1 shared_informer.go:318] Caches are synced for attach detach

	I1004 00:24:43.912523       1 shared_informer.go:318] Caches are synced for garbage collector

	I1004 00:24:43.962530       1 shared_informer.go:318] Caches are synced for garbage collector

	I1004 00:24:43.962553       1 garbagecollector.go:166] "All resource monitors have synced. Proceeding to collect garbage"

	* 

	* ==> kube-proxy [9f05e1e6df36] <==

	* I1004 00:25:12.564071       1 server_others.go:69] "Using iptables proxy"

	I1004 00:25:12.570886       1 node.go:141] Successfully retrieved node IP: 192.168.105.4

	I1004 00:25:12.593631       1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"

	I1004 00:25:12.593643       1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I1004 00:25:12.594338       1 server_others.go:152] "Using iptables Proxier"

	I1004 00:25:12.594356       1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I1004 00:25:12.594435       1 server.go:846] "Version info" version="v1.28.2"

	I1004 00:25:12.594439       1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I1004 00:25:12.601027       1 config.go:188] "Starting service config controller"

	I1004 00:25:12.601085       1 shared_informer.go:311] Waiting for caches to sync for service config

	I1004 00:25:12.601115       1 config.go:97] "Starting endpoint slice config controller"

	I1004 00:25:12.604045       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config

	I1004 00:25:12.604254       1 config.go:315] "Starting node config controller"

	I1004 00:25:12.604287       1 shared_informer.go:311] Waiting for caches to sync for node config

	I1004 00:25:12.701924       1 shared_informer.go:318] Caches are synced for service config

	I1004 00:25:12.705103       1 shared_informer.go:318] Caches are synced for node config

	I1004 00:25:12.705111       1 shared_informer.go:318] Caches are synced for endpoint slice config

	* 

	* ==> kube-proxy [b15e1c0913c9] <==

	* I1004 00:24:29.840867       1 server_others.go:69] "Using iptables proxy"

	E1004 00:24:30.943865       1 node.go:130] Failed to retrieve node info: nodes "functional-488000" is forbidden: User "system:serviceaccount:kube-system:kube-proxy" cannot get resource "nodes" in API group "" at the cluster scope

	I1004 00:24:32.091260       1 node.go:141] Successfully retrieved node IP: 192.168.105.4

	I1004 00:24:32.099898       1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"

	I1004 00:24:32.099912       1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I1004 00:24:32.100526       1 server_others.go:152] "Using iptables Proxier"

	I1004 00:24:32.100552       1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I1004 00:24:32.100632       1 server.go:846] "Version info" version="v1.28.2"

	I1004 00:24:32.100637       1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I1004 00:24:32.100917       1 config.go:188] "Starting service config controller"

	I1004 00:24:32.100925       1 shared_informer.go:311] Waiting for caches to sync for service config

	I1004 00:24:32.100932       1 config.go:97] "Starting endpoint slice config controller"

	I1004 00:24:32.100934       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config

	I1004 00:24:32.101501       1 config.go:315] "Starting node config controller"

	I1004 00:24:32.101504       1 shared_informer.go:311] Waiting for caches to sync for node config

	I1004 00:24:32.201583       1 shared_informer.go:318] Caches are synced for node config

	I1004 00:24:32.201585       1 shared_informer.go:318] Caches are synced for service config

	I1004 00:24:32.201600       1 shared_informer.go:318] Caches are synced for endpoint slice config

	* 

	* ==> kube-scheduler [6f0962fc282a] <==

	* I1004 00:25:10.236294       1 serving.go:348] Generated self-signed cert in-memory

	W1004 00:25:11.897235       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W1004 00:25:11.897244       1 authentication.go:368] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W1004 00:25:11.897249       1 authentication.go:369] Continuing without authentication configuration. This may treat all requests as anonymous.

	W1004 00:25:11.897251       1 authentication.go:370] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I1004 00:25:11.933677       1 server.go:154] "Starting Kubernetes Scheduler" version="v1.28.2"

	I1004 00:25:11.933692       1 server.go:156] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I1004 00:25:11.934599       1 secure_serving.go:210] Serving securely on 127.0.0.1:10259

	I1004 00:25:11.934648       1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I1004 00:25:11.934657       1 shared_informer.go:311] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I1004 00:25:11.934693       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"

	I1004 00:25:12.036784       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	* 

	* ==> kube-scheduler [f552969b825a] <==

	* E1004 00:24:30.937445       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	W1004 00:24:30.937479       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E1004 00:24:30.937486       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W1004 00:24:30.940968       1 reflector.go:535] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E1004 00:24:30.940985       1 reflector.go:147] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	W1004 00:24:30.941137       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E1004 00:24:30.941163       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	W1004 00:24:30.941146       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E1004 00:24:30.941202       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	W1004 00:24:30.941241       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1004 00:24:30.941281       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	W1004 00:24:30.941281       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E1004 00:24:30.941291       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	W1004 00:24:30.941318       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E1004 00:24:30.941327       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W1004 00:24:30.941357       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E1004 00:24:30.941371       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W1004 00:24:30.941362       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E1004 00:24:30.941385       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	W1004 00:24:30.941407       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E1004 00:24:30.941415       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	I1004 00:24:32.332763       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I1004 00:24:55.979062       1 secure_serving.go:255] Stopped listening on 127.0.0.1:10259

	I1004 00:24:55.979083       1 tlsconfig.go:255] "Shutting down DynamicServingCertificateController"

	E1004 00:24:55.979141       1 run.go:74] "command failed" err="finished without leader elect"

	* 

	* ==> kubelet <==

	* -- Journal begins at Wed 2023-10-04 00:23:39 UTC, ends at Wed 2023-10-04 00:26:29 UTC. --

	Oct 04 00:26:10 functional-488000 kubelet[7178]: E1004 00:26:10.470285    7178 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echoserver-arm\" with CrashLoopBackOff: \"back-off 20s restarting failed container=echoserver-arm pod=hello-node-connect-7799dfb7c6-nzszr_default(edc365f6-d551-4665-af2f-225bc6837e9e)\"" pod="default/hello-node-connect-7799dfb7c6-nzszr" podUID="edc365f6-d551-4665-af2f-225bc6837e9e"

	Oct 04 00:26:10 functional-488000 kubelet[7178]: I1004 00:26:10.791033    7178 topology_manager.go:215] "Topology Admit Handler" podUID="ef8e1b32-a71d-465d-98ee-46e71af8a8a0" podNamespace="default" podName="busybox-mount"

	Oct 04 00:26:10 functional-488000 kubelet[7178]: I1004 00:26:10.983994    7178 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzn6x\" (UniqueName: \"kubernetes.io/projected/ef8e1b32-a71d-465d-98ee-46e71af8a8a0-kube-api-access-fzn6x\") pod \"busybox-mount\" (UID: \"ef8e1b32-a71d-465d-98ee-46e71af8a8a0\") " pod="default/busybox-mount"

	Oct 04 00:26:10 functional-488000 kubelet[7178]: I1004 00:26:10.984047    7178 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-volume\" (UniqueName: \"kubernetes.io/host-path/ef8e1b32-a71d-465d-98ee-46e71af8a8a0-test-volume\") pod \"busybox-mount\" (UID: \"ef8e1b32-a71d-465d-98ee-46e71af8a8a0\") " pod="default/busybox-mount"

	Oct 04 00:26:13 functional-488000 kubelet[7178]: I1004 00:26:13.701225    7178 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzn6x\" (UniqueName: \"kubernetes.io/projected/ef8e1b32-a71d-465d-98ee-46e71af8a8a0-kube-api-access-fzn6x\") pod \"ef8e1b32-a71d-465d-98ee-46e71af8a8a0\" (UID: \"ef8e1b32-a71d-465d-98ee-46e71af8a8a0\") "

	Oct 04 00:26:13 functional-488000 kubelet[7178]: I1004 00:26:13.701263    7178 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"test-volume\" (UniqueName: \"kubernetes.io/host-path/ef8e1b32-a71d-465d-98ee-46e71af8a8a0-test-volume\") pod \"ef8e1b32-a71d-465d-98ee-46e71af8a8a0\" (UID: \"ef8e1b32-a71d-465d-98ee-46e71af8a8a0\") "

	Oct 04 00:26:13 functional-488000 kubelet[7178]: I1004 00:26:13.701293    7178 operation_generator.go:878] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ef8e1b32-a71d-465d-98ee-46e71af8a8a0-test-volume" (OuterVolumeSpecName: "test-volume") pod "ef8e1b32-a71d-465d-98ee-46e71af8a8a0" (UID: "ef8e1b32-a71d-465d-98ee-46e71af8a8a0"). InnerVolumeSpecName "test-volume". PluginName "kubernetes.io/host-path", VolumeGidValue ""

	Oct 04 00:26:13 functional-488000 kubelet[7178]: I1004 00:26:13.704008    7178 operation_generator.go:878] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef8e1b32-a71d-465d-98ee-46e71af8a8a0-kube-api-access-fzn6x" (OuterVolumeSpecName: "kube-api-access-fzn6x") pod "ef8e1b32-a71d-465d-98ee-46e71af8a8a0" (UID: "ef8e1b32-a71d-465d-98ee-46e71af8a8a0"). InnerVolumeSpecName "kube-api-access-fzn6x". PluginName "kubernetes.io/projected", VolumeGidValue ""

	Oct 04 00:26:13 functional-488000 kubelet[7178]: I1004 00:26:13.801337    7178 reconciler_common.go:300] "Volume detached for volume \"test-volume\" (UniqueName: \"kubernetes.io/host-path/ef8e1b32-a71d-465d-98ee-46e71af8a8a0-test-volume\") on node \"functional-488000\" DevicePath \"\""

	Oct 04 00:26:13 functional-488000 kubelet[7178]: I1004 00:26:13.801359    7178 reconciler_common.go:300] "Volume detached for volume \"kube-api-access-fzn6x\" (UniqueName: \"kubernetes.io/projected/ef8e1b32-a71d-465d-98ee-46e71af8a8a0-kube-api-access-fzn6x\") on node \"functional-488000\" DevicePath \"\""

	Oct 04 00:26:14 functional-488000 kubelet[7178]: I1004 00:26:14.497185    7178 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="085501f08b95a945940acc7351b2bbd367d5741bb8d69ac0810163844a8ee2cb"

	Oct 04 00:26:18 functional-488000 kubelet[7178]: I1004 00:26:18.035336    7178 scope.go:117] "RemoveContainer" containerID="1759fa87cf1a4389c8d6b3d58ed81910ebe881a57b85b3cf879595699ba37f59"

	Oct 04 00:26:18 functional-488000 kubelet[7178]: I1004 00:26:18.519729    7178 scope.go:117] "RemoveContainer" containerID="1759fa87cf1a4389c8d6b3d58ed81910ebe881a57b85b3cf879595699ba37f59"

	Oct 04 00:26:18 functional-488000 kubelet[7178]: I1004 00:26:18.519947    7178 scope.go:117] "RemoveContainer" containerID="6d29eb0846b0dc90b4fb3db1528deabd56c6f69e8d7e8f0afc20536b92d974c1"

	Oct 04 00:26:18 functional-488000 kubelet[7178]: E1004 00:26:18.520034    7178 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echoserver-arm\" with CrashLoopBackOff: \"back-off 20s restarting failed container=echoserver-arm pod=hello-node-759d89bdcc-w8tqc_default(8d75cba7-a791-4207-8484-c811058cc91b)\"" pod="default/hello-node-759d89bdcc-w8tqc" podUID="8d75cba7-a791-4207-8484-c811058cc91b"

	Oct 04 00:26:21 functional-488000 kubelet[7178]: I1004 00:26:21.035299    7178 scope.go:117] "RemoveContainer" containerID="eee59ec12de82005d72b576162cfd1555f6e7abd6052bbe8055ade7b753afe53"

	Oct 04 00:26:21 functional-488000 kubelet[7178]: E1004 00:26:21.035389    7178 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echoserver-arm\" with CrashLoopBackOff: \"back-off 20s restarting failed container=echoserver-arm pod=hello-node-connect-7799dfb7c6-nzszr_default(edc365f6-d551-4665-af2f-225bc6837e9e)\"" pod="default/hello-node-connect-7799dfb7c6-nzszr" podUID="edc365f6-d551-4665-af2f-225bc6837e9e"

	Oct 04 00:26:26 functional-488000 kubelet[7178]: I1004 00:26:26.241401    7178 topology_manager.go:215] "Topology Admit Handler" podUID="91622edc-fa8c-4c11-aaa4-e2aa715cd423" podNamespace="kubernetes-dashboard" podName="kubernetes-dashboard-8694d4445c-45lvq"

	Oct 04 00:26:26 functional-488000 kubelet[7178]: E1004 00:26:26.241470    7178 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="ef8e1b32-a71d-465d-98ee-46e71af8a8a0" containerName="mount-munger"

	Oct 04 00:26:26 functional-488000 kubelet[7178]: I1004 00:26:26.241486    7178 memory_manager.go:346] "RemoveStaleState removing state" podUID="ef8e1b32-a71d-465d-98ee-46e71af8a8a0" containerName="mount-munger"

	Oct 04 00:26:26 functional-488000 kubelet[7178]: I1004 00:26:26.269121    7178 topology_manager.go:215] "Topology Admit Handler" podUID="52fe2dd3-921c-4fe7-944e-089ff8f0c843" podNamespace="kubernetes-dashboard" podName="dashboard-metrics-scraper-7fd5cb4ddc-fms84"

	Oct 04 00:26:26 functional-488000 kubelet[7178]: I1004 00:26:26.375875    7178 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtgmw\" (UniqueName: \"kubernetes.io/projected/91622edc-fa8c-4c11-aaa4-e2aa715cd423-kube-api-access-mtgmw\") pod \"kubernetes-dashboard-8694d4445c-45lvq\" (UID: \"91622edc-fa8c-4c11-aaa4-e2aa715cd423\") " pod="kubernetes-dashboard/kubernetes-dashboard-8694d4445c-45lvq"

	Oct 04 00:26:26 functional-488000 kubelet[7178]: I1004 00:26:26.375899    7178 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-volume\" (UniqueName: \"kubernetes.io/empty-dir/91622edc-fa8c-4c11-aaa4-e2aa715cd423-tmp-volume\") pod \"kubernetes-dashboard-8694d4445c-45lvq\" (UID: \"91622edc-fa8c-4c11-aaa4-e2aa715cd423\") " pod="kubernetes-dashboard/kubernetes-dashboard-8694d4445c-45lvq"

	Oct 04 00:26:26 functional-488000 kubelet[7178]: I1004 00:26:26.375910    7178 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-volume\" (UniqueName: \"kubernetes.io/empty-dir/52fe2dd3-921c-4fe7-944e-089ff8f0c843-tmp-volume\") pod \"dashboard-metrics-scraper-7fd5cb4ddc-fms84\" (UID: \"52fe2dd3-921c-4fe7-944e-089ff8f0c843\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc-fms84"

	Oct 04 00:26:26 functional-488000 kubelet[7178]: I1004 00:26:26.375933    7178 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvtxc\" (UniqueName: \"kubernetes.io/projected/52fe2dd3-921c-4fe7-944e-089ff8f0c843-kube-api-access-zvtxc\") pod \"dashboard-metrics-scraper-7fd5cb4ddc-fms84\" (UID: \"52fe2dd3-921c-4fe7-944e-089ff8f0c843\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc-fms84"

	* 

	* ==> storage-provisioner [15cf0e45db24] <==

	* I1004 00:24:42.507499       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I1004 00:24:42.512430       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I1004 00:24:42.512448       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I1004 00:24:42.515024       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I1004 00:24:42.515151       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-488000_eb40320f-bebe-4d23-a477-25d0dbdeaaf9!

	I1004 00:24:42.515414       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"256db409-305f-4146-9485-b9c1c36e67dd", APIVersion:"v1", ResourceVersion:"453", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-488000_eb40320f-bebe-4d23-a477-25d0dbdeaaf9 became leader

	I1004 00:24:42.615332       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-488000_eb40320f-bebe-4d23-a477-25d0dbdeaaf9!

	* 

	* ==> storage-provisioner [2893cf6a6b37] <==

	* I1004 00:25:12.614153       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I1004 00:25:12.617788       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I1004 00:25:12.617830       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I1004 00:25:30.001091       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I1004 00:25:30.001148       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-488000_9171e651-c266-4573-b5a5-24bd77e4ef15!

	I1004 00:25:30.001173       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"256db409-305f-4146-9485-b9c1c36e67dd", APIVersion:"v1", ResourceVersion:"562", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-488000_9171e651-c266-4573-b5a5-24bd77e4ef15 became leader

	I1004 00:25:30.102259       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-488000_9171e651-c266-4573-b5a5-24bd77e4ef15!

	I1004 00:25:42.704861       1 controller.go:1332] provision "default/myclaim" class "standard": started

	I1004 00:25:42.704885       1 storage_provisioner.go:61] Provisioning volume {&StorageClass{ObjectMeta:{standard    3e9b4d2a-432e-4e42-8926-f1b763f33999 347 0 2023-10-04 00:24:10 +0000 UTC <nil> <nil> map[addonmanager.kubernetes.io/mode:EnsureExists] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"storage.k8s.io/v1","kind":"StorageClass","metadata":{"annotations":{"storageclass.kubernetes.io/is-default-class":"true"},"labels":{"addonmanager.kubernetes.io/mode":"EnsureExists"},"name":"standard"},"provisioner":"k8s.io/minikube-hostpath"}

	 storageclass.kubernetes.io/is-default-class:true] [] []  [{kubectl-client-side-apply Update storage.k8s.io/v1 2023-10-04 00:24:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{},"f:storageclass.kubernetes.io/is-default-class":{}},"f:labels":{".":{},"f:addonmanager.kubernetes.io/mode":{}}},"f:provisioner":{},"f:reclaimPolicy":{},"f:volumeBindingMode":{}}}]},Provisioner:k8s.io/minikube-hostpath,Parameters:map[string]string{},ReclaimPolicy:*Delete,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*Immediate,AllowedTopologies:[]TopologySelectorTerm{},} pvc-931a4cdc-5524-4d3d-aaec-715ddc68fc61 &PersistentVolumeClaim{ObjectMeta:{myclaim  default  931a4cdc-5524-4d3d-aaec-715ddc68fc61 623 0 2023-10-04 00:25:42 +0000 UTC <nil> <nil> map[] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"myclaim","namespace":"default"},"spec":{"accessModes":["Rea

dWriteOnce"],"resources":{"requests":{"storage":"500Mi"}},"volumeMode":"Filesystem"}}

	 volume.beta.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath volume.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath] [] [kubernetes.io/pvc-protection]  [{kube-controller-manager Update v1 2023-10-04 00:25:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}}}} {kubectl-client-side-apply Update v1 2023-10-04 00:25:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}}}]},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{524288000 0} {<nil>} 500Mi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*standard,VolumeMode:*Filesystem,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:

ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},} nil} to /tmp/hostpath-provisioner/default/myclaim

	I1004 00:25:42.705333       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"931a4cdc-5524-4d3d-aaec-715ddc68fc61", APIVersion:"v1", ResourceVersion:"623", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/myclaim"

	I1004 00:25:42.705453       1 controller.go:1439] provision "default/myclaim" class "standard": volume "pvc-931a4cdc-5524-4d3d-aaec-715ddc68fc61" provisioned

	I1004 00:25:42.705460       1 controller.go:1456] provision "default/myclaim" class "standard": succeeded

	I1004 00:25:42.705463       1 volume_store.go:212] Trying to save persistentvolume "pvc-931a4cdc-5524-4d3d-aaec-715ddc68fc61"

	I1004 00:25:42.713625       1 volume_store.go:219] persistentvolume "pvc-931a4cdc-5524-4d3d-aaec-715ddc68fc61" saved

	I1004 00:25:42.714359       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"931a4cdc-5524-4d3d-aaec-715ddc68fc61", APIVersion:"v1", ResourceVersion:"623", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-931a4cdc-5524-4d3d-aaec-715ddc68fc61

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p functional-488000 -n functional-488000

helpers_test.go:261: (dbg) Run:  kubectl --context functional-488000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:272: non-running pods: busybox-mount dashboard-metrics-scraper-7fd5cb4ddc-fms84 kubernetes-dashboard-8694d4445c-45lvq

helpers_test.go:274: ======> post-mortem[TestFunctional/parallel/ServiceCmdConnect]: describe non-running pods <======

helpers_test.go:277: (dbg) Run:  kubectl --context functional-488000 describe pod busybox-mount dashboard-metrics-scraper-7fd5cb4ddc-fms84 kubernetes-dashboard-8694d4445c-45lvq

helpers_test.go:277: (dbg) Non-zero exit: kubectl --context functional-488000 describe pod busybox-mount dashboard-metrics-scraper-7fd5cb4ddc-fms84 kubernetes-dashboard-8694d4445c-45lvq: exit status 1 (41.647208ms)

-- stdout --

	Name:             busybox-mount

	Namespace:        default

	Priority:         0

	Service Account:  default

	Node:             functional-488000/192.168.105.4

	Start Time:       Tue, 03 Oct 2023 17:26:10 -0700

	Labels:           integration-test=busybox-mount

	Annotations:      <none>

	Status:           Succeeded

	IP:               10.244.0.11

	IPs:

	  IP:  10.244.0.11

	Containers:

	  mount-munger:

	    Container ID:  docker://ac4df190eca9d6a9e5c4eb9d887697137f8cb5f92f96435de54a3a48b02cf519

	    Image:         gcr.io/k8s-minikube/busybox:1.28.4-glibc

	    Image ID:      docker-pullable://gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e

	    Port:          <none>

	    Host Port:     <none>

	    Command:

	      /bin/sh

	      -c

	      --

	    Args:

	      cat /mount-9p/created-by-test; echo test > /mount-9p/created-by-pod; rm /mount-9p/created-by-test-removed-by-pod; echo test > /mount-9p/created-by-pod-removed-by-test date >> /mount-9p/pod-dates

	    State:          Terminated

	      Reason:       Completed

	      Exit Code:    0

	      Started:      Tue, 03 Oct 2023 17:26:12 -0700

	      Finished:     Tue, 03 Oct 2023 17:26:12 -0700

	    Ready:          False

	    Restart Count:  0

	    Environment:    <none>

	    Mounts:

	      /mount-9p from test-volume (rw)

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-fzn6x (ro)

	Conditions:

	  Type              Status

	  Initialized       True 

	  Ready             False 

	  ContainersReady   False 

	  PodScheduled      True 

	Volumes:

	  test-volume:

	    Type:          HostPath (bare host directory volume)

	    Path:          /mount-9p

	    HostPathType:  

	  kube-api-access-fzn6x:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	QoS Class:                   BestEffort

	Node-Selectors:              <none>

	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type    Reason     Age   From               Message

	  ----    ------     ----  ----               -------

	  Normal  Scheduled  19s   default-scheduler  Successfully assigned default/busybox-mount to functional-488000

	  Normal  Pulling    18s   kubelet            Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"

	  Normal  Pulled     17s   kubelet            Successfully pulled image "gcr.io/k8s-minikube/busybox:1.28.4-glibc" in 1.038s (1.038s including waiting)

	  Normal  Created    17s   kubelet            Created container mount-munger

	  Normal  Started    17s   kubelet            Started container mount-munger

-- /stdout --

** stderr ** 

	Error from server (NotFound): pods "dashboard-metrics-scraper-7fd5cb4ddc-fms84" not found

	Error from server (NotFound): pods "kubernetes-dashboard-8694d4445c-45lvq" not found

** /stderr **

helpers_test.go:279: kubectl --context functional-488000 describe pod busybox-mount dashboard-metrics-scraper-7fd5cb4ddc-fms84 kubernetes-dashboard-8694d4445c-45lvq: exit status 1

--- FAIL: TestFunctional/parallel/ServiceCmdConnect (41.27s)

=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel

functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-darwin-arm64 -p functional-488000 tunnel --alsologtostderr]

functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-darwin-arm64 -p functional-488000 tunnel --alsologtostderr]

functional_test_tunnel_test.go:190: tunnel command failed with unexpected error: exit code 80. stderr: I1003 17:25:37.527035    2447 out.go:296] Setting OutFile to fd 1 ...

I1003 17:25:37.527294    2447 out.go:343] TERM=,COLORTERM=, which probably does not support color

I1003 17:25:37.527299    2447 out.go:309] Setting ErrFile to fd 2...

I1003 17:25:37.527301    2447 out.go:343] TERM=,COLORTERM=, which probably does not support color

I1003 17:25:37.527430    2447 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17345-986/.minikube/bin

I1003 17:25:37.527684    2447 mustload.go:65] Loading cluster: functional-488000

I1003 17:25:37.527890    2447 config.go:182] Loaded profile config "functional-488000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.2

I1003 17:25:37.531576    2447 out.go:177] 

W1003 17:25:37.535660    2447 out.go:239] X Exiting due to GUEST_STATUS: Unable to get machine status: state: connect: dial unix /Users/jenkins/minikube-integration/17345-986/.minikube/machines/functional-488000/monitor: connect: connection refused

X Exiting due to GUEST_STATUS: Unable to get machine status: state: connect: dial unix /Users/jenkins/minikube-integration/17345-986/.minikube/machines/functional-488000/monitor: connect: connection refused

W1003 17:25:37.535669    2447 out.go:239] * 

* 

W1003 17:25:37.536985    2447 out.go:239] ╭───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                                                           │

│    * If the above advice does not help, please let us know:                                                               │

│      https://github.com/kubernetes/minikube/issues/new/choose                                                             │

│                                                                                                                           │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                  │

│    * Please also attach the following file to the GitHub issue:                                                           │

│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_tunnel_7075cb44437691034d825beac909ba5df9688569_0.log    │

│                                                                                                                           │

╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

╭───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                                                           │

│    * If the above advice does not help, please let us know:                                                               │

│      https://github.com/kubernetes/minikube/issues/new/choose                                                             │

│                                                                                                                           │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                  │

│    * Please also attach the following file to the GitHub issue:                                                           │

│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_tunnel_7075cb44437691034d825beac909ba5df9688569_0.log    │

│                                                                                                                           │

╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

I1003 17:25:37.539519    2447 out.go:177] 

stdout: 

functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-darwin-arm64 -p functional-488000 tunnel --alsologtostderr] ...

helpers_test.go:490: unable to find parent, assuming dead: process does not exist

functional_test_tunnel_test.go:194: read stdout failed: read |0: file already closed

functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-arm64 -p functional-488000 tunnel --alsologtostderr] stdout:

functional_test_tunnel_test.go:194: read stderr failed: read |0: file already closed

functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-arm64 -p functional-488000 tunnel --alsologtostderr] stderr:

functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-darwin-arm64 -p functional-488000 tunnel --alsologtostderr] ...

helpers_test.go:508: unable to kill pid 2446: os: process already finished

functional_test_tunnel_test.go:194: read stdout failed: read |0: file already closed

functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-arm64 -p functional-488000 tunnel --alsologtostderr] stdout:

functional_test_tunnel_test.go:194: read stderr failed: read |0: file already closed

functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-arm64 -p functional-488000 tunnel --alsologtostderr] stderr:

--- FAIL: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.18s)

=== RUN   TestImageBuild/serial/BuildWithBuildArg

image_test.go:99: (dbg) Run:  out/minikube-darwin-arm64 image build -t aaa:latest --build-opt=build-arg=ENV_A=test_env_str --build-opt=no-cache ./testdata/image-build/test-arg -p image-329000

image_test.go:105: failed to pass build-args with args: "out/minikube-darwin-arm64 image build -t aaa:latest --build-opt=build-arg=ENV_A=test_env_str --build-opt=no-cache ./testdata/image-build/test-arg -p image-329000" : 

-- stdout --

	Sending build context to Docker daemon  2.048kB

	Step 1/5 : FROM gcr.io/google-containers/alpine-with-bash:1.0

	 ---> 822c13824dc2

	Step 2/5 : ARG ENV_A

	 ---> [Warning] The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested

	 ---> Running in 1eb48772889a

	Removing intermediate container 1eb48772889a

	 ---> 83faf0d5defb

	Step 3/5 : ARG ENV_B

	 ---> [Warning] The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested

	 ---> Running in 043f9ae9c8a1

	Removing intermediate container 043f9ae9c8a1

	 ---> 329dcfcd1187

	Step 4/5 : RUN echo "test-build-arg" $ENV_A $ENV_B

	 ---> [Warning] The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested

	 ---> Running in 99642807770f

	exec /bin/sh: exec format error

	

-- /stdout --

** stderr ** 

	DEPRECATED: The legacy builder is deprecated and will be removed in a future release.

	            Install the buildx component to build images with BuildKit:

	            https://docs.docker.com/go/buildx/

	The command '/bin/sh -c echo "test-build-arg" $ENV_A $ENV_B' returned a non-zero code: 1

** /stderr **

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p image-329000 -n image-329000

helpers_test.go:244: <<< TestImageBuild/serial/BuildWithBuildArg FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestImageBuild/serial/BuildWithBuildArg]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p image-329000 logs -n 25

helpers_test.go:252: TestImageBuild/serial/BuildWithBuildArg logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |---------|-----------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	| Command |                                                      Args                                                       |      Profile      |  User   | Version |     Start Time      |      End Time       |

	|---------|-----------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	| tunnel  | functional-488000 tunnel                                                                                        | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:25 PDT |                     |

	|         | --alsologtostderr                                                                                               |                   |         |         |                     |                     |

	| tunnel  | functional-488000 tunnel                                                                                        | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:25 PDT |                     |

	|         | --alsologtostderr                                                                                               |                   |         |         |                     |                     |

	| addons  | functional-488000 addons list                                                                                   | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:25 PDT | 03 Oct 23 17:25 PDT |

	| addons  | functional-488000 addons list                                                                                   | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:25 PDT | 03 Oct 23 17:25 PDT |

	|         | -o json                                                                                                         |                   |         |         |                     |                     |

	| service | functional-488000 service                                                                                       | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT | 03 Oct 23 17:26 PDT |

	|         | hello-node-connect --url                                                                                        |                   |         |         |                     |                     |

	| service | functional-488000 service list                                                                                  | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT | 03 Oct 23 17:26 PDT |

	| service | functional-488000 service list                                                                                  | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT | 03 Oct 23 17:26 PDT |

	|         | -o json                                                                                                         |                   |         |         |                     |                     |

	| service | functional-488000 service                                                                                       | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT | 03 Oct 23 17:26 PDT |

	|         | --namespace=default --https                                                                                     |                   |         |         |                     |                     |

	|         | --url hello-node                                                                                                |                   |         |         |                     |                     |

	| service | functional-488000                                                                                               | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT | 03 Oct 23 17:26 PDT |

	|         | service hello-node --url                                                                                        |                   |         |         |                     |                     |

	|         | --format={{.IP}}                                                                                                |                   |         |         |                     |                     |

	| service | functional-488000 service                                                                                       | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT | 03 Oct 23 17:26 PDT |

	|         | hello-node --url                                                                                                |                   |         |         |                     |                     |

	| mount   | -p functional-488000                                                                                            | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT |                     |

	|         | /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdany-port2195568235/001:/mount-9p |                   |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                                                                          |                   |         |         |                     |                     |

	| ssh     | functional-488000 ssh findmnt                                                                                   | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT |                     |

	|         | -T /mount-9p | grep 9p                                                                                          |                   |         |         |                     |                     |

	| ssh     | functional-488000 ssh findmnt                                                                                   | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT | 03 Oct 23 17:26 PDT |

	|         | -T /mount-9p | grep 9p                                                                                          |                   |         |         |                     |                     |

	| ssh     | functional-488000 ssh -- ls                                                                                     | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT | 03 Oct 23 17:26 PDT |

	|         | -la /mount-9p                                                                                                   |                   |         |         |                     |                     |

	| ssh     | functional-488000 ssh cat                                                                                       | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT | 03 Oct 23 17:26 PDT |

	|         | /mount-9p/test-1696379169954988000                                                                              |                   |         |         |                     |                     |

	| ssh     | functional-488000 ssh stat                                                                                      | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT | 03 Oct 23 17:26 PDT |

	|         | /mount-9p/created-by-test                                                                                       |                   |         |         |                     |                     |

	| image   | functional-488000                                                                                               | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT | 03 Oct 23 17:26 PDT |

	|         | image ls --format json                                                                                          |                   |         |         |                     |                     |

	|         | --alsologtostderr                                                                                               |                   |         |         |                     |                     |

	| image   | functional-488000                                                                                               | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT | 03 Oct 23 17:26 PDT |

	|         | image ls --format table                                                                                         |                   |         |         |                     |                     |

	|         | --alsologtostderr                                                                                               |                   |         |         |                     |                     |

	| ssh     | functional-488000 ssh pgrep                                                                                     | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT |                     |

	|         | buildkitd                                                                                                       |                   |         |         |                     |                     |

	| image   | functional-488000 image build -t                                                                                | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT | 03 Oct 23 17:26 PDT |

	|         | localhost/my-image:functional-488000                                                                            |                   |         |         |                     |                     |

	|         | testdata/build --alsologtostderr                                                                                |                   |         |         |                     |                     |

	| image   | functional-488000 image ls                                                                                      | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT | 03 Oct 23 17:26 PDT |

	| delete  | -p functional-488000                                                                                            | functional-488000 | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT | 03 Oct 23 17:26 PDT |

	| start   | -p image-329000 --driver=qemu2                                                                                  | image-329000      | jenkins | v1.31.2 | 03 Oct 23 17:26 PDT | 03 Oct 23 17:27 PDT |

	|         |                                                                                                                 |                   |         |         |                     |                     |

	| image   | build -t aaa:latest                                                                                             | image-329000      | jenkins | v1.31.2 | 03 Oct 23 17:27 PDT | 03 Oct 23 17:27 PDT |

	|         | ./testdata/image-build/test-normal                                                                              |                   |         |         |                     |                     |

	|         | -p image-329000                                                                                                 |                   |         |         |                     |                     |

	| image   | build -t aaa:latest                                                                                             | image-329000      | jenkins | v1.31.2 | 03 Oct 23 17:27 PDT | 03 Oct 23 17:27 PDT |

	|         | --build-opt=build-arg=ENV_A=test_env_str                                                                        |                   |         |         |                     |                     |

	|         | --build-opt=no-cache                                                                                            |                   |         |         |                     |                     |

	|         | ./testdata/image-build/test-arg -p                                                                              |                   |         |         |                     |                     |

	|         | image-329000                                                                                                    |                   |         |         |                     |                     |

	|---------|-----------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2023/10/03 17:26:42

	Running on machine: MacOS-M1-Agent-2

	Binary: Built with gc go1.21.1 for darwin/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1003 17:26:42.811524    2851 out.go:296] Setting OutFile to fd 1 ...

	I1003 17:26:42.811666    2851 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1003 17:26:42.811668    2851 out.go:309] Setting ErrFile to fd 2...

	I1003 17:26:42.811670    2851 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1003 17:26:42.811813    2851 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17345-986/.minikube/bin

	I1003 17:26:42.812943    2851 out.go:303] Setting JSON to false

	I1003 17:26:42.830587    2851 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":1576,"bootTime":1696377626,"procs":470,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.0","kernelVersion":"23.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W1003 17:26:42.830711    2851 start.go:136] gopshost.Virtualization returned error: not implemented yet

	I1003 17:26:42.834588    2851 out.go:177] * [image-329000] minikube v1.31.2 on Darwin 14.0 (arm64)

	I1003 17:26:42.841599    2851 out.go:177]   - MINIKUBE_LOCATION=17345

	I1003 17:26:42.841623    2851 notify.go:220] Checking for updates...

	I1003 17:26:42.845453    2851 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17345-986/kubeconfig

	I1003 17:26:42.848615    2851 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I1003 17:26:42.851552    2851 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1003 17:26:42.854450    2851 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17345-986/.minikube

	I1003 17:26:42.857505    2851 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1003 17:26:42.860693    2851 driver.go:373] Setting default libvirt URI to qemu:///system

	I1003 17:26:42.864489    2851 out.go:177] * Using the qemu2 driver based on user configuration

	I1003 17:26:42.871531    2851 start.go:298] selected driver: qemu2

	I1003 17:26:42.871538    2851 start.go:902] validating driver "qemu2" against <nil>

	I1003 17:26:42.871543    2851 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1003 17:26:42.871603    2851 start_flags.go:307] no existing cluster config was found, will generate one from the flags 

	I1003 17:26:42.874511    2851 out.go:177] * Automatically selected the socket_vmnet network

	I1003 17:26:42.880135    2851 start_flags.go:384] Using suggested 4000MB memory alloc based on sys=16384MB, container=0MB

	I1003 17:26:42.880222    2851 start_flags.go:905] Wait components to verify : map[apiserver:true system_pods:true]

	I1003 17:26:42.880241    2851 cni.go:84] Creating CNI manager for ""

	I1003 17:26:42.880246    2851 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1003 17:26:42.880249    2851 start_flags.go:316] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I1003 17:26:42.880253    2851 start_flags.go:321] config:

	{Name:image-329000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.2 ClusterName:image-329000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRIS

ocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I1003 17:26:42.884701    2851 iso.go:125] acquiring lock: {Name:mkcc00c41dbf3c669d3c57dcea55708ed569b7af Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1003 17:26:42.891441    2851 out.go:177] * Starting control plane node image-329000 in cluster image-329000

	I1003 17:26:42.895561    2851 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime docker

	I1003 17:26:42.895574    2851 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17345-986/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-arm64.tar.lz4

	I1003 17:26:42.895588    2851 cache.go:57] Caching tarball of preloaded images

	I1003 17:26:42.895647    2851 preload.go:174] Found /Users/jenkins/minikube-integration/17345-986/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I1003 17:26:42.895651    2851 cache.go:60] Finished verifying existence of preloaded tar for  v1.28.2 on docker

	I1003 17:26:42.895825    2851 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/config.json ...

	I1003 17:26:42.895835    2851 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/config.json: {Name:mkd7bca0dc0391720cf43d59c01cbe8818323453 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:26:42.896024    2851 start.go:365] acquiring machines lock for image-329000: {Name:mk16657683bb2d197cbddad244cc8b10f1cb12f0 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1003 17:26:42.896052    2851 start.go:369] acquired machines lock for "image-329000" in 24.667µs

	I1003 17:26:42.896061    2851 start.go:93] Provisioning new machine with config: &{Name:image-329000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig

:{KubernetesVersion:v1.28.2 ClusterName:image-329000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: D

isableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1003 17:26:42.896086    2851 start.go:125] createHost starting for "" (driver="qemu2")

	I1003 17:26:42.903499    2851 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	I1003 17:26:42.923338    2851 start.go:159] libmachine.API.Create for "image-329000" (driver="qemu2")

	I1003 17:26:42.923364    2851 client.go:168] LocalClient.Create starting

	I1003 17:26:42.923426    2851 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem

	I1003 17:26:42.923456    2851 main.go:141] libmachine: Decoding PEM data...

	I1003 17:26:42.923463    2851 main.go:141] libmachine: Parsing certificate...

	I1003 17:26:42.923499    2851 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17345-986/.minikube/certs/cert.pem

	I1003 17:26:42.923515    2851 main.go:141] libmachine: Decoding PEM data...

	I1003 17:26:42.923520    2851 main.go:141] libmachine: Parsing certificate...

	I1003 17:26:42.923863    2851 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17345-986/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17345-986/.minikube/cache/iso/arm64/minikube-v1.31.0-1695060926-17240-arm64.iso...

	I1003 17:26:43.144125    2851 main.go:141] libmachine: Creating SSH key...

	I1003 17:26:43.329235    2851 main.go:141] libmachine: Creating Disk image...

	I1003 17:26:43.329241    2851 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I1003 17:26:43.329414    2851 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17345-986/.minikube/machines/image-329000/disk.qcow2.raw /Users/jenkins/minikube-integration/17345-986/.minikube/machines/image-329000/disk.qcow2

	I1003 17:26:43.344747    2851 main.go:141] libmachine: STDOUT: 

	I1003 17:26:43.344760    2851 main.go:141] libmachine: STDERR: 

	I1003 17:26:43.344806    2851 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17345-986/.minikube/machines/image-329000/disk.qcow2 +20000M

	I1003 17:26:43.352469    2851 main.go:141] libmachine: STDOUT: Image resized.

	I1003 17:26:43.352478    2851 main.go:141] libmachine: STDERR: 

	I1003 17:26:43.352494    2851 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17345-986/.minikube/machines/image-329000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17345-986/.minikube/machines/image-329000/disk.qcow2

	I1003 17:26:43.352500    2851 main.go:141] libmachine: Starting QEMU VM...

	I1003 17:26:43.352536    2851 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17345-986/.minikube/machines/image-329000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/image-329000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17345-986/.minikube/machines/image-329000/qemu.pid -device virtio-net-pci,netdev=net0,mac=12:90:df:54:86:bb -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17345-986/.minikube/machines/image-329000/disk.qcow2

	I1003 17:26:43.392302    2851 main.go:141] libmachine: STDOUT: 

	I1003 17:26:43.392318    2851 main.go:141] libmachine: STDERR: 

	I1003 17:26:43.392321    2851 main.go:141] libmachine: Attempt 0

	I1003 17:26:43.392337    2851 main.go:141] libmachine: Searching for 12:90:df:54:86:bb in /var/db/dhcpd_leases ...

	I1003 17:26:43.392402    2851 main.go:141] libmachine: Found 3 entries in /var/db/dhcpd_leases!

	I1003 17:26:43.392418    2851 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:3a:42:d7:84:21:44 ID:1,3a:42:d7:84:21:44 Lease:0x651e020b}

	I1003 17:26:43.392423    2851 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:a:c5:28:37:53:67 ID:1,a:c5:28:37:53:67 Lease:0x651cb07e}

	I1003 17:26:43.392427    2851 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:56:68:9c:60:58:22 ID:1,56:68:9c:60:58:22 Lease:0x651cb05b}

	I1003 17:26:45.394561    2851 main.go:141] libmachine: Attempt 1

	I1003 17:26:45.394608    2851 main.go:141] libmachine: Searching for 12:90:df:54:86:bb in /var/db/dhcpd_leases ...

	I1003 17:26:45.394863    2851 main.go:141] libmachine: Found 3 entries in /var/db/dhcpd_leases!

	I1003 17:26:45.394967    2851 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:3a:42:d7:84:21:44 ID:1,3a:42:d7:84:21:44 Lease:0x651e020b}

	I1003 17:26:45.394994    2851 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:a:c5:28:37:53:67 ID:1,a:c5:28:37:53:67 Lease:0x651cb07e}

	I1003 17:26:45.395058    2851 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:56:68:9c:60:58:22 ID:1,56:68:9c:60:58:22 Lease:0x651cb05b}

	I1003 17:26:47.397204    2851 main.go:141] libmachine: Attempt 2

	I1003 17:26:47.397219    2851 main.go:141] libmachine: Searching for 12:90:df:54:86:bb in /var/db/dhcpd_leases ...

	I1003 17:26:47.397412    2851 main.go:141] libmachine: Found 3 entries in /var/db/dhcpd_leases!

	I1003 17:26:47.397444    2851 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:3a:42:d7:84:21:44 ID:1,3a:42:d7:84:21:44 Lease:0x651e020b}

	I1003 17:26:47.397451    2851 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:a:c5:28:37:53:67 ID:1,a:c5:28:37:53:67 Lease:0x651cb07e}

	I1003 17:26:47.397456    2851 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:56:68:9c:60:58:22 ID:1,56:68:9c:60:58:22 Lease:0x651cb05b}

	I1003 17:26:49.399497    2851 main.go:141] libmachine: Attempt 3

	I1003 17:26:49.399509    2851 main.go:141] libmachine: Searching for 12:90:df:54:86:bb in /var/db/dhcpd_leases ...

	I1003 17:26:49.399560    2851 main.go:141] libmachine: Found 3 entries in /var/db/dhcpd_leases!

	I1003 17:26:49.399568    2851 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:3a:42:d7:84:21:44 ID:1,3a:42:d7:84:21:44 Lease:0x651e020b}

	I1003 17:26:49.399573    2851 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:a:c5:28:37:53:67 ID:1,a:c5:28:37:53:67 Lease:0x651cb07e}

	I1003 17:26:49.399577    2851 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:56:68:9c:60:58:22 ID:1,56:68:9c:60:58:22 Lease:0x651cb05b}

	I1003 17:26:51.401585    2851 main.go:141] libmachine: Attempt 4

	I1003 17:26:51.401590    2851 main.go:141] libmachine: Searching for 12:90:df:54:86:bb in /var/db/dhcpd_leases ...

	I1003 17:26:51.401634    2851 main.go:141] libmachine: Found 3 entries in /var/db/dhcpd_leases!

	I1003 17:26:51.401639    2851 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:3a:42:d7:84:21:44 ID:1,3a:42:d7:84:21:44 Lease:0x651e020b}

	I1003 17:26:51.401643    2851 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:a:c5:28:37:53:67 ID:1,a:c5:28:37:53:67 Lease:0x651cb07e}

	I1003 17:26:51.401647    2851 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:56:68:9c:60:58:22 ID:1,56:68:9c:60:58:22 Lease:0x651cb05b}

	I1003 17:26:53.403705    2851 main.go:141] libmachine: Attempt 5

	I1003 17:26:53.403716    2851 main.go:141] libmachine: Searching for 12:90:df:54:86:bb in /var/db/dhcpd_leases ...

	I1003 17:26:53.403808    2851 main.go:141] libmachine: Found 3 entries in /var/db/dhcpd_leases!

	I1003 17:26:53.403816    2851 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:3a:42:d7:84:21:44 ID:1,3a:42:d7:84:21:44 Lease:0x651e020b}

	I1003 17:26:53.403820    2851 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:a:c5:28:37:53:67 ID:1,a:c5:28:37:53:67 Lease:0x651cb07e}

	I1003 17:26:53.403824    2851 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:56:68:9c:60:58:22 ID:1,56:68:9c:60:58:22 Lease:0x651cb05b}

	I1003 17:26:55.405876    2851 main.go:141] libmachine: Attempt 6

	I1003 17:26:55.405891    2851 main.go:141] libmachine: Searching for 12:90:df:54:86:bb in /var/db/dhcpd_leases ...

	I1003 17:26:55.406015    2851 main.go:141] libmachine: Found 4 entries in /var/db/dhcpd_leases!

	I1003 17:26:55.406029    2851 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.5 HWAddress:12:90:df:54:86:bb ID:1,12:90:df:54:86:bb Lease:0x651e02ce}

	I1003 17:26:55.406032    2851 main.go:141] libmachine: Found match: 12:90:df:54:86:bb

	I1003 17:26:55.406044    2851 main.go:141] libmachine: IP: 192.168.105.5

	I1003 17:26:55.406049    2851 main.go:141] libmachine: Waiting for VM to start (ssh -p 22 docker@192.168.105.5)...

	I1003 17:26:56.411274    2851 machine.go:88] provisioning docker machine ...

	I1003 17:26:56.411293    2851 buildroot.go:166] provisioning hostname "image-329000"

	I1003 17:26:56.411351    2851 main.go:141] libmachine: Using SSH client type: native

	I1003 17:26:56.411619    2851 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x104721e60] 0x1047245d0 <nil>  [] 0s} 192.168.105.5 22 <nil> <nil>}

	I1003 17:26:56.411623    2851 main.go:141] libmachine: About to run SSH command:

	sudo hostname image-329000 && echo "image-329000" | sudo tee /etc/hostname

	I1003 17:26:56.487223    2851 main.go:141] libmachine: SSH cmd err, output: <nil>: image-329000

	I1003 17:26:56.487274    2851 main.go:141] libmachine: Using SSH client type: native

	I1003 17:26:56.487525    2851 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x104721e60] 0x1047245d0 <nil>  [] 0s} 192.168.105.5 22 <nil> <nil>}

	I1003 17:26:56.487532    2851 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\simage-329000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 image-329000/g' /etc/hosts;

				else 

					echo '127.0.1.1 image-329000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1003 17:26:56.560765    2851 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1003 17:26:56.560773    2851 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/17345-986/.minikube CaCertPath:/Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/17345-986/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/17345-986/.minikube}

	I1003 17:26:56.560780    2851 buildroot.go:174] setting up certificates

	I1003 17:26:56.560784    2851 provision.go:83] configureAuth start

	I1003 17:26:56.560787    2851 provision.go:138] copyHostCerts

	I1003 17:26:56.560844    2851 exec_runner.go:144] found /Users/jenkins/minikube-integration/17345-986/.minikube/ca.pem, removing ...

	I1003 17:26:56.560851    2851 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17345-986/.minikube/ca.pem

	I1003 17:26:56.560970    2851 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/17345-986/.minikube/ca.pem (1082 bytes)

	I1003 17:26:56.561152    2851 exec_runner.go:144] found /Users/jenkins/minikube-integration/17345-986/.minikube/cert.pem, removing ...

	I1003 17:26:56.561154    2851 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17345-986/.minikube/cert.pem

	I1003 17:26:56.561195    2851 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/17345-986/.minikube/cert.pem (1123 bytes)

	I1003 17:26:56.561288    2851 exec_runner.go:144] found /Users/jenkins/minikube-integration/17345-986/.minikube/key.pem, removing ...

	I1003 17:26:56.561289    2851 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17345-986/.minikube/key.pem

	I1003 17:26:56.561340    2851 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/17345-986/.minikube/key.pem (1679 bytes)

	I1003 17:26:56.561427    2851 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/17345-986/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca-key.pem org=jenkins.image-329000 san=[192.168.105.5 192.168.105.5 localhost 127.0.0.1 minikube image-329000]

	I1003 17:26:56.651185    2851 provision.go:172] copyRemoteCerts

	I1003 17:26:56.651208    2851 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1003 17:26:56.651213    2851 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/image-329000/id_rsa Username:docker}

	I1003 17:26:56.689835    2851 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1003 17:26:56.696943    2851 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/machines/server.pem --> /etc/docker/server.pem (1212 bytes)

	I1003 17:26:56.704289    2851 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I1003 17:26:56.710890    2851 provision.go:86] duration metric: configureAuth took 150.105416ms

	I1003 17:26:56.710896    2851 buildroot.go:189] setting minikube options for container-runtime

	I1003 17:26:56.710992    2851 config.go:182] Loaded profile config "image-329000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 17:26:56.711025    2851 main.go:141] libmachine: Using SSH client type: native

	I1003 17:26:56.711242    2851 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x104721e60] 0x1047245d0 <nil>  [] 0s} 192.168.105.5 22 <nil> <nil>}

	I1003 17:26:56.711245    2851 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1003 17:26:56.782949    2851 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I1003 17:26:56.782955    2851 buildroot.go:70] root file system type: tmpfs

	I1003 17:26:56.783014    2851 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I1003 17:26:56.783067    2851 main.go:141] libmachine: Using SSH client type: native

	I1003 17:26:56.783334    2851 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x104721e60] 0x1047245d0 <nil>  [] 0s} 192.168.105.5 22 <nil> <nil>}

	I1003 17:26:56.783370    2851 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1003 17:26:56.859685    2851 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I1003 17:26:56.859738    2851 main.go:141] libmachine: Using SSH client type: native

	I1003 17:26:56.860000    2851 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x104721e60] 0x1047245d0 <nil>  [] 0s} 192.168.105.5 22 <nil> <nil>}

	I1003 17:26:56.860008    2851 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1003 17:26:57.189382    2851 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I1003 17:26:57.189390    2851 machine.go:91] provisioned docker machine in 778.124542ms

	I1003 17:26:57.189394    2851 client.go:171] LocalClient.Create took 14.266299s

	I1003 17:26:57.189412    2851 start.go:167] duration metric: libmachine.API.Create for "image-329000" took 14.266357583s

	I1003 17:26:57.189416    2851 start.go:300] post-start starting for "image-329000" (driver="qemu2")

	I1003 17:26:57.189420    2851 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1003 17:26:57.189498    2851 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1003 17:26:57.189506    2851 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/image-329000/id_rsa Username:docker}

	I1003 17:26:57.226046    2851 ssh_runner.go:195] Run: cat /etc/os-release

	I1003 17:26:57.227526    2851 info.go:137] Remote host: Buildroot 2021.02.12

	I1003 17:26:57.227535    2851 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17345-986/.minikube/addons for local assets ...

	I1003 17:26:57.227602    2851 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17345-986/.minikube/files for local assets ...

	I1003 17:26:57.227698    2851 filesync.go:149] local asset: /Users/jenkins/minikube-integration/17345-986/.minikube/files/etc/ssl/certs/14472.pem -> 14472.pem in /etc/ssl/certs

	I1003 17:26:57.227795    2851 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1003 17:26:57.230237    2851 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/files/etc/ssl/certs/14472.pem --> /etc/ssl/certs/14472.pem (1708 bytes)

	I1003 17:26:57.237449    2851 start.go:303] post-start completed in 48.030792ms

	I1003 17:26:57.237836    2851 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/config.json ...

	I1003 17:26:57.237991    2851 start.go:128] duration metric: createHost completed in 14.342175292s

	I1003 17:26:57.238015    2851 main.go:141] libmachine: Using SSH client type: native

	I1003 17:26:57.238227    2851 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x104721e60] 0x1047245d0 <nil>  [] 0s} 192.168.105.5 22 <nil> <nil>}

	I1003 17:26:57.238230    2851 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I1003 17:26:57.308483    2851 main.go:141] libmachine: SSH cmd err, output: <nil>: 1696379217.520050793

	I1003 17:26:57.308488    2851 fix.go:206] guest clock: 1696379217.520050793

	I1003 17:26:57.308491    2851 fix.go:219] Guest: 2023-10-03 17:26:57.520050793 -0700 PDT Remote: 2023-10-03 17:26:57.237993 -0700 PDT m=+14.447468876 (delta=282.057793ms)

	I1003 17:26:57.308501    2851 fix.go:190] guest clock delta is within tolerance: 282.057793ms

	I1003 17:26:57.308503    2851 start.go:83] releasing machines lock for "image-329000", held for 14.412722833s

	I1003 17:26:57.308806    2851 ssh_runner.go:195] Run: cat /version.json

	I1003 17:26:57.308812    2851 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/image-329000/id_rsa Username:docker}

	I1003 17:26:57.308817    2851 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I1003 17:26:57.308835    2851 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/image-329000/id_rsa Username:docker}

	I1003 17:26:57.346674    2851 ssh_runner.go:195] Run: systemctl --version

	I1003 17:26:57.390897    2851 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W1003 17:26:57.392861    2851 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I1003 17:26:57.392891    2851 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1003 17:26:57.398765    2851 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I1003 17:26:57.398770    2851 start.go:469] detecting cgroup driver to use...

	I1003 17:26:57.398838    2851 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1003 17:26:57.404473    2851 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I1003 17:26:57.407918    2851 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I1003 17:26:57.411119    2851 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...

	I1003 17:26:57.411139    2851 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I1003 17:26:57.414070    2851 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1003 17:26:57.417406    2851 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I1003 17:26:57.420688    2851 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1003 17:26:57.424048    2851 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1003 17:26:57.427086    2851 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I1003 17:26:57.429908    2851 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1003 17:26:57.433053    2851 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1003 17:26:57.436099    2851 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 17:26:57.496205    2851 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I1003 17:26:57.504275    2851 start.go:469] detecting cgroup driver to use...

	I1003 17:26:57.504342    2851 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1003 17:26:57.510700    2851 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1003 17:26:57.515497    2851 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I1003 17:26:57.521182    2851 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1003 17:26:57.526421    2851 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1003 17:26:57.530946    2851 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I1003 17:26:57.569394    2851 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1003 17:26:57.574660    2851 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1003 17:26:57.579913    2851 ssh_runner.go:195] Run: which cri-dockerd

	I1003 17:26:57.581184    2851 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I1003 17:26:57.584303    2851 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I1003 17:26:57.589584    2851 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I1003 17:26:57.652487    2851 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I1003 17:26:57.715906    2851 docker.go:554] configuring docker to use "cgroupfs" as cgroup driver...

	I1003 17:26:57.715961    2851 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I1003 17:26:57.721412    2851 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 17:26:57.786080    2851 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1003 17:26:58.946642    2851 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.160568209s)

	I1003 17:26:58.946692    2851 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I1003 17:26:59.024310    2851 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I1003 17:26:59.083218    2851 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I1003 17:26:59.143558    2851 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 17:26:59.201744    2851 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I1003 17:26:59.209194    2851 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 17:26:59.276301    2851 ssh_runner.go:195] Run: sudo systemctl restart cri-docker

	I1003 17:26:59.298737    2851 start.go:516] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I1003 17:26:59.298796    2851 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I1003 17:26:59.301413    2851 start.go:537] Will wait 60s for crictl version

	I1003 17:26:59.301456    2851 ssh_runner.go:195] Run: which crictl

	I1003 17:26:59.302983    2851 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I1003 17:26:59.321995    2851 start.go:553] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  24.0.6

	RuntimeApiVersion:  v1

	I1003 17:26:59.322066    2851 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1003 17:26:59.333418    2851 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1003 17:26:59.346809    2851 out.go:204] * Preparing Kubernetes v1.28.2 on Docker 24.0.6 ...

	I1003 17:26:59.346952    2851 ssh_runner.go:195] Run: grep 192.168.105.1	host.minikube.internal$ /etc/hosts

	I1003 17:26:59.348308    2851 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.105.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1003 17:26:59.352326    2851 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime docker

	I1003 17:26:59.352372    2851 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1003 17:26:59.360889    2851 docker.go:664] Got preloaded images: 

	I1003 17:26:59.360893    2851 docker.go:670] registry.k8s.io/kube-apiserver:v1.28.2 wasn't preloaded

	I1003 17:26:59.360924    2851 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I1003 17:26:59.363920    2851 ssh_runner.go:195] Run: which lz4

	I1003 17:26:59.365167    2851 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I1003 17:26:59.366410    2851 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I1003 17:26:59.366422    2851 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (356993689 bytes)

	I1003 17:27:00.662456    2851 docker.go:628] Took 1.297334 seconds to copy over tarball

	I1003 17:27:00.662510    2851 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4

	I1003 17:27:01.691815    2851 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (1.029311667s)

	I1003 17:27:01.691824    2851 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I1003 17:27:01.707322    2851 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I1003 17:27:01.710305    2851 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2629 bytes)

	I1003 17:27:01.715341    2851 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 17:27:01.774138    2851 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1003 17:27:03.245270    2851 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.471146292s)

	I1003 17:27:03.245345    2851 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1003 17:27:03.255725    2851 docker.go:664] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.28.2

	registry.k8s.io/kube-controller-manager:v1.28.2

	registry.k8s.io/kube-scheduler:v1.28.2

	registry.k8s.io/kube-proxy:v1.28.2

	registry.k8s.io/etcd:3.5.9-0

	registry.k8s.io/coredns/coredns:v1.10.1

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I1003 17:27:03.255731    2851 cache_images.go:84] Images are preloaded, skipping loading

	I1003 17:27:03.255787    2851 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I1003 17:27:03.263355    2851 cni.go:84] Creating CNI manager for ""

	I1003 17:27:03.263361    2851 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1003 17:27:03.263368    2851 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I1003 17:27:03.263376    2851 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.105.5 APIServerPort:8443 KubernetesVersion:v1.28.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:image-329000 NodeName:image-329000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.105.5"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.105.5 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kube

rnetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I1003 17:27:03.263442    2851 kubeadm.go:181] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.105.5

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "image-329000"

	  kubeletExtraArgs:

	    node-ip: 192.168.105.5

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.105.5"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.28.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1003 17:27:03.263471    2851 kubeadm.go:976] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.28.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=image-329000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.105.5

	[Install]

	 config:

	{KubernetesVersion:v1.28.2 ClusterName:image-329000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I1003 17:27:03.263525    2851 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.2

	I1003 17:27:03.266430    2851 binaries.go:44] Found k8s binaries, skipping transfer

	I1003 17:27:03.266454    2851 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1003 17:27:03.269292    2851 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (374 bytes)

	I1003 17:27:03.274437    2851 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1003 17:27:03.279296    2851 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2098 bytes)

	I1003 17:27:03.284556    2851 ssh_runner.go:195] Run: grep 192.168.105.5	control-plane.minikube.internal$ /etc/hosts

	I1003 17:27:03.285887    2851 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.105.5	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1003 17:27:03.289765    2851 certs.go:56] Setting up /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000 for IP: 192.168.105.5

	I1003 17:27:03.289772    2851 certs.go:190] acquiring lock for shared ca certs: {Name:mk60f926c1ccb065a30406b60af36acc708e601e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:27:03.289900    2851 certs.go:199] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/17345-986/.minikube/ca.key

	I1003 17:27:03.289935    2851 certs.go:199] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/17345-986/.minikube/proxy-client-ca.key

	I1003 17:27:03.289959    2851 certs.go:319] generating minikube-user signed cert: /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/client.key

	I1003 17:27:03.289965    2851 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/client.crt with IP's: []

	I1003 17:27:03.477304    2851 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/client.crt ...

	I1003 17:27:03.477309    2851 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/client.crt: {Name:mk3db56b1c4c181fe6a243e27789f44d44e3207a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:27:03.477582    2851 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/client.key ...

	I1003 17:27:03.477584    2851 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/client.key: {Name:mkbad821b2cfe8a5ca0b314c9aeedb5e7aab7bbd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:27:03.477700    2851 certs.go:319] generating minikube signed cert: /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/apiserver.key.e69b33ca

	I1003 17:27:03.477705    2851 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/apiserver.crt.e69b33ca with IP's: [192.168.105.5 10.96.0.1 127.0.0.1 10.0.0.1]

	I1003 17:27:03.556883    2851 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/apiserver.crt.e69b33ca ...

	I1003 17:27:03.556885    2851 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/apiserver.crt.e69b33ca: {Name:mk22282108492de843003fa615aea06c2e672e49 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:27:03.557020    2851 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/apiserver.key.e69b33ca ...

	I1003 17:27:03.557022    2851 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/apiserver.key.e69b33ca: {Name:mk1edf0f0e102ceb11cf1dfcc0f4346b4bb20a9e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:27:03.557125    2851 certs.go:337] copying /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/apiserver.crt.e69b33ca -> /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/apiserver.crt

	I1003 17:27:03.557370    2851 certs.go:341] copying /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/apiserver.key.e69b33ca -> /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/apiserver.key

	I1003 17:27:03.557499    2851 certs.go:319] generating aggregator signed cert: /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/proxy-client.key

	I1003 17:27:03.557505    2851 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/proxy-client.crt with IP's: []

	I1003 17:27:03.891443    2851 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/proxy-client.crt ...

	I1003 17:27:03.891450    2851 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/proxy-client.crt: {Name:mk08f1e15dfdc51a6693a2e7ac0d0b5bf68e0e92 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:27:03.891760    2851 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/proxy-client.key ...

	I1003 17:27:03.891762    2851 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/proxy-client.key: {Name:mk7441b245dfde48464bd8e2024e39fb28988894 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:27:03.892006    2851 certs.go:437] found cert: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/Users/jenkins/minikube-integration/17345-986/.minikube/certs/1447.pem (1338 bytes)

	W1003 17:27:03.892042    2851 certs.go:433] ignoring /Users/jenkins/minikube-integration/17345-986/.minikube/certs/Users/jenkins/minikube-integration/17345-986/.minikube/certs/1447_empty.pem, impossibly tiny 0 bytes

	I1003 17:27:03.892047    2851 certs.go:437] found cert: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca-key.pem (1679 bytes)

	I1003 17:27:03.892066    2851 certs.go:437] found cert: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/Users/jenkins/minikube-integration/17345-986/.minikube/certs/ca.pem (1082 bytes)

	I1003 17:27:03.892082    2851 certs.go:437] found cert: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/Users/jenkins/minikube-integration/17345-986/.minikube/certs/cert.pem (1123 bytes)

	I1003 17:27:03.892098    2851 certs.go:437] found cert: /Users/jenkins/minikube-integration/17345-986/.minikube/certs/Users/jenkins/minikube-integration/17345-986/.minikube/certs/key.pem (1679 bytes)

	I1003 17:27:03.892136    2851 certs.go:437] found cert: /Users/jenkins/minikube-integration/17345-986/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/17345-986/.minikube/files/etc/ssl/certs/14472.pem (1708 bytes)

	I1003 17:27:03.892514    2851 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I1003 17:27:03.900596    2851 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I1003 17:27:03.907815    2851 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1003 17:27:03.914697    2851 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/profiles/image-329000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I1003 17:27:03.921514    2851 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1003 17:27:03.928891    2851 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I1003 17:27:03.936143    2851 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1003 17:27:03.942656    2851 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I1003 17:27:03.949485    2851 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1003 17:27:03.956752    2851 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/certs/1447.pem --> /usr/share/ca-certificates/1447.pem (1338 bytes)

	I1003 17:27:03.963866    2851 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17345-986/.minikube/files/etc/ssl/certs/14472.pem --> /usr/share/ca-certificates/14472.pem (1708 bytes)

	I1003 17:27:03.970457    2851 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1003 17:27:03.975159    2851 ssh_runner.go:195] Run: openssl version

	I1003 17:27:03.977209    2851 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1003 17:27:03.980539    2851 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1003 17:27:03.981978    2851 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Oct  4 00:04 /usr/share/ca-certificates/minikubeCA.pem

	I1003 17:27:03.981996    2851 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1003 17:27:03.983757    2851 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1003 17:27:03.986663    2851 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1447.pem && ln -fs /usr/share/ca-certificates/1447.pem /etc/ssl/certs/1447.pem"

	I1003 17:27:03.989684    2851 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1447.pem

	I1003 17:27:03.991152    2851 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Oct  4 00:23 /usr/share/ca-certificates/1447.pem

	I1003 17:27:03.991167    2851 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1447.pem

	I1003 17:27:03.992969    2851 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1447.pem /etc/ssl/certs/51391683.0"

	I1003 17:27:03.996043    2851 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14472.pem && ln -fs /usr/share/ca-certificates/14472.pem /etc/ssl/certs/14472.pem"

	I1003 17:27:03.999045    2851 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14472.pem

	I1003 17:27:04.000425    2851 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Oct  4 00:23 /usr/share/ca-certificates/14472.pem

	I1003 17:27:04.000441    2851 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14472.pem

	I1003 17:27:04.002211    2851 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14472.pem /etc/ssl/certs/3ec20f2e.0"

	I1003 17:27:04.005321    2851 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd

	I1003 17:27:04.006547    2851 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory

	I1003 17:27:04.006576    2851 kubeadm.go:404] StartCluster: {Name:image-329000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696360059-17345@sha256:76d99edd1576614d5c20a839dd16ae1d7c810f3b909a01797063d483159ea3ae Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1

.28.2 ClusterName:image-329000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOpt

imizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I1003 17:27:04.006638    2851 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1003 17:27:04.019426    2851 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1003 17:27:04.022133    2851 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1003 17:27:04.025159    2851 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1003 17:27:04.027908    2851 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1003 17:27:04.027919    2851 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I1003 17:27:04.049526    2851 kubeadm.go:322] [init] Using Kubernetes version: v1.28.2

	I1003 17:27:04.049556    2851 kubeadm.go:322] [preflight] Running pre-flight checks

	I1003 17:27:04.107803    2851 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster

	I1003 17:27:04.107845    2851 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I1003 17:27:04.107898    2851 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I1003 17:27:04.206877    2851 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I1003 17:27:04.216062    2851 out.go:204]   - Generating certificates and keys ...

	I1003 17:27:04.216095    2851 kubeadm.go:322] [certs] Using existing ca certificate authority

	I1003 17:27:04.216124    2851 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk

	I1003 17:27:04.362192    2851 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key

	I1003 17:27:04.445906    2851 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key

	I1003 17:27:04.648758    2851 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key

	I1003 17:27:04.767841    2851 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key

	I1003 17:27:04.921939    2851 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key

	I1003 17:27:04.921996    2851 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [image-329000 localhost] and IPs [192.168.105.5 127.0.0.1 ::1]

	I1003 17:27:05.069604    2851 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key

	I1003 17:27:05.069666    2851 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [image-329000 localhost] and IPs [192.168.105.5 127.0.0.1 ::1]

	I1003 17:27:05.094779    2851 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key

	I1003 17:27:05.233795    2851 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key

	I1003 17:27:05.420933    2851 kubeadm.go:322] [certs] Generating "sa" key and public key

	I1003 17:27:05.420965    2851 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I1003 17:27:05.489593    2851 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file

	I1003 17:27:05.545074    2851 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I1003 17:27:05.819910    2851 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I1003 17:27:06.004802    2851 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I1003 17:27:06.005263    2851 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I1003 17:27:06.006685    2851 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I1003 17:27:06.013852    2851 out.go:204]   - Booting up control plane ...

	I1003 17:27:06.013941    2851 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I1003 17:27:06.013980    2851 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I1003 17:27:06.014018    2851 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I1003 17:27:06.014069    2851 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I1003 17:27:06.014108    2851 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I1003 17:27:06.014130    2851 kubeadm.go:322] [kubelet-start] Starting the kubelet

	I1003 17:27:06.103233    2851 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	I1003 17:27:10.106698    2851 kubeadm.go:322] [apiclient] All control plane components are healthy after 4.003752 seconds

	I1003 17:27:10.106752    2851 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I1003 17:27:10.116311    2851 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I1003 17:27:10.625848    2851 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs

	I1003 17:27:10.625935    2851 kubeadm.go:322] [mark-control-plane] Marking the node image-329000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I1003 17:27:11.130928    2851 kubeadm.go:322] [bootstrap-token] Using token: 43jofe.or1fcbtcuku2ig6w

	I1003 17:27:11.136144    2851 out.go:204]   - Configuring RBAC rules ...

	I1003 17:27:11.136196    2851 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I1003 17:27:11.137350    2851 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I1003 17:27:11.145699    2851 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I1003 17:27:11.146972    2851 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I1003 17:27:11.148203    2851 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I1003 17:27:11.149322    2851 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I1003 17:27:11.153218    2851 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I1003 17:27:11.321423    2851 kubeadm.go:322] [addons] Applied essential addon: CoreDNS

	I1003 17:27:11.539839    2851 kubeadm.go:322] [addons] Applied essential addon: kube-proxy

	I1003 17:27:11.540258    2851 kubeadm.go:322] 

	I1003 17:27:11.540290    2851 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!

	I1003 17:27:11.540292    2851 kubeadm.go:322] 

	I1003 17:27:11.540326    2851 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:

	I1003 17:27:11.540329    2851 kubeadm.go:322] 

	I1003 17:27:11.540340    2851 kubeadm.go:322]   mkdir -p $HOME/.kube

	I1003 17:27:11.540376    2851 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I1003 17:27:11.540416    2851 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I1003 17:27:11.540419    2851 kubeadm.go:322] 

	I1003 17:27:11.540443    2851 kubeadm.go:322] Alternatively, if you are the root user, you can run:

	I1003 17:27:11.540447    2851 kubeadm.go:322] 

	I1003 17:27:11.540472    2851 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I1003 17:27:11.540474    2851 kubeadm.go:322] 

	I1003 17:27:11.540497    2851 kubeadm.go:322] You should now deploy a pod network to the cluster.

	I1003 17:27:11.540538    2851 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I1003 17:27:11.540570    2851 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I1003 17:27:11.540572    2851 kubeadm.go:322] 

	I1003 17:27:11.540621    2851 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities

	I1003 17:27:11.540663    2851 kubeadm.go:322] and service account keys on each node and then running the following as root:

	I1003 17:27:11.540666    2851 kubeadm.go:322] 

	I1003 17:27:11.540715    2851 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token 43jofe.or1fcbtcuku2ig6w \

	I1003 17:27:11.540772    2851 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:9490a7a2ce6f448c9720863afea1604779c0ef0543f588db367e732362807037 \

	I1003 17:27:11.540782    2851 kubeadm.go:322] 	--control-plane 

	I1003 17:27:11.540784    2851 kubeadm.go:322] 

	I1003 17:27:11.540831    2851 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:

	I1003 17:27:11.540833    2851 kubeadm.go:322] 

	I1003 17:27:11.540868    2851 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token 43jofe.or1fcbtcuku2ig6w \

	I1003 17:27:11.540916    2851 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:9490a7a2ce6f448c9720863afea1604779c0ef0543f588db367e732362807037 

	I1003 17:27:11.541017    2851 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I1003 17:27:11.541023    2851 cni.go:84] Creating CNI manager for ""

	I1003 17:27:11.541031    2851 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1003 17:27:11.547527    2851 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I1003 17:27:11.553495    2851 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I1003 17:27:11.556637    2851 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)

	I1003 17:27:11.561524    2851 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I1003 17:27:11.561588    2851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:27:11.561591    2851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl label nodes minikube.k8s.io/version=v1.31.2 minikube.k8s.io/commit=d9526fa6c1a1bb1b20f95e15606f1308e308d84a minikube.k8s.io/name=image-329000 minikube.k8s.io/updated_at=2023_10_03T17_27_11_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I1003 17:27:11.573725    2851 ops.go:34] apiserver oom_adj: -16

	I1003 17:27:11.620286    2851 kubeadm.go:1081] duration metric: took 58.723791ms to wait for elevateKubeSystemPrivileges.

	I1003 17:27:11.626342    2851 kubeadm.go:406] StartCluster complete in 7.619909792s

	I1003 17:27:11.626354    2851 settings.go:142] acquiring lock: {Name:mkad5f21e92defa14247d9a0adf05a6e4272cec8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:27:11.626425    2851 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/17345-986/kubeconfig

	I1003 17:27:11.626984    2851 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17345-986/kubeconfig: {Name:mke3e06a6a2057954076f4772b87ca4469721c09 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 17:27:11.627324    2851 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I1003 17:27:11.627407    2851 config.go:182] Loaded profile config "image-329000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 17:27:11.627411    2851 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false]

	I1003 17:27:11.627542    2851 addons.go:69] Setting default-storageclass=true in profile "image-329000"

	I1003 17:27:11.627549    2851 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "image-329000"

	I1003 17:27:11.627568    2851 addons.go:69] Setting storage-provisioner=true in profile "image-329000"

	I1003 17:27:11.627574    2851 addons.go:231] Setting addon storage-provisioner=true in "image-329000"

	I1003 17:27:11.627601    2851 host.go:66] Checking if "image-329000" exists ...

	I1003 17:27:11.628923    2851 addons.go:231] Setting addon default-storageclass=true in "image-329000"

	I1003 17:27:11.628930    2851 host.go:66] Checking if "image-329000" exists ...

	I1003 17:27:11.633001    2851 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I1003 17:27:11.629573    2851 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml

	I1003 17:27:11.637021    2851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I1003 17:27:11.637032    2851 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/image-329000/id_rsa Username:docker}

	I1003 17:27:11.637099    2851 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I1003 17:27:11.637102    2851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I1003 17:27:11.637105    2851 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17345-986/.minikube/machines/image-329000/id_rsa Username:docker}

	I1003 17:27:11.639536    2851 kapi.go:248] "coredns" deployment in "kube-system" namespace and "image-329000" context rescaled to 1 replicas

	I1003 17:27:11.639550    2851 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1003 17:27:11.641870    2851 out.go:177] * Verifying Kubernetes components...

	I1003 17:27:11.646048    2851 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1003 17:27:11.672310    2851 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.105.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.28.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I1003 17:27:11.672658    2851 api_server.go:52] waiting for apiserver process to appear ...

	I1003 17:27:11.672690    2851 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1003 17:27:11.710895    2851 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I1003 17:27:11.731176    2851 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1003 17:27:12.083584    2851 api_server.go:72] duration metric: took 444.028792ms to wait for apiserver process to appear ...

	I1003 17:27:12.083590    2851 api_server.go:88] waiting for apiserver healthz status ...

	I1003 17:27:12.083597    2851 api_server.go:253] Checking apiserver healthz at https://192.168.105.5:8443/healthz ...

	I1003 17:27:12.083629    2851 start.go:923] {"host.minikube.internal": 192.168.105.1} host record injected into CoreDNS's ConfigMap

	I1003 17:27:12.086708    2851 api_server.go:279] https://192.168.105.5:8443/healthz returned 200:

	ok

	I1003 17:27:12.087527    2851 api_server.go:141] control plane version: v1.28.2

	I1003 17:27:12.087531    2851 api_server.go:131] duration metric: took 3.938709ms to wait for apiserver health ...

	I1003 17:27:12.087535    2851 system_pods.go:43] waiting for kube-system pods to appear ...

	I1003 17:27:12.091348    2851 system_pods.go:59] 4 kube-system pods found

	I1003 17:27:12.091354    2851 system_pods.go:61] "etcd-image-329000" [dc37c778-a1d6-4642-8226-af9ec70505b9] Pending

	I1003 17:27:12.091356    2851 system_pods.go:61] "kube-apiserver-image-329000" [77d61d7c-d103-42b6-afaf-66eb46cc96a9] Pending

	I1003 17:27:12.091358    2851 system_pods.go:61] "kube-controller-manager-image-329000" [a0ea702e-4d11-495f-b5a4-9cfc38ed99d2] Pending

	I1003 17:27:12.091359    2851 system_pods.go:61] "kube-scheduler-image-329000" [7724e046-6efc-4b43-9a9f-2eb0bca483ce] Pending

	I1003 17:27:12.091361    2851 system_pods.go:74] duration metric: took 3.824542ms to wait for pod list to return data ...

	I1003 17:27:12.091364    2851 kubeadm.go:581] duration metric: took 451.814458ms to wait for : map[apiserver:true system_pods:true] ...

	I1003 17:27:12.091369    2851 node_conditions.go:102] verifying NodePressure condition ...

	I1003 17:27:12.092669    2851 node_conditions.go:122] node storage ephemeral capacity is 17784760Ki

	I1003 17:27:12.092677    2851 node_conditions.go:123] node cpu capacity is 2

	I1003 17:27:12.092682    2851 node_conditions.go:105] duration metric: took 1.311ms to run NodePressure ...

	I1003 17:27:12.092686    2851 start.go:228] waiting for startup goroutines ...

	I1003 17:27:12.181196    2851 out.go:177] * Enabled addons: default-storageclass, storage-provisioner

	I1003 17:27:12.189261    2851 addons.go:502] enable addons completed in 561.9175ms: enabled=[default-storageclass storage-provisioner]

	I1003 17:27:12.189275    2851 start.go:233] waiting for cluster config update ...

	I1003 17:27:12.189279    2851 start.go:242] writing updated cluster config ...

	I1003 17:27:12.189577    2851 ssh_runner.go:195] Run: rm -f paused

	I1003 17:27:12.218523    2851 start.go:600] kubectl: 1.27.2, cluster: 1.28.2 (minor skew: 1)

	I1003 17:27:12.223222    2851 out.go:177] * Done! kubectl is now configured to use "image-329000" cluster and "default" namespace by default

	* 

	* ==> Docker <==

	* -- Journal begins at Wed 2023-10-04 00:26:54 UTC, ends at Wed 2023-10-04 00:27:14 UTC. --

	Oct 04 00:27:07 image-329000 dockerd[1114]: time="2023-10-04T00:27:07.380908756Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Oct 04 00:27:07 image-329000 dockerd[1114]: time="2023-10-04T00:27:07.380915381Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 04 00:27:07 image-329000 dockerd[1114]: time="2023-10-04T00:27:07.382807006Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Oct 04 00:27:07 image-329000 dockerd[1114]: time="2023-10-04T00:27:07.382827214Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 04 00:27:07 image-329000 dockerd[1114]: time="2023-10-04T00:27:07.382833756Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Oct 04 00:27:07 image-329000 dockerd[1114]: time="2023-10-04T00:27:07.382838006Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 04 00:27:07 image-329000 dockerd[1114]: time="2023-10-04T00:27:07.411128548Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Oct 04 00:27:07 image-329000 dockerd[1114]: time="2023-10-04T00:27:07.411259839Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 04 00:27:07 image-329000 dockerd[1114]: time="2023-10-04T00:27:07.411287506Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Oct 04 00:27:07 image-329000 dockerd[1114]: time="2023-10-04T00:27:07.411312714Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 04 00:27:07 image-329000 dockerd[1114]: time="2023-10-04T00:27:07.467112714Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Oct 04 00:27:07 image-329000 dockerd[1114]: time="2023-10-04T00:27:07.467135964Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 04 00:27:07 image-329000 dockerd[1114]: time="2023-10-04T00:27:07.467141506Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Oct 04 00:27:07 image-329000 dockerd[1114]: time="2023-10-04T00:27:07.467252339Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 04 00:27:13 image-329000 dockerd[1108]: time="2023-10-04T00:27:13.457792926Z" level=info msg="Layer sha256:5e5d01bb2a8d3e34816f24ff1a055b5d084e5a5a1919cd77684120916d61c3eb cleaned up"

	Oct 04 00:27:13 image-329000 dockerd[1108]: time="2023-10-04T00:27:13.583558801Z" level=info msg="Layer sha256:5e5d01bb2a8d3e34816f24ff1a055b5d084e5a5a1919cd77684120916d61c3eb cleaned up"

	Oct 04 00:27:13 image-329000 dockerd[1108]: time="2023-10-04T00:27:13.600275884Z" level=info msg="Layer sha256:5e5d01bb2a8d3e34816f24ff1a055b5d084e5a5a1919cd77684120916d61c3eb cleaned up"

	Oct 04 00:27:13 image-329000 dockerd[1114]: time="2023-10-04T00:27:13.640624759Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Oct 04 00:27:13 image-329000 dockerd[1114]: time="2023-10-04T00:27:13.640658426Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 04 00:27:13 image-329000 dockerd[1114]: time="2023-10-04T00:27:13.640665926Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Oct 04 00:27:13 image-329000 dockerd[1114]: time="2023-10-04T00:27:13.640866051Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 04 00:27:13 image-329000 dockerd[1108]: time="2023-10-04T00:27:13.761794426Z" level=info msg="ignoring event" container=99642807770fb59abd00c452639d912eaf6991fec6efbaf3c1975abe8812d037 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Oct 04 00:27:13 image-329000 dockerd[1114]: time="2023-10-04T00:27:13.761964884Z" level=info msg="shim disconnected" id=99642807770fb59abd00c452639d912eaf6991fec6efbaf3c1975abe8812d037 namespace=moby

	Oct 04 00:27:13 image-329000 dockerd[1114]: time="2023-10-04T00:27:13.761994009Z" level=warning msg="cleaning up after shim disconnected" id=99642807770fb59abd00c452639d912eaf6991fec6efbaf3c1975abe8812d037 namespace=moby

	Oct 04 00:27:13 image-329000 dockerd[1114]: time="2023-10-04T00:27:13.761998592Z" level=info msg="cleaning up dead shim" namespace=moby

	* 

	* ==> container status <==

	* CONTAINER           IMAGE               CREATED             STATE               NAME                      ATTEMPT             POD ID              POD

	6eedc8f439e51       64fc40cee3716       7 seconds ago       Running             kube-scheduler            0                   8fd7f9b4f4971       kube-scheduler-image-329000

	913698178eb82       9cdd6470f48c8       7 seconds ago       Running             etcd                      0                   12e41af44ded2       etcd-image-329000

	cc281224b290d       89d57b83c1786       7 seconds ago       Running             kube-controller-manager   0                   0e06c19eb0a31       kube-controller-manager-image-329000

	5b0a0cfabdd3c       30bb499447fe1       7 seconds ago       Running             kube-apiserver            0                   e992b4fcc7fcf       kube-apiserver-image-329000

	* 

	* ==> describe nodes <==

	* Name:               image-329000

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=image-329000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=d9526fa6c1a1bb1b20f95e15606f1308e308d84a

	                    minikube.k8s.io/name=image-329000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2023_10_03T17_27_11_0700

	                    minikube.k8s.io/version=v1.31.2

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 04 Oct 2023 00:27:09 +0000

	Taints:             node.kubernetes.io/not-ready:NoSchedule

	Unschedulable:      false

	Lease:

	  HolderIdentity:  image-329000

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 04 Oct 2023 00:27:11 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 04 Oct 2023 00:27:11 +0000   Wed, 04 Oct 2023 00:27:08 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 04 Oct 2023 00:27:11 +0000   Wed, 04 Oct 2023 00:27:08 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 04 Oct 2023 00:27:11 +0000   Wed, 04 Oct 2023 00:27:08 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            False   Wed, 04 Oct 2023 00:27:11 +0000   Wed, 04 Oct 2023 00:27:08 +0000   KubeletNotReady              container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized

	Addresses:

	  InternalIP:  192.168.105.5

	  Hostname:    image-329000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17784760Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3905012Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17784760Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3905012Ki

	  pods:               110

	System Info:

	  Machine ID:                 1977ce02a99c4e31b40d7a9cec05b494

	  System UUID:                1977ce02a99c4e31b40d7a9cec05b494

	  Boot ID:                    0cc7b4ce-da3e-4f35-a8fb-0b5286237b43

	  Kernel Version:             5.10.57

	  OS Image:                   Buildroot 2021.02.12

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  docker://24.0.6

	  Kubelet Version:            v1.28.2

	  Kube-Proxy Version:         v1.28.2

	Non-terminated Pods:          (4 in total)

	  Namespace                   Name                                    CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                    ------------  ----------  ---------------  -------------  ---

	  kube-system                 etcd-image-329000                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (2%!)(MISSING)       0 (0%!)(MISSING)         3s

	  kube-system                 kube-apiserver-image-329000             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3s

	  kube-system                 kube-controller-manager-image-329000    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3s

	  kube-system                 kube-scheduler-image-329000             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                650m (32%!)(MISSING)  0 (0%!)(MISSING)

	  memory             100Mi (2%!)(MISSING)  0 (0%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age   From     Message

	  ----    ------                   ----  ----     -------

	  Normal  Starting                 3s    kubelet  Starting kubelet.

	  Normal  NodeAllocatableEnforced  3s    kubelet  Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  3s    kubelet  Node image-329000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    3s    kubelet  Node image-329000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     3s    kubelet  Node image-329000 status is now: NodeHasSufficientPID

	* 

	* ==> dmesg <==

	* [Oct 4 00:26] ACPI: SRAT not present

	[  +0.000000] KASLR disabled due to lack of seed

	[  +0.645406] EINJ: EINJ table not found.

	[  +0.523878] systemd-fstab-generator[117]: Ignoring "noauto" for root device

	[  +0.044108] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.

	[  +0.000885] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)

	[  +3.134891] systemd-fstab-generator[481]: Ignoring "noauto" for root device

	[  +0.060065] systemd-fstab-generator[493]: Ignoring "noauto" for root device

	[  +0.440283] systemd-fstab-generator[672]: Ignoring "noauto" for root device

	[  +0.154368] systemd-fstab-generator[708]: Ignoring "noauto" for root device

	[  +0.063115] systemd-fstab-generator[719]: Ignoring "noauto" for root device

	[  +0.068740] systemd-fstab-generator[732]: Ignoring "noauto" for root device

	[  +1.147154] kauditd_printk_skb: 17 callbacks suppressed

	[  +0.092392] systemd-fstab-generator[921]: Ignoring "noauto" for root device

	[  +0.058828] systemd-fstab-generator[932]: Ignoring "noauto" for root device

	[  +0.062059] systemd-fstab-generator[943]: Ignoring "noauto" for root device

	[  +0.059622] systemd-fstab-generator[954]: Ignoring "noauto" for root device

	[  +0.070508] systemd-fstab-generator[995]: Ignoring "noauto" for root device

	[Oct 4 00:27] systemd-fstab-generator[1101]: Ignoring "noauto" for root device

	[  +4.323336] systemd-fstab-generator[1485]: Ignoring "noauto" for root device

	[  +0.353642] kauditd_printk_skb: 68 callbacks suppressed

	[  +4.760872] systemd-fstab-generator[2195]: Ignoring "noauto" for root device

	[  +2.227200] kauditd_printk_skb: 2 callbacks suppressed

	* 

	* ==> etcd [913698178eb8] <==

	* {"level":"info","ts":"2023-10-04T00:27:07.508691Z","caller":"embed/etcd.go:597","msg":"serving peer traffic","address":"192.168.105.5:2380"}

	{"level":"info","ts":"2023-10-04T00:27:07.508764Z","caller":"embed/etcd.go:569","msg":"cmux::serve","address":"192.168.105.5:2380"}

	{"level":"info","ts":"2023-10-04T00:27:07.509063Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"58de0efec1d86300 switched to configuration voters=(6403572207504089856)"}

	{"level":"info","ts":"2023-10-04T00:27:07.509122Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"cd5c0afff2184bea","local-member-id":"58de0efec1d86300","added-peer-id":"58de0efec1d86300","added-peer-peer-urls":["https://192.168.105.5:2380"]}

	{"level":"info","ts":"2023-10-04T00:27:07.50864Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap.db","max":5,"interval":"30s"}

	{"level":"info","ts":"2023-10-04T00:27:07.509242Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap","max":5,"interval":"30s"}

	{"level":"info","ts":"2023-10-04T00:27:07.509282Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/wal","suffix":"wal","max":5,"interval":"30s"}

	{"level":"info","ts":"2023-10-04T00:27:08.49715Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"58de0efec1d86300 is starting a new election at term 1"}

	{"level":"info","ts":"2023-10-04T00:27:08.497303Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"58de0efec1d86300 became pre-candidate at term 1"}

	{"level":"info","ts":"2023-10-04T00:27:08.497374Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"58de0efec1d86300 received MsgPreVoteResp from 58de0efec1d86300 at term 1"}

	{"level":"info","ts":"2023-10-04T00:27:08.497735Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"58de0efec1d86300 became candidate at term 2"}

	{"level":"info","ts":"2023-10-04T00:27:08.497848Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"58de0efec1d86300 received MsgVoteResp from 58de0efec1d86300 at term 2"}

	{"level":"info","ts":"2023-10-04T00:27:08.498032Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"58de0efec1d86300 became leader at term 2"}

	{"level":"info","ts":"2023-10-04T00:27:08.498087Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 58de0efec1d86300 elected leader 58de0efec1d86300 at term 2"}

	{"level":"info","ts":"2023-10-04T00:27:08.500125Z","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}

	{"level":"info","ts":"2023-10-04T00:27:08.501327Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"58de0efec1d86300","local-member-attributes":"{Name:image-329000 ClientURLs:[https://192.168.105.5:2379]}","request-path":"/0/members/58de0efec1d86300/attributes","cluster-id":"cd5c0afff2184bea","publish-timeout":"7s"}

	{"level":"info","ts":"2023-10-04T00:27:08.501619Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"cd5c0afff2184bea","local-member-id":"58de0efec1d86300","cluster-version":"3.5"}

	{"level":"info","ts":"2023-10-04T00:27:08.501761Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2023-10-04T00:27:08.502091Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}

	{"level":"info","ts":"2023-10-04T00:27:08.5021Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-10-04T00:27:08.502325Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2023-10-04T00:27:08.502427Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2023-10-04T00:27:08.502146Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-10-04T00:27:08.505067Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.5:2379"}

	{"level":"info","ts":"2023-10-04T00:27:08.505106Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	* 

	* ==> kernel <==

	*  00:27:14 up 0 min,  0 users,  load average: 0.47, 0.11, 0.04

	Linux image-329000 5.10.57 #1 SMP PREEMPT Mon Sep 18 20:10:16 UTC 2023 aarch64 GNU/Linux

	PRETTY_NAME="Buildroot 2021.02.12"

	* 

	* ==> kube-apiserver [5b0a0cfabdd3] <==

	* I1004 00:27:09.159323       1 apf_controller.go:377] Running API Priority and Fairness config worker

	I1004 00:27:09.159337       1 apf_controller.go:380] Running API Priority and Fairness periodic rebalancing process

	I1004 00:27:09.159930       1 controller.go:624] quota admission added evaluator for: namespaces

	I1004 00:27:09.161370       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller

	I1004 00:27:09.161998       1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller

	I1004 00:27:09.162259       1 shared_informer.go:318] Caches are synced for crd-autoregister

	I1004 00:27:09.162522       1 aggregator.go:166] initial CRD sync complete...

	I1004 00:27:09.162534       1 autoregister_controller.go:141] Starting autoregister controller

	I1004 00:27:09.162536       1 cache.go:32] Waiting for caches to sync for autoregister controller

	I1004 00:27:09.162539       1 cache.go:39] Caches are synced for autoregister controller

	I1004 00:27:09.168290       1 shared_informer.go:318] Caches are synced for node_authorizer

	I1004 00:27:09.179931       1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io

	I1004 00:27:10.063697       1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000

	I1004 00:27:10.065769       1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000

	I1004 00:27:10.065815       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.

	I1004 00:27:10.206527       1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I1004 00:27:10.216777       1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	I1004 00:27:10.263004       1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}

	W1004 00:27:10.265031       1 lease.go:263] Resetting endpoints for master service "kubernetes" to [192.168.105.5]

	I1004 00:27:10.265382       1 controller.go:624] quota admission added evaluator for: endpoints

	I1004 00:27:10.267011       1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I1004 00:27:11.089825       1 controller.go:624] quota admission added evaluator for: serviceaccounts

	I1004 00:27:11.528782       1 controller.go:624] quota admission added evaluator for: deployments.apps

	I1004 00:27:11.532855       1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}

	I1004 00:27:11.538220       1 controller.go:624] quota admission added evaluator for: daemonsets.apps

	* 

	* ==> kube-controller-manager [cc281224b290] <==

	* I1004 00:27:13.990761       1 resource_quota_monitor.go:210] "QuotaMonitor created object count evaluator" resource="daemonsets.apps"

	I1004 00:27:13.990770       1 resource_quota_monitor.go:210] "QuotaMonitor created object count evaluator" resource="rolebindings.rbac.authorization.k8s.io"

	I1004 00:27:13.990777       1 resource_quota_monitor.go:210] "QuotaMonitor created object count evaluator" resource="endpoints"

	I1004 00:27:13.990785       1 resource_quota_monitor.go:210] "QuotaMonitor created object count evaluator" resource="podtemplates"

	I1004 00:27:13.990797       1 resource_quota_monitor.go:210] "QuotaMonitor created object count evaluator" resource="cronjobs.batch"

	I1004 00:27:13.990812       1 resource_quota_monitor.go:210] "QuotaMonitor created object count evaluator" resource="leases.coordination.k8s.io"

	I1004 00:27:13.990824       1 resource_quota_monitor.go:210] "QuotaMonitor created object count evaluator" resource="limitranges"

	I1004 00:27:13.990829       1 resource_quota_monitor.go:210] "QuotaMonitor created object count evaluator" resource="replicasets.apps"

	I1004 00:27:13.990834       1 resource_quota_monitor.go:210] "QuotaMonitor created object count evaluator" resource="deployments.apps"

	I1004 00:27:13.990842       1 resource_quota_monitor.go:210] "QuotaMonitor created object count evaluator" resource="poddisruptionbudgets.policy"

	W1004 00:27:13.990855       1 shared_informer.go:593] resyncPeriod 13h13m49.883779725s is smaller than resyncCheckPeriod 17h20m20.250511555s and the informer has already started. Changing it to 17h20m20.250511555s

	I1004 00:27:13.990870       1 resource_quota_monitor.go:210] "QuotaMonitor created object count evaluator" resource="serviceaccounts"

	I1004 00:27:13.990876       1 resource_quota_monitor.go:210] "QuotaMonitor created object count evaluator" resource="roles.rbac.authorization.k8s.io"

	I1004 00:27:13.990882       1 resource_quota_monitor.go:210] "QuotaMonitor created object count evaluator" resource="endpointslices.discovery.k8s.io"

	I1004 00:27:13.990893       1 resource_quota_monitor.go:210] "QuotaMonitor created object count evaluator" resource="horizontalpodautoscalers.autoscaling"

	I1004 00:27:13.990898       1 resource_quota_monitor.go:210] "QuotaMonitor created object count evaluator" resource="jobs.batch"

	I1004 00:27:13.990906       1 resource_quota_monitor.go:210] "QuotaMonitor created object count evaluator" resource="ingresses.networking.k8s.io"

	I1004 00:27:13.990912       1 resource_quota_monitor.go:210] "QuotaMonitor created object count evaluator" resource="statefulsets.apps"

	I1004 00:27:13.990925       1 controllermanager.go:642] "Started controller" controller="resourcequota-controller"

	I1004 00:27:13.991004       1 resource_quota_controller.go:295] "Starting resource quota controller"

	I1004 00:27:13.991009       1 shared_informer.go:311] Waiting for caches to sync for resource quota

	I1004 00:27:13.991017       1 resource_quota_monitor.go:291] "QuotaMonitor running"

	I1004 00:27:14.241282       1 controllermanager.go:642] "Started controller" controller="namespace-controller"

	I1004 00:27:14.241456       1 namespace_controller.go:197] "Starting namespace controller"

	I1004 00:27:14.241460       1 shared_informer.go:311] Waiting for caches to sync for namespace

	* 

	* ==> kube-scheduler [6eedc8f439e5] <==

	* W1004 00:27:09.136110       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E1004 00:27:09.136122       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W1004 00:27:09.136145       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E1004 00:27:09.136244       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	W1004 00:27:09.958955       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1004 00:27:09.959008       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	W1004 00:27:09.967585       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E1004 00:27:09.967598       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	W1004 00:27:09.973772       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E1004 00:27:09.973782       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W1004 00:27:10.029573       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E1004 00:27:10.029583       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	W1004 00:27:10.053232       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E1004 00:27:10.053246       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	W1004 00:27:10.072043       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E1004 00:27:10.072059       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	W1004 00:27:10.100152       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E1004 00:27:10.100245       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	W1004 00:27:10.105802       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E1004 00:27:10.105850       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	W1004 00:27:10.124313       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E1004 00:27:10.124331       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	W1004 00:27:10.133059       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E1004 00:27:10.133117       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	I1004 00:27:10.424871       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	* 

	* ==> kubelet <==

	* -- Journal begins at Wed 2023-10-04 00:26:54 UTC, ends at Wed 2023-10-04 00:27:14 UTC. --

	Oct 04 00:27:11 image-329000 kubelet[2201]: I1004 00:27:11.688383    2201 topology_manager.go:215] "Topology Admit Handler" podUID="c4eaea8f307aeb9e3b1f69475b461d8c" podNamespace="kube-system" podName="kube-controller-manager-image-329000"

	Oct 04 00:27:11 image-329000 kubelet[2201]: I1004 00:27:11.688400    2201 topology_manager.go:215] "Topology Admit Handler" podUID="84796ce4422a8feb25b67e35bf823db7" podNamespace="kube-system" podName="kube-scheduler-image-329000"

	Oct 04 00:27:11 image-329000 kubelet[2201]: I1004 00:27:11.688412    2201 topology_manager.go:215] "Topology Admit Handler" podUID="2414ef2e87d590c46acf59bd230af081" podNamespace="kube-system" podName="etcd-image-329000"

	Oct 04 00:27:11 image-329000 kubelet[2201]: I1004 00:27:11.691144    2201 kubelet_node_status.go:70] "Attempting to register node" node="image-329000"

	Oct 04 00:27:11 image-329000 kubelet[2201]: I1004 00:27:11.696447    2201 kubelet_node_status.go:108] "Node was previously registered" node="image-329000"

	Oct 04 00:27:11 image-329000 kubelet[2201]: I1004 00:27:11.696484    2201 kubelet_node_status.go:73] "Successfully registered node" node="image-329000"

	Oct 04 00:27:11 image-329000 kubelet[2201]: I1004 00:27:11.786420    2201 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-certs\" (UniqueName: \"kubernetes.io/host-path/2414ef2e87d590c46acf59bd230af081-etcd-certs\") pod \"etcd-image-329000\" (UID: \"2414ef2e87d590c46acf59bd230af081\") " pod="kube-system/etcd-image-329000"

	Oct 04 00:27:11 image-329000 kubelet[2201]: I1004 00:27:11.786437    2201 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/08275d1e965d432205e5708a2ca5b47d-ca-certs\") pod \"kube-apiserver-image-329000\" (UID: \"08275d1e965d432205e5708a2ca5b47d\") " pod="kube-system/kube-apiserver-image-329000"

	Oct 04 00:27:11 image-329000 kubelet[2201]: I1004 00:27:11.786448    2201 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/08275d1e965d432205e5708a2ca5b47d-k8s-certs\") pod \"kube-apiserver-image-329000\" (UID: \"08275d1e965d432205e5708a2ca5b47d\") " pod="kube-system/kube-apiserver-image-329000"

	Oct 04 00:27:11 image-329000 kubelet[2201]: I1004 00:27:11.786457    2201 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/c4eaea8f307aeb9e3b1f69475b461d8c-ca-certs\") pod \"kube-controller-manager-image-329000\" (UID: \"c4eaea8f307aeb9e3b1f69475b461d8c\") " pod="kube-system/kube-controller-manager-image-329000"

	Oct 04 00:27:11 image-329000 kubelet[2201]: I1004 00:27:11.786676    2201 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flexvolume-dir\" (UniqueName: \"kubernetes.io/host-path/c4eaea8f307aeb9e3b1f69475b461d8c-flexvolume-dir\") pod \"kube-controller-manager-image-329000\" (UID: \"c4eaea8f307aeb9e3b1f69475b461d8c\") " pod="kube-system/kube-controller-manager-image-329000"

	Oct 04 00:27:11 image-329000 kubelet[2201]: I1004 00:27:11.786688    2201 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/c4eaea8f307aeb9e3b1f69475b461d8c-kubeconfig\") pod \"kube-controller-manager-image-329000\" (UID: \"c4eaea8f307aeb9e3b1f69475b461d8c\") " pod="kube-system/kube-controller-manager-image-329000"

	Oct 04 00:27:11 image-329000 kubelet[2201]: I1004 00:27:11.786697    2201 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/c4eaea8f307aeb9e3b1f69475b461d8c-usr-share-ca-certificates\") pod \"kube-controller-manager-image-329000\" (UID: \"c4eaea8f307aeb9e3b1f69475b461d8c\") " pod="kube-system/kube-controller-manager-image-329000"

	Oct 04 00:27:11 image-329000 kubelet[2201]: I1004 00:27:11.786707    2201 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/08275d1e965d432205e5708a2ca5b47d-usr-share-ca-certificates\") pod \"kube-apiserver-image-329000\" (UID: \"08275d1e965d432205e5708a2ca5b47d\") " pod="kube-system/kube-apiserver-image-329000"

	Oct 04 00:27:11 image-329000 kubelet[2201]: I1004 00:27:11.786715    2201 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/c4eaea8f307aeb9e3b1f69475b461d8c-k8s-certs\") pod \"kube-controller-manager-image-329000\" (UID: \"c4eaea8f307aeb9e3b1f69475b461d8c\") " pod="kube-system/kube-controller-manager-image-329000"

	Oct 04 00:27:11 image-329000 kubelet[2201]: I1004 00:27:11.786744    2201 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/84796ce4422a8feb25b67e35bf823db7-kubeconfig\") pod \"kube-scheduler-image-329000\" (UID: \"84796ce4422a8feb25b67e35bf823db7\") " pod="kube-system/kube-scheduler-image-329000"

	Oct 04 00:27:11 image-329000 kubelet[2201]: I1004 00:27:11.786754    2201 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-data\" (UniqueName: \"kubernetes.io/host-path/2414ef2e87d590c46acf59bd230af081-etcd-data\") pod \"etcd-image-329000\" (UID: \"2414ef2e87d590c46acf59bd230af081\") " pod="kube-system/etcd-image-329000"

	Oct 04 00:27:12 image-329000 kubelet[2201]: I1004 00:27:12.570691    2201 apiserver.go:52] "Watching apiserver"

	Oct 04 00:27:12 image-329000 kubelet[2201]: I1004 00:27:12.586048    2201 desired_state_of_world_populator.go:159] "Finished populating initial desired state of world"

	Oct 04 00:27:12 image-329000 kubelet[2201]: E1004 00:27:12.642118    2201 kubelet.go:1890] "Failed creating a mirror pod for" err="pods \"kube-apiserver-image-329000\" already exists" pod="kube-system/kube-apiserver-image-329000"

	Oct 04 00:27:12 image-329000 kubelet[2201]: E1004 00:27:12.647479    2201 kubelet.go:1890] "Failed creating a mirror pod for" err="pods \"kube-scheduler-image-329000\" already exists" pod="kube-system/kube-scheduler-image-329000"

	Oct 04 00:27:12 image-329000 kubelet[2201]: I1004 00:27:12.648447    2201 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/kube-scheduler-image-329000" podStartSLOduration=1.648412425 podCreationTimestamp="2023-10-04 00:27:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2023-10-04 00:27:12.643625342 +0000 UTC m=+1.126923960" watchObservedRunningTime="2023-10-04 00:27:12.648412425 +0000 UTC m=+1.131711043"

	Oct 04 00:27:12 image-329000 kubelet[2201]: I1004 00:27:12.655980    2201 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/kube-apiserver-image-329000" podStartSLOduration=1.655948842 podCreationTimestamp="2023-10-04 00:27:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2023-10-04 00:27:12.654916342 +0000 UTC m=+1.138214960" watchObservedRunningTime="2023-10-04 00:27:12.655948842 +0000 UTC m=+1.139247418"

	Oct 04 00:27:12 image-329000 kubelet[2201]: I1004 00:27:12.656031    2201 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/etcd-image-329000" podStartSLOduration=1.656024009 podCreationTimestamp="2023-10-04 00:27:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2023-10-04 00:27:12.648557425 +0000 UTC m=+1.131856043" watchObservedRunningTime="2023-10-04 00:27:12.656024009 +0000 UTC m=+1.139322626"

	Oct 04 00:27:12 image-329000 kubelet[2201]: I1004 00:27:12.660496    2201 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/kube-controller-manager-image-329000" podStartSLOduration=1.660480717 podCreationTimestamp="2023-10-04 00:27:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2023-10-04 00:27:12.660408675 +0000 UTC m=+1.143707293" watchObservedRunningTime="2023-10-04 00:27:12.660480717 +0000 UTC m=+1.143779293"

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p image-329000 -n image-329000

helpers_test.go:261: (dbg) Run:  kubectl --context image-329000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:272: non-running pods: storage-provisioner

helpers_test.go:274: ======> post-mortem[TestImageBuild/serial/BuildWithBuildArg]: describe non-running pods <======

helpers_test.go:277: (dbg) Run:  kubectl --context image-329000 describe pod storage-provisioner

helpers_test.go:277: (dbg) Non-zero exit: kubectl --context image-329000 describe pod storage-provisioner: exit status 1 (37.7875ms)

** stderr ** 

	Error from server (NotFound): pods "storage-provisioner" not found

** /stderr **

helpers_test.go:279: kubectl --context image-329000 describe pod storage-provisioner: exit status 1

--- FAIL: TestImageBuild/serial/BuildWithBuildArg (1.08s)