=== RUN   TestMultiNode/serial/RestartKeepsNodes

multinode_test.go:283: (dbg) Run:  out/minikube-darwin-amd64 node list -p multinode-528000

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 stop -p multinode-528000

E1003 18:20:43.922007   10269 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/functional-154000/client.crt: no such file or directory

multinode_test.go:290: (dbg) Done: out/minikube-darwin-amd64 stop -p multinode-528000: (18.414460401s)

multinode_test.go:295: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-528000 --wait=true -v=8 --alsologtostderr

E1003 18:21:33.928106   10269 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/ingress-addon-legacy-423000/client.crt: no such file or directory

multinode_test.go:295: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-528000 --wait=true -v=8 --alsologtostderr: exit status 90 (1m58.3566727s)

-- stdout --

	* [multinode-528000] minikube v1.31.2 on Darwin 14.0

	  - MINIKUBE_LOCATION=17348

	  - KUBECONFIG=/Users/jenkins/minikube-integration/17348-9809/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17348-9809/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the hyperkit driver based on existing profile

	* Starting control plane node multinode-528000 in cluster multinode-528000

	* Restarting existing hyperkit VM for "multinode-528000" ...

	* Preparing Kubernetes v1.28.2 on Docker 24.0.6 ...

	* Configuring CNI (Container Networking Interface) ...

	* Enabled addons: 

	* Verifying Kubernetes components...

	* Starting worker node multinode-528000-m02 in cluster multinode-528000

	* Restarting existing hyperkit VM for "multinode-528000-m02" ...

	* Found network options:

	  - NO_PROXY=192.168.89.41

	* Preparing Kubernetes v1.28.2 on Docker 24.0.6 ...

	  - env NO_PROXY=192.168.89.41

	* Verifying Kubernetes components...

	* Starting worker node multinode-528000-m03 in cluster multinode-528000

	* Restarting existing hyperkit VM for "multinode-528000-m03" ...

	* Found network options:

	  - NO_PROXY=192.168.89.41,192.168.89.42

-- /stdout --

** stderr ** 

	I1003 18:20:50.019735   12504 out.go:296] Setting OutFile to fd 1 ...

	I1003 18:20:50.020034   12504 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1003 18:20:50.020039   12504 out.go:309] Setting ErrFile to fd 2...

	I1003 18:20:50.020043   12504 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1003 18:20:50.020231   12504 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17348-9809/.minikube/bin

	I1003 18:20:50.021622   12504 out.go:303] Setting JSON to false

	I1003 18:20:50.043387   12504 start.go:128] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":4818,"bootTime":1696377632,"procs":436,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.0","kernelVersion":"23.0.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}

	W1003 18:20:50.043484   12504 start.go:136] gopshost.Virtualization returned error: not implemented yet

	I1003 18:20:50.066088   12504 out.go:177] * [multinode-528000] minikube v1.31.2 on Darwin 14.0

	I1003 18:20:50.108829   12504 out.go:177]   - MINIKUBE_LOCATION=17348

	I1003 18:20:50.108933   12504 notify.go:220] Checking for updates...

	I1003 18:20:50.131137   12504 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17348-9809/kubeconfig

	I1003 18:20:50.153051   12504 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I1003 18:20:50.174768   12504 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1003 18:20:50.196984   12504 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17348-9809/.minikube

	I1003 18:20:50.218821   12504 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1003 18:20:50.240559   12504 config.go:182] Loaded profile config "multinode-528000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 18:20:50.240734   12504 driver.go:373] Setting default libvirt URI to qemu:///system

	I1003 18:20:50.241482   12504 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I1003 18:20:50.241581   12504 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I1003 18:20:50.251023   12504 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59232

	I1003 18:20:50.251802   12504 main.go:141] libmachine: () Calling .GetVersion

	I1003 18:20:50.252252   12504 main.go:141] libmachine: Using API Version  1

	I1003 18:20:50.252267   12504 main.go:141] libmachine: () Calling .SetConfigRaw

	I1003 18:20:50.252465   12504 main.go:141] libmachine: () Calling .GetMachineName

	I1003 18:20:50.252582   12504 main.go:141] libmachine: (multinode-528000) Calling .DriverName

	I1003 18:20:50.280788   12504 out.go:177] * Using the hyperkit driver based on existing profile

	I1003 18:20:50.322586   12504 start.go:298] selected driver: hyperkit

	I1003 18:20:50.322611   12504 start.go:902] validating driver "hyperkit" against &{Name:multinode-528000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696241247-17339@sha256:77c3e98870a99538e39ecb73a5e5230b746fa8c633c297c3d287ad4bba01a880 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernete

sConfig:{KubernetesVersion:v1.28.2 ClusterName:multinode-528000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.89.41 Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.89.42 Port:0 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:false Worker:true} {Name:m03 IP:192.168.89.43 Port:0 KubernetesVersion:v1.28.2 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false

inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMe

trics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I1003 18:20:50.322855   12504 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1003 18:20:50.323044   12504 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1003 18:20:50.323239   12504 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17348-9809/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin

	I1003 18:20:50.331534   12504 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.31.2

	I1003 18:20:50.335417   12504 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I1003 18:20:50.335435   12504 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good

	I1003 18:20:50.338018   12504 start_flags.go:923] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1003 18:20:50.338062   12504 cni.go:84] Creating CNI manager for ""

	I1003 18:20:50.338070   12504 cni.go:136] 3 nodes found, recommending kindnet

	I1003 18:20:50.338077   12504 start_flags.go:321] config:

	{Name:multinode-528000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696241247-17339@sha256:77c3e98870a99538e39ecb73a5e5230b746fa8c633c297c3d287ad4bba01a880 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.2 ClusterName:multinode-528000 Namespace:default

APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.89.41 Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.89.42 Port:0 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:false Worker:true} {Name:m03 IP:192.168.89.43 Port:0 KubernetesVersion:v1.28.2 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false i

stio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Static

IP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I1003 18:20:50.338294   12504 iso.go:125] acquiring lock: {Name:mk4d10f3b7d20b83c967d75071154a129aae7352 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1003 18:20:50.382755   12504 out.go:177] * Starting control plane node multinode-528000 in cluster multinode-528000

	I1003 18:20:50.403945   12504 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime docker

	I1003 18:20:50.404015   12504 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17348-9809/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-amd64.tar.lz4

	I1003 18:20:50.404041   12504 cache.go:57] Caching tarball of preloaded images

	I1003 18:20:50.404213   12504 preload.go:174] Found /Users/jenkins/minikube-integration/17348-9809/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I1003 18:20:50.404234   12504 cache.go:60] Finished verifying existence of preloaded tar for  v1.28.2 on docker

	I1003 18:20:50.404417   12504 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/config.json ...

	I1003 18:20:50.405398   12504 start.go:365] acquiring machines lock for multinode-528000: {Name:mk592c6e7c5aa7c823729561bf878fc0544d84d2 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1003 18:20:50.405507   12504 start.go:369] acquired machines lock for "multinode-528000" in 84.187µs

	I1003 18:20:50.405539   12504 start.go:96] Skipping create...Using existing machine configuration

	I1003 18:20:50.405552   12504 fix.go:54] fixHost starting: 

	I1003 18:20:50.405999   12504 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I1003 18:20:50.406042   12504 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I1003 18:20:50.414492   12504 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59234

	I1003 18:20:50.414850   12504 main.go:141] libmachine: () Calling .GetVersion

	I1003 18:20:50.415259   12504 main.go:141] libmachine: Using API Version  1

	I1003 18:20:50.415277   12504 main.go:141] libmachine: () Calling .SetConfigRaw

	I1003 18:20:50.415543   12504 main.go:141] libmachine: () Calling .GetMachineName

	I1003 18:20:50.415677   12504 main.go:141] libmachine: (multinode-528000) Calling .DriverName

	I1003 18:20:50.415788   12504 main.go:141] libmachine: (multinode-528000) Calling .GetState

	I1003 18:20:50.415889   12504 main.go:141] libmachine: (multinode-528000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I1003 18:20:50.415943   12504 main.go:141] libmachine: (multinode-528000) DBG | hyperkit pid from json: 12168

	I1003 18:20:50.416879   12504 main.go:141] libmachine: (multinode-528000) DBG | hyperkit pid 12168 missing from process table

	I1003 18:20:50.416910   12504 fix.go:102] recreateIfNeeded on multinode-528000: state=Stopped err=<nil>

	I1003 18:20:50.416929   12504 main.go:141] libmachine: (multinode-528000) Calling .DriverName

	W1003 18:20:50.417008   12504 fix.go:128] unexpected machine state, will restart: <nil>

	I1003 18:20:50.437941   12504 out.go:177] * Restarting existing hyperkit VM for "multinode-528000" ...

	I1003 18:20:50.479830   12504 main.go:141] libmachine: (multinode-528000) Calling .Start

	I1003 18:20:50.480158   12504 main.go:141] libmachine: (multinode-528000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I1003 18:20:50.480206   12504 main.go:141] libmachine: (multinode-528000) minikube might have been shutdown in an unclean way, the hyperkit pid file still exists: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/hyperkit.pid

	I1003 18:20:50.482009   12504 main.go:141] libmachine: (multinode-528000) DBG | hyperkit pid 12168 missing from process table

	I1003 18:20:50.482023   12504 main.go:141] libmachine: (multinode-528000) DBG | pid 12168 is in state "Stopped"

	I1003 18:20:50.482044   12504 main.go:141] libmachine: (multinode-528000) DBG | Removing stale pid file /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/hyperkit.pid...

	I1003 18:20:50.482215   12504 main.go:141] libmachine: (multinode-528000) DBG | Using UUID d3ae89d0-6253-11ee-8906-149d997cd0f1

	I1003 18:20:50.522410   12504 main.go:141] libmachine: (multinode-528000) DBG | Generated MAC 76:a6:64:b1:fb:af

	I1003 18:20:50.522448   12504 main.go:141] libmachine: (multinode-528000) DBG | Starting with cmdline: loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-528000

	I1003 18:20:50.522621   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 DEBUG: hyperkit: Start &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"d3ae89d0-6253-11ee-8906-149d997cd0f1", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc00044ce40)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/bzimage", Initrd:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:"", process:(*os.Proce

ss)(nil)}

	I1003 18:20:50.522670   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 DEBUG: hyperkit: check &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"d3ae89d0-6253-11ee-8906-149d997cd0f1", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc00044ce40)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/bzimage", Initrd:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:"", process:(*os.Proce

ss)(nil)}

	I1003 18:20:50.522735   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 DEBUG: hyperkit: Arguments: []string{"-A", "-u", "-F", "/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/hyperkit.pid", "-c", "2", "-m", "2200M", "-s", "0:0,hostbridge", "-s", "31,lpc", "-s", "1:0,virtio-net", "-U", "d3ae89d0-6253-11ee-8906-149d997cd0f1", "-s", "2:0,virtio-blk,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/multinode-528000.rawdisk", "-s", "3,ahci-cd,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/boot2docker.iso", "-s", "4,virtio-rnd", "-l", "com1,autopty=/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/tty,log=/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/console-ring", "-f", "kexec,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/bzimage,/Users/jenkins/minikube-integration/1734

8-9809/.minikube/machines/multinode-528000/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-528000"}

	I1003 18:20:50.522793   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 DEBUG: hyperkit: CmdLine: "/usr/local/bin/hyperkit -A -u -F /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/hyperkit.pid -c 2 -m 2200M -s 0:0,hostbridge -s 31,lpc -s 1:0,virtio-net -U d3ae89d0-6253-11ee-8906-149d997cd0f1 -s 2:0,virtio-blk,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/multinode-528000.rawdisk -s 3,ahci-cd,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/boot2docker.iso -s 4,virtio-rnd -l com1,autopty=/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/tty,log=/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/console-ring -f kexec,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/bzimage,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/initrd,earlyprintk=

serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-528000"

	I1003 18:20:50.522817   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 DEBUG: hyperkit: Redirecting stdout/stderr to logger

	I1003 18:20:50.524256   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 DEBUG: hyperkit: Pid is 12516

	I1003 18:20:50.524707   12504 main.go:141] libmachine: (multinode-528000) DBG | Attempt 0

	I1003 18:20:50.524726   12504 main.go:141] libmachine: (multinode-528000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I1003 18:20:50.524844   12504 main.go:141] libmachine: (multinode-528000) DBG | hyperkit pid from json: 12516

	I1003 18:20:50.526476   12504 main.go:141] libmachine: (multinode-528000) DBG | Searching for 76:a6:64:b1:fb:af in /var/db/dhcpd_leases ...

	I1003 18:20:50.526589   12504 main.go:141] libmachine: (multinode-528000) DBG | Found 58 entries in /var/db/dhcpd_leases!

	I1003 18:20:50.526620   12504 main.go:141] libmachine: (multinode-528000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.89.43 HWAddress:f2:fa:7b:e9:10:aa ID:1,f2:fa:7b:e9:10:aa Lease:0x651cbdf1}

	I1003 18:20:50.526660   12504 main.go:141] libmachine: (multinode-528000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.89.42 HWAddress:7a:7f:34:e0:d9:d0 ID:1,7a:7f:34:e0:d9:d0 Lease:0x651e0efe}

	I1003 18:20:50.526718   12504 main.go:141] libmachine: (multinode-528000) Calling .GetConfigRaw

	I1003 18:20:50.526733   12504 main.go:141] libmachine: (multinode-528000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.89.41 HWAddress:76:a6:64:b1:fb:af ID:1,76:a6:64:b1:fb:af Lease:0x651e0ec3}

	I1003 18:20:50.526749   12504 main.go:141] libmachine: (multinode-528000) DBG | Found match: 76:a6:64:b1:fb:af

	I1003 18:20:50.526768   12504 main.go:141] libmachine: (multinode-528000) DBG | IP: 192.168.89.41

	I1003 18:20:50.527526   12504 main.go:141] libmachine: (multinode-528000) Calling .GetIP

	I1003 18:20:50.527769   12504 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/config.json ...

	I1003 18:20:50.528212   12504 machine.go:88] provisioning docker machine ...

	I1003 18:20:50.528223   12504 main.go:141] libmachine: (multinode-528000) Calling .DriverName

	I1003 18:20:50.528329   12504 main.go:141] libmachine: (multinode-528000) Calling .GetMachineName

	I1003 18:20:50.528440   12504 buildroot.go:166] provisioning hostname "multinode-528000"

	I1003 18:20:50.528450   12504 main.go:141] libmachine: (multinode-528000) Calling .GetMachineName

	I1003 18:20:50.528559   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHHostname

	I1003 18:20:50.528656   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHPort

	I1003 18:20:50.528758   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:20:50.528846   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:20:50.528931   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHUsername

	I1003 18:20:50.529063   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:20:50.529384   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.41 22 <nil> <nil>}

	I1003 18:20:50.529393   12504 main.go:141] libmachine: About to run SSH command:

	sudo hostname multinode-528000 && echo "multinode-528000" | sudo tee /etc/hostname

	I1003 18:20:50.532147   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 INFO : hyperkit: stderr: Using fd 5 for I/O notifications

	I1003 18:20:50.552835   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 INFO : hyperkit: stderr: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/boot2docker.iso: fcntl(F_PUNCHHOLE) Operation not permitted: block device will not support TRIM/DISCARD

	I1003 18:20:50.553614   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0

	I1003 18:20:50.553642   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0

	I1003 18:20:50.553651   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0

	I1003 18:20:50.553663   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0

	I1003 18:20:50.920813   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 0

	I1003 18:20:50.920869   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 0

	I1003 18:20:51.024888   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:51 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0

	I1003 18:20:51.024910   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:51 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0

	I1003 18:20:51.024931   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:51 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0

	I1003 18:20:51.024949   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:51 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0

	I1003 18:20:51.025829   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:51 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 1

	I1003 18:20:51.025840   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:51 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 1

	I1003 18:20:55.910790   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:55 INFO : hyperkit: stderr: rdmsr to register 0x64d on vcpu 0

	I1003 18:20:55.910890   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:55 INFO : hyperkit: stderr: rdmsr to register 0x64e on vcpu 0

	I1003 18:20:55.910913   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:55 INFO : hyperkit: stderr: rdmsr to register 0x34 on vcpu 0

	I1003 18:21:01.620728   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-528000

	I1003 18:21:01.620747   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHHostname

	I1003 18:21:01.620926   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHPort

	I1003 18:21:01.621011   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:01.621104   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:01.621197   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHUsername

	I1003 18:21:01.621331   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:21:01.621595   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.41 22 <nil> <nil>}

	I1003 18:21:01.621610   12504 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\smultinode-528000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 multinode-528000/g' /etc/hosts;

				else 

					echo '127.0.1.1 multinode-528000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1003 18:21:01.700734   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1003 18:21:01.700753   12504 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/17348-9809/.minikube CaCertPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/17348-9809/.minikube}

	I1003 18:21:01.700768   12504 buildroot.go:174] setting up certificates

	I1003 18:21:01.700780   12504 provision.go:83] configureAuth start

	I1003 18:21:01.700787   12504 main.go:141] libmachine: (multinode-528000) Calling .GetMachineName

	I1003 18:21:01.700929   12504 main.go:141] libmachine: (multinode-528000) Calling .GetIP

	I1003 18:21:01.701022   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHHostname

	I1003 18:21:01.701123   12504 provision.go:138] copyHostCerts

	I1003 18:21:01.701156   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem -> /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.pem

	I1003 18:21:01.701210   12504 exec_runner.go:144] found /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.pem, removing ...

	I1003 18:21:01.701220   12504 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.pem

	I1003 18:21:01.701352   12504 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.pem (1082 bytes)

	I1003 18:21:01.701549   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/cert.pem -> /Users/jenkins/minikube-integration/17348-9809/.minikube/cert.pem

	I1003 18:21:01.701585   12504 exec_runner.go:144] found /Users/jenkins/minikube-integration/17348-9809/.minikube/cert.pem, removing ...

	I1003 18:21:01.701590   12504 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17348-9809/.minikube/cert.pem

	I1003 18:21:01.701660   12504 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/17348-9809/.minikube/cert.pem (1123 bytes)

	I1003 18:21:01.701864   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/key.pem -> /Users/jenkins/minikube-integration/17348-9809/.minikube/key.pem

	I1003 18:21:01.701898   12504 exec_runner.go:144] found /Users/jenkins/minikube-integration/17348-9809/.minikube/key.pem, removing ...

	I1003 18:21:01.701904   12504 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17348-9809/.minikube/key.pem

	I1003 18:21:01.701981   12504 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/17348-9809/.minikube/key.pem (1679 bytes)

	I1003 18:21:01.702160   12504 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca-key.pem org=jenkins.multinode-528000 san=[192.168.89.41 192.168.89.41 localhost 127.0.0.1 minikube multinode-528000]

	I1003 18:21:01.989613   12504 provision.go:172] copyRemoteCerts

	I1003 18:21:01.989669   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1003 18:21:01.989687   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHHostname

	I1003 18:21:01.989978   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHPort

	I1003 18:21:01.990199   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:01.990334   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHUsername

	I1003 18:21:01.990510   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.41 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/id_rsa Username:docker}

	I1003 18:21:02.036392   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server.pem -> /etc/docker/server.pem

	I1003 18:21:02.036465   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)

	I1003 18:21:02.052328   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I1003 18:21:02.052380   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I1003 18:21:02.068199   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I1003 18:21:02.068251   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1003 18:21:02.084199   12504 provision.go:86] duration metric: configureAuth took 383.394416ms

	I1003 18:21:02.084210   12504 buildroot.go:189] setting minikube options for container-runtime

	I1003 18:21:02.084372   12504 config.go:182] Loaded profile config "multinode-528000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 18:21:02.084405   12504 main.go:141] libmachine: (multinode-528000) Calling .DriverName

	I1003 18:21:02.084543   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHHostname

	I1003 18:21:02.084635   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHPort

	I1003 18:21:02.084724   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:02.084816   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:02.084900   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHUsername

	I1003 18:21:02.085015   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:21:02.085259   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.41 22 <nil> <nil>}

	I1003 18:21:02.085268   12504 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1003 18:21:02.160569   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I1003 18:21:02.160583   12504 buildroot.go:70] root file system type: tmpfs

	I1003 18:21:02.160661   12504 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I1003 18:21:02.160674   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHHostname

	I1003 18:21:02.160818   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHPort

	I1003 18:21:02.160928   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:02.161029   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:02.161124   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHUsername

	I1003 18:21:02.161253   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:21:02.161501   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.41 22 <nil> <nil>}

	I1003 18:21:02.161545   12504 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1003 18:21:02.246329   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I1003 18:21:02.246351   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHHostname

	I1003 18:21:02.246483   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHPort

	I1003 18:21:02.246582   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:02.246664   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:02.246770   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHUsername

	I1003 18:21:02.246890   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:21:02.247142   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.41 22 <nil> <nil>}

	I1003 18:21:02.247156   12504 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1003 18:21:02.855612   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I1003 18:21:02.855627   12504 machine.go:91] provisioned docker machine in 12.327246851s

	I1003 18:21:02.855638   12504 start.go:300] post-start starting for "multinode-528000" (driver="hyperkit")

	I1003 18:21:02.855648   12504 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1003 18:21:02.855660   12504 main.go:141] libmachine: (multinode-528000) Calling .DriverName

	I1003 18:21:02.855837   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1003 18:21:02.855849   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHHostname

	I1003 18:21:02.855938   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHPort

	I1003 18:21:02.856026   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:02.856116   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHUsername

	I1003 18:21:02.856206   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.41 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/id_rsa Username:docker}

	I1003 18:21:02.899315   12504 ssh_runner.go:195] Run: cat /etc/os-release

	I1003 18:21:02.901839   12504 command_runner.go:130] > NAME=Buildroot

	I1003 18:21:02.901850   12504 command_runner.go:130] > VERSION=2021.02.12-1-gb090841-dirty

	I1003 18:21:02.901858   12504 command_runner.go:130] > ID=buildroot

	I1003 18:21:02.901864   12504 command_runner.go:130] > VERSION_ID=2021.02.12

	I1003 18:21:02.901875   12504 command_runner.go:130] > PRETTY_NAME="Buildroot 2021.02.12"

	I1003 18:21:02.901945   12504 info.go:137] Remote host: Buildroot 2021.02.12

	I1003 18:21:02.901960   12504 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17348-9809/.minikube/addons for local assets ...

	I1003 18:21:02.902056   12504 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17348-9809/.minikube/files for local assets ...

	I1003 18:21:02.902212   12504 filesync.go:149] local asset: /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem -> 102692.pem in /etc/ssl/certs

	I1003 18:21:02.902219   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem -> /etc/ssl/certs/102692.pem

	I1003 18:21:02.902391   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1003 18:21:02.907946   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem --> /etc/ssl/certs/102692.pem (1708 bytes)

	I1003 18:21:02.923994   12504 start.go:303] post-start completed in 68.345552ms

	I1003 18:21:02.924008   12504 fix.go:56] fixHost completed within 12.518297955s

	I1003 18:21:02.924027   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHHostname

	I1003 18:21:02.924152   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHPort

	I1003 18:21:02.924239   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:02.924346   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:02.924427   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHUsername

	I1003 18:21:02.924545   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:21:02.924796   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.41 22 <nil> <nil>}

	I1003 18:21:02.924803   12504 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I1003 18:21:02.997984   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: 1696382463.169617211

	I1003 18:21:02.997995   12504 fix.go:206] guest clock: 1696382463.169617211

	I1003 18:21:02.998002   12504 fix.go:219] Guest: 2023-10-03 18:21:03.169617211 -0700 PDT Remote: 2023-10-03 18:21:02.924013 -0700 PDT m=+12.935887906 (delta=245.604211ms)

	I1003 18:21:02.998020   12504 fix.go:190] guest clock delta is within tolerance: 245.604211ms

	I1003 18:21:02.998024   12504 start.go:83] releasing machines lock for "multinode-528000", held for 12.59234322s

	I1003 18:21:02.998052   12504 main.go:141] libmachine: (multinode-528000) Calling .DriverName

	I1003 18:21:02.998194   12504 main.go:141] libmachine: (multinode-528000) Calling .GetIP

	I1003 18:21:02.998286   12504 main.go:141] libmachine: (multinode-528000) Calling .DriverName

	I1003 18:21:02.998589   12504 main.go:141] libmachine: (multinode-528000) Calling .DriverName

	I1003 18:21:02.998718   12504 main.go:141] libmachine: (multinode-528000) Calling .DriverName

	I1003 18:21:02.998786   12504 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I1003 18:21:02.998815   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHHostname

	I1003 18:21:02.998884   12504 ssh_runner.go:195] Run: cat /version.json

	I1003 18:21:02.998898   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHHostname

	I1003 18:21:02.998902   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHPort

	I1003 18:21:02.998998   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHPort

	I1003 18:21:02.999013   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:02.999084   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHUsername

	I1003 18:21:02.999111   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:02.999188   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.41 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/id_rsa Username:docker}

	I1003 18:21:02.999220   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHUsername

	I1003 18:21:02.999304   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.41 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/id_rsa Username:docker}

	I1003 18:21:03.039585   12504 command_runner.go:130] > {"iso_version": "v1.31.0-1695060926-17240", "kicbase_version": "v0.0.40-1694798187-17250", "minikube_version": "v1.31.2", "commit": "0402681e4770013826956f326b174c70611f3073"}

	I1003 18:21:03.039975   12504 ssh_runner.go:195] Run: systemctl --version

	I1003 18:21:03.086755   12504 command_runner.go:130] > <a href="https://github.com/kubernetes/registry.k8s.io">Temporary Redirect</a>.

	I1003 18:21:03.087729   12504 command_runner.go:130] > systemd 247 (247)

	I1003 18:21:03.087757   12504 command_runner.go:130] > -PAM -AUDIT -SELINUX -IMA -APPARMOR -SMACK -SYSVINIT -UTMP -LIBCRYPTSETUP -GCRYPT -GNUTLS +ACL +XZ +LZ4 -ZSTD +SECCOMP +BLKID -ELFUTILS +KMOD -IDN2 -IDN -PCRE2 default-hierarchy=hybrid

	I1003 18:21:03.087915   12504 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	I1003 18:21:03.092190   12504 command_runner.go:130] ! stat: cannot statx '/etc/cni/net.d/*loopback.conf*': No such file or directory

	W1003 18:21:03.092209   12504 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I1003 18:21:03.092250   12504 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1003 18:21:03.101920   12504 command_runner.go:139] > /etc/cni/net.d/87-podman-bridge.conflist, 

	I1003 18:21:03.101938   12504 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I1003 18:21:03.101944   12504 start.go:469] detecting cgroup driver to use...

	I1003 18:21:03.102080   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1003 18:21:03.114600   12504 command_runner.go:130] > runtime-endpoint: unix:///run/containerd/containerd.sock

	I1003 18:21:03.114674   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I1003 18:21:03.121697   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I1003 18:21:03.128875   12504 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...

	I1003 18:21:03.128922   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I1003 18:21:03.135906   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1003 18:21:03.142897   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I1003 18:21:03.149762   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1003 18:21:03.156762   12504 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1003 18:21:03.163931   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I1003 18:21:03.170828   12504 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1003 18:21:03.176901   12504 command_runner.go:130] > net.bridge.bridge-nf-call-iptables = 1

	I1003 18:21:03.177045   12504 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1003 18:21:03.183327   12504 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 18:21:03.277187   12504 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I1003 18:21:03.289737   12504 start.go:469] detecting cgroup driver to use...

	I1003 18:21:03.289812   12504 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1003 18:21:03.315939   12504 command_runner.go:130] > # /usr/lib/systemd/system/docker.service

	I1003 18:21:03.316382   12504 command_runner.go:130] > [Unit]

	I1003 18:21:03.316414   12504 command_runner.go:130] > Description=Docker Application Container Engine

	I1003 18:21:03.316419   12504 command_runner.go:130] > Documentation=https://docs.docker.com

	I1003 18:21:03.316425   12504 command_runner.go:130] > After=network.target  minikube-automount.service docker.socket

	I1003 18:21:03.316430   12504 command_runner.go:130] > Requires= minikube-automount.service docker.socket 

	I1003 18:21:03.316435   12504 command_runner.go:130] > StartLimitBurst=3

	I1003 18:21:03.316440   12504 command_runner.go:130] > StartLimitIntervalSec=60

	I1003 18:21:03.316444   12504 command_runner.go:130] > [Service]

	I1003 18:21:03.316448   12504 command_runner.go:130] > Type=notify

	I1003 18:21:03.316452   12504 command_runner.go:130] > Restart=on-failure

	I1003 18:21:03.316458   12504 command_runner.go:130] > # This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	I1003 18:21:03.316466   12504 command_runner.go:130] > # The base configuration already specifies an 'ExecStart=...' command. The first directive

	I1003 18:21:03.316477   12504 command_runner.go:130] > # here is to clear out that command inherited from the base configuration. Without this,

	I1003 18:21:03.316483   12504 command_runner.go:130] > # the command from the base configuration and the command specified here are treated as

	I1003 18:21:03.316489   12504 command_runner.go:130] > # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	I1003 18:21:03.316495   12504 command_runner.go:130] > # will catch this invalid input and refuse to start the service with an error like:

	I1003 18:21:03.316503   12504 command_runner.go:130] > #  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	I1003 18:21:03.316510   12504 command_runner.go:130] > # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	I1003 18:21:03.316516   12504 command_runner.go:130] > # container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	I1003 18:21:03.316520   12504 command_runner.go:130] > ExecStart=

	I1003 18:21:03.316532   12504 command_runner.go:130] > ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	I1003 18:21:03.316538   12504 command_runner.go:130] > ExecReload=/bin/kill -s HUP $MAINPID

	I1003 18:21:03.316544   12504 command_runner.go:130] > # Having non-zero Limit*s causes performance problems due to accounting overhead

	I1003 18:21:03.316550   12504 command_runner.go:130] > # in the kernel. We recommend using cgroups to do container-local accounting.

	I1003 18:21:03.316554   12504 command_runner.go:130] > LimitNOFILE=infinity

	I1003 18:21:03.316595   12504 command_runner.go:130] > LimitNPROC=infinity

	I1003 18:21:03.316598   12504 command_runner.go:130] > LimitCORE=infinity

	I1003 18:21:03.316625   12504 command_runner.go:130] > # Uncomment TasksMax if your systemd version supports it.

	I1003 18:21:03.316630   12504 command_runner.go:130] > # Only systemd 226 and above support this version.

	I1003 18:21:03.316634   12504 command_runner.go:130] > TasksMax=infinity

	I1003 18:21:03.316637   12504 command_runner.go:130] > TimeoutStartSec=0

	I1003 18:21:03.316644   12504 command_runner.go:130] > # set delegate yes so that systemd does not reset the cgroups of docker containers

	I1003 18:21:03.316662   12504 command_runner.go:130] > Delegate=yes

	I1003 18:21:03.316667   12504 command_runner.go:130] > # kill only the docker process, not all processes in the cgroup

	I1003 18:21:03.316694   12504 command_runner.go:130] > KillMode=process

	I1003 18:21:03.316698   12504 command_runner.go:130] > [Install]

	I1003 18:21:03.316703   12504 command_runner.go:130] > WantedBy=multi-user.target

	I1003 18:21:03.317414   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1003 18:21:03.331351   12504 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I1003 18:21:03.356949   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1003 18:21:03.366244   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1003 18:21:03.377037   12504 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I1003 18:21:03.402914   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1003 18:21:03.412127   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1003 18:21:03.423151   12504 command_runner.go:130] > runtime-endpoint: unix:///var/run/cri-dockerd.sock

	I1003 18:21:03.423477   12504 ssh_runner.go:195] Run: which cri-dockerd

	I1003 18:21:03.425714   12504 command_runner.go:130] > /usr/bin/cri-dockerd

	I1003 18:21:03.425923   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I1003 18:21:03.432067   12504 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I1003 18:21:03.442974   12504 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I1003 18:21:03.529497   12504 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I1003 18:21:03.621874   12504 docker.go:554] configuring docker to use "cgroupfs" as cgroup driver...

	I1003 18:21:03.621978   12504 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I1003 18:21:03.633648   12504 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 18:21:03.724046   12504 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1003 18:21:05.023006   12504 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.298902914s)

	I1003 18:21:05.044987   12504 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I1003 18:21:05.133507   12504 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I1003 18:21:05.232679   12504 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I1003 18:21:05.320168   12504 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 18:21:05.403622   12504 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I1003 18:21:05.418898   12504 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 18:21:05.514617   12504 ssh_runner.go:195] Run: sudo systemctl restart cri-docker

	I1003 18:21:05.566172   12504 start.go:516] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I1003 18:21:05.566250   12504 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I1003 18:21:05.569966   12504 command_runner.go:130] >   File: /var/run/cri-dockerd.sock

	I1003 18:21:05.569984   12504 command_runner.go:130] >   Size: 0         	Blocks: 0          IO Block: 4096   socket

	I1003 18:21:05.569993   12504 command_runner.go:130] > Device: 16h/22d	Inode: 906         Links: 1

	I1003 18:21:05.570001   12504 command_runner.go:130] > Access: (0660/srw-rw----)  Uid: (    0/    root)   Gid: ( 1000/  docker)

	I1003 18:21:05.570005   12504 command_runner.go:130] > Access: 2023-10-04 01:21:05.698266928 +0000

	I1003 18:21:05.570009   12504 command_runner.go:130] > Modify: 2023-10-04 01:21:05.698266928 +0000

	I1003 18:21:05.570014   12504 command_runner.go:130] > Change: 2023-10-04 01:21:05.700266928 +0000

	I1003 18:21:05.570017   12504 command_runner.go:130] >  Birth: -

	I1003 18:21:05.570039   12504 start.go:537] Will wait 60s for crictl version

	I1003 18:21:05.570083   12504 ssh_runner.go:195] Run: which crictl

	I1003 18:21:05.572199   12504 command_runner.go:130] > /usr/bin/crictl

	I1003 18:21:05.572424   12504 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I1003 18:21:05.613062   12504 command_runner.go:130] > Version:  0.1.0

	I1003 18:21:05.613077   12504 command_runner.go:130] > RuntimeName:  docker

	I1003 18:21:05.613084   12504 command_runner.go:130] > RuntimeVersion:  24.0.6

	I1003 18:21:05.613091   12504 command_runner.go:130] > RuntimeApiVersion:  v1

	I1003 18:21:05.614292   12504 start.go:553] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  24.0.6

	RuntimeApiVersion:  v1

	I1003 18:21:05.614357   12504 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1003 18:21:05.631409   12504 command_runner.go:130] > 24.0.6

	I1003 18:21:05.632223   12504 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1003 18:21:05.649333   12504 command_runner.go:130] > 24.0.6

	I1003 18:21:05.671585   12504 out.go:204] * Preparing Kubernetes v1.28.2 on Docker 24.0.6 ...

	I1003 18:21:05.671630   12504 main.go:141] libmachine: (multinode-528000) Calling .GetIP

	I1003 18:21:05.672008   12504 ssh_runner.go:195] Run: grep 192.168.89.1	host.minikube.internal$ /etc/hosts

	I1003 18:21:05.676051   12504 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.89.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1003 18:21:05.684885   12504 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime docker

	I1003 18:21:05.684961   12504 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1003 18:21:05.697926   12504 command_runner.go:130] > registry.k8s.io/kube-apiserver:v1.28.2

	I1003 18:21:05.697939   12504 command_runner.go:130] > registry.k8s.io/kube-scheduler:v1.28.2

	I1003 18:21:05.697943   12504 command_runner.go:130] > registry.k8s.io/kube-proxy:v1.28.2

	I1003 18:21:05.697947   12504 command_runner.go:130] > registry.k8s.io/kube-controller-manager:v1.28.2

	I1003 18:21:05.697951   12504 command_runner.go:130] > kindest/kindnetd:v20230809-80a64d96

	I1003 18:21:05.697956   12504 command_runner.go:130] > registry.k8s.io/etcd:3.5.9-0

	I1003 18:21:05.697963   12504 command_runner.go:130] > registry.k8s.io/coredns/coredns:v1.10.1

	I1003 18:21:05.697967   12504 command_runner.go:130] > registry.k8s.io/pause:3.9

	I1003 18:21:05.697972   12504 command_runner.go:130] > gcr.io/k8s-minikube/storage-provisioner:v5

	I1003 18:21:05.697975   12504 command_runner.go:130] > gcr.io/k8s-minikube/busybox:1.28

	I1003 18:21:05.698568   12504 docker.go:664] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.28.2

	registry.k8s.io/kube-scheduler:v1.28.2

	registry.k8s.io/kube-proxy:v1.28.2

	registry.k8s.io/kube-controller-manager:v1.28.2

	kindest/kindnetd:v20230809-80a64d96

	registry.k8s.io/etcd:3.5.9-0

	registry.k8s.io/coredns/coredns:v1.10.1

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	gcr.io/k8s-minikube/busybox:1.28

	-- /stdout --

	I1003 18:21:05.698581   12504 docker.go:594] Images already preloaded, skipping extraction

	I1003 18:21:05.698646   12504 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1003 18:21:05.711240   12504 command_runner.go:130] > registry.k8s.io/kube-apiserver:v1.28.2

	I1003 18:21:05.711250   12504 command_runner.go:130] > registry.k8s.io/kube-controller-manager:v1.28.2

	I1003 18:21:05.711255   12504 command_runner.go:130] > registry.k8s.io/kube-scheduler:v1.28.2

	I1003 18:21:05.711261   12504 command_runner.go:130] > registry.k8s.io/kube-proxy:v1.28.2

	I1003 18:21:05.711265   12504 command_runner.go:130] > kindest/kindnetd:v20230809-80a64d96

	I1003 18:21:05.711269   12504 command_runner.go:130] > registry.k8s.io/etcd:3.5.9-0

	I1003 18:21:05.711278   12504 command_runner.go:130] > registry.k8s.io/coredns/coredns:v1.10.1

	I1003 18:21:05.711283   12504 command_runner.go:130] > registry.k8s.io/pause:3.9

	I1003 18:21:05.711289   12504 command_runner.go:130] > gcr.io/k8s-minikube/storage-provisioner:v5

	I1003 18:21:05.711294   12504 command_runner.go:130] > gcr.io/k8s-minikube/busybox:1.28

	I1003 18:21:05.711858   12504 docker.go:664] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.28.2

	registry.k8s.io/kube-controller-manager:v1.28.2

	registry.k8s.io/kube-scheduler:v1.28.2

	registry.k8s.io/kube-proxy:v1.28.2

	kindest/kindnetd:v20230809-80a64d96

	registry.k8s.io/etcd:3.5.9-0

	registry.k8s.io/coredns/coredns:v1.10.1

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	gcr.io/k8s-minikube/busybox:1.28

	-- /stdout --

	I1003 18:21:05.711884   12504 cache_images.go:84] Images are preloaded, skipping loading

	I1003 18:21:05.711950   12504 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I1003 18:21:05.729035   12504 command_runner.go:130] > cgroupfs

	I1003 18:21:05.729628   12504 cni.go:84] Creating CNI manager for ""

	I1003 18:21:05.729636   12504 cni.go:136] 3 nodes found, recommending kindnet

	I1003 18:21:05.729650   12504 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I1003 18:21:05.729667   12504 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.89.41 APIServerPort:8443 KubernetesVersion:v1.28.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:multinode-528000 NodeName:multinode-528000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.89.41"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.89.41 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/

etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I1003 18:21:05.729765   12504 kubeadm.go:181] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.89.41

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "multinode-528000"

	  kubeletExtraArgs:

	    node-ip: 192.168.89.41

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.89.41"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.28.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1003 18:21:05.729815   12504 kubeadm.go:976] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.28.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=multinode-528000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.89.41

	[Install]

	 config:

	{KubernetesVersion:v1.28.2 ClusterName:multinode-528000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I1003 18:21:05.729869   12504 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.2

	I1003 18:21:05.736169   12504 command_runner.go:130] > kubeadm

	I1003 18:21:05.736177   12504 command_runner.go:130] > kubectl

	I1003 18:21:05.736180   12504 command_runner.go:130] > kubelet

	I1003 18:21:05.736261   12504 binaries.go:44] Found k8s binaries, skipping transfer

	I1003 18:21:05.736308   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1003 18:21:05.742557   12504 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (378 bytes)

	I1003 18:21:05.753531   12504 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1003 18:21:05.764601   12504 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2102 bytes)

	I1003 18:21:05.775996   12504 ssh_runner.go:195] Run: grep 192.168.89.41	control-plane.minikube.internal$ /etc/hosts

	I1003 18:21:05.778396   12504 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.89.41	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1003 18:21:05.786104   12504 certs.go:56] Setting up /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000 for IP: 192.168.89.41

	I1003 18:21:05.786119   12504 certs.go:190] acquiring lock for shared ca certs: {Name:mk3b53aae05d89faa161c9ed5bb05e7f02553427 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 18:21:05.786394   12504 certs.go:199] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.key

	I1003 18:21:05.786450   12504 certs.go:199] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/17348-9809/.minikube/proxy-client-ca.key

	I1003 18:21:05.786561   12504 certs.go:315] skipping minikube-user signed cert generation: /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/client.key

	I1003 18:21:05.786628   12504 certs.go:315] skipping minikube signed cert generation: /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/apiserver.key.73d945d2

	I1003 18:21:05.786684   12504 certs.go:315] skipping aggregator signed cert generation: /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/proxy-client.key

	I1003 18:21:05.786693   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I1003 18:21:05.786719   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I1003 18:21:05.786742   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I1003 18:21:05.786759   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I1003 18:21:05.786776   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I1003 18:21:05.786793   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I1003 18:21:05.786807   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I1003 18:21:05.786823   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I1003 18:21:05.786911   12504 certs.go:437] found cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/10269.pem (1338 bytes)

	W1003 18:21:05.786950   12504 certs.go:433] ignoring /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/10269_empty.pem, impossibly tiny 0 bytes

	I1003 18:21:05.786959   12504 certs.go:437] found cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca-key.pem (1675 bytes)

	I1003 18:21:05.786990   12504 certs.go:437] found cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem (1082 bytes)

	I1003 18:21:05.787020   12504 certs.go:437] found cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/cert.pem (1123 bytes)

	I1003 18:21:05.787047   12504 certs.go:437] found cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/key.pem (1679 bytes)

	I1003 18:21:05.787149   12504 certs.go:437] found cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem (1708 bytes)

	I1003 18:21:05.787178   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem -> /usr/share/ca-certificates/102692.pem

	I1003 18:21:05.787196   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I1003 18:21:05.787211   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/10269.pem -> /usr/share/ca-certificates/10269.pem

	I1003 18:21:05.787634   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I1003 18:21:05.803550   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I1003 18:21:05.819514   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1003 18:21:05.835972   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I1003 18:21:05.851731   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1003 18:21:05.867337   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1003 18:21:05.883254   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1003 18:21:05.898876   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I1003 18:21:05.914805   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem --> /usr/share/ca-certificates/102692.pem (1708 bytes)

	I1003 18:21:05.930229   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1003 18:21:05.945978   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/10269.pem --> /usr/share/ca-certificates/10269.pem (1338 bytes)

	I1003 18:21:05.961607   12504 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1003 18:21:05.972903   12504 ssh_runner.go:195] Run: openssl version

	I1003 18:21:05.976210   12504 command_runner.go:130] > OpenSSL 1.1.1n  15 Mar 2022

	I1003 18:21:05.976464   12504 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/102692.pem && ln -fs /usr/share/ca-certificates/102692.pem /etc/ssl/certs/102692.pem"

	I1003 18:21:05.983440   12504 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/102692.pem

	I1003 18:21:05.986258   12504 command_runner.go:130] > -rw-r--r-- 1 root root 1708 Oct  4 01:07 /usr/share/ca-certificates/102692.pem

	I1003 18:21:05.986441   12504 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Oct  4 01:07 /usr/share/ca-certificates/102692.pem

	I1003 18:21:05.986476   12504 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/102692.pem

	I1003 18:21:05.989991   12504 command_runner.go:130] > 3ec20f2e

	I1003 18:21:05.990152   12504 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/102692.pem /etc/ssl/certs/3ec20f2e.0"

	I1003 18:21:05.997194   12504 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1003 18:21:06.004154   12504 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1003 18:21:06.006972   12504 command_runner.go:130] > -rw-r--r-- 1 root root 1111 Oct  4 01:03 /usr/share/ca-certificates/minikubeCA.pem

	I1003 18:21:06.007073   12504 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Oct  4 01:03 /usr/share/ca-certificates/minikubeCA.pem

	I1003 18:21:06.007105   12504 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1003 18:21:06.010494   12504 command_runner.go:130] > b5213941

	I1003 18:21:06.010865   12504 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1003 18:21:06.018092   12504 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/10269.pem && ln -fs /usr/share/ca-certificates/10269.pem /etc/ssl/certs/10269.pem"

	I1003 18:21:06.025096   12504 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/10269.pem

	I1003 18:21:06.028021   12504 command_runner.go:130] > -rw-r--r-- 1 root root 1338 Oct  4 01:07 /usr/share/ca-certificates/10269.pem

	I1003 18:21:06.028182   12504 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Oct  4 01:07 /usr/share/ca-certificates/10269.pem

	I1003 18:21:06.028216   12504 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/10269.pem

	I1003 18:21:06.031654   12504 command_runner.go:130] > 51391683

	I1003 18:21:06.032015   12504 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/10269.pem /etc/ssl/certs/51391683.0"

	I1003 18:21:06.039189   12504 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd

	I1003 18:21:06.041833   12504 command_runner.go:130] > ca.crt

	I1003 18:21:06.041860   12504 command_runner.go:130] > ca.key

	I1003 18:21:06.041865   12504 command_runner.go:130] > healthcheck-client.crt

	I1003 18:21:06.041869   12504 command_runner.go:130] > healthcheck-client.key

	I1003 18:21:06.041874   12504 command_runner.go:130] > peer.crt

	I1003 18:21:06.041877   12504 command_runner.go:130] > peer.key

	I1003 18:21:06.041882   12504 command_runner.go:130] > server.crt

	I1003 18:21:06.041885   12504 command_runner.go:130] > server.key

	I1003 18:21:06.042002   12504 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400

	I1003 18:21:06.045489   12504 command_runner.go:130] > Certificate will not expire

	I1003 18:21:06.045769   12504 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400

	I1003 18:21:06.049270   12504 command_runner.go:130] > Certificate will not expire

	I1003 18:21:06.049517   12504 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400

	I1003 18:21:06.053256   12504 command_runner.go:130] > Certificate will not expire

	I1003 18:21:06.053687   12504 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400

	I1003 18:21:06.057258   12504 command_runner.go:130] > Certificate will not expire

	I1003 18:21:06.057548   12504 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400

	I1003 18:21:06.060940   12504 command_runner.go:130] > Certificate will not expire

	I1003 18:21:06.061242   12504 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400

	I1003 18:21:06.064695   12504 command_runner.go:130] > Certificate will not expire

	I1003 18:21:06.064915   12504 kubeadm.go:404] StartCluster: {Name:multinode-528000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696241247-17339@sha256:77c3e98870a99538e39ecb73a5e5230b746fa8c633c297c3d287ad4bba01a880 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVer

sion:v1.28.2 ClusterName:multinode-528000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.89.41 Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.89.42 Port:0 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:false Worker:true} {Name:m03 IP:192.168.89.43 Port:0 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false in

gress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cust

omQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I1003 18:21:06.065016   12504 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1003 18:21:06.077648   12504 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1003 18:21:06.084295   12504 command_runner.go:130] > /var/lib/kubelet/config.yaml

	I1003 18:21:06.084304   12504 command_runner.go:130] > /var/lib/kubelet/kubeadm-flags.env

	I1003 18:21:06.084309   12504 command_runner.go:130] > /var/lib/minikube/etcd:

	I1003 18:21:06.084314   12504 command_runner.go:130] > member

	I1003 18:21:06.084371   12504 kubeadm.go:419] found existing configuration files, will attempt cluster restart

	I1003 18:21:06.084385   12504 kubeadm.go:636] restartCluster start

	I1003 18:21:06.084426   12504 ssh_runner.go:195] Run: sudo test -d /data/minikube

	I1003 18:21:06.090501   12504 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:06.090789   12504 kubeconfig.go:135] verify returned: extract IP: "multinode-528000" does not appear in /Users/jenkins/minikube-integration/17348-9809/kubeconfig

	I1003 18:21:06.090854   12504 kubeconfig.go:146] "multinode-528000" context is missing from /Users/jenkins/minikube-integration/17348-9809/kubeconfig - will repair!

	I1003 18:21:06.091042   12504 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17348-9809/kubeconfig: {Name:mkec8dac3aa4bbce21b67d3eb3832cabc3df6000 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 18:21:06.091750   12504 loader.go:395] Config loaded from file:  /Users/jenkins/minikube-integration/17348-9809/kubeconfig

	I1003 18:21:06.091940   12504 kapi.go:59] client config for multinode-528000: &rest.Config{Host:"https://192.168.89.41:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/client.key", CAFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Next

Protos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27c7a00), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1003 18:21:06.092372   12504 cert_rotation.go:137] Starting client certificate rotation controller

	I1003 18:21:06.092549   12504 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I1003 18:21:06.098627   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:06.098664   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:06.107165   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:06.107187   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:06.107296   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:06.115423   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:06.615532   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:06.615610   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:06.625505   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:07.117567   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:07.117716   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:07.128799   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:07.617641   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:07.617788   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:07.628838   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:08.117044   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:08.117185   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:08.128322   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:08.617634   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:08.617772   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:08.628347   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:09.116055   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:09.116164   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:09.126773   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:09.617623   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:09.617757   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:09.628267   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:10.117046   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:10.117188   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:10.127695   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:10.616576   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:10.616712   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:10.627660   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:11.117639   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:11.118392   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:11.130169   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:11.616829   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:11.616984   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:11.628153   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:12.115607   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:12.115686   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:12.125730   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:12.616586   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:12.616694   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:12.627366   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:13.116685   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:13.116831   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:13.127226   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:13.617651   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:13.617796   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:13.628769   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:14.117092   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:14.117245   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:14.127982   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:14.617596   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:14.617703   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:14.627110   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:15.116983   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:15.117065   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:15.126550   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:15.615594   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:15.615701   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:15.624768   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:16.099300   12504 kubeadm.go:611] needs reconfigure: apiserver error: context deadline exceeded

	I1003 18:21:16.099342   12504 kubeadm.go:1128] stopping kube-system containers ...

	I1003 18:21:16.099461   12504 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1003 18:21:16.117315   12504 command_runner.go:130] > ae6170e1c32e

	I1003 18:21:16.117326   12504 command_runner.go:130] > c777e3c5420d

	I1003 18:21:16.117330   12504 command_runner.go:130] > 7a7ac2be1e04

	I1003 18:21:16.117333   12504 command_runner.go:130] > d7643a9cc4b2

	I1003 18:21:16.117337   12504 command_runner.go:130] > b8024fee3a61

	I1003 18:21:16.117340   12504 command_runner.go:130] > d67acc5427bf

	I1003 18:21:16.117344   12504 command_runner.go:130] > 53bbec086eff

	I1003 18:21:16.117347   12504 command_runner.go:130] > 2791a8742711

	I1003 18:21:16.117350   12504 command_runner.go:130] > 9dc263cb45fb

	I1003 18:21:16.117356   12504 command_runner.go:130] > ee159c10d5d1

	I1003 18:21:16.117360   12504 command_runner.go:130] > b49c890ba5e9

	I1003 18:21:16.117363   12504 command_runner.go:130] > 9e6ae6e7777d

	I1003 18:21:16.117366   12504 command_runner.go:130] > b88a4172043e

	I1003 18:21:16.117375   12504 command_runner.go:130] > 941b6138c42c

	I1003 18:21:16.117378   12504 command_runner.go:130] > f1c546e1f118

	I1003 18:21:16.117382   12504 command_runner.go:130] > 0209621ce1a3

	I1003 18:21:16.117931   12504 docker.go:463] Stopping containers: [ae6170e1c32e c777e3c5420d 7a7ac2be1e04 d7643a9cc4b2 b8024fee3a61 d67acc5427bf 53bbec086eff 2791a8742711 9dc263cb45fb ee159c10d5d1 b49c890ba5e9 9e6ae6e7777d b88a4172043e 941b6138c42c f1c546e1f118 0209621ce1a3]

	I1003 18:21:16.117998   12504 ssh_runner.go:195] Run: docker stop ae6170e1c32e c777e3c5420d 7a7ac2be1e04 d7643a9cc4b2 b8024fee3a61 d67acc5427bf 53bbec086eff 2791a8742711 9dc263cb45fb ee159c10d5d1 b49c890ba5e9 9e6ae6e7777d b88a4172043e 941b6138c42c f1c546e1f118 0209621ce1a3

	I1003 18:21:16.130947   12504 command_runner.go:130] > ae6170e1c32e

	I1003 18:21:16.130958   12504 command_runner.go:130] > c777e3c5420d

	I1003 18:21:16.130962   12504 command_runner.go:130] > 7a7ac2be1e04

	I1003 18:21:16.130966   12504 command_runner.go:130] > d7643a9cc4b2

	I1003 18:21:16.130998   12504 command_runner.go:130] > b8024fee3a61

	I1003 18:21:16.131005   12504 command_runner.go:130] > d67acc5427bf

	I1003 18:21:16.131009   12504 command_runner.go:130] > 53bbec086eff

	I1003 18:21:16.131034   12504 command_runner.go:130] > 2791a8742711

	I1003 18:21:16.131121   12504 command_runner.go:130] > 9dc263cb45fb

	I1003 18:21:16.131324   12504 command_runner.go:130] > ee159c10d5d1

	I1003 18:21:16.131390   12504 command_runner.go:130] > b49c890ba5e9

	I1003 18:21:16.131676   12504 command_runner.go:130] > 9e6ae6e7777d

	I1003 18:21:16.131708   12504 command_runner.go:130] > b88a4172043e

	I1003 18:21:16.131957   12504 command_runner.go:130] > 941b6138c42c

	I1003 18:21:16.132024   12504 command_runner.go:130] > f1c546e1f118

	I1003 18:21:16.132165   12504 command_runner.go:130] > 0209621ce1a3

	I1003 18:21:16.132951   12504 ssh_runner.go:195] Run: sudo systemctl stop kubelet

	I1003 18:21:16.143984   12504 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1003 18:21:16.150345   12504 command_runner.go:130] ! ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	I1003 18:21:16.150356   12504 command_runner.go:130] ! ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	I1003 18:21:16.150362   12504 command_runner.go:130] ! ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	I1003 18:21:16.150369   12504 command_runner.go:130] ! ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1003 18:21:16.150389   12504 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1003 18:21:16.150427   12504 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1003 18:21:16.156749   12504 kubeadm.go:713] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml

	I1003 18:21:16.156757   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"

	I1003 18:21:16.217200   12504 command_runner.go:130] > [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I1003 18:21:16.217553   12504 command_runner.go:130] > [certs] Using existing ca certificate authority

	I1003 18:21:16.217954   12504 command_runner.go:130] > [certs] Using existing apiserver certificate and key on disk

	I1003 18:21:16.218335   12504 command_runner.go:130] > [certs] Using existing apiserver-kubelet-client certificate and key on disk

	I1003 18:21:16.218795   12504 command_runner.go:130] > [certs] Using existing front-proxy-ca certificate authority

	I1003 18:21:16.219249   12504 command_runner.go:130] > [certs] Using existing front-proxy-client certificate and key on disk

	I1003 18:21:16.219840   12504 command_runner.go:130] > [certs] Using existing etcd/ca certificate authority

	I1003 18:21:16.220210   12504 command_runner.go:130] > [certs] Using existing etcd/server certificate and key on disk

	I1003 18:21:16.220575   12504 command_runner.go:130] > [certs] Using existing etcd/peer certificate and key on disk

	I1003 18:21:16.220920   12504 command_runner.go:130] > [certs] Using existing etcd/healthcheck-client certificate and key on disk

	I1003 18:21:16.221313   12504 command_runner.go:130] > [certs] Using existing apiserver-etcd-client certificate and key on disk

	I1003 18:21:16.221715   12504 command_runner.go:130] > [certs] Using the existing "sa" key

	I1003 18:21:16.222703   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"

	I1003 18:21:16.261982   12504 command_runner.go:130] > [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I1003 18:21:16.422433   12504 command_runner.go:130] > [kubeconfig] Writing "admin.conf" kubeconfig file

	I1003 18:21:16.645555   12504 command_runner.go:130] > [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I1003 18:21:16.842517   12504 command_runner.go:130] > [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I1003 18:21:17.124827   12504 command_runner.go:130] > [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I1003 18:21:17.126961   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"

	I1003 18:21:17.173109   12504 command_runner.go:130] > [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I1003 18:21:17.173952   12504 command_runner.go:130] > [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I1003 18:21:17.173961   12504 command_runner.go:130] > [kubelet-start] Starting the kubelet

	I1003 18:21:17.264969   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"

	I1003 18:21:17.307273   12504 command_runner.go:130] > [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I1003 18:21:17.307303   12504 command_runner.go:130] > [control-plane] Creating static Pod manifest for "kube-apiserver"

	I1003 18:21:17.309725   12504 command_runner.go:130] > [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I1003 18:21:17.310781   12504 command_runner.go:130] > [control-plane] Creating static Pod manifest for "kube-scheduler"

	I1003 18:21:17.312686   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"

	I1003 18:21:17.368748   12504 command_runner.go:130] > [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I1003 18:21:17.371535   12504 api_server.go:52] waiting for apiserver process to appear ...

	I1003 18:21:17.371595   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1003 18:21:17.382558   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1003 18:21:17.894397   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1003 18:21:18.394658   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1003 18:21:18.894564   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1003 18:21:18.919533   12504 command_runner.go:130] > 1660

	I1003 18:21:18.919619   12504 api_server.go:72] duration metric: took 1.548086923s to wait for apiserver process to appear ...

	I1003 18:21:18.919626   12504 api_server.go:88] waiting for apiserver healthz status ...

	I1003 18:21:18.919654   12504 api_server.go:253] Checking apiserver healthz at https://192.168.89.41:8443/healthz ...

	I1003 18:21:21.996630   12504 api_server.go:279] https://192.168.89.41:8443/healthz returned 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	W1003 18:21:21.996687   12504 api_server.go:103] status: https://192.168.89.41:8443/healthz returned error 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	I1003 18:21:21.996711   12504 api_server.go:253] Checking apiserver healthz at https://192.168.89.41:8443/healthz ...

	I1003 18:21:22.051736   12504 api_server.go:279] https://192.168.89.41:8443/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[-]poststarthook/start-apiextensions-controllers failed: reason withheld

	[-]poststarthook/crd-informer-synced failed: reason withheld

	[-]poststarthook/start-service-ip-repair-controllers failed: reason withheld

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[-]poststarthook/priority-and-fairness-config-producer failed: reason withheld

	[+]poststarthook/start-system-namespaces-controller ok

	[-]poststarthook/bootstrap-controller failed: reason withheld

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[-]poststarthook/apiservice-registration-controller failed: reason withheld

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	healthz check failed

	W1003 18:21:22.051755   12504 api_server.go:103] status: https://192.168.89.41:8443/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[-]poststarthook/start-apiextensions-controllers failed: reason withheld

	[-]poststarthook/crd-informer-synced failed: reason withheld

	[-]poststarthook/start-service-ip-repair-controllers failed: reason withheld

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[-]poststarthook/priority-and-fairness-config-producer failed: reason withheld

	[+]poststarthook/start-system-namespaces-controller ok

	[-]poststarthook/bootstrap-controller failed: reason withheld

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[-]poststarthook/apiservice-registration-controller failed: reason withheld

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	healthz check failed

	I1003 18:21:22.552514   12504 api_server.go:253] Checking apiserver healthz at https://192.168.89.41:8443/healthz ...

	I1003 18:21:22.558224   12504 api_server.go:279] https://192.168.89.41:8443/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	healthz check failed

	W1003 18:21:22.558242   12504 api_server.go:103] status: https://192.168.89.41:8443/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	healthz check failed

	I1003 18:21:23.052327   12504 api_server.go:253] Checking apiserver healthz at https://192.168.89.41:8443/healthz ...

	I1003 18:21:23.067920   12504 api_server.go:279] https://192.168.89.41:8443/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	healthz check failed

	W1003 18:21:23.067937   12504 api_server.go:103] status: https://192.168.89.41:8443/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	healthz check failed

	I1003 18:21:23.553450   12504 api_server.go:253] Checking apiserver healthz at https://192.168.89.41:8443/healthz ...

	I1003 18:21:23.557489   12504 api_server.go:279] https://192.168.89.41:8443/healthz returned 200:

	ok

	I1003 18:21:23.557585   12504 round_trippers.go:463] GET https://192.168.89.41:8443/version

	I1003 18:21:23.557590   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:23.557600   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:23.557606   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:23.563064   12504 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I1003 18:21:23.563090   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:23.563096   12504 round_trippers.go:580]     Audit-Id: e4c37542-b2ef-4d9d-a5e7-cbb71f0f6efa

	I1003 18:21:23.563101   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:23.563106   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:23.563132   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:23.563137   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:23.563142   12504 round_trippers.go:580]     Content-Length: 263

	I1003 18:21:23.563147   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:23 GMT

	I1003 18:21:23.563168   12504 request.go:1212] Response Body: {

	  "major": "1",

	  "minor": "28",

	  "gitVersion": "v1.28.2",

	  "gitCommit": "89a4ea3e1e4ddd7f7572286090359983e0387b2f",

	  "gitTreeState": "clean",

	  "buildDate": "2023-09-13T09:29:07Z",

	  "goVersion": "go1.20.8",

	  "compiler": "gc",

	  "platform": "linux/amd64"

	}

	I1003 18:21:23.563219   12504 api_server.go:141] control plane version: v1.28.2

	I1003 18:21:23.563229   12504 api_server.go:131] duration metric: took 4.643622509s to wait for apiserver health ...

	I1003 18:21:23.563234   12504 cni.go:84] Creating CNI manager for ""

	I1003 18:21:23.563253   12504 cni.go:136] 3 nodes found, recommending kindnet

	I1003 18:21:23.585590   12504 out.go:177] * Configuring CNI (Container Networking Interface) ...

	I1003 18:21:23.607471   12504 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap

	I1003 18:21:23.611088   12504 command_runner.go:130] >   File: /opt/cni/bin/portmap

	I1003 18:21:23.611100   12504 command_runner.go:130] >   Size: 2615256   	Blocks: 5112       IO Block: 4096   regular file

	I1003 18:21:23.611105   12504 command_runner.go:130] > Device: 11h/17d	Inode: 3544        Links: 1

	I1003 18:21:23.611110   12504 command_runner.go:130] > Access: (0755/-rwxr-xr-x)  Uid: (    0/    root)   Gid: (    0/    root)

	I1003 18:21:23.611115   12504 command_runner.go:130] > Access: 2023-10-04 01:20:59.445267298 +0000

	I1003 18:21:23.611120   12504 command_runner.go:130] > Modify: 2023-09-19 00:07:45.000000000 +0000

	I1003 18:21:23.611125   12504 command_runner.go:130] > Change: 2023-10-04 01:20:57.047134463 +0000

	I1003 18:21:23.611128   12504 command_runner.go:130] >  Birth: -

	I1003 18:21:23.611364   12504 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.28.2/kubectl ...

	I1003 18:21:23.611372   12504 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)

	I1003 18:21:23.661213   12504 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I1003 18:21:24.452406   12504 command_runner.go:130] > clusterrole.rbac.authorization.k8s.io/kindnet unchanged

	I1003 18:21:24.455861   12504 command_runner.go:130] > clusterrolebinding.rbac.authorization.k8s.io/kindnet unchanged

	I1003 18:21:24.457766   12504 command_runner.go:130] > serviceaccount/kindnet unchanged

	I1003 18:21:24.469478   12504 command_runner.go:130] > daemonset.apps/kindnet configured

	I1003 18:21:24.471307   12504 system_pods.go:43] waiting for kube-system pods to appear ...

	I1003 18:21:24.471367   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods

	I1003 18:21:24.471372   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:24.471379   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:24.471384   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:24.474082   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:24.474098   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:24.474107   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:24.474116   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:24.474124   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:24.474144   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:24 GMT

	I1003 18:21:24.474162   12504 round_trippers.go:580]     Audit-Id: 47f3b751-d728-4d2a-ac8b-046c03d80c28

	I1003 18:21:24.474171   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:24.474826   12504 request.go:1212] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"809"},"items":[{"metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f

:preferredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{ [truncated 84534 chars]

	I1003 18:21:24.477990   12504 system_pods.go:59] 12 kube-system pods found

	I1003 18:21:24.478003   12504 system_pods.go:61] "coredns-5dd5756b68-rtwd9" [3da6e23f-9391-4ec9-99aa-db9b421b00ad] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])

	I1003 18:21:24.478017   12504 system_pods.go:61] "etcd-multinode-528000" [a86312b2-3ca5-488d-b5bc-06c3346dc64e] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])

	I1003 18:21:24.478023   12504 system_pods.go:61] "kindnet-nvwhf" [1e450dcf-51ca-4715-a758-2def2e9fa38f] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])

	I1003 18:21:24.478027   12504 system_pods.go:61] "kindnet-nz8t4" [ede223c2-a0e9-4366-ba78-1eb90a1705d3] Running

	I1003 18:21:24.478031   12504 system_pods.go:61] "kindnet-tl478" [037a12f0-6b69-4fac-8cdc-bee5f7247624] Running

	I1003 18:21:24.478036   12504 system_pods.go:61] "kube-apiserver-multinode-528000" [e9361a2b-5db4-4742-9ef6-fbecda9d22a9] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])

	I1003 18:21:24.478041   12504 system_pods.go:61] "kube-controller-manager-multinode-528000" [54a13f47-e858-461b-afae-d3307752880b] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])

	I1003 18:21:24.478046   12504 system_pods.go:61] "kube-proxy-69bxc" [f621588e-bd8a-4135-aa5c-94eb292062f8] Running

	I1003 18:21:24.478051   12504 system_pods.go:61] "kube-proxy-8bl5p" [11839b32-7219-414d-a63f-026b1be9ab5c] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])

	I1003 18:21:24.478055   12504 system_pods.go:61] "kube-proxy-9pd2m" [41452f70-63bc-473d-b7bd-93e2efa7a304] Running

	I1003 18:21:24.478060   12504 system_pods.go:61] "kube-scheduler-multinode-528000" [ff27b767-6913-4efa-8a1e-8398fba84175] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])

	I1003 18:21:24.478065   12504 system_pods.go:61] "storage-provisioner" [874a29bb-bf60-4c95-9bdd-90dbb9c3c115] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I1003 18:21:24.478070   12504 system_pods.go:74] duration metric: took 6.756769ms to wait for pod list to return data ...

	I1003 18:21:24.478077   12504 node_conditions.go:102] verifying NodePressure condition ...

	I1003 18:21:24.478112   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes

	I1003 18:21:24.478117   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:24.478123   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:24.478129   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:24.479926   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:24.479938   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:24.479943   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:24.479948   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:24.479952   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:24.479958   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:24.479962   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:24 GMT

	I1003 18:21:24.479968   12504 round_trippers.go:580]     Audit-Id: e40730f6-9170-46f3-9087-1ac168a081df

	I1003 18:21:24.480266   12504 request.go:1212] Response Body: {"kind":"NodeList","apiVersion":"v1","metadata":{"resourceVersion":"809"},"items":[{"metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFiel

ds":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time" [truncated 13686 chars]

	I1003 18:21:24.480764   12504 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki

	I1003 18:21:24.480781   12504 node_conditions.go:123] node cpu capacity is 2

	I1003 18:21:24.480791   12504 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki

	I1003 18:21:24.480795   12504 node_conditions.go:123] node cpu capacity is 2

	I1003 18:21:24.480800   12504 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki

	I1003 18:21:24.480803   12504 node_conditions.go:123] node cpu capacity is 2

	I1003 18:21:24.480806   12504 node_conditions.go:105] duration metric: took 2.725051ms to run NodePressure ...

	I1003 18:21:24.480820   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"

	I1003 18:21:24.577040   12504 command_runner.go:130] > [addons] Applied essential addon: CoreDNS

	I1003 18:21:24.611536   12504 command_runner.go:130] > [addons] Applied essential addon: kube-proxy

	I1003 18:21:24.614553   12504 kubeadm.go:772] waiting for restarted kubelet to initialise ...

	I1003 18:21:24.614650   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods?labelSelector=tier%3Dcontrol-plane

	I1003 18:21:24.614655   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:24.614661   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:24.614682   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:24.617705   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:24.617715   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:24.617721   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:24.617728   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:24.617737   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:24.617743   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:24 GMT

	I1003 18:21:24.617750   12504 round_trippers.go:580]     Audit-Id: 5f7810f4-96f7-47a2-980f-320663658f38

	I1003 18:21:24.617757   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:24.618015   12504 request.go:1212] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"811"},"items":[{"metadata":{"name":"etcd-multinode-528000","namespace":"kube-system","uid":"a86312b2-3ca5-488d-b5bc-06c3346dc64e","resourceVersion":"739","creationTimestamp":"2023-10-04T01:18:19Z","labels":{"component":"etcd","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/etcd.advertise-client-urls":"https://192.168.89.41:2379","kubernetes.io/config.hash":"ae74302b7aebd7fdcc26eb5602da4836","kubernetes.io/config.mirror":"ae74302b7aebd7fdcc26eb5602da4836","kubernetes.io/config.seen":"2023-10-04T01:18:19.349005085Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:19Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations

":{".":{},"f:kubeadm.kubernetes.io/etcd.advertise-client-urls":{},"f:ku [truncated 29761 chars]

	I1003 18:21:24.618687   12504 kubeadm.go:787] kubelet initialised

	I1003 18:21:24.618696   12504 kubeadm.go:788] duration metric: took 4.13235ms waiting for restarted kubelet to initialise ...

	I1003 18:21:24.618703   12504 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1003 18:21:24.618737   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods

	I1003 18:21:24.618741   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:24.618747   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:24.618752   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:24.621240   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:24.621250   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:24.621255   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:24.621260   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:24.621265   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:24 GMT

	I1003 18:21:24.621269   12504 round_trippers.go:580]     Audit-Id: 5e0dac6e-318d-46b5-a657-342c8b17a98f

	I1003 18:21:24.621274   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:24.621280   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:24.622285   12504 request.go:1212] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"811"},"items":[{"metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f

:preferredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{ [truncated 84534 chars]

	I1003 18:21:24.624033   12504 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:24.624071   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:24.624077   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:24.624082   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:24.624088   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:24.625449   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:24.625457   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:24.625463   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:24.625468   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:24 GMT

	I1003 18:21:24.625473   12504 round_trippers.go:580]     Audit-Id: d6917bf8-5c23-4ab2-b1f7-7ede67c7f732

	I1003 18:21:24.625477   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:24.625483   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:24.625487   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:24.625705   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:24.625943   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:24.625949   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:24.625955   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:24.625960   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:24.627195   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:24.627206   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:24.627228   12504 round_trippers.go:580]     Audit-Id: 424ffa5d-bf93-4908-b309-d02639d04cee

	I1003 18:21:24.627233   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:24.627237   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:24.627242   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:24.627247   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:24.627253   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:24 GMT

	I1003 18:21:24.627337   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:24.627515   12504 pod_ready.go:97] node "multinode-528000" hosting pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000" has status "Ready":"False"

	I1003 18:21:24.627524   12504 pod_ready.go:81] duration metric: took 3.482148ms waiting for pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace to be "Ready" ...

	E1003 18:21:24.627530   12504 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-528000" hosting pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000" has status "Ready":"False"

	I1003 18:21:24.627536   12504 pod_ready.go:78] waiting up to 4m0s for pod "etcd-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:24.627564   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/etcd-multinode-528000

	I1003 18:21:24.627568   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:24.627574   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:24.627579   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:24.628847   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:24.628854   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:24.628859   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:24.628863   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:24.628868   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:24.628873   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:24 GMT

	I1003 18:21:24.628878   12504 round_trippers.go:580]     Audit-Id: e55100f6-82f1-4d5c-b107-72e93442576e

	I1003 18:21:24.628883   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:24.629082   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"etcd-multinode-528000","namespace":"kube-system","uid":"a86312b2-3ca5-488d-b5bc-06c3346dc64e","resourceVersion":"739","creationTimestamp":"2023-10-04T01:18:19Z","labels":{"component":"etcd","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/etcd.advertise-client-urls":"https://192.168.89.41:2379","kubernetes.io/config.hash":"ae74302b7aebd7fdcc26eb5602da4836","kubernetes.io/config.mirror":"ae74302b7aebd7fdcc26eb5602da4836","kubernetes.io/config.seen":"2023-10-04T01:18:19.349005085Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:19Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubeadm.kubernetes.io/etcd.advertise-c

lient-urls":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config [truncated 6295 chars]

	I1003 18:21:24.629288   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:24.629295   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:24.629300   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:24.629306   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:24.630553   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:24.630560   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:24.630565   12504 round_trippers.go:580]     Audit-Id: dc3bedba-2e5c-44fd-a41d-a0d981eb13ff

	I1003 18:21:24.630570   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:24.630574   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:24.630578   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:24.630583   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:24.630588   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:24 GMT

	I1003 18:21:24.630724   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:24.630889   12504 pod_ready.go:97] node "multinode-528000" hosting pod "etcd-multinode-528000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000" has status "Ready":"False"

	I1003 18:21:24.630897   12504 pod_ready.go:81] duration metric: took 3.356098ms waiting for pod "etcd-multinode-528000" in "kube-system" namespace to be "Ready" ...

	E1003 18:21:24.630904   12504 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-528000" hosting pod "etcd-multinode-528000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000" has status "Ready":"False"

	I1003 18:21:24.630912   12504 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:24.630937   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-multinode-528000

	I1003 18:21:24.630942   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:24.630947   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:24.630953   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:24.632092   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:24.632102   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:24.632112   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:24.632119   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:24.632125   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:24.632145   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:24 GMT

	I1003 18:21:24.632151   12504 round_trippers.go:580]     Audit-Id: 5630d527-6a23-4155-9328-8bb1466c55d3

	I1003 18:21:24.632157   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:24.632250   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-apiserver-multinode-528000","namespace":"kube-system","uid":"e9361a2b-5db4-4742-9ef6-fbecda9d22a9","resourceVersion":"740","creationTimestamp":"2023-10-04T01:18:19Z","labels":{"component":"kube-apiserver","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint":"192.168.89.41:8443","kubernetes.io/config.hash":"6c45fd2961dfe8d00019d2277ceb95bd","kubernetes.io/config.mirror":"6c45fd2961dfe8d00019d2277ceb95bd","kubernetes.io/config.seen":"2023-10-04T01:18:19.349011685Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:19Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubeadm.kub

ernetes.io/kube-apiserver.advertise-address.endpoint":{},"f:kubernetes. [truncated 7850 chars]

	I1003 18:21:24.632469   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:24.632475   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:24.632481   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:24.632487   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:24.633583   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:24.633608   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:24.633614   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:24.633620   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:24.633624   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:24 GMT

	I1003 18:21:24.633630   12504 round_trippers.go:580]     Audit-Id: 1f7bfde6-804e-40b9-87e0-1057cce9eafa

	I1003 18:21:24.633635   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:24.633640   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:24.633740   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:24.633930   12504 pod_ready.go:97] node "multinode-528000" hosting pod "kube-apiserver-multinode-528000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000" has status "Ready":"False"

	I1003 18:21:24.633938   12504 pod_ready.go:81] duration metric: took 3.021091ms waiting for pod "kube-apiserver-multinode-528000" in "kube-system" namespace to be "Ready" ...

	E1003 18:21:24.633944   12504 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-528000" hosting pod "kube-apiserver-multinode-528000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000" has status "Ready":"False"

	I1003 18:21:24.633972   12504 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:24.672370   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-multinode-528000

	I1003 18:21:24.672385   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:24.672397   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:24.672408   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:24.674780   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:24.674792   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:24.674804   12504 round_trippers.go:580]     Audit-Id: 871be31a-7010-4a52-a39b-08d44a962618

	I1003 18:21:24.674811   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:24.674817   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:24.674825   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:24.674831   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:24.674837   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:24 GMT

	I1003 18:21:24.675066   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-controller-manager-multinode-528000","namespace":"kube-system","uid":"54a13f47-e858-461b-afae-d3307752880b","resourceVersion":"741","creationTimestamp":"2023-10-04T01:18:17Z","labels":{"component":"kube-controller-manager","tier":"control-plane"},"annotations":{"kubernetes.io/config.hash":"eeb9be3a2727f46db49245f383b6c839","kubernetes.io/config.mirror":"eeb9be3a2727f46db49245f383b6c839","kubernetes.io/config.seen":"2023-10-04T01:18:12.593443479Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:17Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config.mirror":{},"f:kubernetes.i

o/config.seen":{},"f:kubernetes.io/config.source":{}},"f:labels":{".":{ [truncated 7436 chars]

	I1003 18:21:24.872169   12504 request.go:629] Waited for 196.767625ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:24.872226   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:24.872249   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:24.872261   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:24.872268   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:24.874456   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:24.874466   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:24.874472   12504 round_trippers.go:580]     Audit-Id: 6b62645f-8b92-4899-a188-7fad1dc5cfbd

	I1003 18:21:24.874477   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:24.874483   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:24.874487   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:24.874492   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:24.874498   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:25 GMT

	I1003 18:21:24.874557   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:24.874749   12504 pod_ready.go:97] node "multinode-528000" hosting pod "kube-controller-manager-multinode-528000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000" has status "Ready":"False"

	I1003 18:21:24.874758   12504 pod_ready.go:81] duration metric: took 240.783167ms waiting for pod "kube-controller-manager-multinode-528000" in "kube-system" namespace to be "Ready" ...

	E1003 18:21:24.874765   12504 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-528000" hosting pod "kube-controller-manager-multinode-528000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000" has status "Ready":"False"

	I1003 18:21:24.874771   12504 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-69bxc" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:25.071494   12504 request.go:629] Waited for 196.692215ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-69bxc

	I1003 18:21:25.071535   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-69bxc

	I1003 18:21:25.071541   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:25.071547   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:25.071553   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:25.073308   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:25.073318   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:25.073324   12504 round_trippers.go:580]     Audit-Id: cbedbd4f-2a04-41e5-a02c-1cc2fd8028df

	I1003 18:21:25.073330   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:25.073337   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:25.073343   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:25.073349   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:25.073353   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:25 GMT

	I1003 18:21:25.073444   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-69bxc","generateName":"kube-proxy-","namespace":"kube-system","uid":"f621588e-bd8a-4135-aa5c-94eb292062f8","resourceVersion":"712","creationTimestamp":"2023-10-04T01:19:40Z","labels":{"controller-revision-hash":"5cbdb8dcbd","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"d64f3f20-7d64-423e-8050-9b9944997ed5","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:19:40Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"d64f3f20-7d64-423e-8050-9b9944997ed5\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r

equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5746 chars]

	I1003 18:21:25.272700   12504 request.go:629] Waited for 198.988678ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m03

	I1003 18:21:25.272753   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m03

	I1003 18:21:25.272762   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:25.272774   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:25.272786   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:25.275733   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:25.275750   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:25.275757   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:25.275764   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:25 GMT

	I1003 18:21:25.275770   12504 round_trippers.go:580]     Audit-Id: 5a8e6bee-3977-4df1-9a1d-bcfeb9cd736a

	I1003 18:21:25.275776   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:25.275788   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:25.275794   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:25.275894   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m03","uid":"8b2fb46e-7671-4d24-b736-562f2f0cd353","resourceVersion":"731","creationTimestamp":"2023-10-04T01:20:20Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m03","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:20:20Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{

}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 3083 chars]

	I1003 18:21:25.276096   12504 pod_ready.go:92] pod "kube-proxy-69bxc" in "kube-system" namespace has status "Ready":"True"

	I1003 18:21:25.276106   12504 pod_ready.go:81] duration metric: took 401.332135ms waiting for pod "kube-proxy-69bxc" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:25.276114   12504 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-8bl5p" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:25.472661   12504 request.go:629] Waited for 196.507895ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-8bl5p

	I1003 18:21:25.472692   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-8bl5p

	I1003 18:21:25.472697   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:25.472703   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:25.472708   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:25.476820   12504 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1003 18:21:25.476834   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:25.476842   12504 round_trippers.go:580]     Audit-Id: dad6a5c0-23bf-4cdc-a4bf-b31dae2994ed

	I1003 18:21:25.476863   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:25.476873   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:25.476878   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:25.476883   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:25.476888   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:25 GMT

	I1003 18:21:25.477005   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-8bl5p","generateName":"kube-proxy-","namespace":"kube-system","uid":"11839b32-7219-414d-a63f-026b1be9ab5c","resourceVersion":"746","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"controller-revision-hash":"5cbdb8dcbd","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"d64f3f20-7d64-423e-8050-9b9944997ed5","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"d64f3f20-7d64-423e-8050-9b9944997ed5\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r

equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5928 chars]

	I1003 18:21:25.673313   12504 request.go:629] Waited for 196.049836ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:25.673349   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:25.673354   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:25.673359   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:25.673364   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:25.675098   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:25.675107   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:25.675112   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:25.675119   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:25 GMT

	I1003 18:21:25.675128   12504 round_trippers.go:580]     Audit-Id: 2539f64b-c2ea-45fc-b1d2-ef60fbb06c17

	I1003 18:21:25.675135   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:25.675143   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:25.675149   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:25.675304   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:25.675492   12504 pod_ready.go:97] node "multinode-528000" hosting pod "kube-proxy-8bl5p" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000" has status "Ready":"False"

	I1003 18:21:25.675500   12504 pod_ready.go:81] duration metric: took 399.385211ms waiting for pod "kube-proxy-8bl5p" in "kube-system" namespace to be "Ready" ...

	E1003 18:21:25.675507   12504 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-528000" hosting pod "kube-proxy-8bl5p" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000" has status "Ready":"False"

	I1003 18:21:25.675512   12504 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-9pd2m" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:25.873243   12504 request.go:629] Waited for 197.690721ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-9pd2m

	I1003 18:21:25.873334   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-9pd2m

	I1003 18:21:25.873344   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:25.873355   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:25.873365   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:25.876163   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:25.876176   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:25.876185   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:25.876194   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:26 GMT

	I1003 18:21:25.876201   12504 round_trippers.go:580]     Audit-Id: 5e1bff94-45d4-40b5-b591-bf7eebf2cea0

	I1003 18:21:25.876209   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:25.876215   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:25.876224   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:25.876364   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-9pd2m","generateName":"kube-proxy-","namespace":"kube-system","uid":"41452f70-63bc-473d-b7bd-93e2efa7a304","resourceVersion":"517","creationTimestamp":"2023-10-04T01:19:04Z","labels":{"controller-revision-hash":"5cbdb8dcbd","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"d64f3f20-7d64-423e-8050-9b9944997ed5","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:19:04Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"d64f3f20-7d64-423e-8050-9b9944997ed5\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r

equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5541 chars]

	I1003 18:21:26.071809   12504 request.go:629] Waited for 195.108778ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:21:26.071885   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:21:26.071947   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:26.071959   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:26.071972   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:26.074600   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:26.074613   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:26.074620   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:26.074652   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:26 GMT

	I1003 18:21:26.074667   12504 round_trippers.go:580]     Audit-Id: ff150d8b-b92d-4eed-a89e-326cc303a81e

	I1003 18:21:26.074687   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:26.074697   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:26.074704   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:26.074769   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m02","uid":"0073defe-0d22-4c69-83ae-9ebd7055fa45","resourceVersion":"582","creationTimestamp":"2023-10-04T01:19:04Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:19:04Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{

}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 3266 chars]

	I1003 18:21:26.074975   12504 pod_ready.go:92] pod "kube-proxy-9pd2m" in "kube-system" namespace has status "Ready":"True"

	I1003 18:21:26.074985   12504 pod_ready.go:81] duration metric: took 399.471148ms waiting for pod "kube-proxy-9pd2m" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:26.074994   12504 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:26.272020   12504 request.go:629] Waited for 196.940715ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-multinode-528000

	I1003 18:21:26.272069   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-multinode-528000

	I1003 18:21:26.272082   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:26.272094   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:26.272106   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:26.275172   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:26.275188   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:26.275195   12504 round_trippers.go:580]     Audit-Id: 9018ffe3-274b-4d28-bb6d-e0a4fc733d0f

	I1003 18:21:26.275202   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:26.275208   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:26.275214   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:26.275220   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:26.275226   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:26 GMT

	I1003 18:21:26.275312   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-scheduler-multinode-528000","namespace":"kube-system","uid":"ff27b767-6913-4efa-8a1e-8398fba84175","resourceVersion":"742","creationTimestamp":"2023-10-04T01:18:17Z","labels":{"component":"kube-scheduler","tier":"control-plane"},"annotations":{"kubernetes.io/config.hash":"e3e48fd34564ef6993a5357d3bb10a96","kubernetes.io/config.mirror":"e3e48fd34564ef6993a5357d3bb10a96","kubernetes.io/config.seen":"2023-10-04T01:18:12.593444031Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:17Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config.mirror":{},"f:kubernetes.io/config.seen":{},

"f:kubernetes.io/config.source":{}},"f:labels":{".":{},"f:component":{} [truncated 5148 chars]

	I1003 18:21:26.471552   12504 request.go:629] Waited for 195.951912ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:26.471592   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:26.471598   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:26.471608   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:26.471672   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:26.473902   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:26.473912   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:26.473917   12504 round_trippers.go:580]     Audit-Id: d6794825-5ce2-4e95-a0ed-a504200c57f8

	I1003 18:21:26.473922   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:26.473927   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:26.473931   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:26.473936   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:26.473941   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:26 GMT

	I1003 18:21:26.474018   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:26.474212   12504 pod_ready.go:97] node "multinode-528000" hosting pod "kube-scheduler-multinode-528000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000" has status "Ready":"False"

	I1003 18:21:26.474222   12504 pod_ready.go:81] duration metric: took 399.226531ms waiting for pod "kube-scheduler-multinode-528000" in "kube-system" namespace to be "Ready" ...

	E1003 18:21:26.474229   12504 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-528000" hosting pod "kube-scheduler-multinode-528000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000" has status "Ready":"False"

	I1003 18:21:26.474238   12504 pod_ready.go:38] duration metric: took 1.855543692s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1003 18:21:26.474253   12504 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I1003 18:21:26.488165   12504 command_runner.go:130] > -16

	I1003 18:21:26.488607   12504 ops.go:34] apiserver oom_adj: -16

	I1003 18:21:26.488622   12504 kubeadm.go:640] restartCluster took 20.404189051s

	I1003 18:21:26.488628   12504 kubeadm.go:406] StartCluster complete in 20.423682835s

	I1003 18:21:26.488640   12504 settings.go:142] acquiring lock: {Name:mkf02269a45dee1a6eaba9498791af3b04c749e3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 18:21:26.488720   12504 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/17348-9809/kubeconfig

	I1003 18:21:26.489153   12504 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17348-9809/kubeconfig: {Name:mkec8dac3aa4bbce21b67d3eb3832cabc3df6000 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 18:21:26.489454   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I1003 18:21:26.489484   12504 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false]

	I1003 18:21:26.489617   12504 config.go:182] Loaded profile config "multinode-528000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 18:21:26.489949   12504 loader.go:395] Config loaded from file:  /Users/jenkins/minikube-integration/17348-9809/kubeconfig

	I1003 18:21:26.511026   12504 out.go:177] * Enabled addons: 

	I1003 18:21:26.548616   12504 addons.go:502] enable addons completed in 59.141628ms: enabled=[]

	I1003 18:21:26.511250   12504 kapi.go:59] client config for multinode-528000: &rest.Config{Host:"https://192.168.89.41:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/client.key", CAFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Next

Protos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27c7a00), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1003 18:21:26.548905   12504 round_trippers.go:463] GET https://192.168.89.41:8443/apis/apps/v1/namespaces/kube-system/deployments/coredns/scale

	I1003 18:21:26.548915   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:26.548924   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:26.548931   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:26.551526   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:26.551536   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:26.551541   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:26.551546   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:26.551551   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:26.551555   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:26.551560   12504 round_trippers.go:580]     Content-Length: 291

	I1003 18:21:26.551564   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:26 GMT

	I1003 18:21:26.551569   12504 round_trippers.go:580]     Audit-Id: aeb5ea5b-c31e-4fc6-93af-536e0077c8a7

	I1003 18:21:26.551581   12504 request.go:1212] Response Body: {"kind":"Scale","apiVersion":"autoscaling/v1","metadata":{"name":"coredns","namespace":"kube-system","uid":"922fb573-befe-48bc-bc7c-aeeaaee4dd54","resourceVersion":"810","creationTimestamp":"2023-10-04T01:18:19Z"},"spec":{"replicas":1},"status":{"replicas":1,"selector":"k8s-app=kube-dns"}}

	I1003 18:21:26.551675   12504 kapi.go:248] "coredns" deployment in "kube-system" namespace and "multinode-528000" context rescaled to 1 replicas

	I1003 18:21:26.551695   12504 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.89.41 Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1003 18:21:26.572701   12504 out.go:177] * Verifying Kubernetes components...

	I1003 18:21:26.647608   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1003 18:21:26.664523   12504 command_runner.go:130] > apiVersion: v1

	I1003 18:21:26.664535   12504 command_runner.go:130] > data:

	I1003 18:21:26.664539   12504 command_runner.go:130] >   Corefile: |

	I1003 18:21:26.664542   12504 command_runner.go:130] >     .:53 {

	I1003 18:21:26.664546   12504 command_runner.go:130] >         log

	I1003 18:21:26.664550   12504 command_runner.go:130] >         errors

	I1003 18:21:26.664578   12504 command_runner.go:130] >         health {

	I1003 18:21:26.664582   12504 command_runner.go:130] >            lameduck 5s

	I1003 18:21:26.664585   12504 command_runner.go:130] >         }

	I1003 18:21:26.664593   12504 command_runner.go:130] >         ready

	I1003 18:21:26.664598   12504 command_runner.go:130] >         kubernetes cluster.local in-addr.arpa ip6.arpa {

	I1003 18:21:26.664602   12504 command_runner.go:130] >            pods insecure

	I1003 18:21:26.664609   12504 command_runner.go:130] >            fallthrough in-addr.arpa ip6.arpa

	I1003 18:21:26.664613   12504 command_runner.go:130] >            ttl 30

	I1003 18:21:26.664616   12504 command_runner.go:130] >         }

	I1003 18:21:26.664622   12504 command_runner.go:130] >         prometheus :9153

	I1003 18:21:26.664626   12504 command_runner.go:130] >         hosts {

	I1003 18:21:26.664633   12504 command_runner.go:130] >            192.168.89.1 host.minikube.internal

	I1003 18:21:26.664652   12504 command_runner.go:130] >            fallthrough

	I1003 18:21:26.664655   12504 command_runner.go:130] >         }

	I1003 18:21:26.664661   12504 command_runner.go:130] >         forward . /etc/resolv.conf {

	I1003 18:21:26.664667   12504 command_runner.go:130] >            max_concurrent 1000

	I1003 18:21:26.664671   12504 command_runner.go:130] >         }

	I1003 18:21:26.664675   12504 command_runner.go:130] >         cache 30

	I1003 18:21:26.664679   12504 command_runner.go:130] >         loop

	I1003 18:21:26.664684   12504 command_runner.go:130] >         reload

	I1003 18:21:26.664687   12504 command_runner.go:130] >         loadbalance

	I1003 18:21:26.664692   12504 command_runner.go:130] >     }

	I1003 18:21:26.664696   12504 command_runner.go:130] > kind: ConfigMap

	I1003 18:21:26.664700   12504 command_runner.go:130] > metadata:

	I1003 18:21:26.664704   12504 command_runner.go:130] >   creationTimestamp: "2023-10-04T01:18:19Z"

	I1003 18:21:26.664709   12504 command_runner.go:130] >   name: coredns

	I1003 18:21:26.664727   12504 command_runner.go:130] >   namespace: kube-system

	I1003 18:21:26.664734   12504 command_runner.go:130] >   resourceVersion: "398"

	I1003 18:21:26.664738   12504 command_runner.go:130] >   uid: cb6f6791-ee44-4f9b-af52-ece342b3d8a0

	I1003 18:21:26.668145   12504 node_ready.go:35] waiting up to 6m0s for node "multinode-528000" to be "Ready" ...

	I1003 18:21:26.668149   12504 start.go:896] CoreDNS already contains "host.minikube.internal" host record, skipping...

	I1003 18:21:26.671405   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:26.671414   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:26.671421   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:26.671426   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:26.673245   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:26.673257   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:26.673265   12504 round_trippers.go:580]     Audit-Id: 35b81ccd-05b7-4954-9dfb-63109513e6c1

	I1003 18:21:26.673271   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:26.673276   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:26.673281   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:26.673287   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:26.673294   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:26 GMT

	I1003 18:21:26.673435   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:26.871460   12504 request.go:629] Waited for 197.779271ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:26.871494   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:26.871500   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:26.871508   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:26.871517   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:26.873427   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:26.873440   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:26.873449   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:27 GMT

	I1003 18:21:26.873456   12504 round_trippers.go:580]     Audit-Id: 2f9206e2-71ed-469d-898e-253a1df997c7

	I1003 18:21:26.873467   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:26.873475   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:26.873483   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:26.873488   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:26.873692   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:27.374891   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:27.374907   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:27.374914   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:27.374919   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:27.376830   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:27.376839   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:27.376845   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:27.376850   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:27 GMT

	I1003 18:21:27.376855   12504 round_trippers.go:580]     Audit-Id: 1dcc0191-db17-46e4-930f-a81af5b5beb3

	I1003 18:21:27.376860   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:27.376875   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:27.376891   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:27.377035   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:27.875660   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:27.875687   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:27.875699   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:27.875708   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:27.878528   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:27.878547   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:27.878554   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:27.878561   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:27.878567   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:28 GMT

	I1003 18:21:27.878574   12504 round_trippers.go:580]     Audit-Id: 40cf556c-f1ef-4092-99db-409c1bd3ac83

	I1003 18:21:27.878588   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:27.878594   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:27.878662   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:28.374389   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:28.374411   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:28.374423   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:28.374433   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:28.377407   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:28.377422   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:28.377429   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:28.377435   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:28.377441   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:28.377447   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:28.377453   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:28 GMT

	I1003 18:21:28.377477   12504 round_trippers.go:580]     Audit-Id: 0a6dc545-f57e-417e-9808-a3da0d3233fa

	I1003 18:21:28.377572   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:28.874574   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:28.874596   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:28.874608   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:28.874618   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:28.877400   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:28.877414   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:28.877421   12504 round_trippers.go:580]     Audit-Id: 096a7038-12ae-483e-8402-40370160736c

	I1003 18:21:28.877428   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:28.877434   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:28.877444   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:28.877456   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:28.877481   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:29 GMT

	I1003 18:21:28.877668   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:28.877937   12504 node_ready.go:58] node "multinode-528000" has status "Ready":"False"

	I1003 18:21:29.374216   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:29.374235   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:29.374247   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:29.374257   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:29.376593   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:29.376610   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:29.376621   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:29.376633   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:29 GMT

	I1003 18:21:29.376643   12504 round_trippers.go:580]     Audit-Id: 4a942b92-b505-4418-b62a-86700641f1fc

	I1003 18:21:29.376653   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:29.376675   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:29.376686   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:29.376856   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:29.874308   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:29.874328   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:29.874341   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:29.874351   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:29.876828   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:29.876840   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:29.876847   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:29.876852   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:29.876857   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:30 GMT

	I1003 18:21:29.876861   12504 round_trippers.go:580]     Audit-Id: db9845a3-3b0d-4104-a4c3-5179e9cbcd43

	I1003 18:21:29.876866   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:29.876872   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:29.876987   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:30.374134   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:30.374146   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:30.374153   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:30.374158   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:30.376000   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:30.376014   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:30.376022   12504 round_trippers.go:580]     Audit-Id: a71259bd-74ff-4dec-b458-597074486eaf

	I1003 18:21:30.376029   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:30.376036   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:30.376041   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:30.376045   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:30.376051   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:30 GMT

	I1003 18:21:30.376166   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:30.875343   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:30.875364   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:30.875376   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:30.875386   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:30.878326   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:30.878341   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:30.878348   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:30.878354   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:30.878361   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:31 GMT

	I1003 18:21:30.878367   12504 round_trippers.go:580]     Audit-Id: 63ae463d-8328-4f61-98ef-5dac71de63e9

	I1003 18:21:30.878374   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:30.878381   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:30.878506   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:30.878759   12504 node_ready.go:49] node "multinode-528000" has status "Ready":"True"

	I1003 18:21:30.878774   12504 node_ready.go:38] duration metric: took 4.210484161s waiting for node "multinode-528000" to be "Ready" ...

	I1003 18:21:30.878782   12504 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1003 18:21:30.878823   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods

	I1003 18:21:30.878829   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:30.878837   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:30.878845   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:30.881539   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:30.881547   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:30.881554   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:31 GMT

	I1003 18:21:30.881558   12504 round_trippers.go:580]     Audit-Id: 6a3ce6a3-4ffe-4e0f-9022-839375c1b3cd

	I1003 18:21:30.881563   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:30.881568   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:30.881575   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:30.881583   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:30.882277   12504 request.go:1212] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"830"},"items":[{"metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f

:preferredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{ [truncated 83700 chars]

	I1003 18:21:30.884029   12504 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:30.884064   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:30.884069   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:30.884086   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:30.884094   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:30.885587   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:30.885597   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:30.885604   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:31 GMT

	I1003 18:21:30.885612   12504 round_trippers.go:580]     Audit-Id: da454dcf-8a01-4d07-ac22-a13eb516d0c6

	I1003 18:21:30.885621   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:30.885632   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:30.885641   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:30.885648   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:30.885759   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:30.886014   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:30.886021   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:30.886026   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:30.886030   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:30.887230   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:30.887241   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:30.887249   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:30.887257   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:30.887263   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:30.887268   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:31 GMT

	I1003 18:21:30.887272   12504 round_trippers.go:580]     Audit-Id: 03364104-ca64-4f8a-9de8-de75d0ae14ed

	I1003 18:21:30.887277   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:30.887444   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:30.887646   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:30.887652   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:30.887658   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:30.887663   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:30.888740   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:30.888748   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:30.888753   12504 round_trippers.go:580]     Audit-Id: 3b5fcc25-d93a-4722-9f4b-2759710ac24d

	I1003 18:21:30.888763   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:30.888771   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:30.888778   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:30.888784   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:30.888789   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:31 GMT

	I1003 18:21:30.888925   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:30.889147   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:30.889153   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:30.889159   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:30.889164   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:30.890358   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:30.890365   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:30.890370   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:30.890375   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:30.890380   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:30.890385   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:31 GMT

	I1003 18:21:30.890389   12504 round_trippers.go:580]     Audit-Id: cb9688c1-be60-4d8d-b2a1-56c0441c0710

	I1003 18:21:30.890394   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:30.890678   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:31.391601   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:31.391626   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:31.391640   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:31.391650   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:31.394496   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:31.394508   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:31.394515   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:31.394521   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:31.394527   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:31 GMT

	I1003 18:21:31.394533   12504 round_trippers.go:580]     Audit-Id: 5dd8936c-febd-4e3c-82f5-02bef1039d8c

	I1003 18:21:31.394540   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:31.394545   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:31.394629   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:31.394973   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:31.394982   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:31.394990   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:31.394997   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:31.396783   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:31.396792   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:31.396799   12504 round_trippers.go:580]     Audit-Id: 1e43310f-e13c-4916-be81-9ddf256e9e6b

	I1003 18:21:31.396804   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:31.396808   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:31.396812   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:31.396818   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:31.396822   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:31 GMT

	I1003 18:21:31.397045   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:31.891799   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:31.891821   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:31.891871   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:31.891880   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:31.893860   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:31.893869   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:31.893874   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:31.893880   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:31.893885   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:32 GMT

	I1003 18:21:31.893889   12504 round_trippers.go:580]     Audit-Id: 1498e059-5c69-4461-925f-1710c449b700

	I1003 18:21:31.893894   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:31.893898   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:31.893998   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:31.894272   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:31.894279   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:31.894284   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:31.894289   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:31.895544   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:31.895552   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:31.895558   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:31.895564   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:32 GMT

	I1003 18:21:31.895571   12504 round_trippers.go:580]     Audit-Id: ccbb478c-cb55-46f5-b19a-db50c9cb2e6f

	I1003 18:21:31.895577   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:31.895582   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:31.895588   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:31.895702   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:32.392455   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:32.392527   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:32.392544   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:32.392554   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:32.395769   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:32.395781   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:32.395788   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:32.395795   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:32.395802   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:32 GMT

	I1003 18:21:32.395808   12504 round_trippers.go:580]     Audit-Id: f214596f-e418-46e7-985b-bf3d010c37b8

	I1003 18:21:32.395816   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:32.395823   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:32.395986   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:32.396336   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:32.396345   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:32.396353   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:32.396360   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:32.398018   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:32.398031   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:32.398039   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:32.398046   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:32.398054   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:32 GMT

	I1003 18:21:32.398063   12504 round_trippers.go:580]     Audit-Id: bc2d8109-0357-4efb-8710-daffd6494b96

	I1003 18:21:32.398078   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:32.398086   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:32.398196   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:32.891877   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:32.891903   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:32.891943   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:32.891956   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:32.895225   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:32.895240   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:32.895248   12504 round_trippers.go:580]     Audit-Id: 07570475-c2ac-49a2-b162-8cf720b2da9f

	I1003 18:21:32.895254   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:32.895260   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:32.895269   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:32.895284   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:32.895291   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:33 GMT

	I1003 18:21:32.895421   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:32.895690   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:32.895696   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:32.895702   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:32.895707   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:32.897152   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:32.897163   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:32.897171   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:33 GMT

	I1003 18:21:32.897178   12504 round_trippers.go:580]     Audit-Id: 02e6e6e4-0d27-4eb7-9ea4-87ae856f890a

	I1003 18:21:32.897187   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:32.897193   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:32.897198   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:32.897202   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:32.897378   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:32.897542   12504 pod_ready.go:102] pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace has status "Ready":"False"

	I1003 18:21:33.391901   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:33.391926   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:33.391940   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:33.391950   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:33.395193   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:33.395208   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:33.395216   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:33.395222   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:33 GMT

	I1003 18:21:33.395228   12504 round_trippers.go:580]     Audit-Id: c1bc75cb-2ba5-4390-8a62-bbb7e1186578

	I1003 18:21:33.395236   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:33.395242   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:33.395248   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:33.395530   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:33.395883   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:33.395894   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:33.395903   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:33.395929   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:33.397346   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:33.397355   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:33.397360   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:33.397365   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:33 GMT

	I1003 18:21:33.397370   12504 round_trippers.go:580]     Audit-Id: 846cf09a-fcb1-4f33-95a8-e5813bd3d767

	I1003 18:21:33.397374   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:33.397380   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:33.397390   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:33.397472   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:33.892613   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:33.892639   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:33.892651   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:33.892661   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:33.895734   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:33.895749   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:33.895756   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:34 GMT

	I1003 18:21:33.895763   12504 round_trippers.go:580]     Audit-Id: de2fb9ba-e820-49dd-b94e-f72542e2e218

	I1003 18:21:33.895775   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:33.895782   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:33.895788   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:33.895794   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:33.895861   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:33.896214   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:33.896223   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:33.896231   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:33.896238   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:33.897913   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:33.897923   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:33.897931   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:34 GMT

	I1003 18:21:33.897940   12504 round_trippers.go:580]     Audit-Id: 5d162851-05bb-4db6-9e7b-ff5f003ab3cb

	I1003 18:21:33.897947   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:33.897954   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:33.897961   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:33.897968   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:33.898025   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:34.391084   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:34.391096   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:34.391105   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:34.391111   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:34.392947   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:34.392956   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:34.392961   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:34.392966   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:34.392970   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:34.392977   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:34 GMT

	I1003 18:21:34.392984   12504 round_trippers.go:580]     Audit-Id: d208b0c0-3dbe-4241-80cb-ff6f2ae5eba6

	I1003 18:21:34.392992   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:34.393101   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:34.393384   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:34.393390   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:34.393395   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:34.393400   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:34.394914   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:34.394923   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:34.394928   12504 round_trippers.go:580]     Audit-Id: a1fe4b1f-6803-4da0-82da-4e97fcfbfada

	I1003 18:21:34.394933   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:34.394937   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:34.394946   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:34.394952   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:34.394956   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:34 GMT

	I1003 18:21:34.395027   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:34.891303   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:34.891329   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:34.891340   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:34.891350   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:34.894860   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:34.894876   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:34.894883   12504 round_trippers.go:580]     Audit-Id: d9c2ad43-9957-484a-bfa1-aabeb5738e96

	I1003 18:21:34.894890   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:34.894896   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:34.894905   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:34.894911   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:34.894918   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:35 GMT

	I1003 18:21:34.895014   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:34.895326   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:34.895333   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:34.895338   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:34.895343   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:34.896681   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:34.896691   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:34.896696   12504 round_trippers.go:580]     Audit-Id: 3d3f2ead-b5bf-4a0b-98a9-0ca4dd565888

	I1003 18:21:34.896702   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:34.896707   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:34.896714   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:34.896722   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:34.896730   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:35 GMT

	I1003 18:21:34.896846   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:35.392021   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:35.392044   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:35.392056   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:35.392066   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:35.395328   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:35.395343   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:35.395351   12504 round_trippers.go:580]     Audit-Id: 7fcecf5e-8d0c-4676-99c8-913b47d08fc9

	I1003 18:21:35.395357   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:35.395363   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:35.395368   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:35.395374   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:35.395380   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:35 GMT

	I1003 18:21:35.395508   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:35.395838   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:35.395844   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:35.395850   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:35.395854   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:35.397166   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:35.397176   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:35.397181   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:35.397185   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:35 GMT

	I1003 18:21:35.397190   12504 round_trippers.go:580]     Audit-Id: 1480a73d-afcf-4e45-ac38-939d6dc66c7e

	I1003 18:21:35.397195   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:35.397199   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:35.397204   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:35.397320   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:35.397490   12504 pod_ready.go:102] pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace has status "Ready":"False"

	I1003 18:21:35.891258   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:35.891270   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:35.891276   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:35.891281   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:35.893023   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:35.893032   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:35.893037   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:35.893042   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:35.893047   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:35.893051   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:35.893056   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:36 GMT

	I1003 18:21:35.893062   12504 round_trippers.go:580]     Audit-Id: a8c20599-db4a-4e90-996e-4e1344388940

	I1003 18:21:35.893204   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:35.893470   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:35.893476   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:35.893481   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:35.893486   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:35.895293   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:35.895301   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:35.895306   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:35.895311   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:35.895323   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:35.895328   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:35.895333   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:36 GMT

	I1003 18:21:35.895338   12504 round_trippers.go:580]     Audit-Id: d1a6ba80-7d0b-401e-85ea-6e290165a053

	I1003 18:21:35.895449   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:36.391926   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:36.391947   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:36.391959   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:36.391970   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:36.395373   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:36.395387   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:36.395394   12504 round_trippers.go:580]     Audit-Id: 79456092-8556-4f5c-9620-f39e7c42b8bc

	I1003 18:21:36.395400   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:36.395406   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:36.395413   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:36.395419   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:36.395447   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:36 GMT

	I1003 18:21:36.395579   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:36.395930   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:36.395939   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:36.395946   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:36.395953   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:36.397622   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:36.397631   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:36.397636   12504 round_trippers.go:580]     Audit-Id: c9f784db-14c7-4436-ae64-d751fc31dd3b

	I1003 18:21:36.397640   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:36.397645   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:36.397664   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:36.397671   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:36.397677   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:36 GMT

	I1003 18:21:36.397739   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:36.891135   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:36.891150   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:36.891159   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:36.891166   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:36.893350   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:36.893363   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:36.893372   12504 round_trippers.go:580]     Audit-Id: 417f4d89-803b-497b-82af-c985bfc3c12a

	I1003 18:21:36.893379   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:36.893386   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:36.893393   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:36.893400   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:36.893405   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:37 GMT

	I1003 18:21:36.893564   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:36.893826   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:36.893833   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:36.893839   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:36.893844   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:36.895198   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:36.895208   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:36.895215   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:36.895222   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:36.895231   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:36.895239   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:36.895250   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:37 GMT

	I1003 18:21:36.895254   12504 round_trippers.go:580]     Audit-Id: 440b547a-304b-4a6d-b2db-1d88bce5f8fb

	I1003 18:21:36.895386   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:37.391251   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:37.391271   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:37.391283   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:37.391293   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:37.394273   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:37.394283   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:37.394289   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:37.394302   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:37.394313   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:37.394326   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:37 GMT

	I1003 18:21:37.394335   12504 round_trippers.go:580]     Audit-Id: 0b051f38-8cbc-4b3f-a095-e6eaee9ba9d5

	I1003 18:21:37.394346   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:37.394467   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:37.394736   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:37.394744   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:37.394749   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:37.394761   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:37.396252   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:37.396259   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:37.396264   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:37.396278   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:37.396286   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:37.396292   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:37 GMT

	I1003 18:21:37.396300   12504 round_trippers.go:580]     Audit-Id: 3cff7ea1-7659-4af0-bf27-37b6d8acdda1

	I1003 18:21:37.396308   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:37.396552   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:37.891562   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:37.891594   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:37.891605   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:37.891615   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:37.895051   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:37.895065   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:37.895073   12504 round_trippers.go:580]     Audit-Id: 925fa2fa-21ab-428c-b115-82aa61c7bc52

	I1003 18:21:37.895079   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:37.895085   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:37.895092   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:37.895099   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:37.895107   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:38 GMT

	I1003 18:21:37.895201   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:37.895563   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:37.895572   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:37.895581   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:37.895588   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:37.897026   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:37.897036   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:37.897041   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:37.897047   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:37.897051   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:37.897055   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:37.897061   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:38 GMT

	I1003 18:21:37.897065   12504 round_trippers.go:580]     Audit-Id: 7df34ddd-e72a-4760-8f41-b93bed020ff2

	I1003 18:21:37.897142   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:37.897324   12504 pod_ready.go:102] pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace has status "Ready":"False"

	I1003 18:21:38.392042   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:38.392053   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:38.392060   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:38.392065   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:38.393692   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:38.393701   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:38.393707   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:38.393712   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:38.393716   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:38.393720   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:38.393724   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:38 GMT

	I1003 18:21:38.393729   12504 round_trippers.go:580]     Audit-Id: ec969a43-6c1e-4ba4-b0a4-701cd2703ad4

	I1003 18:21:38.393873   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:38.394173   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:38.394181   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:38.394187   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:38.394193   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:38.395881   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:38.395890   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:38.395896   12504 round_trippers.go:580]     Audit-Id: 5c8fbfed-abfb-4520-9966-2968502f1b9c

	I1003 18:21:38.395901   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:38.395908   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:38.395917   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:38.395927   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:38.395932   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:38 GMT

	I1003 18:21:38.396119   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:38.892357   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:38.892369   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:38.892375   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:38.892395   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:38.895553   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:38.895565   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:38.895585   12504 round_trippers.go:580]     Audit-Id: b03f3e1e-0a2a-4b6f-bedd-ec2095c2cbd8

	I1003 18:21:38.895590   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:38.895614   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:38.895619   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:38.895625   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:38.895631   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:39 GMT

	I1003 18:21:38.895849   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:38.896175   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:38.896182   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:38.896188   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:38.896214   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:38.897727   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:38.897752   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:38.897780   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:38.897788   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:39 GMT

	I1003 18:21:38.897795   12504 round_trippers.go:580]     Audit-Id: 3c8ad78c-3085-409c-af93-a50f4e509154

	I1003 18:21:38.897800   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:38.897816   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:38.897823   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:38.898231   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:39.391664   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:39.391685   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:39.391698   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:39.391707   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:39.394923   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:39.394939   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:39.394947   12504 round_trippers.go:580]     Audit-Id: 6e4f67e1-352f-46bc-92cc-354f7830db2f

	I1003 18:21:39.394953   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:39.394960   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:39.394966   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:39.394973   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:39.394979   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:39 GMT

	I1003 18:21:39.395048   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:39.395401   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:39.395410   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:39.395419   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:39.395426   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:39.396868   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:39.396876   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:39.396881   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:39 GMT

	I1003 18:21:39.396896   12504 round_trippers.go:580]     Audit-Id: 34bb4a44-ece1-409d-ae10-19ec2679da00

	I1003 18:21:39.396902   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:39.396906   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:39.396911   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:39.396915   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:39.397088   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:39.892683   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:39.892700   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:39.892709   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:39.892716   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:39.895186   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:39.895199   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:39.895205   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:39.895216   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:39.895222   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:39.895227   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:39.895231   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:40 GMT

	I1003 18:21:39.895236   12504 round_trippers.go:580]     Audit-Id: 532f0dec-9017-4006-9a55-e0664cf83b75

	I1003 18:21:39.895292   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:39.895562   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:39.895569   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:39.895574   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:39.895579   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:39.896816   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:39.896837   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:39.896846   12504 round_trippers.go:580]     Audit-Id: 42cca22f-4aa3-4484-8d99-eb5d1ebe8d0a

	I1003 18:21:39.896851   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:39.896857   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:39.896869   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:39.896875   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:39.896879   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:40 GMT

	I1003 18:21:39.897123   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:40.393219   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:40.393258   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:40.393270   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:40.393280   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:40.396360   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:40.396375   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:40.396383   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:40.396389   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:40.396396   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:40.396403   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:40 GMT

	I1003 18:21:40.396410   12504 round_trippers.go:580]     Audit-Id: 342a7a3f-3f3e-432d-b606-b1ce402b8b69

	I1003 18:21:40.396417   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:40.396571   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"856","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6719 chars]

	I1003 18:21:40.396932   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:40.396941   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:40.396949   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:40.396956   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:40.398515   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:40.398528   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:40.398536   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:40 GMT

	I1003 18:21:40.398544   12504 round_trippers.go:580]     Audit-Id: e5349345-ad73-43ba-bc5c-a5b021bccc66

	I1003 18:21:40.398551   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:40.398560   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:40.398567   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:40.398574   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:40.398680   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:40.398847   12504 pod_ready.go:102] pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace has status "Ready":"False"

	I1003 18:21:40.892064   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:40.892086   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:40.892098   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:40.892107   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:40.895177   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:40.895197   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:40.895208   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:40.895218   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:40.895228   12504 round_trippers.go:580]     Audit-Id: dacc5b14-e477-436d-a852-51676401498e

	I1003 18:21:40.895237   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:40.895249   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:40.895259   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:40.895372   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"856","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6719 chars]

	I1003 18:21:40.895742   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:40.895750   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:40.895758   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:40.895766   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:40.897208   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:40.897216   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:40.897222   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:40.897229   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:40.897235   12504 round_trippers.go:580]     Audit-Id: 88a76a8b-0c31-4c10-9e2a-3e05dc884c2d

	I1003 18:21:40.897242   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:40.897249   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:40.897256   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:40.897332   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:41.391178   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:41.391206   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:41.391258   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:41.391270   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:41.393957   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:41.393967   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:41.393975   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:41.393994   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:41.394003   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:41.394010   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:41.394019   12504 round_trippers.go:580]     Audit-Id: 42ea76bf-7ac6-4a0e-8fb8-3e450b2501a2

	I1003 18:21:41.394028   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:41.394092   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"862","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6490 chars]

	I1003 18:21:41.394358   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:41.394365   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:41.394371   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:41.394376   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:41.395812   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:41.395819   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:41.395824   12504 round_trippers.go:580]     Audit-Id: 8d355fb5-f4a8-4f66-b0bd-a0aabcb38a60

	I1003 18:21:41.395828   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:41.395834   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:41.395838   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:41.395843   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:41.395848   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:41.396146   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:41.396310   12504 pod_ready.go:92] pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace has status "Ready":"True"

	I1003 18:21:41.396317   12504 pod_ready.go:81] duration metric: took 10.512110846s waiting for pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:41.396323   12504 pod_ready.go:78] waiting up to 6m0s for pod "etcd-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:41.396349   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/etcd-multinode-528000

	I1003 18:21:41.396353   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:41.396359   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:41.396364   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:41.397833   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:41.397845   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:41.397853   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:41.397862   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:41.397871   12504 round_trippers.go:580]     Audit-Id: 53aa3bd8-7616-436c-a98a-2768b49f6c3c

	I1003 18:21:41.397879   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:41.397886   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:41.397891   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:41.398020   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"etcd-multinode-528000","namespace":"kube-system","uid":"a86312b2-3ca5-488d-b5bc-06c3346dc64e","resourceVersion":"847","creationTimestamp":"2023-10-04T01:18:19Z","labels":{"component":"etcd","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/etcd.advertise-client-urls":"https://192.168.89.41:2379","kubernetes.io/config.hash":"ae74302b7aebd7fdcc26eb5602da4836","kubernetes.io/config.mirror":"ae74302b7aebd7fdcc26eb5602da4836","kubernetes.io/config.seen":"2023-10-04T01:18:19.349005085Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:19Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubeadm.kubernetes.io/etcd.advertise-c

lient-urls":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config [truncated 6071 chars]

	I1003 18:21:41.398240   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:41.398247   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:41.398252   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:41.398258   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:41.399629   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:41.399639   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:41.399646   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:41.399653   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:41.399660   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:41.399666   12504 round_trippers.go:580]     Audit-Id: c2b242df-c49e-437b-b2bc-25698993486a

	I1003 18:21:41.399671   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:41.399675   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:41.399780   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:41.399939   12504 pod_ready.go:92] pod "etcd-multinode-528000" in "kube-system" namespace has status "Ready":"True"

	I1003 18:21:41.399945   12504 pod_ready.go:81] duration metric: took 3.616945ms waiting for pod "etcd-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:41.399955   12504 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:41.399981   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-multinode-528000

	I1003 18:21:41.399986   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:41.399991   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:41.399996   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:41.401074   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:41.401084   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:41.401091   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:41.401099   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:41.401105   12504 round_trippers.go:580]     Audit-Id: 2e9e186b-e502-4479-8613-4bec647bffd5

	I1003 18:21:41.401111   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:41.401133   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:41.401142   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:41.401278   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-apiserver-multinode-528000","namespace":"kube-system","uid":"e9361a2b-5db4-4742-9ef6-fbecda9d22a9","resourceVersion":"825","creationTimestamp":"2023-10-04T01:18:19Z","labels":{"component":"kube-apiserver","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint":"192.168.89.41:8443","kubernetes.io/config.hash":"6c45fd2961dfe8d00019d2277ceb95bd","kubernetes.io/config.mirror":"6c45fd2961dfe8d00019d2277ceb95bd","kubernetes.io/config.seen":"2023-10-04T01:18:19.349011685Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:19Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubeadm.kub

ernetes.io/kube-apiserver.advertise-address.endpoint":{},"f:kubernetes. [truncated 7606 chars]

	I1003 18:21:41.401497   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:41.401504   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:41.401509   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:41.401514   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:41.402720   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:41.402728   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:41.402733   12504 round_trippers.go:580]     Audit-Id: 09b47ad4-6f7c-4b69-9bc8-74361ae4f369

	I1003 18:21:41.402739   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:41.402747   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:41.402754   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:41.402762   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:41.402769   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:41.402878   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:41.403035   12504 pod_ready.go:92] pod "kube-apiserver-multinode-528000" in "kube-system" namespace has status "Ready":"True"

	I1003 18:21:41.403044   12504 pod_ready.go:81] duration metric: took 3.082761ms waiting for pod "kube-apiserver-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:41.403050   12504 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:41.403082   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-multinode-528000

	I1003 18:21:41.403087   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:41.403093   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:41.403098   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:41.404226   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:41.404234   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:41.404239   12504 round_trippers.go:580]     Audit-Id: 6fc46fa6-5333-428b-b1ff-2a1daaae6332

	I1003 18:21:41.404244   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:41.404248   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:41.404254   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:41.404260   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:41.404268   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:41.404496   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-controller-manager-multinode-528000","namespace":"kube-system","uid":"54a13f47-e858-461b-afae-d3307752880b","resourceVersion":"845","creationTimestamp":"2023-10-04T01:18:17Z","labels":{"component":"kube-controller-manager","tier":"control-plane"},"annotations":{"kubernetes.io/config.hash":"eeb9be3a2727f46db49245f383b6c839","kubernetes.io/config.mirror":"eeb9be3a2727f46db49245f383b6c839","kubernetes.io/config.seen":"2023-10-04T01:18:12.593443479Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:17Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config.mirror":{},"f:kubernetes.i

o/config.seen":{},"f:kubernetes.io/config.source":{}},"f:labels":{".":{ [truncated 7174 chars]

	I1003 18:21:41.404708   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:41.404715   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:41.404721   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:41.404727   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:41.405905   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:41.405912   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:41.405917   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:41.405925   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:41.405932   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:41.405936   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:41.405941   12504 round_trippers.go:580]     Audit-Id: 7e073fbc-0301-4350-a390-bece117e54ee

	I1003 18:21:41.405946   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:41.406078   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:41.406234   12504 pod_ready.go:92] pod "kube-controller-manager-multinode-528000" in "kube-system" namespace has status "Ready":"True"

	I1003 18:21:41.406241   12504 pod_ready.go:81] duration metric: took 3.179342ms waiting for pod "kube-controller-manager-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:41.406247   12504 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-69bxc" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:41.406272   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-69bxc

	I1003 18:21:41.406276   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:41.406282   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:41.406288   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:41.407320   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:41.407328   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:41.407333   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:41.407338   12504 round_trippers.go:580]     Audit-Id: aa39656a-cf9e-4f37-a127-abe29c2585ef

	I1003 18:21:41.407343   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:41.407347   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:41.407351   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:41.407356   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:41.407524   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-69bxc","generateName":"kube-proxy-","namespace":"kube-system","uid":"f621588e-bd8a-4135-aa5c-94eb292062f8","resourceVersion":"712","creationTimestamp":"2023-10-04T01:19:40Z","labels":{"controller-revision-hash":"5cbdb8dcbd","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"d64f3f20-7d64-423e-8050-9b9944997ed5","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:19:40Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"d64f3f20-7d64-423e-8050-9b9944997ed5\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r

equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5746 chars]

	I1003 18:21:41.407724   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m03

	I1003 18:21:41.407730   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:41.407737   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:41.407743   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:41.408892   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:41.408901   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:41.408907   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:41.408913   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:41.408918   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:41.408924   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:41.408929   12504 round_trippers.go:580]     Audit-Id: 1b0b2768-02b8-4c15-9b79-ec784e966253

	I1003 18:21:41.408934   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:41.409140   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m03","uid":"8b2fb46e-7671-4d24-b736-562f2f0cd353","resourceVersion":"731","creationTimestamp":"2023-10-04T01:20:20Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m03","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:20:20Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{

}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 3083 chars]

	I1003 18:21:41.409264   12504 pod_ready.go:92] pod "kube-proxy-69bxc" in "kube-system" namespace has status "Ready":"True"

	I1003 18:21:41.409270   12504 pod_ready.go:81] duration metric: took 3.018751ms waiting for pod "kube-proxy-69bxc" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:41.409276   12504 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-8bl5p" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:41.592498   12504 request.go:629] Waited for 183.141706ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-8bl5p

	I1003 18:21:41.592543   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-8bl5p

	I1003 18:21:41.592552   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:41.592565   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:41.592574   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:41.595122   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:41.595135   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:41.595142   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:41.595149   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:41.595156   12504 round_trippers.go:580]     Audit-Id: 16600be8-daaa-444b-8d4e-25f5127399a3

	I1003 18:21:41.595162   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:41.595168   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:41.595173   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:41.595424   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-8bl5p","generateName":"kube-proxy-","namespace":"kube-system","uid":"11839b32-7219-414d-a63f-026b1be9ab5c","resourceVersion":"820","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"controller-revision-hash":"5cbdb8dcbd","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"d64f3f20-7d64-423e-8050-9b9944997ed5","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"d64f3f20-7d64-423e-8050-9b9944997ed5\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r

equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5738 chars]

	I1003 18:21:41.792371   12504 request.go:629] Waited for 196.622174ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:41.792433   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:41.792449   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:41.792465   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:41.792490   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:41.794681   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:41.794695   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:41.794702   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:41.794710   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:41.794719   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:41.794731   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:41.794740   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:41.794750   12504 round_trippers.go:580]     Audit-Id: ee48926d-2f28-4825-8280-ee21d13d78a5

	I1003 18:21:41.794869   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:41.795118   12504 pod_ready.go:92] pod "kube-proxy-8bl5p" in "kube-system" namespace has status "Ready":"True"

	I1003 18:21:41.795126   12504 pod_ready.go:81] duration metric: took 385.842789ms waiting for pod "kube-proxy-8bl5p" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:41.795132   12504 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-9pd2m" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:41.992753   12504 request.go:629] Waited for 197.587002ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-9pd2m

	I1003 18:21:41.992883   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-9pd2m

	I1003 18:21:41.992892   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:41.992900   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:41.992907   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:41.995102   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:41.995115   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:41.995120   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:42 GMT

	I1003 18:21:41.995125   12504 round_trippers.go:580]     Audit-Id: e29645ac-1e70-474f-9948-8dcc8d4488a2

	I1003 18:21:41.995129   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:41.995133   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:41.995138   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:41.995142   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:41.995196   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-9pd2m","generateName":"kube-proxy-","namespace":"kube-system","uid":"41452f70-63bc-473d-b7bd-93e2efa7a304","resourceVersion":"517","creationTimestamp":"2023-10-04T01:19:04Z","labels":{"controller-revision-hash":"5cbdb8dcbd","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"d64f3f20-7d64-423e-8050-9b9944997ed5","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:19:04Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"d64f3f20-7d64-423e-8050-9b9944997ed5\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r

equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5541 chars]

	I1003 18:21:42.191532   12504 request.go:629] Waited for 196.083769ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:21:42.191649   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:21:42.191660   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:42.191672   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:42.191683   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:42.194402   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:42.194414   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:42.194422   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:42.194429   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:42.194436   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:42.194443   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:42.194449   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:42 GMT

	I1003 18:21:42.194455   12504 round_trippers.go:580]     Audit-Id: a31a1f53-95a0-4112-aa84-8f845972a88e

	I1003 18:21:42.194574   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m02","uid":"0073defe-0d22-4c69-83ae-9ebd7055fa45","resourceVersion":"582","creationTimestamp":"2023-10-04T01:19:04Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:19:04Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{

}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 3266 chars]

	I1003 18:21:42.194776   12504 pod_ready.go:92] pod "kube-proxy-9pd2m" in "kube-system" namespace has status "Ready":"True"

	I1003 18:21:42.194785   12504 pod_ready.go:81] duration metric: took 399.64712ms waiting for pod "kube-proxy-9pd2m" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:42.194794   12504 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:42.391330   12504 request.go:629] Waited for 196.422488ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-multinode-528000

	I1003 18:21:42.391383   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-multinode-528000

	I1003 18:21:42.391392   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:42.391403   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:42.391426   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:42.394073   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:42.394091   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:42.394099   12504 round_trippers.go:580]     Audit-Id: 1109dfb0-93e1-49dc-997b-49540fadc398

	I1003 18:21:42.394113   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:42.394121   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:42.394129   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:42.394139   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:42.394150   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:42 GMT

	I1003 18:21:42.394292   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-scheduler-multinode-528000","namespace":"kube-system","uid":"ff27b767-6913-4efa-8a1e-8398fba84175","resourceVersion":"846","creationTimestamp":"2023-10-04T01:18:17Z","labels":{"component":"kube-scheduler","tier":"control-plane"},"annotations":{"kubernetes.io/config.hash":"e3e48fd34564ef6993a5357d3bb10a96","kubernetes.io/config.mirror":"e3e48fd34564ef6993a5357d3bb10a96","kubernetes.io/config.seen":"2023-10-04T01:18:12.593444031Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:17Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config.mirror":{},"f:kubernetes.io/config.seen":{},

"f:kubernetes.io/config.source":{}},"f:labels":{".":{},"f:component":{} [truncated 4904 chars]

	I1003 18:21:42.592526   12504 request.go:629] Waited for 197.919743ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:42.592595   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:42.592603   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:42.592611   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:42.592619   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:42.594393   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:42.594403   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:42.594409   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:42.594413   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:42.594418   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:42 GMT

	I1003 18:21:42.594423   12504 round_trippers.go:580]     Audit-Id: f28bcbd4-2e26-4511-b0c9-b8713a8ce35d

	I1003 18:21:42.594428   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:42.594433   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:42.594531   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:42.594721   12504 pod_ready.go:92] pod "kube-scheduler-multinode-528000" in "kube-system" namespace has status "Ready":"True"

	I1003 18:21:42.594729   12504 pod_ready.go:81] duration metric: took 399.927413ms waiting for pod "kube-scheduler-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:42.594736   12504 pod_ready.go:38] duration metric: took 11.715773442s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1003 18:21:42.594747   12504 api_server.go:52] waiting for apiserver process to appear ...

	I1003 18:21:42.594800   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1003 18:21:42.603709   12504 command_runner.go:130] > 1660

	I1003 18:21:42.603981   12504 api_server.go:72] duration metric: took 16.051966923s to wait for apiserver process to appear ...

	I1003 18:21:42.603991   12504 api_server.go:88] waiting for apiserver healthz status ...

	I1003 18:21:42.604002   12504 api_server.go:253] Checking apiserver healthz at https://192.168.89.41:8443/healthz ...

	I1003 18:21:42.607681   12504 api_server.go:279] https://192.168.89.41:8443/healthz returned 200:

	ok

	I1003 18:21:42.607721   12504 round_trippers.go:463] GET https://192.168.89.41:8443/version

	I1003 18:21:42.607726   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:42.607733   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:42.607738   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:42.608398   12504 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I1003 18:21:42.608406   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:42.608412   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:42 GMT

	I1003 18:21:42.608417   12504 round_trippers.go:580]     Audit-Id: 8f58ba4b-e14c-40d1-9ad3-dd4560e14af8

	I1003 18:21:42.608422   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:42.608429   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:42.608433   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:42.608438   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:42.608442   12504 round_trippers.go:580]     Content-Length: 263

	I1003 18:21:42.608452   12504 request.go:1212] Response Body: {

	  "major": "1",

	  "minor": "28",

	  "gitVersion": "v1.28.2",

	  "gitCommit": "89a4ea3e1e4ddd7f7572286090359983e0387b2f",

	  "gitTreeState": "clean",

	  "buildDate": "2023-09-13T09:29:07Z",

	  "goVersion": "go1.20.8",

	  "compiler": "gc",

	  "platform": "linux/amd64"

	}

	I1003 18:21:42.608473   12504 api_server.go:141] control plane version: v1.28.2

	I1003 18:21:42.608479   12504 api_server.go:131] duration metric: took 4.483737ms to wait for apiserver health ...

	I1003 18:21:42.608484   12504 system_pods.go:43] waiting for kube-system pods to appear ...

	I1003 18:21:42.792015   12504 request.go:629] Waited for 183.487525ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods

	I1003 18:21:42.792063   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods

	I1003 18:21:42.792094   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:42.792113   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:42.792127   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:42.796488   12504 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1003 18:21:42.796499   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:42.796504   12504 round_trippers.go:580]     Audit-Id: ab6d5ff4-e09a-4f5f-89c8-b41f1c24897f

	I1003 18:21:42.796509   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:42.796514   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:42.796521   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:42.796528   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:42.796533   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:42 GMT

	I1003 18:21:42.797831   12504 request.go:1212] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"868"},"items":[{"metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"862","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f

:preferredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{ [truncated 82918 chars]

	I1003 18:21:42.800367   12504 system_pods.go:59] 12 kube-system pods found

	I1003 18:21:42.800380   12504 system_pods.go:61] "coredns-5dd5756b68-rtwd9" [3da6e23f-9391-4ec9-99aa-db9b421b00ad] Running

	I1003 18:21:42.800384   12504 system_pods.go:61] "etcd-multinode-528000" [a86312b2-3ca5-488d-b5bc-06c3346dc64e] Running

	I1003 18:21:42.800387   12504 system_pods.go:61] "kindnet-nvwhf" [1e450dcf-51ca-4715-a758-2def2e9fa38f] Running

	I1003 18:21:42.800391   12504 system_pods.go:61] "kindnet-nz8t4" [ede223c2-a0e9-4366-ba78-1eb90a1705d3] Running

	I1003 18:21:42.800394   12504 system_pods.go:61] "kindnet-tl478" [037a12f0-6b69-4fac-8cdc-bee5f7247624] Running

	I1003 18:21:42.800401   12504 system_pods.go:61] "kube-apiserver-multinode-528000" [e9361a2b-5db4-4742-9ef6-fbecda9d22a9] Running

	I1003 18:21:42.800404   12504 system_pods.go:61] "kube-controller-manager-multinode-528000" [54a13f47-e858-461b-afae-d3307752880b] Running

	I1003 18:21:42.800408   12504 system_pods.go:61] "kube-proxy-69bxc" [f621588e-bd8a-4135-aa5c-94eb292062f8] Running

	I1003 18:21:42.800412   12504 system_pods.go:61] "kube-proxy-8bl5p" [11839b32-7219-414d-a63f-026b1be9ab5c] Running

	I1003 18:21:42.800415   12504 system_pods.go:61] "kube-proxy-9pd2m" [41452f70-63bc-473d-b7bd-93e2efa7a304] Running

	I1003 18:21:42.800418   12504 system_pods.go:61] "kube-scheduler-multinode-528000" [ff27b767-6913-4efa-8a1e-8398fba84175] Running

	I1003 18:21:42.800422   12504 system_pods.go:61] "storage-provisioner" [874a29bb-bf60-4c95-9bdd-90dbb9c3c115] Running

	I1003 18:21:42.800426   12504 system_pods.go:74] duration metric: took 191.936821ms to wait for pod list to return data ...

	I1003 18:21:42.800431   12504 default_sa.go:34] waiting for default service account to be created ...

	I1003 18:21:42.992576   12504 request.go:629] Waited for 192.055162ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/default/serviceaccounts

	I1003 18:21:42.992625   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/default/serviceaccounts

	I1003 18:21:42.992634   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:42.992645   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:42.992658   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:42.995522   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:42.995537   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:42.995544   12504 round_trippers.go:580]     Audit-Id: 330c7f8b-32b6-4f86-9c05-e86cca09546b

	I1003 18:21:42.995550   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:42.995556   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:42.995572   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:42.995580   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:42.995586   12504 round_trippers.go:580]     Content-Length: 261

	I1003 18:21:42.995594   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:43 GMT

	I1003 18:21:42.995609   12504 request.go:1212] Response Body: {"kind":"ServiceAccountList","apiVersion":"v1","metadata":{"resourceVersion":"868"},"items":[{"metadata":{"name":"default","namespace":"default","uid":"a7bb2045-a7cd-485e-8e6a-bf7e59692d5c","resourceVersion":"372","creationTimestamp":"2023-10-04T01:18:32Z"}}]}

	I1003 18:21:42.995749   12504 default_sa.go:45] found service account: "default"

	I1003 18:21:42.995760   12504 default_sa.go:55] duration metric: took 195.322757ms for default service account to be created ...

	I1003 18:21:42.995767   12504 system_pods.go:116] waiting for k8s-apps to be running ...

	I1003 18:21:43.191792   12504 request.go:629] Waited for 195.97729ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods

	I1003 18:21:43.191881   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods

	I1003 18:21:43.191891   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:43.191902   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:43.191912   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:43.196392   12504 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1003 18:21:43.196410   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:43.196419   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:43 GMT

	I1003 18:21:43.196427   12504 round_trippers.go:580]     Audit-Id: fdafd031-c4ae-44f1-a143-6efcea26da9c

	I1003 18:21:43.196443   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:43.196451   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:43.196457   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:43.196462   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:43.196991   12504 request.go:1212] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"868"},"items":[{"metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"862","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f

:preferredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{ [truncated 82918 chars]

	I1003 18:21:43.198724   12504 system_pods.go:86] 12 kube-system pods found

	I1003 18:21:43.198733   12504 system_pods.go:89] "coredns-5dd5756b68-rtwd9" [3da6e23f-9391-4ec9-99aa-db9b421b00ad] Running

	I1003 18:21:43.198737   12504 system_pods.go:89] "etcd-multinode-528000" [a86312b2-3ca5-488d-b5bc-06c3346dc64e] Running

	I1003 18:21:43.198741   12504 system_pods.go:89] "kindnet-nvwhf" [1e450dcf-51ca-4715-a758-2def2e9fa38f] Running

	I1003 18:21:43.198744   12504 system_pods.go:89] "kindnet-nz8t4" [ede223c2-a0e9-4366-ba78-1eb90a1705d3] Running

	I1003 18:21:43.198747   12504 system_pods.go:89] "kindnet-tl478" [037a12f0-6b69-4fac-8cdc-bee5f7247624] Running

	I1003 18:21:43.198751   12504 system_pods.go:89] "kube-apiserver-multinode-528000" [e9361a2b-5db4-4742-9ef6-fbecda9d22a9] Running

	I1003 18:21:43.198755   12504 system_pods.go:89] "kube-controller-manager-multinode-528000" [54a13f47-e858-461b-afae-d3307752880b] Running

	I1003 18:21:43.198758   12504 system_pods.go:89] "kube-proxy-69bxc" [f621588e-bd8a-4135-aa5c-94eb292062f8] Running

	I1003 18:21:43.198761   12504 system_pods.go:89] "kube-proxy-8bl5p" [11839b32-7219-414d-a63f-026b1be9ab5c] Running

	I1003 18:21:43.198764   12504 system_pods.go:89] "kube-proxy-9pd2m" [41452f70-63bc-473d-b7bd-93e2efa7a304] Running

	I1003 18:21:43.198769   12504 system_pods.go:89] "kube-scheduler-multinode-528000" [ff27b767-6913-4efa-8a1e-8398fba84175] Running

	I1003 18:21:43.198772   12504 system_pods.go:89] "storage-provisioner" [874a29bb-bf60-4c95-9bdd-90dbb9c3c115] Running

	I1003 18:21:43.198777   12504 system_pods.go:126] duration metric: took 203.005383ms to wait for k8s-apps to be running ...

	I1003 18:21:43.198782   12504 system_svc.go:44] waiting for kubelet service to be running ....

	I1003 18:21:43.198830   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1003 18:21:43.207979   12504 system_svc.go:56] duration metric: took 9.191615ms WaitForService to wait for kubelet.

	I1003 18:21:43.207990   12504 kubeadm.go:581] duration metric: took 16.655977485s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I1003 18:21:43.208001   12504 node_conditions.go:102] verifying NodePressure condition ...

	I1003 18:21:43.391543   12504 request.go:629] Waited for 183.46057ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes

	I1003 18:21:43.391587   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes

	I1003 18:21:43.391658   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:43.391672   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:43.391682   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:43.394797   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:43.394811   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:43.394819   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:43.394827   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:43 GMT

	I1003 18:21:43.394833   12504 round_trippers.go:580]     Audit-Id: 8eed91b1-5bc3-4c35-a4d2-165b921a618c

	I1003 18:21:43.394839   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:43.394845   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:43.394852   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:43.395162   12504 request.go:1212] Response Body: {"kind":"NodeList","apiVersion":"v1","metadata":{"resourceVersion":"869"},"items":[{"metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFiel

ds":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time" [truncated 13559 chars]

	I1003 18:21:43.395661   12504 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki

	I1003 18:21:43.395671   12504 node_conditions.go:123] node cpu capacity is 2

	I1003 18:21:43.395677   12504 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki

	I1003 18:21:43.395681   12504 node_conditions.go:123] node cpu capacity is 2

	I1003 18:21:43.395684   12504 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki

	I1003 18:21:43.395687   12504 node_conditions.go:123] node cpu capacity is 2

	I1003 18:21:43.395690   12504 node_conditions.go:105] duration metric: took 187.6854ms to run NodePressure ...

	I1003 18:21:43.395696   12504 start.go:228] waiting for startup goroutines ...

	I1003 18:21:43.395701   12504 start.go:233] waiting for cluster config update ...

	I1003 18:21:43.395707   12504 start.go:242] writing updated cluster config ...

	I1003 18:21:43.396408   12504 config.go:182] Loaded profile config "multinode-528000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 18:21:43.396462   12504 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/config.json ...

	I1003 18:21:43.440296   12504 out.go:177] * Starting worker node multinode-528000-m02 in cluster multinode-528000

	I1003 18:21:43.462206   12504 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime docker

	I1003 18:21:43.462227   12504 cache.go:57] Caching tarball of preloaded images

	I1003 18:21:43.462325   12504 preload.go:174] Found /Users/jenkins/minikube-integration/17348-9809/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I1003 18:21:43.462335   12504 cache.go:60] Finished verifying existence of preloaded tar for  v1.28.2 on docker

	I1003 18:21:43.462398   12504 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/config.json ...

	I1003 18:21:43.463109   12504 start.go:365] acquiring machines lock for multinode-528000-m02: {Name:mk592c6e7c5aa7c823729561bf878fc0544d84d2 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1003 18:21:43.463159   12504 start.go:369] acquired machines lock for "multinode-528000-m02" in 37.941µs

	I1003 18:21:43.463172   12504 start.go:96] Skipping create...Using existing machine configuration

	I1003 18:21:43.463176   12504 fix.go:54] fixHost starting: m02

	I1003 18:21:43.463390   12504 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I1003 18:21:43.463404   12504 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I1003 18:21:43.471301   12504 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59260

	I1003 18:21:43.471642   12504 main.go:141] libmachine: () Calling .GetVersion

	I1003 18:21:43.471964   12504 main.go:141] libmachine: Using API Version  1

	I1003 18:21:43.471977   12504 main.go:141] libmachine: () Calling .SetConfigRaw

	I1003 18:21:43.472210   12504 main.go:141] libmachine: () Calling .GetMachineName

	I1003 18:21:43.472314   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .DriverName

	I1003 18:21:43.472396   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetState

	I1003 18:21:43.472467   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I1003 18:21:43.472540   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | hyperkit pid from json: 12178

	I1003 18:21:43.473459   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | hyperkit pid 12178 missing from process table

	I1003 18:21:43.473477   12504 fix.go:102] recreateIfNeeded on multinode-528000-m02: state=Stopped err=<nil>

	I1003 18:21:43.473485   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .DriverName

	W1003 18:21:43.473562   12504 fix.go:128] unexpected machine state, will restart: <nil>

	I1003 18:21:43.494145   12504 out.go:177] * Restarting existing hyperkit VM for "multinode-528000-m02" ...

	I1003 18:21:43.536202   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .Start

	I1003 18:21:43.536428   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I1003 18:21:43.536503   12504 main.go:141] libmachine: (multinode-528000-m02) minikube might have been shutdown in an unclean way, the hyperkit pid file still exists: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/hyperkit.pid

	I1003 18:21:43.538195   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | hyperkit pid 12178 missing from process table

	I1003 18:21:43.538210   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | pid 12178 is in state "Stopped"

	I1003 18:21:43.538228   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | Removing stale pid file /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/hyperkit.pid...

	I1003 18:21:43.538526   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | Using UUID f6c90a8a-6253-11ee-8906-149d997cd0f1

	I1003 18:21:43.555941   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | Generated MAC 7a:7f:34:e0:d9:d0

	I1003 18:21:43.555980   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | Starting with cmdline: loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-528000

	I1003 18:21:43.556222   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 DEBUG: hyperkit: Start &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"f6c90a8a-6253-11ee-8906-149d997cd0f1", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc000450cc0)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/bzimage", Initrd:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:""

, process:(*os.Process)(nil)}

	I1003 18:21:43.556273   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 DEBUG: hyperkit: check &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"f6c90a8a-6253-11ee-8906-149d997cd0f1", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc000450cc0)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/bzimage", Initrd:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:""

, process:(*os.Process)(nil)}

	I1003 18:21:43.556364   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 DEBUG: hyperkit: Arguments: []string{"-A", "-u", "-F", "/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/hyperkit.pid", "-c", "2", "-m", "2200M", "-s", "0:0,hostbridge", "-s", "31,lpc", "-s", "1:0,virtio-net", "-U", "f6c90a8a-6253-11ee-8906-149d997cd0f1", "-s", "2:0,virtio-blk,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/multinode-528000-m02.rawdisk", "-s", "3,ahci-cd,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/boot2docker.iso", "-s", "4,virtio-rnd", "-l", "com1,autopty=/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/tty,log=/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/console-ring", "-f", "kexec,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/bzimage,/Users/j

enkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-528000"}

	I1003 18:21:43.556435   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 DEBUG: hyperkit: CmdLine: "/usr/local/bin/hyperkit -A -u -F /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/hyperkit.pid -c 2 -m 2200M -s 0:0,hostbridge -s 31,lpc -s 1:0,virtio-net -U f6c90a8a-6253-11ee-8906-149d997cd0f1 -s 2:0,virtio-blk,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/multinode-528000-m02.rawdisk -s 3,ahci-cd,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/boot2docker.iso -s 4,virtio-rnd -l com1,autopty=/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/tty,log=/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/console-ring -f kexec,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/bzimage,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/mult

inode-528000-m02/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-528000"

	I1003 18:21:43.556462   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 DEBUG: hyperkit: Redirecting stdout/stderr to logger

	I1003 18:21:43.557882   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 DEBUG: hyperkit: Pid is 12534

	I1003 18:21:43.558297   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | Attempt 0

	I1003 18:21:43.558322   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I1003 18:21:43.558416   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | hyperkit pid from json: 12534

	I1003 18:21:43.560261   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | Searching for 7a:7f:34:e0:d9:d0 in /var/db/dhcpd_leases ...

	I1003 18:21:43.560420   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | Found 58 entries in /var/db/dhcpd_leases!

	I1003 18:21:43.560447   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.168.89.41 HWAddress:76:a6:64:b1:fb:af ID:1,76:a6:64:b1:fb:af Lease:0x651e0f7a}

	I1003 18:21:43.560464   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.168.89.43 HWAddress:f2:fa:7b:e9:10:aa ID:1,f2:fa:7b:e9:10:aa Lease:0x651cbdf1}

	I1003 18:21:43.560480   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.168.89.42 HWAddress:7a:7f:34:e0:d9:d0 ID:1,7a:7f:34:e0:d9:d0 Lease:0x651e0efe}

	I1003 18:21:43.560494   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | Found match: 7a:7f:34:e0:d9:d0

	I1003 18:21:43.560505   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | IP: 192.168.89.42

	I1003 18:21:43.560523   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetConfigRaw

	I1003 18:21:43.561207   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetIP

	I1003 18:21:43.561423   12504 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/config.json ...

	I1003 18:21:43.561791   12504 machine.go:88] provisioning docker machine ...

	I1003 18:21:43.561802   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .DriverName

	I1003 18:21:43.561925   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetMachineName

	I1003 18:21:43.562034   12504 buildroot.go:166] provisioning hostname "multinode-528000-m02"

	I1003 18:21:43.562045   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetMachineName

	I1003 18:21:43.562143   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHHostname

	I1003 18:21:43.562248   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHPort

	I1003 18:21:43.562368   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:21:43.562506   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:21:43.562625   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHUsername

	I1003 18:21:43.562756   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:21:43.563024   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.42 22 <nil> <nil>}

	I1003 18:21:43.563035   12504 main.go:141] libmachine: About to run SSH command:

	sudo hostname multinode-528000-m02 && echo "multinode-528000-m02" | sudo tee /etc/hostname

	I1003 18:21:43.565689   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 INFO : hyperkit: stderr: Using fd 5 for I/O notifications

	I1003 18:21:43.574251   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 INFO : hyperkit: stderr: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/boot2docker.iso: fcntl(F_PUNCHHOLE) Operation not permitted: block device will not support TRIM/DISCARD

	I1003 18:21:43.575182   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0

	I1003 18:21:43.575205   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0

	I1003 18:21:43.575216   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0

	I1003 18:21:43.575225   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0

	I1003 18:21:43.944339   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 0

	I1003 18:21:43.944355   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 0

	I1003 18:21:44.048457   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:44 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0

	I1003 18:21:44.048479   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:44 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0

	I1003 18:21:44.048491   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:44 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0

	I1003 18:21:44.048500   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:44 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0

	I1003 18:21:44.049336   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:44 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 1

	I1003 18:21:44.049347   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:44 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 1

	I1003 18:21:48.960822   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:48 INFO : hyperkit: stderr: rdmsr to register 0x64d on vcpu 1

	I1003 18:21:48.960883   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:48 INFO : hyperkit: stderr: rdmsr to register 0x64e on vcpu 1

	I1003 18:21:48.960893   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:48 INFO : hyperkit: stderr: rdmsr to register 0x34 on vcpu 1

	I1003 18:22:18.640540   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-528000-m02

	I1003 18:22:18.640557   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHHostname

	I1003 18:22:18.640683   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHPort

	I1003 18:22:18.640783   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:18.640874   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:18.640956   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHUsername

	I1003 18:22:18.641083   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:22:18.641338   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.42 22 <nil> <nil>}

	I1003 18:22:18.641351   12504 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\smultinode-528000-m02' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 multinode-528000-m02/g' /etc/hosts;

				else 

					echo '127.0.1.1 multinode-528000-m02' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1003 18:22:18.704278   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1003 18:22:18.704294   12504 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/17348-9809/.minikube CaCertPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/17348-9809/.minikube}

	I1003 18:22:18.704307   12504 buildroot.go:174] setting up certificates

	I1003 18:22:18.704313   12504 provision.go:83] configureAuth start

	I1003 18:22:18.704327   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetMachineName

	I1003 18:22:18.704457   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetIP

	I1003 18:22:18.704568   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHHostname

	I1003 18:22:18.704643   12504 provision.go:138] copyHostCerts

	I1003 18:22:18.704670   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/cert.pem -> /Users/jenkins/minikube-integration/17348-9809/.minikube/cert.pem

	I1003 18:22:18.704712   12504 exec_runner.go:144] found /Users/jenkins/minikube-integration/17348-9809/.minikube/cert.pem, removing ...

	I1003 18:22:18.704718   12504 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17348-9809/.minikube/cert.pem

	I1003 18:22:18.704833   12504 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/17348-9809/.minikube/cert.pem (1123 bytes)

	I1003 18:22:18.705024   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/key.pem -> /Users/jenkins/minikube-integration/17348-9809/.minikube/key.pem

	I1003 18:22:18.705050   12504 exec_runner.go:144] found /Users/jenkins/minikube-integration/17348-9809/.minikube/key.pem, removing ...

	I1003 18:22:18.705054   12504 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17348-9809/.minikube/key.pem

	I1003 18:22:18.705126   12504 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/17348-9809/.minikube/key.pem (1679 bytes)

	I1003 18:22:18.705264   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem -> /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.pem

	I1003 18:22:18.705289   12504 exec_runner.go:144] found /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.pem, removing ...

	I1003 18:22:18.705293   12504 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.pem

	I1003 18:22:18.705360   12504 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.pem (1082 bytes)

	I1003 18:22:18.705498   12504 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca-key.pem org=jenkins.multinode-528000-m02 san=[192.168.89.42 192.168.89.42 localhost 127.0.0.1 minikube multinode-528000-m02]

	I1003 18:22:18.913935   12504 provision.go:172] copyRemoteCerts

	I1003 18:22:18.913984   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1003 18:22:18.913999   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHHostname

	I1003 18:22:18.914181   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHPort

	I1003 18:22:18.914383   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:18.914480   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHUsername

	I1003 18:22:18.914666   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.42 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/id_rsa Username:docker}

	I1003 18:22:18.949416   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server.pem -> /etc/docker/server.pem

	I1003 18:22:18.949476   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server.pem --> /etc/docker/server.pem (1237 bytes)

	I1003 18:22:18.964789   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I1003 18:22:18.964843   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I1003 18:22:18.980310   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I1003 18:22:18.980375   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1003 18:22:18.995890   12504 provision.go:86] duration metric: configureAuth took 291.5699ms

	I1003 18:22:18.995902   12504 buildroot.go:189] setting minikube options for container-runtime

	I1003 18:22:18.996081   12504 config.go:182] Loaded profile config "multinode-528000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 18:22:18.996114   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .DriverName

	I1003 18:22:18.996242   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHHostname

	I1003 18:22:18.996350   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHPort

	I1003 18:22:18.996438   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:18.996520   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:18.996595   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHUsername

	I1003 18:22:18.996708   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:22:18.996965   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.42 22 <nil> <nil>}

	I1003 18:22:18.996974   12504 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1003 18:22:19.053901   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I1003 18:22:19.053913   12504 buildroot.go:70] root file system type: tmpfs

	I1003 18:22:19.054001   12504 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I1003 18:22:19.054011   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHHostname

	I1003 18:22:19.054150   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHPort

	I1003 18:22:19.054236   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:19.054336   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:19.054422   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHUsername

	I1003 18:22:19.054563   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:22:19.054820   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.42 22 <nil> <nil>}

	I1003 18:22:19.054870   12504 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	Environment="NO_PROXY=192.168.89.41"

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1003 18:22:19.120819   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	Environment=NO_PROXY=192.168.89.41

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I1003 18:22:19.120838   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHHostname

	I1003 18:22:19.120992   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHPort

	I1003 18:22:19.121099   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:19.121183   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:19.121292   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHUsername

	I1003 18:22:19.121418   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:22:19.121672   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.42 22 <nil> <nil>}

	I1003 18:22:19.121685   12504 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1003 18:22:19.664571   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I1003 18:22:19.664588   12504 machine.go:91] provisioned docker machine in 36.102420899s

	I1003 18:22:19.664595   12504 start.go:300] post-start starting for "multinode-528000-m02" (driver="hyperkit")

	I1003 18:22:19.664606   12504 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1003 18:22:19.664617   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .DriverName

	I1003 18:22:19.664816   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1003 18:22:19.664832   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHHostname

	I1003 18:22:19.664933   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHPort

	I1003 18:22:19.665013   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:19.665109   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHUsername

	I1003 18:22:19.665198   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.42 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/id_rsa Username:docker}

	I1003 18:22:19.699406   12504 ssh_runner.go:195] Run: cat /etc/os-release

	I1003 18:22:19.701837   12504 command_runner.go:130] > NAME=Buildroot

	I1003 18:22:19.701848   12504 command_runner.go:130] > VERSION=2021.02.12-1-gb090841-dirty

	I1003 18:22:19.701852   12504 command_runner.go:130] > ID=buildroot

	I1003 18:22:19.701856   12504 command_runner.go:130] > VERSION_ID=2021.02.12

	I1003 18:22:19.701861   12504 command_runner.go:130] > PRETTY_NAME="Buildroot 2021.02.12"

	I1003 18:22:19.702044   12504 info.go:137] Remote host: Buildroot 2021.02.12

	I1003 18:22:19.702052   12504 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17348-9809/.minikube/addons for local assets ...

	I1003 18:22:19.702126   12504 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17348-9809/.minikube/files for local assets ...

	I1003 18:22:19.702262   12504 filesync.go:149] local asset: /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem -> 102692.pem in /etc/ssl/certs

	I1003 18:22:19.702271   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem -> /etc/ssl/certs/102692.pem

	I1003 18:22:19.702429   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1003 18:22:19.708830   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem --> /etc/ssl/certs/102692.pem (1708 bytes)

	I1003 18:22:19.724301   12504 start.go:303] post-start completed in 59.69839ms

	I1003 18:22:19.724311   12504 fix.go:56] fixHost completed within 36.260766829s

	I1003 18:22:19.724326   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHHostname

	I1003 18:22:19.724453   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHPort

	I1003 18:22:19.724543   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:19.724647   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:19.724735   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHUsername

	I1003 18:22:19.724845   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:22:19.725097   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.42 22 <nil> <nil>}

	I1003 18:22:19.725105   12504 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I1003 18:22:19.782119   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: 1696382539.953585577

	I1003 18:22:19.782133   12504 fix.go:206] guest clock: 1696382539.953585577

	I1003 18:22:19.782138   12504 fix.go:219] Guest: 2023-10-03 18:22:19.953585577 -0700 PDT Remote: 2023-10-03 18:22:19.724316 -0700 PDT m=+89.735411892 (delta=229.269577ms)

	I1003 18:22:19.782156   12504 fix.go:190] guest clock delta is within tolerance: 229.269577ms

	I1003 18:22:19.782161   12504 start.go:83] releasing machines lock for "multinode-528000-m02", held for 36.318628062s

	I1003 18:22:19.782179   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .DriverName

	I1003 18:22:19.782305   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetIP

	I1003 18:22:19.804802   12504 out.go:177] * Found network options:

	I1003 18:22:19.826926   12504 out.go:177]   - NO_PROXY=192.168.89.41

	W1003 18:22:19.848689   12504 proxy.go:119] fail to check proxy env: Error ip not in block

	I1003 18:22:19.848735   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .DriverName

	I1003 18:22:19.849587   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .DriverName

	I1003 18:22:19.849838   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .DriverName

	I1003 18:22:19.849936   12504 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I1003 18:22:19.849980   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHHostname

	W1003 18:22:19.850079   12504 proxy.go:119] fail to check proxy env: Error ip not in block

	I1003 18:22:19.850160   12504 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	I1003 18:22:19.850162   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHPort

	I1003 18:22:19.850183   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHHostname

	I1003 18:22:19.850414   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:19.850458   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHPort

	I1003 18:22:19.850597   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHUsername

	I1003 18:22:19.850674   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:19.850873   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHUsername

	I1003 18:22:19.850886   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.42 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/id_rsa Username:docker}

	I1003 18:22:19.851014   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.42 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/id_rsa Username:docker}

	I1003 18:22:19.884397   12504 command_runner.go:130] ! stat: cannot statx '/etc/cni/net.d/*loopback.conf*': No such file or directory

	W1003 18:22:19.884419   12504 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I1003 18:22:19.884475   12504 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1003 18:22:19.932507   12504 command_runner.go:130] > <a href="https://github.com/kubernetes/registry.k8s.io">Temporary Redirect</a>.

	I1003 18:22:19.932547   12504 command_runner.go:139] > /etc/cni/net.d/87-podman-bridge.conflist, 

	I1003 18:22:19.932572   12504 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I1003 18:22:19.932580   12504 start.go:469] detecting cgroup driver to use...

	I1003 18:22:19.932666   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1003 18:22:19.944675   12504 command_runner.go:130] > runtime-endpoint: unix:///run/containerd/containerd.sock

	I1003 18:22:19.944981   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I1003 18:22:19.952444   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I1003 18:22:19.959726   12504 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...

	I1003 18:22:19.959774   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I1003 18:22:19.967021   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1003 18:22:19.974194   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I1003 18:22:19.981325   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1003 18:22:19.988455   12504 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1003 18:22:19.995920   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I1003 18:22:20.002981   12504 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1003 18:22:20.009283   12504 command_runner.go:130] > net.bridge.bridge-nf-call-iptables = 1

	I1003 18:22:20.009387   12504 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1003 18:22:20.015817   12504 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 18:22:20.101017   12504 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I1003 18:22:20.113699   12504 start.go:469] detecting cgroup driver to use...

	I1003 18:22:20.113763   12504 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1003 18:22:20.122299   12504 command_runner.go:130] > # /usr/lib/systemd/system/docker.service

	I1003 18:22:20.122935   12504 command_runner.go:130] > [Unit]

	I1003 18:22:20.122946   12504 command_runner.go:130] > Description=Docker Application Container Engine

	I1003 18:22:20.122950   12504 command_runner.go:130] > Documentation=https://docs.docker.com

	I1003 18:22:20.122955   12504 command_runner.go:130] > After=network.target  minikube-automount.service docker.socket

	I1003 18:22:20.122966   12504 command_runner.go:130] > Requires= minikube-automount.service docker.socket 

	I1003 18:22:20.122970   12504 command_runner.go:130] > StartLimitBurst=3

	I1003 18:22:20.122973   12504 command_runner.go:130] > StartLimitIntervalSec=60

	I1003 18:22:20.122977   12504 command_runner.go:130] > [Service]

	I1003 18:22:20.122981   12504 command_runner.go:130] > Type=notify

	I1003 18:22:20.122985   12504 command_runner.go:130] > Restart=on-failure

	I1003 18:22:20.122989   12504 command_runner.go:130] > Environment=NO_PROXY=192.168.89.41

	I1003 18:22:20.123002   12504 command_runner.go:130] > # This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	I1003 18:22:20.123009   12504 command_runner.go:130] > # The base configuration already specifies an 'ExecStart=...' command. The first directive

	I1003 18:22:20.123014   12504 command_runner.go:130] > # here is to clear out that command inherited from the base configuration. Without this,

	I1003 18:22:20.123022   12504 command_runner.go:130] > # the command from the base configuration and the command specified here are treated as

	I1003 18:22:20.123027   12504 command_runner.go:130] > # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	I1003 18:22:20.123033   12504 command_runner.go:130] > # will catch this invalid input and refuse to start the service with an error like:

	I1003 18:22:20.123039   12504 command_runner.go:130] > #  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	I1003 18:22:20.123052   12504 command_runner.go:130] > # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	I1003 18:22:20.123059   12504 command_runner.go:130] > # container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	I1003 18:22:20.123062   12504 command_runner.go:130] > ExecStart=

	I1003 18:22:20.123073   12504 command_runner.go:130] > ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	I1003 18:22:20.123079   12504 command_runner.go:130] > ExecReload=/bin/kill -s HUP $MAINPID

	I1003 18:22:20.123087   12504 command_runner.go:130] > # Having non-zero Limit*s causes performance problems due to accounting overhead

	I1003 18:22:20.123094   12504 command_runner.go:130] > # in the kernel. We recommend using cgroups to do container-local accounting.

	I1003 18:22:20.123099   12504 command_runner.go:130] > LimitNOFILE=infinity

	I1003 18:22:20.123103   12504 command_runner.go:130] > LimitNPROC=infinity

	I1003 18:22:20.123106   12504 command_runner.go:130] > LimitCORE=infinity

	I1003 18:22:20.123111   12504 command_runner.go:130] > # Uncomment TasksMax if your systemd version supports it.

	I1003 18:22:20.123117   12504 command_runner.go:130] > # Only systemd 226 and above support this version.

	I1003 18:22:20.123122   12504 command_runner.go:130] > TasksMax=infinity

	I1003 18:22:20.123125   12504 command_runner.go:130] > TimeoutStartSec=0

	I1003 18:22:20.123130   12504 command_runner.go:130] > # set delegate yes so that systemd does not reset the cgroups of docker containers

	I1003 18:22:20.123134   12504 command_runner.go:130] > Delegate=yes

	I1003 18:22:20.123140   12504 command_runner.go:130] > # kill only the docker process, not all processes in the cgroup

	I1003 18:22:20.123155   12504 command_runner.go:130] > KillMode=process

	I1003 18:22:20.123162   12504 command_runner.go:130] > [Install]

	I1003 18:22:20.123168   12504 command_runner.go:130] > WantedBy=multi-user.target

	I1003 18:22:20.123242   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1003 18:22:20.132583   12504 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I1003 18:22:20.145250   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1003 18:22:20.154043   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1003 18:22:20.162203   12504 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I1003 18:22:20.184916   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1003 18:22:20.193679   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1003 18:22:20.205492   12504 command_runner.go:130] > runtime-endpoint: unix:///var/run/cri-dockerd.sock

	I1003 18:22:20.205780   12504 ssh_runner.go:195] Run: which cri-dockerd

	I1003 18:22:20.207975   12504 command_runner.go:130] > /usr/bin/cri-dockerd

	I1003 18:22:20.208142   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I1003 18:22:20.214460   12504 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I1003 18:22:20.225379   12504 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I1003 18:22:20.315043   12504 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I1003 18:22:20.405374   12504 docker.go:554] configuring docker to use "cgroupfs" as cgroup driver...

	I1003 18:22:20.405412   12504 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I1003 18:22:20.418156   12504 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 18:22:20.510020   12504 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1003 18:22:21.785431   12504 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.275396662s)

	I1003 18:22:21.785486   12504 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I1003 18:22:21.869825   12504 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I1003 18:22:21.957945   12504 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I1003 18:22:22.046515   12504 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 18:22:22.130489   12504 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I1003 18:22:22.142724   12504 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 18:22:22.231593   12504 ssh_runner.go:195] Run: sudo systemctl restart cri-docker

	I1003 18:22:22.287026   12504 start.go:516] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I1003 18:22:22.287106   12504 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I1003 18:22:22.290950   12504 command_runner.go:130] >   File: /var/run/cri-dockerd.sock

	I1003 18:22:22.290961   12504 command_runner.go:130] >   Size: 0         	Blocks: 0          IO Block: 4096   socket

	I1003 18:22:22.290967   12504 command_runner.go:130] > Device: 16h/22d	Inode: 855         Links: 1

	I1003 18:22:22.290973   12504 command_runner.go:130] > Access: (0660/srw-rw----)  Uid: (    0/    root)   Gid: ( 1000/  docker)

	I1003 18:22:22.290982   12504 command_runner.go:130] > Access: 2023-10-04 01:22:22.413215863 +0000

	I1003 18:22:22.290988   12504 command_runner.go:130] > Modify: 2023-10-04 01:22:22.413215863 +0000

	I1003 18:22:22.290992   12504 command_runner.go:130] > Change: 2023-10-04 01:22:22.416215863 +0000

	I1003 18:22:22.290995   12504 command_runner.go:130] >  Birth: -

	I1003 18:22:22.291062   12504 start.go:537] Will wait 60s for crictl version

	I1003 18:22:22.291107   12504 ssh_runner.go:195] Run: which crictl

	I1003 18:22:22.293457   12504 command_runner.go:130] > /usr/bin/crictl

	I1003 18:22:22.293511   12504 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I1003 18:22:22.331854   12504 command_runner.go:130] > Version:  0.1.0

	I1003 18:22:22.331893   12504 command_runner.go:130] > RuntimeName:  docker

	I1003 18:22:22.331963   12504 command_runner.go:130] > RuntimeVersion:  24.0.6

	I1003 18:22:22.332032   12504 command_runner.go:130] > RuntimeApiVersion:  v1

	I1003 18:22:22.333174   12504 start.go:553] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  24.0.6

	RuntimeApiVersion:  v1

	I1003 18:22:22.333246   12504 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1003 18:22:22.349526   12504 command_runner.go:130] > 24.0.6

	I1003 18:22:22.350471   12504 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1003 18:22:22.366605   12504 command_runner.go:130] > 24.0.6

	I1003 18:22:22.410824   12504 out.go:204] * Preparing Kubernetes v1.28.2 on Docker 24.0.6 ...

	I1003 18:22:22.432694   12504 out.go:177]   - env NO_PROXY=192.168.89.41

	I1003 18:22:22.453427   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetIP

	I1003 18:22:22.453702   12504 ssh_runner.go:195] Run: grep 192.168.89.1	host.minikube.internal$ /etc/hosts

	I1003 18:22:22.456888   12504 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.89.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1003 18:22:22.464774   12504 certs.go:56] Setting up /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000 for IP: 192.168.89.42

	I1003 18:22:22.464787   12504 certs.go:190] acquiring lock for shared ca certs: {Name:mk3b53aae05d89faa161c9ed5bb05e7f02553427 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 18:22:22.464917   12504 certs.go:199] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.key

	I1003 18:22:22.464965   12504 certs.go:199] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/17348-9809/.minikube/proxy-client-ca.key

	I1003 18:22:22.464974   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I1003 18:22:22.464993   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I1003 18:22:22.465008   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I1003 18:22:22.465025   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I1003 18:22:22.465100   12504 certs.go:437] found cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/10269.pem (1338 bytes)

	W1003 18:22:22.465136   12504 certs.go:433] ignoring /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/10269_empty.pem, impossibly tiny 0 bytes

	I1003 18:22:22.465145   12504 certs.go:437] found cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca-key.pem (1675 bytes)

	I1003 18:22:22.465175   12504 certs.go:437] found cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem (1082 bytes)

	I1003 18:22:22.465210   12504 certs.go:437] found cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/cert.pem (1123 bytes)

	I1003 18:22:22.465239   12504 certs.go:437] found cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/key.pem (1679 bytes)

	I1003 18:22:22.465300   12504 certs.go:437] found cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem (1708 bytes)

	I1003 18:22:22.465332   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem -> /usr/share/ca-certificates/102692.pem

	I1003 18:22:22.465357   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I1003 18:22:22.465373   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/10269.pem -> /usr/share/ca-certificates/10269.pem

	I1003 18:22:22.465623   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1003 18:22:22.481559   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1003 18:22:22.497344   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1003 18:22:22.512869   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I1003 18:22:22.528747   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem --> /usr/share/ca-certificates/102692.pem (1708 bytes)

	I1003 18:22:22.544322   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1003 18:22:22.560185   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/10269.pem --> /usr/share/ca-certificates/10269.pem (1338 bytes)

	I1003 18:22:22.575751   12504 ssh_runner.go:195] Run: openssl version

	I1003 18:22:22.579158   12504 command_runner.go:130] > OpenSSL 1.1.1n  15 Mar 2022

	I1003 18:22:22.579413   12504 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/102692.pem && ln -fs /usr/share/ca-certificates/102692.pem /etc/ssl/certs/102692.pem"

	I1003 18:22:22.586466   12504 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/102692.pem

	I1003 18:22:22.589292   12504 command_runner.go:130] > -rw-r--r-- 1 root root 1708 Oct  4 01:07 /usr/share/ca-certificates/102692.pem

	I1003 18:22:22.589374   12504 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Oct  4 01:07 /usr/share/ca-certificates/102692.pem

	I1003 18:22:22.589406   12504 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/102692.pem

	I1003 18:22:22.592779   12504 command_runner.go:130] > 3ec20f2e

	I1003 18:22:22.593014   12504 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/102692.pem /etc/ssl/certs/3ec20f2e.0"

	I1003 18:22:22.600023   12504 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1003 18:22:22.607257   12504 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1003 18:22:22.610369   12504 command_runner.go:130] > -rw-r--r-- 1 root root 1111 Oct  4 01:03 /usr/share/ca-certificates/minikubeCA.pem

	I1003 18:22:22.610468   12504 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Oct  4 01:03 /usr/share/ca-certificates/minikubeCA.pem

	I1003 18:22:22.610515   12504 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1003 18:22:22.614216   12504 command_runner.go:130] > b5213941

	I1003 18:22:22.614502   12504 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1003 18:22:22.621714   12504 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/10269.pem && ln -fs /usr/share/ca-certificates/10269.pem /etc/ssl/certs/10269.pem"

	I1003 18:22:22.628814   12504 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/10269.pem

	I1003 18:22:22.631853   12504 command_runner.go:130] > -rw-r--r-- 1 root root 1338 Oct  4 01:07 /usr/share/ca-certificates/10269.pem

	I1003 18:22:22.631924   12504 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Oct  4 01:07 /usr/share/ca-certificates/10269.pem

	I1003 18:22:22.631957   12504 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/10269.pem

	I1003 18:22:22.635288   12504 command_runner.go:130] > 51391683

	I1003 18:22:22.635536   12504 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/10269.pem /etc/ssl/certs/51391683.0"

	I1003 18:22:22.642613   12504 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd

	I1003 18:22:22.645167   12504 command_runner.go:130] ! ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory

	I1003 18:22:22.645189   12504 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory

	I1003 18:22:22.645257   12504 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I1003 18:22:22.661598   12504 command_runner.go:130] > cgroupfs

	I1003 18:22:22.662183   12504 cni.go:84] Creating CNI manager for ""

	I1003 18:22:22.662191   12504 cni.go:136] 3 nodes found, recommending kindnet

	I1003 18:22:22.662200   12504 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I1003 18:22:22.662216   12504 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.89.42 APIServerPort:8443 KubernetesVersion:v1.28.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:multinode-528000 NodeName:multinode-528000-m02 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.89.41"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.89.42 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPa

th:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I1003 18:22:22.662824   12504 kubeadm.go:181] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.89.42

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "multinode-528000-m02"

	  kubeletExtraArgs:

	    node-ip: 192.168.89.42

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.89.41"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.28.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1003 18:22:22.662908   12504 kubeadm.go:976] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.28.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=multinode-528000-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.89.42

	[Install]

	 config:

	{KubernetesVersion:v1.28.2 ClusterName:multinode-528000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I1003 18:22:22.662995   12504 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.2

	I1003 18:22:22.669850   12504 command_runner.go:130] > kubeadm

	I1003 18:22:22.669858   12504 command_runner.go:130] > kubectl

	I1003 18:22:22.669862   12504 command_runner.go:130] > kubelet

	I1003 18:22:22.669872   12504 binaries.go:44] Found k8s binaries, skipping transfer

	I1003 18:22:22.669918   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system

	I1003 18:22:22.676131   12504 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (382 bytes)

	I1003 18:22:22.687878   12504 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1003 18:22:22.698914   12504 ssh_runner.go:195] Run: grep 192.168.89.41	control-plane.minikube.internal$ /etc/hosts

	I1003 18:22:22.701240   12504 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.89.41	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1003 18:22:22.710478   12504 host.go:66] Checking if "multinode-528000" exists ...

	I1003 18:22:22.710642   12504 config.go:182] Loaded profile config "multinode-528000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 18:22:22.710720   12504 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I1003 18:22:22.710746   12504 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I1003 18:22:22.718827   12504 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59279

	I1003 18:22:22.719169   12504 main.go:141] libmachine: () Calling .GetVersion

	I1003 18:22:22.719529   12504 main.go:141] libmachine: Using API Version  1

	I1003 18:22:22.719544   12504 main.go:141] libmachine: () Calling .SetConfigRaw

	I1003 18:22:22.719763   12504 main.go:141] libmachine: () Calling .GetMachineName

	I1003 18:22:22.719866   12504 main.go:141] libmachine: (multinode-528000) Calling .DriverName

	I1003 18:22:22.719955   12504 start.go:304] JoinCluster: &{Name:multinode-528000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696241247-17339@sha256:77c3e98870a99538e39ecb73a5e5230b746fa8c633c297c3d287ad4bba01a880 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersi

on:v1.28.2 ClusterName:multinode-528000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.89.41 Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.89.42 Port:0 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:false Worker:true} {Name:m03 IP:192.168.89.43 Port:0 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingr

ess:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom

QemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I1003 18:22:22.720045   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm token create --print-join-command --ttl=0"

	I1003 18:22:22.720058   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHHostname

	I1003 18:22:22.720136   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHPort

	I1003 18:22:22.720219   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:22:22.720297   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHUsername

	I1003 18:22:22.720377   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.41 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/id_rsa Username:docker}

	I1003 18:22:22.818259   12504 command_runner.go:130] > kubeadm join control-plane.minikube.internal:8443 --token lf0gm8.23fzb7jsawk87iu1 --discovery-token-ca-cert-hash sha256:753473a54c0ba856a4674584dd4dc7e8118c2f06516f2cb2508c67099b9c3a98 

	I1003 18:22:22.818332   12504 start.go:317] removing existing worker node "m02" before attempting to rejoin cluster: &{Name:m02 IP:192.168.89.42 Port:0 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:false Worker:true}

	I1003 18:22:22.818362   12504 host.go:66] Checking if "multinode-528000" exists ...

	I1003 18:22:22.818630   12504 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I1003 18:22:22.818657   12504 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I1003 18:22:22.826991   12504 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59282

	I1003 18:22:22.827355   12504 main.go:141] libmachine: () Calling .GetVersion

	I1003 18:22:22.827720   12504 main.go:141] libmachine: Using API Version  1

	I1003 18:22:22.827735   12504 main.go:141] libmachine: () Calling .SetConfigRaw

	I1003 18:22:22.827956   12504 main.go:141] libmachine: () Calling .GetMachineName

	I1003 18:22:22.828062   12504 main.go:141] libmachine: (multinode-528000) Calling .DriverName

	I1003 18:22:22.828209   12504 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl drain multinode-528000-m02 --force --grace-period=1 --skip-wait-for-delete-timeout=1 --disable-eviction --ignore-daemonsets --delete-emptydir-data --delete-local-data

	I1003 18:22:22.828227   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHHostname

	I1003 18:22:22.828313   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHPort

	I1003 18:22:22.828396   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:22:22.828469   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHUsername

	I1003 18:22:22.828553   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.41 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/id_rsa Username:docker}

	I1003 18:22:22.920029   12504 command_runner.go:130] ! Flag --delete-local-data has been deprecated, This option is deprecated and will be deleted. Use --delete-emptydir-data.

	I1003 18:22:22.953614   12504 command_runner.go:130] ! Warning: ignoring DaemonSet-managed Pods: kube-system/kindnet-tl478, kube-system/kube-proxy-9pd2m

	I1003 18:22:25.962647   12504 command_runner.go:130] > node/multinode-528000-m02 cordoned

	I1003 18:22:25.962668   12504 command_runner.go:130] > pod "busybox-5bc68d56bd-6b4hh" has DeletionTimestamp older than 1 seconds, skipping

	I1003 18:22:25.962676   12504 command_runner.go:130] > node/multinode-528000-m02 drained

	I1003 18:22:25.962691   12504 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl drain multinode-528000-m02 --force --grace-period=1 --skip-wait-for-delete-timeout=1 --disable-eviction --ignore-daemonsets --delete-emptydir-data --delete-local-data: (3.134483453s)

	I1003 18:22:25.962703   12504 node.go:108] successfully drained node "m02"

	I1003 18:22:25.963001   12504 loader.go:395] Config loaded from file:  /Users/jenkins/minikube-integration/17348-9809/kubeconfig

	I1003 18:22:25.963189   12504 kapi.go:59] client config for multinode-528000: &rest.Config{Host:"https://192.168.89.41:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/client.key", CAFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Next

Protos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27c7a00), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1003 18:22:25.963484   12504 request.go:1212] Request Body: {"kind":"DeleteOptions","apiVersion":"v1"}

	I1003 18:22:25.963517   12504 round_trippers.go:463] DELETE https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:22:25.963521   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:25.963527   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:25.963535   12504 round_trippers.go:473]     Content-Type: application/json

	I1003 18:22:25.963541   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:25.966310   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:22:25.966320   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:25.966325   12504 round_trippers.go:580]     Audit-Id: c6cc682f-1dc8-4578-aa49-26a862c7d4d2

	I1003 18:22:25.966330   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:25.966335   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:25.966343   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:25.966348   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:25.966353   12504 round_trippers.go:580]     Content-Length: 171

	I1003 18:22:25.966358   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:26 GMT

	I1003 18:22:25.966379   12504 request.go:1212] Response Body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"multinode-528000-m02","kind":"nodes","uid":"0073defe-0d22-4c69-83ae-9ebd7055fa45"}}

	I1003 18:22:25.966396   12504 node.go:124] successfully deleted node "m02"

	I1003 18:22:25.966403   12504 start.go:321] successfully removed existing worker node "m02" from cluster: &{Name:m02 IP:192.168.89.42 Port:0 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:false Worker:true}

	I1003 18:22:25.966417   12504 start.go:325] trying to join worker node "m02" to cluster: &{Name:m02 IP:192.168.89.42 Port:0 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:false Worker:true}

	I1003 18:22:25.966428   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm join control-plane.minikube.internal:8443 --token lf0gm8.23fzb7jsawk87iu1 --discovery-token-ca-cert-hash sha256:753473a54c0ba856a4674584dd4dc7e8118c2f06516f2cb2508c67099b9c3a98 --ignore-preflight-errors=all --cri-socket /var/run/cri-dockerd.sock --node-name=multinode-528000-m02"

	I1003 18:22:26.027129   12504 command_runner.go:130] > [preflight] Running pre-flight checks

	I1003 18:22:26.197021   12504 command_runner.go:130] > [preflight] Reading configuration from the cluster...

	I1003 18:22:26.197035   12504 command_runner.go:130] > [preflight] FYI: You can look at this config file with 'kubectl -n kube-system get cm kubeadm-config -o yaml'

	I1003 18:22:26.222784   12504 command_runner.go:130] > [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I1003 18:22:26.222850   12504 command_runner.go:130] > [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I1003 18:22:26.223072   12504 command_runner.go:130] > [kubelet-start] Starting the kubelet

	I1003 18:22:26.315057   12504 command_runner.go:130] > [kubelet-start] Waiting for the kubelet to perform the TLS Bootstrap...

	I1003 18:22:27.829785   12504 command_runner.go:130] > This node has joined the cluster:

	I1003 18:22:27.829801   12504 command_runner.go:130] > * Certificate signing request was sent to apiserver and a response was received.

	I1003 18:22:27.829806   12504 command_runner.go:130] > * The Kubelet was informed of the new secure connection details.

	I1003 18:22:27.829811   12504 command_runner.go:130] > Run 'kubectl get nodes' on the control-plane to see this node join the cluster.

	I1003 18:22:27.831211   12504 command_runner.go:130] ! W1004 01:22:26.203146    1156 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/var/run/cri-dockerd.sock". Please update your configuration!

	I1003 18:22:27.831225   12504 command_runner.go:130] ! 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I1003 18:22:27.831240   12504 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm join control-plane.minikube.internal:8443 --token lf0gm8.23fzb7jsawk87iu1 --discovery-token-ca-cert-hash sha256:753473a54c0ba856a4674584dd4dc7e8118c2f06516f2cb2508c67099b9c3a98 --ignore-preflight-errors=all --cri-socket /var/run/cri-dockerd.sock --node-name=multinode-528000-m02": (1.864791289s)

	I1003 18:22:27.831251   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I1003 18:22:28.099505   12504 command_runner.go:130] ! Created symlink /etc/systemd/system/multi-user.target.wants/kubelet.service → /usr/lib/systemd/system/kubelet.service.

	I1003 18:22:28.099541   12504 start.go:306] JoinCluster complete in 5.379582725s

	I1003 18:22:28.099551   12504 cni.go:84] Creating CNI manager for ""

	I1003 18:22:28.099560   12504 cni.go:136] 3 nodes found, recommending kindnet

	I1003 18:22:28.099633   12504 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap

	I1003 18:22:28.103205   12504 command_runner.go:130] >   File: /opt/cni/bin/portmap

	I1003 18:22:28.103221   12504 command_runner.go:130] >   Size: 2615256   	Blocks: 5112       IO Block: 4096   regular file

	I1003 18:22:28.103226   12504 command_runner.go:130] > Device: 11h/17d	Inode: 3544        Links: 1

	I1003 18:22:28.103231   12504 command_runner.go:130] > Access: (0755/-rwxr-xr-x)  Uid: (    0/    root)   Gid: (    0/    root)

	I1003 18:22:28.103239   12504 command_runner.go:130] > Access: 2023-10-04 01:20:59.445267298 +0000

	I1003 18:22:28.103244   12504 command_runner.go:130] > Modify: 2023-09-19 00:07:45.000000000 +0000

	I1003 18:22:28.103248   12504 command_runner.go:130] > Change: 2023-10-04 01:20:57.047134463 +0000

	I1003 18:22:28.103258   12504 command_runner.go:130] >  Birth: -

	I1003 18:22:28.103343   12504 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.28.2/kubectl ...

	I1003 18:22:28.103354   12504 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)

	I1003 18:22:28.116055   12504 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I1003 18:22:28.368609   12504 command_runner.go:130] > clusterrole.rbac.authorization.k8s.io/kindnet unchanged

	I1003 18:22:28.370857   12504 command_runner.go:130] > clusterrolebinding.rbac.authorization.k8s.io/kindnet unchanged

	I1003 18:22:28.372588   12504 command_runner.go:130] > serviceaccount/kindnet unchanged

	I1003 18:22:28.378768   12504 command_runner.go:130] > daemonset.apps/kindnet configured

	I1003 18:22:28.380827   12504 loader.go:395] Config loaded from file:  /Users/jenkins/minikube-integration/17348-9809/kubeconfig

	I1003 18:22:28.381030   12504 kapi.go:59] client config for multinode-528000: &rest.Config{Host:"https://192.168.89.41:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/client.key", CAFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Next

Protos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27c7a00), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1003 18:22:28.381251   12504 round_trippers.go:463] GET https://192.168.89.41:8443/apis/apps/v1/namespaces/kube-system/deployments/coredns/scale

	I1003 18:22:28.381258   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:28.381264   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:28.381270   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:28.382676   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:28.382684   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:28.382690   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:28.382697   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:28.382712   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:28.382718   12504 round_trippers.go:580]     Content-Length: 291

	I1003 18:22:28.382722   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:28 GMT

	I1003 18:22:28.382727   12504 round_trippers.go:580]     Audit-Id: 44570bbb-e9c2-4477-a3e4-84f6378f3f5b

	I1003 18:22:28.382732   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:28.382743   12504 request.go:1212] Response Body: {"kind":"Scale","apiVersion":"autoscaling/v1","metadata":{"name":"coredns","namespace":"kube-system","uid":"922fb573-befe-48bc-bc7c-aeeaaee4dd54","resourceVersion":"866","creationTimestamp":"2023-10-04T01:18:19Z"},"spec":{"replicas":1},"status":{"replicas":1,"selector":"k8s-app=kube-dns"}}

	I1003 18:22:28.382786   12504 kapi.go:248] "coredns" deployment in "kube-system" namespace and "multinode-528000" context rescaled to 1 replicas

	I1003 18:22:28.382801   12504 start.go:223] Will wait 6m0s for node &{Name:m02 IP:192.168.89.42 Port:0 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:false Worker:true}

	I1003 18:22:28.407309   12504 out.go:177] * Verifying Kubernetes components...

	I1003 18:22:28.448219   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1003 18:22:28.466023   12504 loader.go:395] Config loaded from file:  /Users/jenkins/minikube-integration/17348-9809/kubeconfig

	I1003 18:22:28.466210   12504 kapi.go:59] client config for multinode-528000: &rest.Config{Host:"https://192.168.89.41:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/client.key", CAFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Next

Protos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27c7a00), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1003 18:22:28.466391   12504 node_ready.go:35] waiting up to 6m0s for node "multinode-528000-m02" to be "Ready" ...

	I1003 18:22:28.466440   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:22:28.466445   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:28.466451   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:28.466457   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:28.468154   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:28.468162   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:28.468167   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:28.468175   12504 round_trippers.go:580]     Content-Length: 4029

	I1003 18:22:28.468185   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:28 GMT

	I1003 18:22:28.468194   12504 round_trippers.go:580]     Audit-Id: 9e486959-f05a-4fad-9d74-8ec7e8e949e4

	I1003 18:22:28.468207   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:28.468216   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:28.468229   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:28.468288   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m02","uid":"9415bef6-fa61-400c-ad0d-fab7e1d71e4c","resourceVersion":"950","creationTimestamp":"2023-10-04T01:22:26Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsT

ype":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:vo [truncated 3005 chars]

	I1003 18:22:28.468452   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:22:28.468458   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:28.468463   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:28.468468   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:28.469769   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:28.469777   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:28.469782   12504 round_trippers.go:580]     Content-Length: 4029

	I1003 18:22:28.469787   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:28 GMT

	I1003 18:22:28.469793   12504 round_trippers.go:580]     Audit-Id: 600176c3-bd65-4fb6-a6b0-9d1736e0a7af

	I1003 18:22:28.469800   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:28.469809   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:28.469813   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:28.469819   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:28.469850   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m02","uid":"9415bef6-fa61-400c-ad0d-fab7e1d71e4c","resourceVersion":"950","creationTimestamp":"2023-10-04T01:22:26Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsT

ype":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:vo [truncated 3005 chars]

	I1003 18:22:28.970457   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:22:28.970471   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:28.970480   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:28.970487   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:28.972364   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:28.972374   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:28.972379   12504 round_trippers.go:580]     Audit-Id: 20f18132-b048-4ec9-b029-9d0426c4e2b1

	I1003 18:22:28.972385   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:28.972392   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:28.972397   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:28.972403   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:28.972407   12504 round_trippers.go:580]     Content-Length: 4029

	I1003 18:22:28.972412   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:29 GMT

	I1003 18:22:28.972470   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m02","uid":"9415bef6-fa61-400c-ad0d-fab7e1d71e4c","resourceVersion":"950","creationTimestamp":"2023-10-04T01:22:26Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsT

ype":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:vo [truncated 3005 chars]

	I1003 18:22:29.471880   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:22:29.471906   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:29.471920   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:29.471985   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:29.474564   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:22:29.474581   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:29.474592   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:29.474604   12504 round_trippers.go:580]     Content-Length: 4029

	I1003 18:22:29.474652   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:29 GMT

	I1003 18:22:29.474668   12504 round_trippers.go:580]     Audit-Id: c857468d-b9fe-4ce1-b1e6-0b2547447025

	I1003 18:22:29.474676   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:29.474687   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:29.474695   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:29.474765   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m02","uid":"9415bef6-fa61-400c-ad0d-fab7e1d71e4c","resourceVersion":"950","creationTimestamp":"2023-10-04T01:22:26Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsT

ype":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:vo [truncated 3005 chars]

	I1003 18:22:29.970801   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:22:29.970845   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:29.970854   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:29.970860   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:29.972930   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:22:29.972939   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:29.972945   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:29.972967   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:30 GMT

	I1003 18:22:29.972976   12504 round_trippers.go:580]     Audit-Id: a87a580a-bd42-4c19-8139-f9d005795826

	I1003 18:22:29.972980   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:29.972987   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:29.972992   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:29.973157   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m02","uid":"9415bef6-fa61-400c-ad0d-fab7e1d71e4c","resourceVersion":"958","creationTimestamp":"2023-10-04T01:22:26Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{

}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 3114 chars]

	I1003 18:22:30.471905   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:22:30.471920   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:30.471977   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:30.471984   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:30.473719   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:30.473729   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:30.473734   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:30.473739   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:30 GMT

	I1003 18:22:30.473758   12504 round_trippers.go:580]     Audit-Id: db132be2-454e-42c3-81f3-86f64bf6ac9c

	I1003 18:22:30.473771   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:30.473787   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:30.473793   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:30.473872   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m02","uid":"9415bef6-fa61-400c-ad0d-fab7e1d71e4c","resourceVersion":"958","creationTimestamp":"2023-10-04T01:22:26Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{

}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 3114 chars]

	I1003 18:22:30.474034   12504 node_ready.go:58] node "multinode-528000-m02" has status "Ready":"False"

	I1003 18:22:30.970509   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:22:30.970523   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:30.970531   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:30.970536   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:30.972528   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:30.972542   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:30.972555   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:30.972561   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:30.972566   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:30.972571   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:30.972576   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:31 GMT

	I1003 18:22:30.972581   12504 round_trippers.go:580]     Audit-Id: bab2f1b3-e272-42a6-9771-caf62b2109aa

	I1003 18:22:30.972645   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m02","uid":"9415bef6-fa61-400c-ad0d-fab7e1d71e4c","resourceVersion":"958","creationTimestamp":"2023-10-04T01:22:26Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{

}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 3114 chars]

	I1003 18:22:31.470821   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:22:31.470846   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:31.470858   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:31.470868   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:31.473746   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:22:31.473762   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:31.473770   12504 round_trippers.go:580]     Audit-Id: 9da862e0-c117-4611-ae5b-41f00ca813cf

	I1003 18:22:31.473776   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:31.473782   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:31.473787   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:31.473798   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:31.473804   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:31 GMT

	I1003 18:22:31.473999   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m02","uid":"9415bef6-fa61-400c-ad0d-fab7e1d71e4c","resourceVersion":"958","creationTimestamp":"2023-10-04T01:22:26Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{

}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 3114 chars]

	I1003 18:22:31.970763   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:22:31.970784   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:31.970795   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:31.970805   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:31.973611   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:22:31.973631   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:31.973643   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:31.973655   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:31.973665   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:32 GMT

	I1003 18:22:31.973676   12504 round_trippers.go:580]     Audit-Id: 46883660-07ab-4d0e-bc25-a9f643b689bb

	I1003 18:22:31.973685   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:31.973694   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:31.973877   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m02","uid":"9415bef6-fa61-400c-ad0d-fab7e1d71e4c","resourceVersion":"958","creationTimestamp":"2023-10-04T01:22:26Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{

}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 3114 chars]

	I1003 18:22:32.471911   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:22:32.471931   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:32.471943   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:32.471953   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:32.474891   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:22:32.474907   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:32.474915   12504 round_trippers.go:580]     Audit-Id: 35920319-6280-42dc-b2ef-88df69ce5fa0

	I1003 18:22:32.474923   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:32.474932   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:32.474941   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:32.474951   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:32.474962   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:32 GMT

	I1003 18:22:32.475109   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m02","uid":"9415bef6-fa61-400c-ad0d-fab7e1d71e4c","resourceVersion":"970","creationTimestamp":"2023-10-04T01:22:26Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{

}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 3372 chars]

	I1003 18:22:32.475325   12504 node_ready.go:49] node "multinode-528000-m02" has status "Ready":"True"

	I1003 18:22:32.475335   12504 node_ready.go:38] duration metric: took 4.008774738s waiting for node "multinode-528000-m02" to be "Ready" ...

	I1003 18:22:32.475342   12504 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1003 18:22:32.475386   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods

	I1003 18:22:32.475394   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:32.475402   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:32.475409   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:32.477866   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:22:32.477875   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:32.477881   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:32 GMT

	I1003 18:22:32.477887   12504 round_trippers.go:580]     Audit-Id: 0991c30a-5d70-4f68-80a8-1f162af03656

	I1003 18:22:32.477895   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:32.477902   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:32.477909   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:32.477916   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:32.478651   12504 request.go:1212] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"972"},"items":[{"metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"862","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f

:preferredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{ [truncated 83778 chars]

	I1003 18:22:32.480541   12504 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:32.480587   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:22:32.480592   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:32.480598   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:32.480603   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:32.481807   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:32.481815   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:32.481820   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:32 GMT

	I1003 18:22:32.481827   12504 round_trippers.go:580]     Audit-Id: 27d787bd-d463-4800-8024-eec0772b387a

	I1003 18:22:32.481832   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:32.481837   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:32.481842   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:32.481846   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:32.481925   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"862","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6490 chars]

	I1003 18:22:32.482169   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:22:32.482176   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:32.482181   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:32.482187   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:32.483299   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:32.483308   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:32.483313   12504 round_trippers.go:580]     Audit-Id: 39ba83ca-ebc4-4df2-bc0d-6ae77339adc1

	I1003 18:22:32.483318   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:32.483323   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:32.483327   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:32.483332   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:32.483338   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:32 GMT

	I1003 18:22:32.483441   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:22:32.483629   12504 pod_ready.go:92] pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace has status "Ready":"True"

	I1003 18:22:32.483636   12504 pod_ready.go:81] duration metric: took 3.086713ms waiting for pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:32.483642   12504 pod_ready.go:78] waiting up to 6m0s for pod "etcd-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:32.483672   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/etcd-multinode-528000

	I1003 18:22:32.483677   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:32.483683   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:32.483689   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:32.484874   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:32.484883   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:32.484891   12504 round_trippers.go:580]     Audit-Id: 231a94af-c7fb-49f9-8214-e3457d47da2b

	I1003 18:22:32.484918   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:32.484930   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:32.484935   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:32.484940   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:32.484944   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:32 GMT

	I1003 18:22:32.485045   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"etcd-multinode-528000","namespace":"kube-system","uid":"a86312b2-3ca5-488d-b5bc-06c3346dc64e","resourceVersion":"847","creationTimestamp":"2023-10-04T01:18:19Z","labels":{"component":"etcd","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/etcd.advertise-client-urls":"https://192.168.89.41:2379","kubernetes.io/config.hash":"ae74302b7aebd7fdcc26eb5602da4836","kubernetes.io/config.mirror":"ae74302b7aebd7fdcc26eb5602da4836","kubernetes.io/config.seen":"2023-10-04T01:18:19.349005085Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:19Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubeadm.kubernetes.io/etcd.advertise-c

lient-urls":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config [truncated 6071 chars]

	I1003 18:22:32.485251   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:22:32.485259   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:32.485264   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:32.485269   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:32.486382   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:32.486389   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:32.486394   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:32.486398   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:32.486404   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:32 GMT

	I1003 18:22:32.486411   12504 round_trippers.go:580]     Audit-Id: 9babcfd4-6c93-45ee-9974-a126585686f9

	I1003 18:22:32.486418   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:32.486432   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:32.486550   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:22:32.486724   12504 pod_ready.go:92] pod "etcd-multinode-528000" in "kube-system" namespace has status "Ready":"True"

	I1003 18:22:32.486731   12504 pod_ready.go:81] duration metric: took 3.08423ms waiting for pod "etcd-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:32.486741   12504 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:32.486771   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-multinode-528000

	I1003 18:22:32.486774   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:32.486780   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:32.486785   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:32.488048   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:32.488056   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:32.488061   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:32.488066   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:32.488070   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:32 GMT

	I1003 18:22:32.488075   12504 round_trippers.go:580]     Audit-Id: b1dd0cee-ea6a-46bf-8e13-e60d5b39843b

	I1003 18:22:32.488080   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:32.488085   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:32.488339   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-apiserver-multinode-528000","namespace":"kube-system","uid":"e9361a2b-5db4-4742-9ef6-fbecda9d22a9","resourceVersion":"825","creationTimestamp":"2023-10-04T01:18:19Z","labels":{"component":"kube-apiserver","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint":"192.168.89.41:8443","kubernetes.io/config.hash":"6c45fd2961dfe8d00019d2277ceb95bd","kubernetes.io/config.mirror":"6c45fd2961dfe8d00019d2277ceb95bd","kubernetes.io/config.seen":"2023-10-04T01:18:19.349011685Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:19Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubeadm.kub

ernetes.io/kube-apiserver.advertise-address.endpoint":{},"f:kubernetes. [truncated 7606 chars]

	I1003 18:22:32.488564   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:22:32.488570   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:32.488576   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:32.488581   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:32.489941   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:32.489950   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:32.489955   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:32.489983   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:32 GMT

	I1003 18:22:32.489993   12504 round_trippers.go:580]     Audit-Id: 3dd7536c-4d17-4ac3-a986-6ed5cb16108e

	I1003 18:22:32.490003   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:32.490009   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:32.490014   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:32.490128   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:22:32.490294   12504 pod_ready.go:92] pod "kube-apiserver-multinode-528000" in "kube-system" namespace has status "Ready":"True"

	I1003 18:22:32.490300   12504 pod_ready.go:81] duration metric: took 3.554936ms waiting for pod "kube-apiserver-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:32.490307   12504 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:32.490339   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-multinode-528000

	I1003 18:22:32.490344   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:32.490351   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:32.490357   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:32.491676   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:32.491684   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:32.491689   12504 round_trippers.go:580]     Audit-Id: f3419181-8ba3-423f-9583-2aa90622f28f

	I1003 18:22:32.491694   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:32.491698   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:32.491702   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:32.491707   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:32.491712   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:32 GMT

	I1003 18:22:32.491839   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-controller-manager-multinode-528000","namespace":"kube-system","uid":"54a13f47-e858-461b-afae-d3307752880b","resourceVersion":"845","creationTimestamp":"2023-10-04T01:18:17Z","labels":{"component":"kube-controller-manager","tier":"control-plane"},"annotations":{"kubernetes.io/config.hash":"eeb9be3a2727f46db49245f383b6c839","kubernetes.io/config.mirror":"eeb9be3a2727f46db49245f383b6c839","kubernetes.io/config.seen":"2023-10-04T01:18:12.593443479Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:17Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config.mirror":{},"f:kubernetes.i

o/config.seen":{},"f:kubernetes.io/config.source":{}},"f:labels":{".":{ [truncated 7174 chars]

	I1003 18:22:32.492073   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:22:32.492080   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:32.492085   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:32.492091   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:32.493280   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:32.493289   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:32.493295   12504 round_trippers.go:580]     Audit-Id: 7a4cec93-d075-447e-ad3f-1353b5ae11c2

	I1003 18:22:32.493302   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:32.493307   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:32.493312   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:32.493317   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:32.493322   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:32 GMT

	I1003 18:22:32.493435   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:22:32.493612   12504 pod_ready.go:92] pod "kube-controller-manager-multinode-528000" in "kube-system" namespace has status "Ready":"True"

	I1003 18:22:32.493619   12504 pod_ready.go:81] duration metric: took 3.306951ms waiting for pod "kube-controller-manager-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:32.493625   12504 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-69bxc" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:32.673495   12504 request.go:629] Waited for 179.808177ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-69bxc

	I1003 18:22:32.673550   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-69bxc

	I1003 18:22:32.673555   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:32.673561   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:32.673569   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:32.675247   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:32.675256   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:32.675279   12504 round_trippers.go:580]     Audit-Id: 4d2a9135-eb01-491e-b238-1f0a57542e23

	I1003 18:22:32.675287   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:32.675292   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:32.675297   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:32.675301   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:32.675305   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:32 GMT

	I1003 18:22:32.675398   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-69bxc","generateName":"kube-proxy-","namespace":"kube-system","uid":"f621588e-bd8a-4135-aa5c-94eb292062f8","resourceVersion":"891","creationTimestamp":"2023-10-04T01:19:40Z","labels":{"controller-revision-hash":"5cbdb8dcbd","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"d64f3f20-7d64-423e-8050-9b9944997ed5","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:19:40Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"d64f3f20-7d64-423e-8050-9b9944997ed5\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r

equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5971 chars]

	I1003 18:22:32.873177   12504 request.go:629] Waited for 197.446703ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m03

	I1003 18:22:32.873275   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m03

	I1003 18:22:32.873286   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:32.873297   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:32.873308   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:32.875974   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:22:32.875991   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:32.876001   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:33 GMT

	I1003 18:22:32.876008   12504 round_trippers.go:580]     Audit-Id: d1ccaeee-488a-4bc9-8634-4bdb3ae32ccd

	I1003 18:22:32.876015   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:32.876021   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:32.876026   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:32.876039   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:32.876122   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m03","uid":"8b2fb46e-7671-4d24-b736-562f2f0cd353","resourceVersion":"892","creationTimestamp":"2023-10-04T01:20:20Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m03","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:20:20Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{

}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 3742 chars]

	I1003 18:22:32.876347   12504 pod_ready.go:97] node "multinode-528000-m03" hosting pod "kube-proxy-69bxc" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000-m03" has status "Ready":"Unknown"

	I1003 18:22:32.876363   12504 pod_ready.go:81] duration metric: took 382.719827ms waiting for pod "kube-proxy-69bxc" in "kube-system" namespace to be "Ready" ...

	E1003 18:22:32.876371   12504 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-528000-m03" hosting pod "kube-proxy-69bxc" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000-m03" has status "Ready":"Unknown"

	I1003 18:22:32.876380   12504 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-8bl5p" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:33.073456   12504 request.go:629] Waited for 197.023773ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-8bl5p

	I1003 18:22:33.073518   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-8bl5p

	I1003 18:22:33.073524   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:33.073530   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:33.073535   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:33.075270   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:33.075286   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:33.075292   12504 round_trippers.go:580]     Audit-Id: 17bf2a6c-4cd6-4cff-8a0e-50cbfd2f5b6e

	I1003 18:22:33.075297   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:33.075303   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:33.075309   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:33.075314   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:33.075319   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:33 GMT

	I1003 18:22:33.075397   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-8bl5p","generateName":"kube-proxy-","namespace":"kube-system","uid":"11839b32-7219-414d-a63f-026b1be9ab5c","resourceVersion":"820","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"controller-revision-hash":"5cbdb8dcbd","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"d64f3f20-7d64-423e-8050-9b9944997ed5","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"d64f3f20-7d64-423e-8050-9b9944997ed5\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r

equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5738 chars]

	I1003 18:22:33.272297   12504 request.go:629] Waited for 196.509741ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:22:33.272344   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:22:33.272353   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:33.272365   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:33.272377   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:33.274741   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:22:33.274755   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:33.274762   12504 round_trippers.go:580]     Audit-Id: f7363788-e9d9-458c-a065-0ffaf8329e20

	I1003 18:22:33.274777   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:33.274784   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:33.274791   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:33.274802   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:33.274822   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:33 GMT

	I1003 18:22:33.275154   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:22:33.275412   12504 pod_ready.go:92] pod "kube-proxy-8bl5p" in "kube-system" namespace has status "Ready":"True"

	I1003 18:22:33.275424   12504 pod_ready.go:81] duration metric: took 399.022644ms waiting for pod "kube-proxy-8bl5p" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:33.275432   12504 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-9pd2m" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:33.473921   12504 request.go:629] Waited for 198.439453ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-9pd2m

	I1003 18:22:33.473999   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-9pd2m

	I1003 18:22:33.474007   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:33.474026   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:33.474035   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:33.476123   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:22:33.476132   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:33.476139   12504 round_trippers.go:580]     Audit-Id: 7c89610a-b3ca-4496-a866-44a29cf69914

	I1003 18:22:33.476146   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:33.476153   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:33.476161   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:33.476169   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:33.476178   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:33 GMT

	I1003 18:22:33.476259   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-9pd2m","generateName":"kube-proxy-","namespace":"kube-system","uid":"41452f70-63bc-473d-b7bd-93e2efa7a304","resourceVersion":"961","creationTimestamp":"2023-10-04T01:19:04Z","labels":{"controller-revision-hash":"5cbdb8dcbd","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"d64f3f20-7d64-423e-8050-9b9944997ed5","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:19:04Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"d64f3f20-7d64-423e-8050-9b9944997ed5\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r

equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5746 chars]

	I1003 18:22:33.672393   12504 request.go:629] Waited for 195.739414ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:22:33.672469   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:22:33.672478   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:33.672491   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:33.672502   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:33.675689   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:22:33.675704   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:33.675711   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:33.675722   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:33.675731   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:33.675743   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:33 GMT

	I1003 18:22:33.675751   12504 round_trippers.go:580]     Audit-Id: efca468e-495d-44b2-8d20-6d4fb45d3f15

	I1003 18:22:33.675760   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:33.675931   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m02","uid":"9415bef6-fa61-400c-ad0d-fab7e1d71e4c","resourceVersion":"970","creationTimestamp":"2023-10-04T01:22:26Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{

}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 3372 chars]

	I1003 18:22:33.676147   12504 pod_ready.go:92] pod "kube-proxy-9pd2m" in "kube-system" namespace has status "Ready":"True"

	I1003 18:22:33.676159   12504 pod_ready.go:81] duration metric: took 400.709688ms waiting for pod "kube-proxy-9pd2m" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:33.676175   12504 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:33.872070   12504 request.go:629] Waited for 195.82922ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-multinode-528000

	I1003 18:22:33.872228   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-multinode-528000

	I1003 18:22:33.872239   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:33.872251   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:33.872261   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:33.874827   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:22:33.874838   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:33.874845   12504 round_trippers.go:580]     Audit-Id: cfe74641-13a1-4504-a843-57f217a7de6c

	I1003 18:22:33.874870   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:33.874881   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:33.874887   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:33.874894   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:33.874905   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:34 GMT

	I1003 18:22:33.875039   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-scheduler-multinode-528000","namespace":"kube-system","uid":"ff27b767-6913-4efa-8a1e-8398fba84175","resourceVersion":"846","creationTimestamp":"2023-10-04T01:18:17Z","labels":{"component":"kube-scheduler","tier":"control-plane"},"annotations":{"kubernetes.io/config.hash":"e3e48fd34564ef6993a5357d3bb10a96","kubernetes.io/config.mirror":"e3e48fd34564ef6993a5357d3bb10a96","kubernetes.io/config.seen":"2023-10-04T01:18:12.593444031Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:17Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config.mirror":{},"f:kubernetes.io/config.seen":{},

"f:kubernetes.io/config.source":{}},"f:labels":{".":{},"f:component":{} [truncated 4904 chars]

	I1003 18:22:34.072738   12504 request.go:629] Waited for 197.353239ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:22:34.072795   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:22:34.072803   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:34.072815   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:34.072827   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:34.075726   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:22:34.075741   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:34.075748   12504 round_trippers.go:580]     Audit-Id: 667d39c6-b9aa-4d01-bf80-8787a20b95f9

	I1003 18:22:34.075755   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:34.075761   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:34.075768   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:34.075777   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:34.075787   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:34 GMT

	I1003 18:22:34.075922   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:22:34.076177   12504 pod_ready.go:92] pod "kube-scheduler-multinode-528000" in "kube-system" namespace has status "Ready":"True"

	I1003 18:22:34.076187   12504 pod_ready.go:81] duration metric: took 399.994337ms waiting for pod "kube-scheduler-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:34.076196   12504 pod_ready.go:38] duration metric: took 1.600797883s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1003 18:22:34.076222   12504 system_svc.go:44] waiting for kubelet service to be running ....

	I1003 18:22:34.076282   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1003 18:22:34.085740   12504 system_svc.go:56] duration metric: took 9.5134ms WaitForService to wait for kubelet.

	I1003 18:22:34.085757   12504 kubeadm.go:581] duration metric: took 5.702728843s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I1003 18:22:34.085769   12504 node_conditions.go:102] verifying NodePressure condition ...

	I1003 18:22:34.272064   12504 request.go:629] Waited for 186.203907ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes

	I1003 18:22:34.272106   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes

	I1003 18:22:34.272111   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:34.272117   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:34.272123   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:34.273859   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:34.273871   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:34.273878   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:34 GMT

	I1003 18:22:34.273885   12504 round_trippers.go:580]     Audit-Id: 79580fce-80a0-457b-8f0f-9119757e9520

	I1003 18:22:34.273893   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:34.273900   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:34.273906   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:34.273911   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:34.274052   12504 request.go:1212] Response Body: {"kind":"NodeList","apiVersion":"v1","metadata":{"resourceVersion":"976"},"items":[{"metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFiel

ds":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time" [truncated 14324 chars]

	I1003 18:22:34.274465   12504 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki

	I1003 18:22:34.274475   12504 node_conditions.go:123] node cpu capacity is 2

	I1003 18:22:34.274481   12504 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki

	I1003 18:22:34.274485   12504 node_conditions.go:123] node cpu capacity is 2

	I1003 18:22:34.274489   12504 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki

	I1003 18:22:34.274493   12504 node_conditions.go:123] node cpu capacity is 2

	I1003 18:22:34.274496   12504 node_conditions.go:105] duration metric: took 188.717951ms to run NodePressure ...

	I1003 18:22:34.274503   12504 start.go:228] waiting for startup goroutines ...

	I1003 18:22:34.274521   12504 start.go:242] writing updated cluster config ...

	I1003 18:22:34.275260   12504 config.go:182] Loaded profile config "multinode-528000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 18:22:34.275319   12504 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/config.json ...

	I1003 18:22:34.319252   12504 out.go:177] * Starting worker node multinode-528000-m03 in cluster multinode-528000

	I1003 18:22:34.339940   12504 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime docker

	I1003 18:22:34.340024   12504 cache.go:57] Caching tarball of preloaded images

	I1003 18:22:34.340190   12504 preload.go:174] Found /Users/jenkins/minikube-integration/17348-9809/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I1003 18:22:34.340208   12504 cache.go:60] Finished verifying existence of preloaded tar for  v1.28.2 on docker

	I1003 18:22:34.340328   12504 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/config.json ...

	I1003 18:22:34.341486   12504 start.go:365] acquiring machines lock for multinode-528000-m03: {Name:mk592c6e7c5aa7c823729561bf878fc0544d84d2 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1003 18:22:34.341580   12504 start.go:369] acquired machines lock for "multinode-528000-m03" in 70.293µs

	I1003 18:22:34.341604   12504 start.go:96] Skipping create...Using existing machine configuration

	I1003 18:22:34.341613   12504 fix.go:54] fixHost starting: m03

	I1003 18:22:34.342010   12504 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I1003 18:22:34.342044   12504 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I1003 18:22:34.350841   12504 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59285

	I1003 18:22:34.351207   12504 main.go:141] libmachine: () Calling .GetVersion

	I1003 18:22:34.351555   12504 main.go:141] libmachine: Using API Version  1

	I1003 18:22:34.351566   12504 main.go:141] libmachine: () Calling .SetConfigRaw

	I1003 18:22:34.351807   12504 main.go:141] libmachine: () Calling .GetMachineName

	I1003 18:22:34.351920   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .DriverName

	I1003 18:22:34.352008   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetState

	I1003 18:22:34.352091   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I1003 18:22:34.352175   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | hyperkit pid from json: 12468

	I1003 18:22:34.353114   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | hyperkit pid 12468 missing from process table

	I1003 18:22:34.353164   12504 fix.go:102] recreateIfNeeded on multinode-528000-m03: state=Stopped err=<nil>

	I1003 18:22:34.353183   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .DriverName

	W1003 18:22:34.353264   12504 fix.go:128] unexpected machine state, will restart: <nil>

	I1003 18:22:34.374225   12504 out.go:177] * Restarting existing hyperkit VM for "multinode-528000-m03" ...

	I1003 18:22:34.417944   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .Start

	I1003 18:22:34.418110   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I1003 18:22:34.418137   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/hyperkit.pid

	I1003 18:22:34.418186   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | Using UUID 0d2b803c-6254-11ee-90e2-149d997cd0f1

	I1003 18:22:34.436446   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | Generated MAC f2:fa:7b:e9:10:aa

	I1003 18:22:34.436517   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | Starting with cmdline: loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-528000

	I1003 18:22:34.436705   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 DEBUG: hyperkit: Start &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"0d2b803c-6254-11ee-90e2-149d997cd0f1", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc000096450)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/bzimage", Initrd:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:""

, process:(*os.Process)(nil)}

	I1003 18:22:34.436763   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 DEBUG: hyperkit: check &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"0d2b803c-6254-11ee-90e2-149d997cd0f1", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc000096450)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/bzimage", Initrd:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:""

, process:(*os.Process)(nil)}

	I1003 18:22:34.436822   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 DEBUG: hyperkit: Arguments: []string{"-A", "-u", "-F", "/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/hyperkit.pid", "-c", "2", "-m", "2200M", "-s", "0:0,hostbridge", "-s", "31,lpc", "-s", "1:0,virtio-net", "-U", "0d2b803c-6254-11ee-90e2-149d997cd0f1", "-s", "2:0,virtio-blk,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/multinode-528000-m03.rawdisk", "-s", "3,ahci-cd,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/boot2docker.iso", "-s", "4,virtio-rnd", "-l", "com1,autopty=/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/tty,log=/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/console-ring", "-f", "kexec,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/bzimage,/Users/j

enkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-528000"}

	I1003 18:22:34.436880   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 DEBUG: hyperkit: CmdLine: "/usr/local/bin/hyperkit -A -u -F /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/hyperkit.pid -c 2 -m 2200M -s 0:0,hostbridge -s 31,lpc -s 1:0,virtio-net -U 0d2b803c-6254-11ee-90e2-149d997cd0f1 -s 2:0,virtio-blk,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/multinode-528000-m03.rawdisk -s 3,ahci-cd,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/boot2docker.iso -s 4,virtio-rnd -l com1,autopty=/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/tty,log=/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/console-ring -f kexec,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/bzimage,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/mult

inode-528000-m03/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-528000"

	I1003 18:22:34.436900   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 DEBUG: hyperkit: Redirecting stdout/stderr to logger

	I1003 18:22:34.438454   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 DEBUG: hyperkit: Pid is 12545

	I1003 18:22:34.438897   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | Attempt 0

	I1003 18:22:34.438912   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I1003 18:22:34.439017   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | hyperkit pid from json: 12545

	I1003 18:22:34.441458   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | Searching for f2:fa:7b:e9:10:aa in /var/db/dhcpd_leases ...

	I1003 18:22:34.441579   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | Found 58 entries in /var/db/dhcpd_leases!

	I1003 18:22:34.441602   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.168.89.42 HWAddress:7a:7f:34:e0:d9:d0 ID:1,7a:7f:34:e0:d9:d0 Lease:0x651e0faf}

	I1003 18:22:34.441632   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.168.89.41 HWAddress:76:a6:64:b1:fb:af ID:1,76:a6:64:b1:fb:af Lease:0x651e0f7a}

	I1003 18:22:34.441642   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetConfigRaw

	I1003 18:22:34.441650   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.168.89.43 HWAddress:f2:fa:7b:e9:10:aa ID:1,f2:fa:7b:e9:10:aa Lease:0x651cbdf1}

	I1003 18:22:34.441703   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | Found match: f2:fa:7b:e9:10:aa

	I1003 18:22:34.441717   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | IP: 192.168.89.43

	I1003 18:22:34.442446   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetIP

	I1003 18:22:34.442631   12504 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/config.json ...

	I1003 18:22:34.443008   12504 machine.go:88] provisioning docker machine ...

	I1003 18:22:34.443019   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .DriverName

	I1003 18:22:34.443170   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetMachineName

	I1003 18:22:34.443274   12504 buildroot.go:166] provisioning hostname "multinode-528000-m03"

	I1003 18:22:34.443286   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetMachineName

	I1003 18:22:34.443404   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHHostname

	I1003 18:22:34.443516   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHPort

	I1003 18:22:34.443604   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:34.443708   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:34.443801   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHUsername

	I1003 18:22:34.443936   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:22:34.444260   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.43 22 <nil> <nil>}

	I1003 18:22:34.444289   12504 main.go:141] libmachine: About to run SSH command:

	sudo hostname multinode-528000-m03 && echo "multinode-528000-m03" | sudo tee /etc/hostname

	I1003 18:22:34.446835   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: Using fd 5 for I/O notifications

	I1003 18:22:34.455719   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/boot2docker.iso: fcntl(F_PUNCHHOLE) Operation not permitted: block device will not support TRIM/DISCARD

	I1003 18:22:34.456598   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0

	I1003 18:22:34.456614   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0

	I1003 18:22:34.456622   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0

	I1003 18:22:34.456628   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0

	I1003 18:22:34.828311   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 0

	I1003 18:22:34.828327   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 0

	I1003 18:22:34.932438   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0

	I1003 18:22:34.932466   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0

	I1003 18:22:34.932479   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0

	I1003 18:22:34.932491   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0

	I1003 18:22:34.933309   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 1

	I1003 18:22:34.933328   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 1

	I1003 18:22:39.877790   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:39 INFO : hyperkit: stderr: rdmsr to register 0x64d on vcpu 1

	I1003 18:22:39.877958   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:39 INFO : hyperkit: stderr: rdmsr to register 0x64e on vcpu 1

	I1003 18:22:39.877987   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:39 INFO : hyperkit: stderr: rdmsr to register 0x34 on vcpu 1

	I1003 18:22:45.534665   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-528000-m03

	I1003 18:22:45.534680   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHHostname

	I1003 18:22:45.534820   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHPort

	I1003 18:22:45.534904   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:45.534987   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:45.535074   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHUsername

	I1003 18:22:45.535197   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:22:45.535482   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.43 22 <nil> <nil>}

	I1003 18:22:45.535495   12504 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\smultinode-528000-m03' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 multinode-528000-m03/g' /etc/hosts;

				else 

					echo '127.0.1.1 multinode-528000-m03' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1003 18:22:45.618997   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1003 18:22:45.619013   12504 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/17348-9809/.minikube CaCertPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/17348-9809/.minikube}

	I1003 18:22:45.619026   12504 buildroot.go:174] setting up certificates

	I1003 18:22:45.619036   12504 provision.go:83] configureAuth start

	I1003 18:22:45.619042   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetMachineName

	I1003 18:22:45.619187   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetIP

	I1003 18:22:45.619278   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHHostname

	I1003 18:22:45.619350   12504 provision.go:138] copyHostCerts

	I1003 18:22:45.619380   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/key.pem -> /Users/jenkins/minikube-integration/17348-9809/.minikube/key.pem

	I1003 18:22:45.619429   12504 exec_runner.go:144] found /Users/jenkins/minikube-integration/17348-9809/.minikube/key.pem, removing ...

	I1003 18:22:45.619435   12504 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17348-9809/.minikube/key.pem

	I1003 18:22:45.619563   12504 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/17348-9809/.minikube/key.pem (1679 bytes)

	I1003 18:22:45.619772   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem -> /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.pem

	I1003 18:22:45.619800   12504 exec_runner.go:144] found /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.pem, removing ...

	I1003 18:22:45.619805   12504 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.pem

	I1003 18:22:45.619869   12504 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.pem (1082 bytes)

	I1003 18:22:45.620014   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/cert.pem -> /Users/jenkins/minikube-integration/17348-9809/.minikube/cert.pem

	I1003 18:22:45.620043   12504 exec_runner.go:144] found /Users/jenkins/minikube-integration/17348-9809/.minikube/cert.pem, removing ...

	I1003 18:22:45.620048   12504 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17348-9809/.minikube/cert.pem

	I1003 18:22:45.620111   12504 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/17348-9809/.minikube/cert.pem (1123 bytes)

	I1003 18:22:45.620256   12504 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca-key.pem org=jenkins.multinode-528000-m03 san=[192.168.89.43 192.168.89.43 localhost 127.0.0.1 minikube multinode-528000-m03]

	I1003 18:22:45.772720   12504 provision.go:172] copyRemoteCerts

	I1003 18:22:45.772797   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1003 18:22:45.772811   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHHostname

	I1003 18:22:45.773008   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHPort

	I1003 18:22:45.773154   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:45.773328   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHUsername

	I1003 18:22:45.773478   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.43 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/id_rsa Username:docker}

	I1003 18:22:45.818262   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server.pem -> /etc/docker/server.pem

	I1003 18:22:45.818329   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server.pem --> /etc/docker/server.pem (1237 bytes)

	I1003 18:22:45.833995   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I1003 18:22:45.834060   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I1003 18:22:45.849244   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I1003 18:22:45.849294   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1003 18:22:45.865069   12504 provision.go:86] duration metric: configureAuth took 246.02493ms

	I1003 18:22:45.865082   12504 buildroot.go:189] setting minikube options for container-runtime

	I1003 18:22:45.865240   12504 config.go:182] Loaded profile config "multinode-528000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 18:22:45.865253   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .DriverName

	I1003 18:22:45.865433   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHHostname

	I1003 18:22:45.865555   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHPort

	I1003 18:22:45.865635   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:45.865729   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:45.865808   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHUsername

	I1003 18:22:45.865909   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:22:45.866148   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.43 22 <nil> <nil>}

	I1003 18:22:45.866156   12504 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1003 18:22:45.941993   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I1003 18:22:45.942005   12504 buildroot.go:70] root file system type: tmpfs

	I1003 18:22:45.942084   12504 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I1003 18:22:45.942095   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHHostname

	I1003 18:22:45.942227   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHPort

	I1003 18:22:45.942327   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:45.942407   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:45.942502   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHUsername

	I1003 18:22:45.942643   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:22:45.942900   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.43 22 <nil> <nil>}

	I1003 18:22:45.942970   12504 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	Environment="NO_PROXY=192.168.89.41"

	Environment="NO_PROXY=192.168.89.41,192.168.89.42"

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1003 18:22:46.027483   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	Environment=NO_PROXY=192.168.89.41

	Environment=NO_PROXY=192.168.89.41,192.168.89.42

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I1003 18:22:46.027503   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHHostname

	I1003 18:22:46.027638   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHPort

	I1003 18:22:46.027726   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:46.027818   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:46.027900   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHUsername

	I1003 18:22:46.028026   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:22:46.028285   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.43 22 <nil> <nil>}

	I1003 18:22:46.028298   12504 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1003 18:22:46.588021   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I1003 18:22:46.588050   12504 machine.go:91] provisioned docker machine in 12.14488497s

	I1003 18:22:46.588057   12504 start.go:300] post-start starting for "multinode-528000-m03" (driver="hyperkit")

	I1003 18:22:46.588084   12504 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1003 18:22:46.588096   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .DriverName

	I1003 18:22:46.588403   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1003 18:22:46.588432   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHHostname

	I1003 18:22:46.588613   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHPort

	I1003 18:22:46.588799   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:46.588934   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHUsername

	I1003 18:22:46.589065   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.43 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/id_rsa Username:docker}

	I1003 18:22:46.631718   12504 ssh_runner.go:195] Run: cat /etc/os-release

	I1003 18:22:46.634422   12504 command_runner.go:130] > NAME=Buildroot

	I1003 18:22:46.634435   12504 command_runner.go:130] > VERSION=2021.02.12-1-gb090841-dirty

	I1003 18:22:46.634441   12504 command_runner.go:130] > ID=buildroot

	I1003 18:22:46.634447   12504 command_runner.go:130] > VERSION_ID=2021.02.12

	I1003 18:22:46.634454   12504 command_runner.go:130] > PRETTY_NAME="Buildroot 2021.02.12"

	I1003 18:22:46.634552   12504 info.go:137] Remote host: Buildroot 2021.02.12

	I1003 18:22:46.634562   12504 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17348-9809/.minikube/addons for local assets ...

	I1003 18:22:46.634638   12504 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17348-9809/.minikube/files for local assets ...

	I1003 18:22:46.634770   12504 filesync.go:149] local asset: /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem -> 102692.pem in /etc/ssl/certs

	I1003 18:22:46.634779   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem -> /etc/ssl/certs/102692.pem

	I1003 18:22:46.634947   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1003 18:22:46.641198   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem --> /etc/ssl/certs/102692.pem (1708 bytes)

	I1003 18:22:46.656802   12504 start.go:303] post-start completed in 68.737316ms

	I1003 18:22:46.656813   12504 fix.go:56] fixHost completed within 12.315050535s

	I1003 18:22:46.656829   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHHostname

	I1003 18:22:46.656954   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHPort

	I1003 18:22:46.657042   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:46.657114   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:46.657189   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHUsername

	I1003 18:22:46.657298   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:22:46.657554   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.43 22 <nil> <nil>}

	I1003 18:22:46.657562   12504 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I1003 18:22:46.733217   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: 1696382566.907054958

	I1003 18:22:46.733232   12504 fix.go:206] guest clock: 1696382566.907054958

	I1003 18:22:46.733238   12504 fix.go:219] Guest: 2023-10-03 18:22:46.907054958 -0700 PDT Remote: 2023-10-03 18:22:46.656819 -0700 PDT m=+116.667538830 (delta=250.235958ms)

	I1003 18:22:46.733250   12504 fix.go:190] guest clock delta is within tolerance: 250.235958ms

	I1003 18:22:46.733254   12504 start.go:83] releasing machines lock for "multinode-528000-m03", held for 12.391514529s

	I1003 18:22:46.733271   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .DriverName

	I1003 18:22:46.733402   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetIP

	I1003 18:22:46.771942   12504 out.go:177] * Found network options:

	I1003 18:22:46.830764   12504 out.go:177]   - NO_PROXY=192.168.89.41,192.168.89.42

	W1003 18:22:46.852924   12504 proxy.go:119] fail to check proxy env: Error ip not in block

	W1003 18:22:46.852951   12504 proxy.go:119] fail to check proxy env: Error ip not in block

	I1003 18:22:46.852970   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .DriverName

	I1003 18:22:46.853747   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .DriverName

	I1003 18:22:46.853962   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .DriverName

	I1003 18:22:46.854071   12504 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I1003 18:22:46.854116   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHHostname

	W1003 18:22:46.854189   12504 proxy.go:119] fail to check proxy env: Error ip not in block

	W1003 18:22:46.854219   12504 proxy.go:119] fail to check proxy env: Error ip not in block

	I1003 18:22:46.854307   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHPort

	I1003 18:22:46.854309   12504 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	I1003 18:22:46.854332   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHHostname

	I1003 18:22:46.854529   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:46.854570   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHPort

	I1003 18:22:46.854740   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:46.854792   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHUsername

	I1003 18:22:46.854971   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.43 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/id_rsa Username:docker}

	I1003 18:22:46.855081   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHUsername

	I1003 18:22:46.855213   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.43 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/id_rsa Username:docker}

	I1003 18:22:46.896689   12504 command_runner.go:130] ! stat: cannot statx '/etc/cni/net.d/*loopback.conf*': No such file or directory

	W1003 18:22:46.896882   12504 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I1003 18:22:46.896937   12504 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1003 18:22:46.948860   12504 command_runner.go:130] > <a href="https://github.com/kubernetes/registry.k8s.io">Temporary Redirect</a>.

	I1003 18:22:46.948986   12504 command_runner.go:139] > /etc/cni/net.d/87-podman-bridge.conflist, 

	I1003 18:22:46.949013   12504 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I1003 18:22:46.949024   12504 start.go:469] detecting cgroup driver to use...

	I1003 18:22:46.949146   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1003 18:22:46.961630   12504 command_runner.go:130] > runtime-endpoint: unix:///run/containerd/containerd.sock

	I1003 18:22:46.962060   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I1003 18:22:46.968515   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I1003 18:22:46.974992   12504 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...

	I1003 18:22:46.975035   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I1003 18:22:46.981378   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1003 18:22:46.987739   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I1003 18:22:46.994215   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1003 18:22:47.000611   12504 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1003 18:22:47.007413   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I1003 18:22:47.014702   12504 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1003 18:22:47.021051   12504 command_runner.go:130] > net.bridge.bridge-nf-call-iptables = 1

	I1003 18:22:47.021201   12504 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1003 18:22:47.027286   12504 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 18:22:47.112723   12504 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I1003 18:22:47.125103   12504 start.go:469] detecting cgroup driver to use...

	I1003 18:22:47.125166   12504 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1003 18:22:47.134359   12504 command_runner.go:130] > # /usr/lib/systemd/system/docker.service

	I1003 18:22:47.134960   12504 command_runner.go:130] > [Unit]

	I1003 18:22:47.134969   12504 command_runner.go:130] > Description=Docker Application Container Engine

	I1003 18:22:47.134975   12504 command_runner.go:130] > Documentation=https://docs.docker.com

	I1003 18:22:47.134980   12504 command_runner.go:130] > After=network.target  minikube-automount.service docker.socket

	I1003 18:22:47.134985   12504 command_runner.go:130] > Requires= minikube-automount.service docker.socket 

	I1003 18:22:47.134992   12504 command_runner.go:130] > StartLimitBurst=3

	I1003 18:22:47.134997   12504 command_runner.go:130] > StartLimitIntervalSec=60

	I1003 18:22:47.135001   12504 command_runner.go:130] > [Service]

	I1003 18:22:47.135004   12504 command_runner.go:130] > Type=notify

	I1003 18:22:47.135020   12504 command_runner.go:130] > Restart=on-failure

	I1003 18:22:47.135027   12504 command_runner.go:130] > Environment=NO_PROXY=192.168.89.41

	I1003 18:22:47.135037   12504 command_runner.go:130] > Environment=NO_PROXY=192.168.89.41,192.168.89.42

	I1003 18:22:47.135045   12504 command_runner.go:130] > # This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	I1003 18:22:47.135055   12504 command_runner.go:130] > # The base configuration already specifies an 'ExecStart=...' command. The first directive

	I1003 18:22:47.135062   12504 command_runner.go:130] > # here is to clear out that command inherited from the base configuration. Without this,

	I1003 18:22:47.135069   12504 command_runner.go:130] > # the command from the base configuration and the command specified here are treated as

	I1003 18:22:47.135075   12504 command_runner.go:130] > # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	I1003 18:22:47.135081   12504 command_runner.go:130] > # will catch this invalid input and refuse to start the service with an error like:

	I1003 18:22:47.135090   12504 command_runner.go:130] > #  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	I1003 18:22:47.135096   12504 command_runner.go:130] > # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	I1003 18:22:47.135102   12504 command_runner.go:130] > # container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	I1003 18:22:47.135106   12504 command_runner.go:130] > ExecStart=

	I1003 18:22:47.135118   12504 command_runner.go:130] > ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	I1003 18:22:47.135126   12504 command_runner.go:130] > ExecReload=/bin/kill -s HUP $MAINPID

	I1003 18:22:47.135135   12504 command_runner.go:130] > # Having non-zero Limit*s causes performance problems due to accounting overhead

	I1003 18:22:47.135142   12504 command_runner.go:130] > # in the kernel. We recommend using cgroups to do container-local accounting.

	I1003 18:22:47.135147   12504 command_runner.go:130] > LimitNOFILE=infinity

	I1003 18:22:47.135154   12504 command_runner.go:130] > LimitNPROC=infinity

	I1003 18:22:47.135159   12504 command_runner.go:130] > LimitCORE=infinity

	I1003 18:22:47.135166   12504 command_runner.go:130] > # Uncomment TasksMax if your systemd version supports it.

	I1003 18:22:47.135171   12504 command_runner.go:130] > # Only systemd 226 and above support this version.

	I1003 18:22:47.135175   12504 command_runner.go:130] > TasksMax=infinity

	I1003 18:22:47.135179   12504 command_runner.go:130] > TimeoutStartSec=0

	I1003 18:22:47.135185   12504 command_runner.go:130] > # set delegate yes so that systemd does not reset the cgroups of docker containers

	I1003 18:22:47.135189   12504 command_runner.go:130] > Delegate=yes

	I1003 18:22:47.135202   12504 command_runner.go:130] > # kill only the docker process, not all processes in the cgroup

	I1003 18:22:47.135208   12504 command_runner.go:130] > KillMode=process

	I1003 18:22:47.135213   12504 command_runner.go:130] > [Install]

	I1003 18:22:47.135217   12504 command_runner.go:130] > WantedBy=multi-user.target

	I1003 18:22:47.135357   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1003 18:22:47.145606   12504 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I1003 18:22:47.161133   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1003 18:22:47.170336   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1003 18:22:47.179241   12504 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I1003 18:22:47.203508   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1003 18:22:47.212052   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1003 18:22:47.223785   12504 command_runner.go:130] > runtime-endpoint: unix:///var/run/cri-dockerd.sock

	I1003 18:22:47.224081   12504 ssh_runner.go:195] Run: which cri-dockerd

	I1003 18:22:47.226307   12504 command_runner.go:130] > /usr/bin/cri-dockerd

	I1003 18:22:47.226477   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I1003 18:22:47.232766   12504 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I1003 18:22:47.244440   12504 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I1003 18:22:47.334098   12504 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I1003 18:22:47.433045   12504 docker.go:554] configuring docker to use "cgroupfs" as cgroup driver...

	I1003 18:22:47.433092   12504 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I1003 18:22:47.445115   12504 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 18:22:47.530747   12504 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1003 18:22:47.819138   12504 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I1003 18:22:47.902767   12504 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I1003 18:22:47.995326   12504 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I1003 18:22:48.087657   12504 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 18:22:48.189878   12504 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I1003 18:22:48.201358   12504 command_runner.go:130] ! Job failed. See "journalctl -xe" for details.

	I1003 18:22:48.224931   12504 out.go:177] 

	W1003 18:22:48.245989   12504 out.go:239] X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart cri-docker.socket: Process exited with status 1

	stdout:

	stderr:

	Job failed. See "journalctl -xe" for details.

	X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart cri-docker.socket: Process exited with status 1

	stdout:

	stderr:

	Job failed. See "journalctl -xe" for details.

	W1003 18:22:48.246003   12504 out.go:239] * 

	* 

	W1003 18:22:48.246581   12504 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I1003 18:22:48.312086   12504 out.go:177] 

** /stderr **

multinode_test.go:297: failed to run minikube start. args "out/minikube-darwin-amd64 node list -p multinode-528000" : exit status 90

multinode_test.go:300: (dbg) Run:  out/minikube-darwin-amd64 node list -p multinode-528000

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-528000 -n multinode-528000

helpers_test.go:244: <<< TestMultiNode/serial/RestartKeepsNodes FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestMultiNode/serial/RestartKeepsNodes]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-528000 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-darwin-amd64 -p multinode-528000 logs -n 25: (2.946642202s)

helpers_test.go:252: TestMultiNode/serial/RestartKeepsNodes logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |---------|-----------------------------------------------------------------------------------------------------------------------------|------------------|---------|---------|---------------------|---------------------|

	| Command |                                                            Args                                                             |     Profile      |  User   | Version |     Start Time      |      End Time       |

	|---------|-----------------------------------------------------------------------------------------------------------------------------|------------------|---------|---------|---------------------|---------------------|

	| ssh     | multinode-528000 ssh -n                                                                                                     | multinode-528000 | jenkins | v1.31.2 | 03 Oct 23 18:19 PDT | 03 Oct 23 18:19 PDT |

	|         | multinode-528000-m02 sudo cat                                                                                               |                  |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                                                                    |                  |         |         |                     |                     |

	| cp      | multinode-528000 cp multinode-528000-m02:/home/docker/cp-test.txt                                                           | multinode-528000 | jenkins | v1.31.2 | 03 Oct 23 18:19 PDT | 03 Oct 23 18:19 PDT |

	|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestMultiNodeserialCopyFile1952490312/001/cp-test_multinode-528000-m02.txt |                  |         |         |                     |                     |

	| ssh     | multinode-528000 ssh -n                                                                                                     | multinode-528000 | jenkins | v1.31.2 | 03 Oct 23 18:19 PDT | 03 Oct 23 18:19 PDT |

	|         | multinode-528000-m02 sudo cat                                                                                               |                  |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                                                                    |                  |         |         |                     |                     |

	| cp      | multinode-528000 cp multinode-528000-m02:/home/docker/cp-test.txt                                                           | multinode-528000 | jenkins | v1.31.2 | 03 Oct 23 18:19 PDT | 03 Oct 23 18:19 PDT |

	|         | multinode-528000:/home/docker/cp-test_multinode-528000-m02_multinode-528000.txt                                             |                  |         |         |                     |                     |

	| ssh     | multinode-528000 ssh -n                                                                                                     | multinode-528000 | jenkins | v1.31.2 | 03 Oct 23 18:19 PDT | 03 Oct 23 18:19 PDT |

	|         | multinode-528000-m02 sudo cat                                                                                               |                  |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                                                                    |                  |         |         |                     |                     |

	| ssh     | multinode-528000 ssh -n multinode-528000 sudo cat                                                                           | multinode-528000 | jenkins | v1.31.2 | 03 Oct 23 18:19 PDT | 03 Oct 23 18:19 PDT |

	|         | /home/docker/cp-test_multinode-528000-m02_multinode-528000.txt                                                              |                  |         |         |                     |                     |

	| cp      | multinode-528000 cp multinode-528000-m02:/home/docker/cp-test.txt                                                           | multinode-528000 | jenkins | v1.31.2 | 03 Oct 23 18:19 PDT | 03 Oct 23 18:19 PDT |

	|         | multinode-528000-m03:/home/docker/cp-test_multinode-528000-m02_multinode-528000-m03.txt                                     |                  |         |         |                     |                     |

	| ssh     | multinode-528000 ssh -n                                                                                                     | multinode-528000 | jenkins | v1.31.2 | 03 Oct 23 18:19 PDT | 03 Oct 23 18:19 PDT |

	|         | multinode-528000-m02 sudo cat                                                                                               |                  |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                                                                    |                  |         |         |                     |                     |

	| ssh     | multinode-528000 ssh -n multinode-528000-m03 sudo cat                                                                       | multinode-528000 | jenkins | v1.31.2 | 03 Oct 23 18:19 PDT | 03 Oct 23 18:19 PDT |

	|         | /home/docker/cp-test_multinode-528000-m02_multinode-528000-m03.txt                                                          |                  |         |         |                     |                     |

	| cp      | multinode-528000 cp testdata/cp-test.txt                                                                                    | multinode-528000 | jenkins | v1.31.2 | 03 Oct 23 18:19 PDT | 03 Oct 23 18:19 PDT |

	|         | multinode-528000-m03:/home/docker/cp-test.txt                                                                               |                  |         |         |                     |                     |

	| ssh     | multinode-528000 ssh -n                                                                                                     | multinode-528000 | jenkins | v1.31.2 | 03 Oct 23 18:19 PDT | 03 Oct 23 18:19 PDT |

	|         | multinode-528000-m03 sudo cat                                                                                               |                  |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                                                                    |                  |         |         |                     |                     |

	| cp      | multinode-528000 cp multinode-528000-m03:/home/docker/cp-test.txt                                                           | multinode-528000 | jenkins | v1.31.2 | 03 Oct 23 18:20 PDT | 03 Oct 23 18:20 PDT |

	|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestMultiNodeserialCopyFile1952490312/001/cp-test_multinode-528000-m03.txt |                  |         |         |                     |                     |

	| ssh     | multinode-528000 ssh -n                                                                                                     | multinode-528000 | jenkins | v1.31.2 | 03 Oct 23 18:20 PDT | 03 Oct 23 18:20 PDT |

	|         | multinode-528000-m03 sudo cat                                                                                               |                  |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                                                                    |                  |         |         |                     |                     |

	| cp      | multinode-528000 cp multinode-528000-m03:/home/docker/cp-test.txt                                                           | multinode-528000 | jenkins | v1.31.2 | 03 Oct 23 18:20 PDT | 03 Oct 23 18:20 PDT |

	|         | multinode-528000:/home/docker/cp-test_multinode-528000-m03_multinode-528000.txt                                             |                  |         |         |                     |                     |

	| ssh     | multinode-528000 ssh -n                                                                                                     | multinode-528000 | jenkins | v1.31.2 | 03 Oct 23 18:20 PDT | 03 Oct 23 18:20 PDT |

	|         | multinode-528000-m03 sudo cat                                                                                               |                  |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                                                                    |                  |         |         |                     |                     |

	| ssh     | multinode-528000 ssh -n multinode-528000 sudo cat                                                                           | multinode-528000 | jenkins | v1.31.2 | 03 Oct 23 18:20 PDT | 03 Oct 23 18:20 PDT |

	|         | /home/docker/cp-test_multinode-528000-m03_multinode-528000.txt                                                              |                  |         |         |                     |                     |

	| cp      | multinode-528000 cp multinode-528000-m03:/home/docker/cp-test.txt                                                           | multinode-528000 | jenkins | v1.31.2 | 03 Oct 23 18:20 PDT | 03 Oct 23 18:20 PDT |

	|         | multinode-528000-m02:/home/docker/cp-test_multinode-528000-m03_multinode-528000-m02.txt                                     |                  |         |         |                     |                     |

	| ssh     | multinode-528000 ssh -n                                                                                                     | multinode-528000 | jenkins | v1.31.2 | 03 Oct 23 18:20 PDT | 03 Oct 23 18:20 PDT |

	|         | multinode-528000-m03 sudo cat                                                                                               |                  |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                                                                    |                  |         |         |                     |                     |

	| ssh     | multinode-528000 ssh -n multinode-528000-m02 sudo cat                                                                       | multinode-528000 | jenkins | v1.31.2 | 03 Oct 23 18:20 PDT | 03 Oct 23 18:20 PDT |

	|         | /home/docker/cp-test_multinode-528000-m03_multinode-528000-m02.txt                                                          |                  |         |         |                     |                     |

	| node    | multinode-528000 node stop m03                                                                                              | multinode-528000 | jenkins | v1.31.2 | 03 Oct 23 18:20 PDT | 03 Oct 23 18:20 PDT |

	| node    | multinode-528000 node start                                                                                                 | multinode-528000 | jenkins | v1.31.2 | 03 Oct 23 18:20 PDT | 03 Oct 23 18:20 PDT |

	|         | m03 --alsologtostderr                                                                                                       |                  |         |         |                     |                     |

	| node    | list -p multinode-528000                                                                                                    | multinode-528000 | jenkins | v1.31.2 | 03 Oct 23 18:20 PDT |                     |

	| stop    | -p multinode-528000                                                                                                         | multinode-528000 | jenkins | v1.31.2 | 03 Oct 23 18:20 PDT | 03 Oct 23 18:20 PDT |

	| start   | -p multinode-528000                                                                                                         | multinode-528000 | jenkins | v1.31.2 | 03 Oct 23 18:20 PDT |                     |

	|         | --wait=true -v=8                                                                                                            |                  |         |         |                     |                     |

	|         | --alsologtostderr                                                                                                           |                  |         |         |                     |                     |

	| node    | list -p multinode-528000                                                                                                    | multinode-528000 | jenkins | v1.31.2 | 03 Oct 23 18:22 PDT |                     |

	|---------|-----------------------------------------------------------------------------------------------------------------------------|------------------|---------|---------|---------------------|---------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2023/10/03 18:20:50

	Running on machine: MacOS-Agent-1

	Binary: Built with gc go1.21.1 for darwin/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1003 18:20:50.019735   12504 out.go:296] Setting OutFile to fd 1 ...

	I1003 18:20:50.020034   12504 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1003 18:20:50.020039   12504 out.go:309] Setting ErrFile to fd 2...

	I1003 18:20:50.020043   12504 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1003 18:20:50.020231   12504 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17348-9809/.minikube/bin

	I1003 18:20:50.021622   12504 out.go:303] Setting JSON to false

	I1003 18:20:50.043387   12504 start.go:128] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":4818,"bootTime":1696377632,"procs":436,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.0","kernelVersion":"23.0.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}

	W1003 18:20:50.043484   12504 start.go:136] gopshost.Virtualization returned error: not implemented yet

	I1003 18:20:50.066088   12504 out.go:177] * [multinode-528000] minikube v1.31.2 on Darwin 14.0

	I1003 18:20:50.108829   12504 out.go:177]   - MINIKUBE_LOCATION=17348

	I1003 18:20:50.108933   12504 notify.go:220] Checking for updates...

	I1003 18:20:50.131137   12504 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17348-9809/kubeconfig

	I1003 18:20:50.153051   12504 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I1003 18:20:50.174768   12504 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1003 18:20:50.196984   12504 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17348-9809/.minikube

	I1003 18:20:50.218821   12504 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1003 18:20:50.240559   12504 config.go:182] Loaded profile config "multinode-528000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 18:20:50.240734   12504 driver.go:373] Setting default libvirt URI to qemu:///system

	I1003 18:20:50.241482   12504 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I1003 18:20:50.241581   12504 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I1003 18:20:50.251023   12504 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59232

	I1003 18:20:50.251802   12504 main.go:141] libmachine: () Calling .GetVersion

	I1003 18:20:50.252252   12504 main.go:141] libmachine: Using API Version  1

	I1003 18:20:50.252267   12504 main.go:141] libmachine: () Calling .SetConfigRaw

	I1003 18:20:50.252465   12504 main.go:141] libmachine: () Calling .GetMachineName

	I1003 18:20:50.252582   12504 main.go:141] libmachine: (multinode-528000) Calling .DriverName

	I1003 18:20:50.280788   12504 out.go:177] * Using the hyperkit driver based on existing profile

	I1003 18:20:50.322586   12504 start.go:298] selected driver: hyperkit

	I1003 18:20:50.322611   12504 start.go:902] validating driver "hyperkit" against &{Name:multinode-528000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696241247-17339@sha256:77c3e98870a99538e39ecb73a5e5230b746fa8c633c297c3d287ad4bba01a880 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernete

sConfig:{KubernetesVersion:v1.28.2 ClusterName:multinode-528000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.89.41 Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.89.42 Port:0 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:false Worker:true} {Name:m03 IP:192.168.89.43 Port:0 KubernetesVersion:v1.28.2 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false

inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMe

trics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I1003 18:20:50.322855   12504 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1003 18:20:50.323044   12504 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1003 18:20:50.323239   12504 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17348-9809/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin

	I1003 18:20:50.331534   12504 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.31.2

	I1003 18:20:50.335417   12504 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I1003 18:20:50.335435   12504 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good

	I1003 18:20:50.338018   12504 start_flags.go:923] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1003 18:20:50.338062   12504 cni.go:84] Creating CNI manager for ""

	I1003 18:20:50.338070   12504 cni.go:136] 3 nodes found, recommending kindnet

	I1003 18:20:50.338077   12504 start_flags.go:321] config:

	{Name:multinode-528000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696241247-17339@sha256:77c3e98870a99538e39ecb73a5e5230b746fa8c633c297c3d287ad4bba01a880 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.2 ClusterName:multinode-528000 Namespace:default

APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.89.41 Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.89.42 Port:0 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:false Worker:true} {Name:m03 IP:192.168.89.43 Port:0 KubernetesVersion:v1.28.2 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false i

stio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Static

IP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I1003 18:20:50.338294   12504 iso.go:125] acquiring lock: {Name:mk4d10f3b7d20b83c967d75071154a129aae7352 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1003 18:20:50.382755   12504 out.go:177] * Starting control plane node multinode-528000 in cluster multinode-528000

	I1003 18:20:50.403945   12504 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime docker

	I1003 18:20:50.404015   12504 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17348-9809/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-amd64.tar.lz4

	I1003 18:20:50.404041   12504 cache.go:57] Caching tarball of preloaded images

	I1003 18:20:50.404213   12504 preload.go:174] Found /Users/jenkins/minikube-integration/17348-9809/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I1003 18:20:50.404234   12504 cache.go:60] Finished verifying existence of preloaded tar for  v1.28.2 on docker

	I1003 18:20:50.404417   12504 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/config.json ...

	I1003 18:20:50.405398   12504 start.go:365] acquiring machines lock for multinode-528000: {Name:mk592c6e7c5aa7c823729561bf878fc0544d84d2 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1003 18:20:50.405507   12504 start.go:369] acquired machines lock for "multinode-528000" in 84.187µs

	I1003 18:20:50.405539   12504 start.go:96] Skipping create...Using existing machine configuration

	I1003 18:20:50.405552   12504 fix.go:54] fixHost starting: 

	I1003 18:20:50.405999   12504 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I1003 18:20:50.406042   12504 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I1003 18:20:50.414492   12504 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59234

	I1003 18:20:50.414850   12504 main.go:141] libmachine: () Calling .GetVersion

	I1003 18:20:50.415259   12504 main.go:141] libmachine: Using API Version  1

	I1003 18:20:50.415277   12504 main.go:141] libmachine: () Calling .SetConfigRaw

	I1003 18:20:50.415543   12504 main.go:141] libmachine: () Calling .GetMachineName

	I1003 18:20:50.415677   12504 main.go:141] libmachine: (multinode-528000) Calling .DriverName

	I1003 18:20:50.415788   12504 main.go:141] libmachine: (multinode-528000) Calling .GetState

	I1003 18:20:50.415889   12504 main.go:141] libmachine: (multinode-528000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I1003 18:20:50.415943   12504 main.go:141] libmachine: (multinode-528000) DBG | hyperkit pid from json: 12168

	I1003 18:20:50.416879   12504 main.go:141] libmachine: (multinode-528000) DBG | hyperkit pid 12168 missing from process table

	I1003 18:20:50.416910   12504 fix.go:102] recreateIfNeeded on multinode-528000: state=Stopped err=<nil>

	I1003 18:20:50.416929   12504 main.go:141] libmachine: (multinode-528000) Calling .DriverName

	W1003 18:20:50.417008   12504 fix.go:128] unexpected machine state, will restart: <nil>

	I1003 18:20:50.437941   12504 out.go:177] * Restarting existing hyperkit VM for "multinode-528000" ...

	I1003 18:20:50.479830   12504 main.go:141] libmachine: (multinode-528000) Calling .Start

	I1003 18:20:50.480158   12504 main.go:141] libmachine: (multinode-528000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I1003 18:20:50.480206   12504 main.go:141] libmachine: (multinode-528000) minikube might have been shutdown in an unclean way, the hyperkit pid file still exists: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/hyperkit.pid

	I1003 18:20:50.482009   12504 main.go:141] libmachine: (multinode-528000) DBG | hyperkit pid 12168 missing from process table

	I1003 18:20:50.482023   12504 main.go:141] libmachine: (multinode-528000) DBG | pid 12168 is in state "Stopped"

	I1003 18:20:50.482044   12504 main.go:141] libmachine: (multinode-528000) DBG | Removing stale pid file /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/hyperkit.pid...

	I1003 18:20:50.482215   12504 main.go:141] libmachine: (multinode-528000) DBG | Using UUID d3ae89d0-6253-11ee-8906-149d997cd0f1

	I1003 18:20:50.522410   12504 main.go:141] libmachine: (multinode-528000) DBG | Generated MAC 76:a6:64:b1:fb:af

	I1003 18:20:50.522448   12504 main.go:141] libmachine: (multinode-528000) DBG | Starting with cmdline: loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-528000

	I1003 18:20:50.522621   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 DEBUG: hyperkit: Start &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"d3ae89d0-6253-11ee-8906-149d997cd0f1", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc00044ce40)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/bzimage", Initrd:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:"", process:(*os.Proce

ss)(nil)}

	I1003 18:20:50.522670   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 DEBUG: hyperkit: check &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"d3ae89d0-6253-11ee-8906-149d997cd0f1", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc00044ce40)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/bzimage", Initrd:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:"", process:(*os.Proce

ss)(nil)}

	I1003 18:20:50.522735   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 DEBUG: hyperkit: Arguments: []string{"-A", "-u", "-F", "/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/hyperkit.pid", "-c", "2", "-m", "2200M", "-s", "0:0,hostbridge", "-s", "31,lpc", "-s", "1:0,virtio-net", "-U", "d3ae89d0-6253-11ee-8906-149d997cd0f1", "-s", "2:0,virtio-blk,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/multinode-528000.rawdisk", "-s", "3,ahci-cd,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/boot2docker.iso", "-s", "4,virtio-rnd", "-l", "com1,autopty=/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/tty,log=/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/console-ring", "-f", "kexec,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/bzimage,/Users/jenkins/minikube-integration/1734

8-9809/.minikube/machines/multinode-528000/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-528000"}

	I1003 18:20:50.522793   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 DEBUG: hyperkit: CmdLine: "/usr/local/bin/hyperkit -A -u -F /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/hyperkit.pid -c 2 -m 2200M -s 0:0,hostbridge -s 31,lpc -s 1:0,virtio-net -U d3ae89d0-6253-11ee-8906-149d997cd0f1 -s 2:0,virtio-blk,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/multinode-528000.rawdisk -s 3,ahci-cd,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/boot2docker.iso -s 4,virtio-rnd -l com1,autopty=/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/tty,log=/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/console-ring -f kexec,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/bzimage,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/initrd,earlyprintk=

serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-528000"

	I1003 18:20:50.522817   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 DEBUG: hyperkit: Redirecting stdout/stderr to logger

	I1003 18:20:50.524256   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 DEBUG: hyperkit: Pid is 12516

	I1003 18:20:50.524707   12504 main.go:141] libmachine: (multinode-528000) DBG | Attempt 0

	I1003 18:20:50.524726   12504 main.go:141] libmachine: (multinode-528000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I1003 18:20:50.524844   12504 main.go:141] libmachine: (multinode-528000) DBG | hyperkit pid from json: 12516

	I1003 18:20:50.526476   12504 main.go:141] libmachine: (multinode-528000) DBG | Searching for 76:a6:64:b1:fb:af in /var/db/dhcpd_leases ...

	I1003 18:20:50.526589   12504 main.go:141] libmachine: (multinode-528000) DBG | Found 58 entries in /var/db/dhcpd_leases!

	I1003 18:20:50.526620   12504 main.go:141] libmachine: (multinode-528000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.89.43 HWAddress:f2:fa:7b:e9:10:aa ID:1,f2:fa:7b:e9:10:aa Lease:0x651cbdf1}

	I1003 18:20:50.526660   12504 main.go:141] libmachine: (multinode-528000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.89.42 HWAddress:7a:7f:34:e0:d9:d0 ID:1,7a:7f:34:e0:d9:d0 Lease:0x651e0efe}

	I1003 18:20:50.526718   12504 main.go:141] libmachine: (multinode-528000) Calling .GetConfigRaw

	I1003 18:20:50.526733   12504 main.go:141] libmachine: (multinode-528000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.89.41 HWAddress:76:a6:64:b1:fb:af ID:1,76:a6:64:b1:fb:af Lease:0x651e0ec3}

	I1003 18:20:50.526749   12504 main.go:141] libmachine: (multinode-528000) DBG | Found match: 76:a6:64:b1:fb:af

	I1003 18:20:50.526768   12504 main.go:141] libmachine: (multinode-528000) DBG | IP: 192.168.89.41

	I1003 18:20:50.527526   12504 main.go:141] libmachine: (multinode-528000) Calling .GetIP

	I1003 18:20:50.527769   12504 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/config.json ...

	I1003 18:20:50.528212   12504 machine.go:88] provisioning docker machine ...

	I1003 18:20:50.528223   12504 main.go:141] libmachine: (multinode-528000) Calling .DriverName

	I1003 18:20:50.528329   12504 main.go:141] libmachine: (multinode-528000) Calling .GetMachineName

	I1003 18:20:50.528440   12504 buildroot.go:166] provisioning hostname "multinode-528000"

	I1003 18:20:50.528450   12504 main.go:141] libmachine: (multinode-528000) Calling .GetMachineName

	I1003 18:20:50.528559   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHHostname

	I1003 18:20:50.528656   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHPort

	I1003 18:20:50.528758   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:20:50.528846   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:20:50.528931   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHUsername

	I1003 18:20:50.529063   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:20:50.529384   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.41 22 <nil> <nil>}

	I1003 18:20:50.529393   12504 main.go:141] libmachine: About to run SSH command:

	sudo hostname multinode-528000 && echo "multinode-528000" | sudo tee /etc/hostname

	I1003 18:20:50.532147   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 INFO : hyperkit: stderr: Using fd 5 for I/O notifications

	I1003 18:20:50.552835   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 INFO : hyperkit: stderr: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/boot2docker.iso: fcntl(F_PUNCHHOLE) Operation not permitted: block device will not support TRIM/DISCARD

	I1003 18:20:50.553614   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0

	I1003 18:20:50.553642   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0

	I1003 18:20:50.553651   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0

	I1003 18:20:50.553663   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0

	I1003 18:20:50.920813   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 0

	I1003 18:20:50.920869   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:50 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 0

	I1003 18:20:51.024888   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:51 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0

	I1003 18:20:51.024910   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:51 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0

	I1003 18:20:51.024931   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:51 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0

	I1003 18:20:51.024949   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:51 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0

	I1003 18:20:51.025829   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:51 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 1

	I1003 18:20:51.025840   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:51 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 1

	I1003 18:20:55.910790   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:55 INFO : hyperkit: stderr: rdmsr to register 0x64d on vcpu 0

	I1003 18:20:55.910890   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:55 INFO : hyperkit: stderr: rdmsr to register 0x64e on vcpu 0

	I1003 18:20:55.910913   12504 main.go:141] libmachine: (multinode-528000) DBG | 2023/10/03 18:20:55 INFO : hyperkit: stderr: rdmsr to register 0x34 on vcpu 0

	I1003 18:21:01.620728   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-528000

	I1003 18:21:01.620747   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHHostname

	I1003 18:21:01.620926   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHPort

	I1003 18:21:01.621011   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:01.621104   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:01.621197   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHUsername

	I1003 18:21:01.621331   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:21:01.621595   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.41 22 <nil> <nil>}

	I1003 18:21:01.621610   12504 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\smultinode-528000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 multinode-528000/g' /etc/hosts;

				else 

					echo '127.0.1.1 multinode-528000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1003 18:21:01.700734   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1003 18:21:01.700753   12504 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/17348-9809/.minikube CaCertPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/17348-9809/.minikube}

	I1003 18:21:01.700768   12504 buildroot.go:174] setting up certificates

	I1003 18:21:01.700780   12504 provision.go:83] configureAuth start

	I1003 18:21:01.700787   12504 main.go:141] libmachine: (multinode-528000) Calling .GetMachineName

	I1003 18:21:01.700929   12504 main.go:141] libmachine: (multinode-528000) Calling .GetIP

	I1003 18:21:01.701022   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHHostname

	I1003 18:21:01.701123   12504 provision.go:138] copyHostCerts

	I1003 18:21:01.701156   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem -> /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.pem

	I1003 18:21:01.701210   12504 exec_runner.go:144] found /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.pem, removing ...

	I1003 18:21:01.701220   12504 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.pem

	I1003 18:21:01.701352   12504 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.pem (1082 bytes)

	I1003 18:21:01.701549   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/cert.pem -> /Users/jenkins/minikube-integration/17348-9809/.minikube/cert.pem

	I1003 18:21:01.701585   12504 exec_runner.go:144] found /Users/jenkins/minikube-integration/17348-9809/.minikube/cert.pem, removing ...

	I1003 18:21:01.701590   12504 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17348-9809/.minikube/cert.pem

	I1003 18:21:01.701660   12504 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/17348-9809/.minikube/cert.pem (1123 bytes)

	I1003 18:21:01.701864   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/key.pem -> /Users/jenkins/minikube-integration/17348-9809/.minikube/key.pem

	I1003 18:21:01.701898   12504 exec_runner.go:144] found /Users/jenkins/minikube-integration/17348-9809/.minikube/key.pem, removing ...

	I1003 18:21:01.701904   12504 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17348-9809/.minikube/key.pem

	I1003 18:21:01.701981   12504 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/17348-9809/.minikube/key.pem (1679 bytes)

	I1003 18:21:01.702160   12504 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca-key.pem org=jenkins.multinode-528000 san=[192.168.89.41 192.168.89.41 localhost 127.0.0.1 minikube multinode-528000]

	I1003 18:21:01.989613   12504 provision.go:172] copyRemoteCerts

	I1003 18:21:01.989669   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1003 18:21:01.989687   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHHostname

	I1003 18:21:01.989978   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHPort

	I1003 18:21:01.990199   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:01.990334   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHUsername

	I1003 18:21:01.990510   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.41 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/id_rsa Username:docker}

	I1003 18:21:02.036392   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server.pem -> /etc/docker/server.pem

	I1003 18:21:02.036465   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)

	I1003 18:21:02.052328   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I1003 18:21:02.052380   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I1003 18:21:02.068199   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I1003 18:21:02.068251   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1003 18:21:02.084199   12504 provision.go:86] duration metric: configureAuth took 383.394416ms

	I1003 18:21:02.084210   12504 buildroot.go:189] setting minikube options for container-runtime

	I1003 18:21:02.084372   12504 config.go:182] Loaded profile config "multinode-528000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 18:21:02.084405   12504 main.go:141] libmachine: (multinode-528000) Calling .DriverName

	I1003 18:21:02.084543   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHHostname

	I1003 18:21:02.084635   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHPort

	I1003 18:21:02.084724   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:02.084816   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:02.084900   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHUsername

	I1003 18:21:02.085015   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:21:02.085259   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.41 22 <nil> <nil>}

	I1003 18:21:02.085268   12504 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1003 18:21:02.160569   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I1003 18:21:02.160583   12504 buildroot.go:70] root file system type: tmpfs

	I1003 18:21:02.160661   12504 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I1003 18:21:02.160674   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHHostname

	I1003 18:21:02.160818   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHPort

	I1003 18:21:02.160928   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:02.161029   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:02.161124   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHUsername

	I1003 18:21:02.161253   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:21:02.161501   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.41 22 <nil> <nil>}

	I1003 18:21:02.161545   12504 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1003 18:21:02.246329   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I1003 18:21:02.246351   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHHostname

	I1003 18:21:02.246483   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHPort

	I1003 18:21:02.246582   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:02.246664   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:02.246770   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHUsername

	I1003 18:21:02.246890   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:21:02.247142   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.41 22 <nil> <nil>}

	I1003 18:21:02.247156   12504 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1003 18:21:02.855612   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I1003 18:21:02.855627   12504 machine.go:91] provisioned docker machine in 12.327246851s

	I1003 18:21:02.855638   12504 start.go:300] post-start starting for "multinode-528000" (driver="hyperkit")

	I1003 18:21:02.855648   12504 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1003 18:21:02.855660   12504 main.go:141] libmachine: (multinode-528000) Calling .DriverName

	I1003 18:21:02.855837   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1003 18:21:02.855849   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHHostname

	I1003 18:21:02.855938   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHPort

	I1003 18:21:02.856026   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:02.856116   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHUsername

	I1003 18:21:02.856206   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.41 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/id_rsa Username:docker}

	I1003 18:21:02.899315   12504 ssh_runner.go:195] Run: cat /etc/os-release

	I1003 18:21:02.901839   12504 command_runner.go:130] > NAME=Buildroot

	I1003 18:21:02.901850   12504 command_runner.go:130] > VERSION=2021.02.12-1-gb090841-dirty

	I1003 18:21:02.901858   12504 command_runner.go:130] > ID=buildroot

	I1003 18:21:02.901864   12504 command_runner.go:130] > VERSION_ID=2021.02.12

	I1003 18:21:02.901875   12504 command_runner.go:130] > PRETTY_NAME="Buildroot 2021.02.12"

	I1003 18:21:02.901945   12504 info.go:137] Remote host: Buildroot 2021.02.12

	I1003 18:21:02.901960   12504 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17348-9809/.minikube/addons for local assets ...

	I1003 18:21:02.902056   12504 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17348-9809/.minikube/files for local assets ...

	I1003 18:21:02.902212   12504 filesync.go:149] local asset: /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem -> 102692.pem in /etc/ssl/certs

	I1003 18:21:02.902219   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem -> /etc/ssl/certs/102692.pem

	I1003 18:21:02.902391   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1003 18:21:02.907946   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem --> /etc/ssl/certs/102692.pem (1708 bytes)

	I1003 18:21:02.923994   12504 start.go:303] post-start completed in 68.345552ms

	I1003 18:21:02.924008   12504 fix.go:56] fixHost completed within 12.518297955s

	I1003 18:21:02.924027   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHHostname

	I1003 18:21:02.924152   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHPort

	I1003 18:21:02.924239   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:02.924346   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:02.924427   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHUsername

	I1003 18:21:02.924545   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:21:02.924796   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.41 22 <nil> <nil>}

	I1003 18:21:02.924803   12504 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I1003 18:21:02.997984   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: 1696382463.169617211

	I1003 18:21:02.997995   12504 fix.go:206] guest clock: 1696382463.169617211

	I1003 18:21:02.998002   12504 fix.go:219] Guest: 2023-10-03 18:21:03.169617211 -0700 PDT Remote: 2023-10-03 18:21:02.924013 -0700 PDT m=+12.935887906 (delta=245.604211ms)

	I1003 18:21:02.998020   12504 fix.go:190] guest clock delta is within tolerance: 245.604211ms

	I1003 18:21:02.998024   12504 start.go:83] releasing machines lock for "multinode-528000", held for 12.59234322s

	I1003 18:21:02.998052   12504 main.go:141] libmachine: (multinode-528000) Calling .DriverName

	I1003 18:21:02.998194   12504 main.go:141] libmachine: (multinode-528000) Calling .GetIP

	I1003 18:21:02.998286   12504 main.go:141] libmachine: (multinode-528000) Calling .DriverName

	I1003 18:21:02.998589   12504 main.go:141] libmachine: (multinode-528000) Calling .DriverName

	I1003 18:21:02.998718   12504 main.go:141] libmachine: (multinode-528000) Calling .DriverName

	I1003 18:21:02.998786   12504 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I1003 18:21:02.998815   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHHostname

	I1003 18:21:02.998884   12504 ssh_runner.go:195] Run: cat /version.json

	I1003 18:21:02.998898   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHHostname

	I1003 18:21:02.998902   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHPort

	I1003 18:21:02.998998   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHPort

	I1003 18:21:02.999013   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:02.999084   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHUsername

	I1003 18:21:02.999111   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:21:02.999188   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.41 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/id_rsa Username:docker}

	I1003 18:21:02.999220   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHUsername

	I1003 18:21:02.999304   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.41 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/id_rsa Username:docker}

	I1003 18:21:03.039585   12504 command_runner.go:130] > {"iso_version": "v1.31.0-1695060926-17240", "kicbase_version": "v0.0.40-1694798187-17250", "minikube_version": "v1.31.2", "commit": "0402681e4770013826956f326b174c70611f3073"}

	I1003 18:21:03.039975   12504 ssh_runner.go:195] Run: systemctl --version

	I1003 18:21:03.086755   12504 command_runner.go:130] > <a href="https://github.com/kubernetes/registry.k8s.io">Temporary Redirect</a>.

	I1003 18:21:03.087729   12504 command_runner.go:130] > systemd 247 (247)

	I1003 18:21:03.087757   12504 command_runner.go:130] > -PAM -AUDIT -SELINUX -IMA -APPARMOR -SMACK -SYSVINIT -UTMP -LIBCRYPTSETUP -GCRYPT -GNUTLS +ACL +XZ +LZ4 -ZSTD +SECCOMP +BLKID -ELFUTILS +KMOD -IDN2 -IDN -PCRE2 default-hierarchy=hybrid

	I1003 18:21:03.087915   12504 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	I1003 18:21:03.092190   12504 command_runner.go:130] ! stat: cannot statx '/etc/cni/net.d/*loopback.conf*': No such file or directory

	W1003 18:21:03.092209   12504 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I1003 18:21:03.092250   12504 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1003 18:21:03.101920   12504 command_runner.go:139] > /etc/cni/net.d/87-podman-bridge.conflist, 

	I1003 18:21:03.101938   12504 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I1003 18:21:03.101944   12504 start.go:469] detecting cgroup driver to use...

	I1003 18:21:03.102080   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1003 18:21:03.114600   12504 command_runner.go:130] > runtime-endpoint: unix:///run/containerd/containerd.sock

	I1003 18:21:03.114674   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I1003 18:21:03.121697   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I1003 18:21:03.128875   12504 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...

	I1003 18:21:03.128922   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I1003 18:21:03.135906   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1003 18:21:03.142897   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I1003 18:21:03.149762   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1003 18:21:03.156762   12504 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1003 18:21:03.163931   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I1003 18:21:03.170828   12504 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1003 18:21:03.176901   12504 command_runner.go:130] > net.bridge.bridge-nf-call-iptables = 1

	I1003 18:21:03.177045   12504 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1003 18:21:03.183327   12504 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 18:21:03.277187   12504 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I1003 18:21:03.289737   12504 start.go:469] detecting cgroup driver to use...

	I1003 18:21:03.289812   12504 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1003 18:21:03.315939   12504 command_runner.go:130] > # /usr/lib/systemd/system/docker.service

	I1003 18:21:03.316382   12504 command_runner.go:130] > [Unit]

	I1003 18:21:03.316414   12504 command_runner.go:130] > Description=Docker Application Container Engine

	I1003 18:21:03.316419   12504 command_runner.go:130] > Documentation=https://docs.docker.com

	I1003 18:21:03.316425   12504 command_runner.go:130] > After=network.target  minikube-automount.service docker.socket

	I1003 18:21:03.316430   12504 command_runner.go:130] > Requires= minikube-automount.service docker.socket 

	I1003 18:21:03.316435   12504 command_runner.go:130] > StartLimitBurst=3

	I1003 18:21:03.316440   12504 command_runner.go:130] > StartLimitIntervalSec=60

	I1003 18:21:03.316444   12504 command_runner.go:130] > [Service]

	I1003 18:21:03.316448   12504 command_runner.go:130] > Type=notify

	I1003 18:21:03.316452   12504 command_runner.go:130] > Restart=on-failure

	I1003 18:21:03.316458   12504 command_runner.go:130] > # This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	I1003 18:21:03.316466   12504 command_runner.go:130] > # The base configuration already specifies an 'ExecStart=...' command. The first directive

	I1003 18:21:03.316477   12504 command_runner.go:130] > # here is to clear out that command inherited from the base configuration. Without this,

	I1003 18:21:03.316483   12504 command_runner.go:130] > # the command from the base configuration and the command specified here are treated as

	I1003 18:21:03.316489   12504 command_runner.go:130] > # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	I1003 18:21:03.316495   12504 command_runner.go:130] > # will catch this invalid input and refuse to start the service with an error like:

	I1003 18:21:03.316503   12504 command_runner.go:130] > #  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	I1003 18:21:03.316510   12504 command_runner.go:130] > # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	I1003 18:21:03.316516   12504 command_runner.go:130] > # container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	I1003 18:21:03.316520   12504 command_runner.go:130] > ExecStart=

	I1003 18:21:03.316532   12504 command_runner.go:130] > ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	I1003 18:21:03.316538   12504 command_runner.go:130] > ExecReload=/bin/kill -s HUP $MAINPID

	I1003 18:21:03.316544   12504 command_runner.go:130] > # Having non-zero Limit*s causes performance problems due to accounting overhead

	I1003 18:21:03.316550   12504 command_runner.go:130] > # in the kernel. We recommend using cgroups to do container-local accounting.

	I1003 18:21:03.316554   12504 command_runner.go:130] > LimitNOFILE=infinity

	I1003 18:21:03.316595   12504 command_runner.go:130] > LimitNPROC=infinity

	I1003 18:21:03.316598   12504 command_runner.go:130] > LimitCORE=infinity

	I1003 18:21:03.316625   12504 command_runner.go:130] > # Uncomment TasksMax if your systemd version supports it.

	I1003 18:21:03.316630   12504 command_runner.go:130] > # Only systemd 226 and above support this version.

	I1003 18:21:03.316634   12504 command_runner.go:130] > TasksMax=infinity

	I1003 18:21:03.316637   12504 command_runner.go:130] > TimeoutStartSec=0

	I1003 18:21:03.316644   12504 command_runner.go:130] > # set delegate yes so that systemd does not reset the cgroups of docker containers

	I1003 18:21:03.316662   12504 command_runner.go:130] > Delegate=yes

	I1003 18:21:03.316667   12504 command_runner.go:130] > # kill only the docker process, not all processes in the cgroup

	I1003 18:21:03.316694   12504 command_runner.go:130] > KillMode=process

	I1003 18:21:03.316698   12504 command_runner.go:130] > [Install]

	I1003 18:21:03.316703   12504 command_runner.go:130] > WantedBy=multi-user.target

	I1003 18:21:03.317414   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1003 18:21:03.331351   12504 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I1003 18:21:03.356949   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1003 18:21:03.366244   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1003 18:21:03.377037   12504 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I1003 18:21:03.402914   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1003 18:21:03.412127   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1003 18:21:03.423151   12504 command_runner.go:130] > runtime-endpoint: unix:///var/run/cri-dockerd.sock

	I1003 18:21:03.423477   12504 ssh_runner.go:195] Run: which cri-dockerd

	I1003 18:21:03.425714   12504 command_runner.go:130] > /usr/bin/cri-dockerd

	I1003 18:21:03.425923   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I1003 18:21:03.432067   12504 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I1003 18:21:03.442974   12504 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I1003 18:21:03.529497   12504 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I1003 18:21:03.621874   12504 docker.go:554] configuring docker to use "cgroupfs" as cgroup driver...

	I1003 18:21:03.621978   12504 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I1003 18:21:03.633648   12504 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 18:21:03.724046   12504 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1003 18:21:05.023006   12504 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.298902914s)

	I1003 18:21:05.044987   12504 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I1003 18:21:05.133507   12504 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I1003 18:21:05.232679   12504 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I1003 18:21:05.320168   12504 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 18:21:05.403622   12504 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I1003 18:21:05.418898   12504 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 18:21:05.514617   12504 ssh_runner.go:195] Run: sudo systemctl restart cri-docker

	I1003 18:21:05.566172   12504 start.go:516] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I1003 18:21:05.566250   12504 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I1003 18:21:05.569966   12504 command_runner.go:130] >   File: /var/run/cri-dockerd.sock

	I1003 18:21:05.569984   12504 command_runner.go:130] >   Size: 0         	Blocks: 0          IO Block: 4096   socket

	I1003 18:21:05.569993   12504 command_runner.go:130] > Device: 16h/22d	Inode: 906         Links: 1

	I1003 18:21:05.570001   12504 command_runner.go:130] > Access: (0660/srw-rw----)  Uid: (    0/    root)   Gid: ( 1000/  docker)

	I1003 18:21:05.570005   12504 command_runner.go:130] > Access: 2023-10-04 01:21:05.698266928 +0000

	I1003 18:21:05.570009   12504 command_runner.go:130] > Modify: 2023-10-04 01:21:05.698266928 +0000

	I1003 18:21:05.570014   12504 command_runner.go:130] > Change: 2023-10-04 01:21:05.700266928 +0000

	I1003 18:21:05.570017   12504 command_runner.go:130] >  Birth: -

	I1003 18:21:05.570039   12504 start.go:537] Will wait 60s for crictl version

	I1003 18:21:05.570083   12504 ssh_runner.go:195] Run: which crictl

	I1003 18:21:05.572199   12504 command_runner.go:130] > /usr/bin/crictl

	I1003 18:21:05.572424   12504 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I1003 18:21:05.613062   12504 command_runner.go:130] > Version:  0.1.0

	I1003 18:21:05.613077   12504 command_runner.go:130] > RuntimeName:  docker

	I1003 18:21:05.613084   12504 command_runner.go:130] > RuntimeVersion:  24.0.6

	I1003 18:21:05.613091   12504 command_runner.go:130] > RuntimeApiVersion:  v1

	I1003 18:21:05.614292   12504 start.go:553] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  24.0.6

	RuntimeApiVersion:  v1

	I1003 18:21:05.614357   12504 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1003 18:21:05.631409   12504 command_runner.go:130] > 24.0.6

	I1003 18:21:05.632223   12504 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1003 18:21:05.649333   12504 command_runner.go:130] > 24.0.6

	I1003 18:21:05.671585   12504 out.go:204] * Preparing Kubernetes v1.28.2 on Docker 24.0.6 ...

	I1003 18:21:05.671630   12504 main.go:141] libmachine: (multinode-528000) Calling .GetIP

	I1003 18:21:05.672008   12504 ssh_runner.go:195] Run: grep 192.168.89.1	host.minikube.internal$ /etc/hosts

	I1003 18:21:05.676051   12504 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.89.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1003 18:21:05.684885   12504 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime docker

	I1003 18:21:05.684961   12504 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1003 18:21:05.697926   12504 command_runner.go:130] > registry.k8s.io/kube-apiserver:v1.28.2

	I1003 18:21:05.697939   12504 command_runner.go:130] > registry.k8s.io/kube-scheduler:v1.28.2

	I1003 18:21:05.697943   12504 command_runner.go:130] > registry.k8s.io/kube-proxy:v1.28.2

	I1003 18:21:05.697947   12504 command_runner.go:130] > registry.k8s.io/kube-controller-manager:v1.28.2

	I1003 18:21:05.697951   12504 command_runner.go:130] > kindest/kindnetd:v20230809-80a64d96

	I1003 18:21:05.697956   12504 command_runner.go:130] > registry.k8s.io/etcd:3.5.9-0

	I1003 18:21:05.697963   12504 command_runner.go:130] > registry.k8s.io/coredns/coredns:v1.10.1

	I1003 18:21:05.697967   12504 command_runner.go:130] > registry.k8s.io/pause:3.9

	I1003 18:21:05.697972   12504 command_runner.go:130] > gcr.io/k8s-minikube/storage-provisioner:v5

	I1003 18:21:05.697975   12504 command_runner.go:130] > gcr.io/k8s-minikube/busybox:1.28

	I1003 18:21:05.698568   12504 docker.go:664] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.28.2

	registry.k8s.io/kube-scheduler:v1.28.2

	registry.k8s.io/kube-proxy:v1.28.2

	registry.k8s.io/kube-controller-manager:v1.28.2

	kindest/kindnetd:v20230809-80a64d96

	registry.k8s.io/etcd:3.5.9-0

	registry.k8s.io/coredns/coredns:v1.10.1

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	gcr.io/k8s-minikube/busybox:1.28

	-- /stdout --

	I1003 18:21:05.698581   12504 docker.go:594] Images already preloaded, skipping extraction

	I1003 18:21:05.698646   12504 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1003 18:21:05.711240   12504 command_runner.go:130] > registry.k8s.io/kube-apiserver:v1.28.2

	I1003 18:21:05.711250   12504 command_runner.go:130] > registry.k8s.io/kube-controller-manager:v1.28.2

	I1003 18:21:05.711255   12504 command_runner.go:130] > registry.k8s.io/kube-scheduler:v1.28.2

	I1003 18:21:05.711261   12504 command_runner.go:130] > registry.k8s.io/kube-proxy:v1.28.2

	I1003 18:21:05.711265   12504 command_runner.go:130] > kindest/kindnetd:v20230809-80a64d96

	I1003 18:21:05.711269   12504 command_runner.go:130] > registry.k8s.io/etcd:3.5.9-0

	I1003 18:21:05.711278   12504 command_runner.go:130] > registry.k8s.io/coredns/coredns:v1.10.1

	I1003 18:21:05.711283   12504 command_runner.go:130] > registry.k8s.io/pause:3.9

	I1003 18:21:05.711289   12504 command_runner.go:130] > gcr.io/k8s-minikube/storage-provisioner:v5

	I1003 18:21:05.711294   12504 command_runner.go:130] > gcr.io/k8s-minikube/busybox:1.28

	I1003 18:21:05.711858   12504 docker.go:664] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.28.2

	registry.k8s.io/kube-controller-manager:v1.28.2

	registry.k8s.io/kube-scheduler:v1.28.2

	registry.k8s.io/kube-proxy:v1.28.2

	kindest/kindnetd:v20230809-80a64d96

	registry.k8s.io/etcd:3.5.9-0

	registry.k8s.io/coredns/coredns:v1.10.1

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	gcr.io/k8s-minikube/busybox:1.28

	-- /stdout --

	I1003 18:21:05.711884   12504 cache_images.go:84] Images are preloaded, skipping loading

	I1003 18:21:05.711950   12504 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I1003 18:21:05.729035   12504 command_runner.go:130] > cgroupfs

	I1003 18:21:05.729628   12504 cni.go:84] Creating CNI manager for ""

	I1003 18:21:05.729636   12504 cni.go:136] 3 nodes found, recommending kindnet

	I1003 18:21:05.729650   12504 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I1003 18:21:05.729667   12504 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.89.41 APIServerPort:8443 KubernetesVersion:v1.28.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:multinode-528000 NodeName:multinode-528000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.89.41"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.89.41 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/

etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I1003 18:21:05.729765   12504 kubeadm.go:181] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.89.41

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "multinode-528000"

	  kubeletExtraArgs:

	    node-ip: 192.168.89.41

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.89.41"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.28.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1003 18:21:05.729815   12504 kubeadm.go:976] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.28.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=multinode-528000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.89.41

	[Install]

	 config:

	{KubernetesVersion:v1.28.2 ClusterName:multinode-528000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I1003 18:21:05.729869   12504 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.2

	I1003 18:21:05.736169   12504 command_runner.go:130] > kubeadm

	I1003 18:21:05.736177   12504 command_runner.go:130] > kubectl

	I1003 18:21:05.736180   12504 command_runner.go:130] > kubelet

	I1003 18:21:05.736261   12504 binaries.go:44] Found k8s binaries, skipping transfer

	I1003 18:21:05.736308   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1003 18:21:05.742557   12504 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (378 bytes)

	I1003 18:21:05.753531   12504 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1003 18:21:05.764601   12504 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2102 bytes)

	I1003 18:21:05.775996   12504 ssh_runner.go:195] Run: grep 192.168.89.41	control-plane.minikube.internal$ /etc/hosts

	I1003 18:21:05.778396   12504 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.89.41	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1003 18:21:05.786104   12504 certs.go:56] Setting up /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000 for IP: 192.168.89.41

	I1003 18:21:05.786119   12504 certs.go:190] acquiring lock for shared ca certs: {Name:mk3b53aae05d89faa161c9ed5bb05e7f02553427 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 18:21:05.786394   12504 certs.go:199] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.key

	I1003 18:21:05.786450   12504 certs.go:199] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/17348-9809/.minikube/proxy-client-ca.key

	I1003 18:21:05.786561   12504 certs.go:315] skipping minikube-user signed cert generation: /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/client.key

	I1003 18:21:05.786628   12504 certs.go:315] skipping minikube signed cert generation: /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/apiserver.key.73d945d2

	I1003 18:21:05.786684   12504 certs.go:315] skipping aggregator signed cert generation: /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/proxy-client.key

	I1003 18:21:05.786693   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I1003 18:21:05.786719   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I1003 18:21:05.786742   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I1003 18:21:05.786759   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I1003 18:21:05.786776   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I1003 18:21:05.786793   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I1003 18:21:05.786807   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I1003 18:21:05.786823   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I1003 18:21:05.786911   12504 certs.go:437] found cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/10269.pem (1338 bytes)

	W1003 18:21:05.786950   12504 certs.go:433] ignoring /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/10269_empty.pem, impossibly tiny 0 bytes

	I1003 18:21:05.786959   12504 certs.go:437] found cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca-key.pem (1675 bytes)

	I1003 18:21:05.786990   12504 certs.go:437] found cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem (1082 bytes)

	I1003 18:21:05.787020   12504 certs.go:437] found cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/cert.pem (1123 bytes)

	I1003 18:21:05.787047   12504 certs.go:437] found cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/key.pem (1679 bytes)

	I1003 18:21:05.787149   12504 certs.go:437] found cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem (1708 bytes)

	I1003 18:21:05.787178   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem -> /usr/share/ca-certificates/102692.pem

	I1003 18:21:05.787196   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I1003 18:21:05.787211   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/10269.pem -> /usr/share/ca-certificates/10269.pem

	I1003 18:21:05.787634   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I1003 18:21:05.803550   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I1003 18:21:05.819514   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1003 18:21:05.835972   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I1003 18:21:05.851731   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1003 18:21:05.867337   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1003 18:21:05.883254   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1003 18:21:05.898876   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I1003 18:21:05.914805   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem --> /usr/share/ca-certificates/102692.pem (1708 bytes)

	I1003 18:21:05.930229   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1003 18:21:05.945978   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/10269.pem --> /usr/share/ca-certificates/10269.pem (1338 bytes)

	I1003 18:21:05.961607   12504 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1003 18:21:05.972903   12504 ssh_runner.go:195] Run: openssl version

	I1003 18:21:05.976210   12504 command_runner.go:130] > OpenSSL 1.1.1n  15 Mar 2022

	I1003 18:21:05.976464   12504 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/102692.pem && ln -fs /usr/share/ca-certificates/102692.pem /etc/ssl/certs/102692.pem"

	I1003 18:21:05.983440   12504 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/102692.pem

	I1003 18:21:05.986258   12504 command_runner.go:130] > -rw-r--r-- 1 root root 1708 Oct  4 01:07 /usr/share/ca-certificates/102692.pem

	I1003 18:21:05.986441   12504 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Oct  4 01:07 /usr/share/ca-certificates/102692.pem

	I1003 18:21:05.986476   12504 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/102692.pem

	I1003 18:21:05.989991   12504 command_runner.go:130] > 3ec20f2e

	I1003 18:21:05.990152   12504 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/102692.pem /etc/ssl/certs/3ec20f2e.0"

	I1003 18:21:05.997194   12504 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1003 18:21:06.004154   12504 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1003 18:21:06.006972   12504 command_runner.go:130] > -rw-r--r-- 1 root root 1111 Oct  4 01:03 /usr/share/ca-certificates/minikubeCA.pem

	I1003 18:21:06.007073   12504 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Oct  4 01:03 /usr/share/ca-certificates/minikubeCA.pem

	I1003 18:21:06.007105   12504 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1003 18:21:06.010494   12504 command_runner.go:130] > b5213941

	I1003 18:21:06.010865   12504 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1003 18:21:06.018092   12504 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/10269.pem && ln -fs /usr/share/ca-certificates/10269.pem /etc/ssl/certs/10269.pem"

	I1003 18:21:06.025096   12504 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/10269.pem

	I1003 18:21:06.028021   12504 command_runner.go:130] > -rw-r--r-- 1 root root 1338 Oct  4 01:07 /usr/share/ca-certificates/10269.pem

	I1003 18:21:06.028182   12504 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Oct  4 01:07 /usr/share/ca-certificates/10269.pem

	I1003 18:21:06.028216   12504 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/10269.pem

	I1003 18:21:06.031654   12504 command_runner.go:130] > 51391683

	I1003 18:21:06.032015   12504 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/10269.pem /etc/ssl/certs/51391683.0"

	I1003 18:21:06.039189   12504 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd

	I1003 18:21:06.041833   12504 command_runner.go:130] > ca.crt

	I1003 18:21:06.041860   12504 command_runner.go:130] > ca.key

	I1003 18:21:06.041865   12504 command_runner.go:130] > healthcheck-client.crt

	I1003 18:21:06.041869   12504 command_runner.go:130] > healthcheck-client.key

	I1003 18:21:06.041874   12504 command_runner.go:130] > peer.crt

	I1003 18:21:06.041877   12504 command_runner.go:130] > peer.key

	I1003 18:21:06.041882   12504 command_runner.go:130] > server.crt

	I1003 18:21:06.041885   12504 command_runner.go:130] > server.key

	I1003 18:21:06.042002   12504 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400

	I1003 18:21:06.045489   12504 command_runner.go:130] > Certificate will not expire

	I1003 18:21:06.045769   12504 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400

	I1003 18:21:06.049270   12504 command_runner.go:130] > Certificate will not expire

	I1003 18:21:06.049517   12504 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400

	I1003 18:21:06.053256   12504 command_runner.go:130] > Certificate will not expire

	I1003 18:21:06.053687   12504 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400

	I1003 18:21:06.057258   12504 command_runner.go:130] > Certificate will not expire

	I1003 18:21:06.057548   12504 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400

	I1003 18:21:06.060940   12504 command_runner.go:130] > Certificate will not expire

	I1003 18:21:06.061242   12504 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400

	I1003 18:21:06.064695   12504 command_runner.go:130] > Certificate will not expire

	I1003 18:21:06.064915   12504 kubeadm.go:404] StartCluster: {Name:multinode-528000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696241247-17339@sha256:77c3e98870a99538e39ecb73a5e5230b746fa8c633c297c3d287ad4bba01a880 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVer

sion:v1.28.2 ClusterName:multinode-528000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.89.41 Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.89.42 Port:0 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:false Worker:true} {Name:m03 IP:192.168.89.43 Port:0 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false in

gress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cust

omQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I1003 18:21:06.065016   12504 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1003 18:21:06.077648   12504 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1003 18:21:06.084295   12504 command_runner.go:130] > /var/lib/kubelet/config.yaml

	I1003 18:21:06.084304   12504 command_runner.go:130] > /var/lib/kubelet/kubeadm-flags.env

	I1003 18:21:06.084309   12504 command_runner.go:130] > /var/lib/minikube/etcd:

	I1003 18:21:06.084314   12504 command_runner.go:130] > member

	I1003 18:21:06.084371   12504 kubeadm.go:419] found existing configuration files, will attempt cluster restart

	I1003 18:21:06.084385   12504 kubeadm.go:636] restartCluster start

	I1003 18:21:06.084426   12504 ssh_runner.go:195] Run: sudo test -d /data/minikube

	I1003 18:21:06.090501   12504 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:06.090789   12504 kubeconfig.go:135] verify returned: extract IP: "multinode-528000" does not appear in /Users/jenkins/minikube-integration/17348-9809/kubeconfig

	I1003 18:21:06.090854   12504 kubeconfig.go:146] "multinode-528000" context is missing from /Users/jenkins/minikube-integration/17348-9809/kubeconfig - will repair!

	I1003 18:21:06.091042   12504 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17348-9809/kubeconfig: {Name:mkec8dac3aa4bbce21b67d3eb3832cabc3df6000 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 18:21:06.091750   12504 loader.go:395] Config loaded from file:  /Users/jenkins/minikube-integration/17348-9809/kubeconfig

	I1003 18:21:06.091940   12504 kapi.go:59] client config for multinode-528000: &rest.Config{Host:"https://192.168.89.41:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/client.key", CAFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Next

Protos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27c7a00), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1003 18:21:06.092372   12504 cert_rotation.go:137] Starting client certificate rotation controller

	I1003 18:21:06.092549   12504 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I1003 18:21:06.098627   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:06.098664   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:06.107165   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:06.107187   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:06.107296   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:06.115423   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:06.615532   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:06.615610   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:06.625505   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:07.117567   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:07.117716   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:07.128799   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:07.617641   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:07.617788   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:07.628838   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:08.117044   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:08.117185   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:08.128322   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:08.617634   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:08.617772   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:08.628347   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:09.116055   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:09.116164   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:09.126773   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:09.617623   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:09.617757   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:09.628267   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:10.117046   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:10.117188   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:10.127695   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:10.616576   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:10.616712   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:10.627660   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:11.117639   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:11.118392   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:11.130169   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:11.616829   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:11.616984   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:11.628153   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:12.115607   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:12.115686   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:12.125730   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:12.616586   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:12.616694   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:12.627366   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:13.116685   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:13.116831   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:13.127226   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:13.617651   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:13.617796   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:13.628769   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:14.117092   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:14.117245   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:14.127982   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:14.617596   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:14.617703   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:14.627110   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:15.116983   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:15.117065   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:15.126550   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:15.615594   12504 api_server.go:166] Checking apiserver status ...

	I1003 18:21:15.615701   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W1003 18:21:15.624768   12504 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I1003 18:21:16.099300   12504 kubeadm.go:611] needs reconfigure: apiserver error: context deadline exceeded

	I1003 18:21:16.099342   12504 kubeadm.go:1128] stopping kube-system containers ...

	I1003 18:21:16.099461   12504 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1003 18:21:16.117315   12504 command_runner.go:130] > ae6170e1c32e

	I1003 18:21:16.117326   12504 command_runner.go:130] > c777e3c5420d

	I1003 18:21:16.117330   12504 command_runner.go:130] > 7a7ac2be1e04

	I1003 18:21:16.117333   12504 command_runner.go:130] > d7643a9cc4b2

	I1003 18:21:16.117337   12504 command_runner.go:130] > b8024fee3a61

	I1003 18:21:16.117340   12504 command_runner.go:130] > d67acc5427bf

	I1003 18:21:16.117344   12504 command_runner.go:130] > 53bbec086eff

	I1003 18:21:16.117347   12504 command_runner.go:130] > 2791a8742711

	I1003 18:21:16.117350   12504 command_runner.go:130] > 9dc263cb45fb

	I1003 18:21:16.117356   12504 command_runner.go:130] > ee159c10d5d1

	I1003 18:21:16.117360   12504 command_runner.go:130] > b49c890ba5e9

	I1003 18:21:16.117363   12504 command_runner.go:130] > 9e6ae6e7777d

	I1003 18:21:16.117366   12504 command_runner.go:130] > b88a4172043e

	I1003 18:21:16.117375   12504 command_runner.go:130] > 941b6138c42c

	I1003 18:21:16.117378   12504 command_runner.go:130] > f1c546e1f118

	I1003 18:21:16.117382   12504 command_runner.go:130] > 0209621ce1a3

	I1003 18:21:16.117931   12504 docker.go:463] Stopping containers: [ae6170e1c32e c777e3c5420d 7a7ac2be1e04 d7643a9cc4b2 b8024fee3a61 d67acc5427bf 53bbec086eff 2791a8742711 9dc263cb45fb ee159c10d5d1 b49c890ba5e9 9e6ae6e7777d b88a4172043e 941b6138c42c f1c546e1f118 0209621ce1a3]

	I1003 18:21:16.117998   12504 ssh_runner.go:195] Run: docker stop ae6170e1c32e c777e3c5420d 7a7ac2be1e04 d7643a9cc4b2 b8024fee3a61 d67acc5427bf 53bbec086eff 2791a8742711 9dc263cb45fb ee159c10d5d1 b49c890ba5e9 9e6ae6e7777d b88a4172043e 941b6138c42c f1c546e1f118 0209621ce1a3

	I1003 18:21:16.130947   12504 command_runner.go:130] > ae6170e1c32e

	I1003 18:21:16.130958   12504 command_runner.go:130] > c777e3c5420d

	I1003 18:21:16.130962   12504 command_runner.go:130] > 7a7ac2be1e04

	I1003 18:21:16.130966   12504 command_runner.go:130] > d7643a9cc4b2

	I1003 18:21:16.130998   12504 command_runner.go:130] > b8024fee3a61

	I1003 18:21:16.131005   12504 command_runner.go:130] > d67acc5427bf

	I1003 18:21:16.131009   12504 command_runner.go:130] > 53bbec086eff

	I1003 18:21:16.131034   12504 command_runner.go:130] > 2791a8742711

	I1003 18:21:16.131121   12504 command_runner.go:130] > 9dc263cb45fb

	I1003 18:21:16.131324   12504 command_runner.go:130] > ee159c10d5d1

	I1003 18:21:16.131390   12504 command_runner.go:130] > b49c890ba5e9

	I1003 18:21:16.131676   12504 command_runner.go:130] > 9e6ae6e7777d

	I1003 18:21:16.131708   12504 command_runner.go:130] > b88a4172043e

	I1003 18:21:16.131957   12504 command_runner.go:130] > 941b6138c42c

	I1003 18:21:16.132024   12504 command_runner.go:130] > f1c546e1f118

	I1003 18:21:16.132165   12504 command_runner.go:130] > 0209621ce1a3

	I1003 18:21:16.132951   12504 ssh_runner.go:195] Run: sudo systemctl stop kubelet

	I1003 18:21:16.143984   12504 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1003 18:21:16.150345   12504 command_runner.go:130] ! ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	I1003 18:21:16.150356   12504 command_runner.go:130] ! ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	I1003 18:21:16.150362   12504 command_runner.go:130] ! ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	I1003 18:21:16.150369   12504 command_runner.go:130] ! ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1003 18:21:16.150389   12504 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1003 18:21:16.150427   12504 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1003 18:21:16.156749   12504 kubeadm.go:713] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml

	I1003 18:21:16.156757   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"

	I1003 18:21:16.217200   12504 command_runner.go:130] > [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I1003 18:21:16.217553   12504 command_runner.go:130] > [certs] Using existing ca certificate authority

	I1003 18:21:16.217954   12504 command_runner.go:130] > [certs] Using existing apiserver certificate and key on disk

	I1003 18:21:16.218335   12504 command_runner.go:130] > [certs] Using existing apiserver-kubelet-client certificate and key on disk

	I1003 18:21:16.218795   12504 command_runner.go:130] > [certs] Using existing front-proxy-ca certificate authority

	I1003 18:21:16.219249   12504 command_runner.go:130] > [certs] Using existing front-proxy-client certificate and key on disk

	I1003 18:21:16.219840   12504 command_runner.go:130] > [certs] Using existing etcd/ca certificate authority

	I1003 18:21:16.220210   12504 command_runner.go:130] > [certs] Using existing etcd/server certificate and key on disk

	I1003 18:21:16.220575   12504 command_runner.go:130] > [certs] Using existing etcd/peer certificate and key on disk

	I1003 18:21:16.220920   12504 command_runner.go:130] > [certs] Using existing etcd/healthcheck-client certificate and key on disk

	I1003 18:21:16.221313   12504 command_runner.go:130] > [certs] Using existing apiserver-etcd-client certificate and key on disk

	I1003 18:21:16.221715   12504 command_runner.go:130] > [certs] Using the existing "sa" key

	I1003 18:21:16.222703   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"

	I1003 18:21:16.261982   12504 command_runner.go:130] > [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I1003 18:21:16.422433   12504 command_runner.go:130] > [kubeconfig] Writing "admin.conf" kubeconfig file

	I1003 18:21:16.645555   12504 command_runner.go:130] > [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I1003 18:21:16.842517   12504 command_runner.go:130] > [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I1003 18:21:17.124827   12504 command_runner.go:130] > [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I1003 18:21:17.126961   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"

	I1003 18:21:17.173109   12504 command_runner.go:130] > [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I1003 18:21:17.173952   12504 command_runner.go:130] > [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I1003 18:21:17.173961   12504 command_runner.go:130] > [kubelet-start] Starting the kubelet

	I1003 18:21:17.264969   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"

	I1003 18:21:17.307273   12504 command_runner.go:130] > [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I1003 18:21:17.307303   12504 command_runner.go:130] > [control-plane] Creating static Pod manifest for "kube-apiserver"

	I1003 18:21:17.309725   12504 command_runner.go:130] > [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I1003 18:21:17.310781   12504 command_runner.go:130] > [control-plane] Creating static Pod manifest for "kube-scheduler"

	I1003 18:21:17.312686   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"

	I1003 18:21:17.368748   12504 command_runner.go:130] > [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I1003 18:21:17.371535   12504 api_server.go:52] waiting for apiserver process to appear ...

	I1003 18:21:17.371595   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1003 18:21:17.382558   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1003 18:21:17.894397   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1003 18:21:18.394658   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1003 18:21:18.894564   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1003 18:21:18.919533   12504 command_runner.go:130] > 1660

	I1003 18:21:18.919619   12504 api_server.go:72] duration metric: took 1.548086923s to wait for apiserver process to appear ...

	I1003 18:21:18.919626   12504 api_server.go:88] waiting for apiserver healthz status ...

	I1003 18:21:18.919654   12504 api_server.go:253] Checking apiserver healthz at https://192.168.89.41:8443/healthz ...

	I1003 18:21:21.996630   12504 api_server.go:279] https://192.168.89.41:8443/healthz returned 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	W1003 18:21:21.996687   12504 api_server.go:103] status: https://192.168.89.41:8443/healthz returned error 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	I1003 18:21:21.996711   12504 api_server.go:253] Checking apiserver healthz at https://192.168.89.41:8443/healthz ...

	I1003 18:21:22.051736   12504 api_server.go:279] https://192.168.89.41:8443/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[-]poststarthook/start-apiextensions-controllers failed: reason withheld

	[-]poststarthook/crd-informer-synced failed: reason withheld

	[-]poststarthook/start-service-ip-repair-controllers failed: reason withheld

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[-]poststarthook/priority-and-fairness-config-producer failed: reason withheld

	[+]poststarthook/start-system-namespaces-controller ok

	[-]poststarthook/bootstrap-controller failed: reason withheld

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[-]poststarthook/apiservice-registration-controller failed: reason withheld

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	healthz check failed

	W1003 18:21:22.051755   12504 api_server.go:103] status: https://192.168.89.41:8443/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[-]poststarthook/start-apiextensions-controllers failed: reason withheld

	[-]poststarthook/crd-informer-synced failed: reason withheld

	[-]poststarthook/start-service-ip-repair-controllers failed: reason withheld

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[-]poststarthook/priority-and-fairness-config-producer failed: reason withheld

	[+]poststarthook/start-system-namespaces-controller ok

	[-]poststarthook/bootstrap-controller failed: reason withheld

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[-]poststarthook/apiservice-registration-controller failed: reason withheld

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	healthz check failed

	I1003 18:21:22.552514   12504 api_server.go:253] Checking apiserver healthz at https://192.168.89.41:8443/healthz ...

	I1003 18:21:22.558224   12504 api_server.go:279] https://192.168.89.41:8443/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	healthz check failed

	W1003 18:21:22.558242   12504 api_server.go:103] status: https://192.168.89.41:8443/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	healthz check failed

	I1003 18:21:23.052327   12504 api_server.go:253] Checking apiserver healthz at https://192.168.89.41:8443/healthz ...

	I1003 18:21:23.067920   12504 api_server.go:279] https://192.168.89.41:8443/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	healthz check failed

	W1003 18:21:23.067937   12504 api_server.go:103] status: https://192.168.89.41:8443/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	healthz check failed

	I1003 18:21:23.553450   12504 api_server.go:253] Checking apiserver healthz at https://192.168.89.41:8443/healthz ...

	I1003 18:21:23.557489   12504 api_server.go:279] https://192.168.89.41:8443/healthz returned 200:

	ok

	I1003 18:21:23.557585   12504 round_trippers.go:463] GET https://192.168.89.41:8443/version

	I1003 18:21:23.557590   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:23.557600   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:23.557606   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:23.563064   12504 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I1003 18:21:23.563090   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:23.563096   12504 round_trippers.go:580]     Audit-Id: e4c37542-b2ef-4d9d-a5e7-cbb71f0f6efa

	I1003 18:21:23.563101   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:23.563106   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:23.563132   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:23.563137   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:23.563142   12504 round_trippers.go:580]     Content-Length: 263

	I1003 18:21:23.563147   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:23 GMT

	I1003 18:21:23.563168   12504 request.go:1212] Response Body: {

	  "major": "1",

	  "minor": "28",

	  "gitVersion": "v1.28.2",

	  "gitCommit": "89a4ea3e1e4ddd7f7572286090359983e0387b2f",

	  "gitTreeState": "clean",

	  "buildDate": "2023-09-13T09:29:07Z",

	  "goVersion": "go1.20.8",

	  "compiler": "gc",

	  "platform": "linux/amd64"

	}

	I1003 18:21:23.563219   12504 api_server.go:141] control plane version: v1.28.2

	I1003 18:21:23.563229   12504 api_server.go:131] duration metric: took 4.643622509s to wait for apiserver health ...

	I1003 18:21:23.563234   12504 cni.go:84] Creating CNI manager for ""

	I1003 18:21:23.563253   12504 cni.go:136] 3 nodes found, recommending kindnet

	I1003 18:21:23.585590   12504 out.go:177] * Configuring CNI (Container Networking Interface) ...

	I1003 18:21:23.607471   12504 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap

	I1003 18:21:23.611088   12504 command_runner.go:130] >   File: /opt/cni/bin/portmap

	I1003 18:21:23.611100   12504 command_runner.go:130] >   Size: 2615256   	Blocks: 5112       IO Block: 4096   regular file

	I1003 18:21:23.611105   12504 command_runner.go:130] > Device: 11h/17d	Inode: 3544        Links: 1

	I1003 18:21:23.611110   12504 command_runner.go:130] > Access: (0755/-rwxr-xr-x)  Uid: (    0/    root)   Gid: (    0/    root)

	I1003 18:21:23.611115   12504 command_runner.go:130] > Access: 2023-10-04 01:20:59.445267298 +0000

	I1003 18:21:23.611120   12504 command_runner.go:130] > Modify: 2023-09-19 00:07:45.000000000 +0000

	I1003 18:21:23.611125   12504 command_runner.go:130] > Change: 2023-10-04 01:20:57.047134463 +0000

	I1003 18:21:23.611128   12504 command_runner.go:130] >  Birth: -

	I1003 18:21:23.611364   12504 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.28.2/kubectl ...

	I1003 18:21:23.611372   12504 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)

	I1003 18:21:23.661213   12504 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I1003 18:21:24.452406   12504 command_runner.go:130] > clusterrole.rbac.authorization.k8s.io/kindnet unchanged

	I1003 18:21:24.455861   12504 command_runner.go:130] > clusterrolebinding.rbac.authorization.k8s.io/kindnet unchanged

	I1003 18:21:24.457766   12504 command_runner.go:130] > serviceaccount/kindnet unchanged

	I1003 18:21:24.469478   12504 command_runner.go:130] > daemonset.apps/kindnet configured

	I1003 18:21:24.471307   12504 system_pods.go:43] waiting for kube-system pods to appear ...

	I1003 18:21:24.471367   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods

	I1003 18:21:24.471372   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:24.471379   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:24.471384   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:24.474082   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:24.474098   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:24.474107   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:24.474116   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:24.474124   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:24.474144   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:24 GMT

	I1003 18:21:24.474162   12504 round_trippers.go:580]     Audit-Id: 47f3b751-d728-4d2a-ac8b-046c03d80c28

	I1003 18:21:24.474171   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:24.474826   12504 request.go:1212] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"809"},"items":[{"metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f

:preferredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{ [truncated 84534 chars]

	I1003 18:21:24.477990   12504 system_pods.go:59] 12 kube-system pods found

	I1003 18:21:24.478003   12504 system_pods.go:61] "coredns-5dd5756b68-rtwd9" [3da6e23f-9391-4ec9-99aa-db9b421b00ad] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])

	I1003 18:21:24.478017   12504 system_pods.go:61] "etcd-multinode-528000" [a86312b2-3ca5-488d-b5bc-06c3346dc64e] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])

	I1003 18:21:24.478023   12504 system_pods.go:61] "kindnet-nvwhf" [1e450dcf-51ca-4715-a758-2def2e9fa38f] Running / Ready:ContainersNotReady (containers with unready status: [kindnet-cni]) / ContainersReady:ContainersNotReady (containers with unready status: [kindnet-cni])

	I1003 18:21:24.478027   12504 system_pods.go:61] "kindnet-nz8t4" [ede223c2-a0e9-4366-ba78-1eb90a1705d3] Running

	I1003 18:21:24.478031   12504 system_pods.go:61] "kindnet-tl478" [037a12f0-6b69-4fac-8cdc-bee5f7247624] Running

	I1003 18:21:24.478036   12504 system_pods.go:61] "kube-apiserver-multinode-528000" [e9361a2b-5db4-4742-9ef6-fbecda9d22a9] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])

	I1003 18:21:24.478041   12504 system_pods.go:61] "kube-controller-manager-multinode-528000" [54a13f47-e858-461b-afae-d3307752880b] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])

	I1003 18:21:24.478046   12504 system_pods.go:61] "kube-proxy-69bxc" [f621588e-bd8a-4135-aa5c-94eb292062f8] Running

	I1003 18:21:24.478051   12504 system_pods.go:61] "kube-proxy-8bl5p" [11839b32-7219-414d-a63f-026b1be9ab5c] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])

	I1003 18:21:24.478055   12504 system_pods.go:61] "kube-proxy-9pd2m" [41452f70-63bc-473d-b7bd-93e2efa7a304] Running

	I1003 18:21:24.478060   12504 system_pods.go:61] "kube-scheduler-multinode-528000" [ff27b767-6913-4efa-8a1e-8398fba84175] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])

	I1003 18:21:24.478065   12504 system_pods.go:61] "storage-provisioner" [874a29bb-bf60-4c95-9bdd-90dbb9c3c115] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I1003 18:21:24.478070   12504 system_pods.go:74] duration metric: took 6.756769ms to wait for pod list to return data ...

	I1003 18:21:24.478077   12504 node_conditions.go:102] verifying NodePressure condition ...

	I1003 18:21:24.478112   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes

	I1003 18:21:24.478117   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:24.478123   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:24.478129   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:24.479926   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:24.479938   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:24.479943   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:24.479948   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:24.479952   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:24.479958   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:24.479962   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:24 GMT

	I1003 18:21:24.479968   12504 round_trippers.go:580]     Audit-Id: e40730f6-9170-46f3-9087-1ac168a081df

	I1003 18:21:24.480266   12504 request.go:1212] Response Body: {"kind":"NodeList","apiVersion":"v1","metadata":{"resourceVersion":"809"},"items":[{"metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFiel

ds":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time" [truncated 13686 chars]

	I1003 18:21:24.480764   12504 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki

	I1003 18:21:24.480781   12504 node_conditions.go:123] node cpu capacity is 2

	I1003 18:21:24.480791   12504 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki

	I1003 18:21:24.480795   12504 node_conditions.go:123] node cpu capacity is 2

	I1003 18:21:24.480800   12504 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki

	I1003 18:21:24.480803   12504 node_conditions.go:123] node cpu capacity is 2

	I1003 18:21:24.480806   12504 node_conditions.go:105] duration metric: took 2.725051ms to run NodePressure ...

	I1003 18:21:24.480820   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"

	I1003 18:21:24.577040   12504 command_runner.go:130] > [addons] Applied essential addon: CoreDNS

	I1003 18:21:24.611536   12504 command_runner.go:130] > [addons] Applied essential addon: kube-proxy

	I1003 18:21:24.614553   12504 kubeadm.go:772] waiting for restarted kubelet to initialise ...

	I1003 18:21:24.614650   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods?labelSelector=tier%!D(MISSING)control-plane

	I1003 18:21:24.614655   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:24.614661   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:24.614682   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:24.617705   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:24.617715   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:24.617721   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:24.617728   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:24.617737   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:24.617743   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:24 GMT

	I1003 18:21:24.617750   12504 round_trippers.go:580]     Audit-Id: 5f7810f4-96f7-47a2-980f-320663658f38

	I1003 18:21:24.617757   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:24.618015   12504 request.go:1212] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"811"},"items":[{"metadata":{"name":"etcd-multinode-528000","namespace":"kube-system","uid":"a86312b2-3ca5-488d-b5bc-06c3346dc64e","resourceVersion":"739","creationTimestamp":"2023-10-04T01:18:19Z","labels":{"component":"etcd","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/etcd.advertise-client-urls":"https://192.168.89.41:2379","kubernetes.io/config.hash":"ae74302b7aebd7fdcc26eb5602da4836","kubernetes.io/config.mirror":"ae74302b7aebd7fdcc26eb5602da4836","kubernetes.io/config.seen":"2023-10-04T01:18:19.349005085Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:19Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations

":{".":{},"f:kubeadm.kubernetes.io/etcd.advertise-client-urls":{},"f:ku [truncated 29761 chars]

	I1003 18:21:24.618687   12504 kubeadm.go:787] kubelet initialised

	I1003 18:21:24.618696   12504 kubeadm.go:788] duration metric: took 4.13235ms waiting for restarted kubelet to initialise ...

	I1003 18:21:24.618703   12504 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1003 18:21:24.618737   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods

	I1003 18:21:24.618741   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:24.618747   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:24.618752   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:24.621240   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:24.621250   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:24.621255   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:24.621260   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:24.621265   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:24 GMT

	I1003 18:21:24.621269   12504 round_trippers.go:580]     Audit-Id: 5e0dac6e-318d-46b5-a657-342c8b17a98f

	I1003 18:21:24.621274   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:24.621280   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:24.622285   12504 request.go:1212] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"811"},"items":[{"metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f

:preferredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{ [truncated 84534 chars]

	I1003 18:21:24.624033   12504 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:24.624071   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:24.624077   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:24.624082   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:24.624088   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:24.625449   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:24.625457   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:24.625463   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:24.625468   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:24 GMT

	I1003 18:21:24.625473   12504 round_trippers.go:580]     Audit-Id: d6917bf8-5c23-4ab2-b1f7-7ede67c7f732

	I1003 18:21:24.625477   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:24.625483   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:24.625487   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:24.625705   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:24.625943   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:24.625949   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:24.625955   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:24.625960   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:24.627195   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:24.627206   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:24.627228   12504 round_trippers.go:580]     Audit-Id: 424ffa5d-bf93-4908-b309-d02639d04cee

	I1003 18:21:24.627233   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:24.627237   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:24.627242   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:24.627247   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:24.627253   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:24 GMT

	I1003 18:21:24.627337   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:24.627515   12504 pod_ready.go:97] node "multinode-528000" hosting pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000" has status "Ready":"False"

	I1003 18:21:24.627524   12504 pod_ready.go:81] duration metric: took 3.482148ms waiting for pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace to be "Ready" ...

	E1003 18:21:24.627530   12504 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-528000" hosting pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000" has status "Ready":"False"

	I1003 18:21:24.627536   12504 pod_ready.go:78] waiting up to 4m0s for pod "etcd-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:24.627564   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/etcd-multinode-528000

	I1003 18:21:24.627568   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:24.627574   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:24.627579   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:24.628847   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:24.628854   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:24.628859   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:24.628863   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:24.628868   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:24.628873   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:24 GMT

	I1003 18:21:24.628878   12504 round_trippers.go:580]     Audit-Id: e55100f6-82f1-4d5c-b107-72e93442576e

	I1003 18:21:24.628883   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:24.629082   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"etcd-multinode-528000","namespace":"kube-system","uid":"a86312b2-3ca5-488d-b5bc-06c3346dc64e","resourceVersion":"739","creationTimestamp":"2023-10-04T01:18:19Z","labels":{"component":"etcd","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/etcd.advertise-client-urls":"https://192.168.89.41:2379","kubernetes.io/config.hash":"ae74302b7aebd7fdcc26eb5602da4836","kubernetes.io/config.mirror":"ae74302b7aebd7fdcc26eb5602da4836","kubernetes.io/config.seen":"2023-10-04T01:18:19.349005085Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:19Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubeadm.kubernetes.io/etcd.advertise-c

lient-urls":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config [truncated 6295 chars]

	I1003 18:21:24.629288   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:24.629295   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:24.629300   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:24.629306   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:24.630553   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:24.630560   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:24.630565   12504 round_trippers.go:580]     Audit-Id: dc3bedba-2e5c-44fd-a41d-a0d981eb13ff

	I1003 18:21:24.630570   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:24.630574   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:24.630578   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:24.630583   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:24.630588   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:24 GMT

	I1003 18:21:24.630724   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:24.630889   12504 pod_ready.go:97] node "multinode-528000" hosting pod "etcd-multinode-528000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000" has status "Ready":"False"

	I1003 18:21:24.630897   12504 pod_ready.go:81] duration metric: took 3.356098ms waiting for pod "etcd-multinode-528000" in "kube-system" namespace to be "Ready" ...

	E1003 18:21:24.630904   12504 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-528000" hosting pod "etcd-multinode-528000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000" has status "Ready":"False"

	I1003 18:21:24.630912   12504 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:24.630937   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-multinode-528000

	I1003 18:21:24.630942   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:24.630947   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:24.630953   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:24.632092   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:24.632102   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:24.632112   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:24.632119   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:24.632125   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:24.632145   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:24 GMT

	I1003 18:21:24.632151   12504 round_trippers.go:580]     Audit-Id: 5630d527-6a23-4155-9328-8bb1466c55d3

	I1003 18:21:24.632157   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:24.632250   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-apiserver-multinode-528000","namespace":"kube-system","uid":"e9361a2b-5db4-4742-9ef6-fbecda9d22a9","resourceVersion":"740","creationTimestamp":"2023-10-04T01:18:19Z","labels":{"component":"kube-apiserver","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint":"192.168.89.41:8443","kubernetes.io/config.hash":"6c45fd2961dfe8d00019d2277ceb95bd","kubernetes.io/config.mirror":"6c45fd2961dfe8d00019d2277ceb95bd","kubernetes.io/config.seen":"2023-10-04T01:18:19.349011685Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:19Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubeadm.kub

ernetes.io/kube-apiserver.advertise-address.endpoint":{},"f:kubernetes. [truncated 7850 chars]

	I1003 18:21:24.632469   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:24.632475   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:24.632481   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:24.632487   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:24.633583   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:24.633608   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:24.633614   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:24.633620   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:24.633624   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:24 GMT

	I1003 18:21:24.633630   12504 round_trippers.go:580]     Audit-Id: 1f7bfde6-804e-40b9-87e0-1057cce9eafa

	I1003 18:21:24.633635   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:24.633640   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:24.633740   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:24.633930   12504 pod_ready.go:97] node "multinode-528000" hosting pod "kube-apiserver-multinode-528000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000" has status "Ready":"False"

	I1003 18:21:24.633938   12504 pod_ready.go:81] duration metric: took 3.021091ms waiting for pod "kube-apiserver-multinode-528000" in "kube-system" namespace to be "Ready" ...

	E1003 18:21:24.633944   12504 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-528000" hosting pod "kube-apiserver-multinode-528000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000" has status "Ready":"False"

	I1003 18:21:24.633972   12504 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:24.672370   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-multinode-528000

	I1003 18:21:24.672385   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:24.672397   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:24.672408   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:24.674780   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:24.674792   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:24.674804   12504 round_trippers.go:580]     Audit-Id: 871be31a-7010-4a52-a39b-08d44a962618

	I1003 18:21:24.674811   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:24.674817   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:24.674825   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:24.674831   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:24.674837   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:24 GMT

	I1003 18:21:24.675066   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-controller-manager-multinode-528000","namespace":"kube-system","uid":"54a13f47-e858-461b-afae-d3307752880b","resourceVersion":"741","creationTimestamp":"2023-10-04T01:18:17Z","labels":{"component":"kube-controller-manager","tier":"control-plane"},"annotations":{"kubernetes.io/config.hash":"eeb9be3a2727f46db49245f383b6c839","kubernetes.io/config.mirror":"eeb9be3a2727f46db49245f383b6c839","kubernetes.io/config.seen":"2023-10-04T01:18:12.593443479Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:17Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config.mirror":{},"f:kubernetes.i

o/config.seen":{},"f:kubernetes.io/config.source":{}},"f:labels":{".":{ [truncated 7436 chars]

	I1003 18:21:24.872169   12504 request.go:629] Waited for 196.767625ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:24.872226   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:24.872249   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:24.872261   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:24.872268   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:24.874456   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:24.874466   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:24.874472   12504 round_trippers.go:580]     Audit-Id: 6b62645f-8b92-4899-a188-7fad1dc5cfbd

	I1003 18:21:24.874477   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:24.874483   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:24.874487   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:24.874492   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:24.874498   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:25 GMT

	I1003 18:21:24.874557   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:24.874749   12504 pod_ready.go:97] node "multinode-528000" hosting pod "kube-controller-manager-multinode-528000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000" has status "Ready":"False"

	I1003 18:21:24.874758   12504 pod_ready.go:81] duration metric: took 240.783167ms waiting for pod "kube-controller-manager-multinode-528000" in "kube-system" namespace to be "Ready" ...

	E1003 18:21:24.874765   12504 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-528000" hosting pod "kube-controller-manager-multinode-528000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000" has status "Ready":"False"

	I1003 18:21:24.874771   12504 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-69bxc" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:25.071494   12504 request.go:629] Waited for 196.692215ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-69bxc

	I1003 18:21:25.071535   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-69bxc

	I1003 18:21:25.071541   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:25.071547   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:25.071553   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:25.073308   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:25.073318   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:25.073324   12504 round_trippers.go:580]     Audit-Id: cbedbd4f-2a04-41e5-a02c-1cc2fd8028df

	I1003 18:21:25.073330   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:25.073337   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:25.073343   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:25.073349   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:25.073353   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:25 GMT

	I1003 18:21:25.073444   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-69bxc","generateName":"kube-proxy-","namespace":"kube-system","uid":"f621588e-bd8a-4135-aa5c-94eb292062f8","resourceVersion":"712","creationTimestamp":"2023-10-04T01:19:40Z","labels":{"controller-revision-hash":"5cbdb8dcbd","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"d64f3f20-7d64-423e-8050-9b9944997ed5","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:19:40Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"d64f3f20-7d64-423e-8050-9b9944997ed5\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r

equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5746 chars]

	I1003 18:21:25.272700   12504 request.go:629] Waited for 198.988678ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m03

	I1003 18:21:25.272753   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m03

	I1003 18:21:25.272762   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:25.272774   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:25.272786   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:25.275733   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:25.275750   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:25.275757   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:25.275764   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:25 GMT

	I1003 18:21:25.275770   12504 round_trippers.go:580]     Audit-Id: 5a8e6bee-3977-4df1-9a1d-bcfeb9cd736a

	I1003 18:21:25.275776   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:25.275788   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:25.275794   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:25.275894   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m03","uid":"8b2fb46e-7671-4d24-b736-562f2f0cd353","resourceVersion":"731","creationTimestamp":"2023-10-04T01:20:20Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m03","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:20:20Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{

}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 3083 chars]

	I1003 18:21:25.276096   12504 pod_ready.go:92] pod "kube-proxy-69bxc" in "kube-system" namespace has status "Ready":"True"

	I1003 18:21:25.276106   12504 pod_ready.go:81] duration metric: took 401.332135ms waiting for pod "kube-proxy-69bxc" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:25.276114   12504 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-8bl5p" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:25.472661   12504 request.go:629] Waited for 196.507895ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-8bl5p

	I1003 18:21:25.472692   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-8bl5p

	I1003 18:21:25.472697   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:25.472703   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:25.472708   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:25.476820   12504 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1003 18:21:25.476834   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:25.476842   12504 round_trippers.go:580]     Audit-Id: dad6a5c0-23bf-4cdc-a4bf-b31dae2994ed

	I1003 18:21:25.476863   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:25.476873   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:25.476878   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:25.476883   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:25.476888   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:25 GMT

	I1003 18:21:25.477005   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-8bl5p","generateName":"kube-proxy-","namespace":"kube-system","uid":"11839b32-7219-414d-a63f-026b1be9ab5c","resourceVersion":"746","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"controller-revision-hash":"5cbdb8dcbd","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"d64f3f20-7d64-423e-8050-9b9944997ed5","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"d64f3f20-7d64-423e-8050-9b9944997ed5\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r

equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5928 chars]

	I1003 18:21:25.673313   12504 request.go:629] Waited for 196.049836ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:25.673349   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:25.673354   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:25.673359   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:25.673364   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:25.675098   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:25.675107   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:25.675112   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:25.675119   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:25 GMT

	I1003 18:21:25.675128   12504 round_trippers.go:580]     Audit-Id: 2539f64b-c2ea-45fc-b1d2-ef60fbb06c17

	I1003 18:21:25.675135   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:25.675143   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:25.675149   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:25.675304   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:25.675492   12504 pod_ready.go:97] node "multinode-528000" hosting pod "kube-proxy-8bl5p" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000" has status "Ready":"False"

	I1003 18:21:25.675500   12504 pod_ready.go:81] duration metric: took 399.385211ms waiting for pod "kube-proxy-8bl5p" in "kube-system" namespace to be "Ready" ...

	E1003 18:21:25.675507   12504 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-528000" hosting pod "kube-proxy-8bl5p" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000" has status "Ready":"False"

	I1003 18:21:25.675512   12504 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-9pd2m" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:25.873243   12504 request.go:629] Waited for 197.690721ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-9pd2m

	I1003 18:21:25.873334   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-9pd2m

	I1003 18:21:25.873344   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:25.873355   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:25.873365   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:25.876163   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:25.876176   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:25.876185   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:25.876194   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:26 GMT

	I1003 18:21:25.876201   12504 round_trippers.go:580]     Audit-Id: 5e1bff94-45d4-40b5-b591-bf7eebf2cea0

	I1003 18:21:25.876209   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:25.876215   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:25.876224   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:25.876364   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-9pd2m","generateName":"kube-proxy-","namespace":"kube-system","uid":"41452f70-63bc-473d-b7bd-93e2efa7a304","resourceVersion":"517","creationTimestamp":"2023-10-04T01:19:04Z","labels":{"controller-revision-hash":"5cbdb8dcbd","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"d64f3f20-7d64-423e-8050-9b9944997ed5","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:19:04Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"d64f3f20-7d64-423e-8050-9b9944997ed5\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r

equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5541 chars]

	I1003 18:21:26.071809   12504 request.go:629] Waited for 195.108778ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:21:26.071885   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:21:26.071947   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:26.071959   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:26.071972   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:26.074600   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:26.074613   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:26.074620   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:26.074652   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:26 GMT

	I1003 18:21:26.074667   12504 round_trippers.go:580]     Audit-Id: ff150d8b-b92d-4eed-a89e-326cc303a81e

	I1003 18:21:26.074687   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:26.074697   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:26.074704   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:26.074769   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m02","uid":"0073defe-0d22-4c69-83ae-9ebd7055fa45","resourceVersion":"582","creationTimestamp":"2023-10-04T01:19:04Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:19:04Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{

}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 3266 chars]

	I1003 18:21:26.074975   12504 pod_ready.go:92] pod "kube-proxy-9pd2m" in "kube-system" namespace has status "Ready":"True"

	I1003 18:21:26.074985   12504 pod_ready.go:81] duration metric: took 399.471148ms waiting for pod "kube-proxy-9pd2m" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:26.074994   12504 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:26.272020   12504 request.go:629] Waited for 196.940715ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-multinode-528000

	I1003 18:21:26.272069   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-multinode-528000

	I1003 18:21:26.272082   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:26.272094   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:26.272106   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:26.275172   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:26.275188   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:26.275195   12504 round_trippers.go:580]     Audit-Id: 9018ffe3-274b-4d28-bb6d-e0a4fc733d0f

	I1003 18:21:26.275202   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:26.275208   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:26.275214   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:26.275220   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:26.275226   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:26 GMT

	I1003 18:21:26.275312   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-scheduler-multinode-528000","namespace":"kube-system","uid":"ff27b767-6913-4efa-8a1e-8398fba84175","resourceVersion":"742","creationTimestamp":"2023-10-04T01:18:17Z","labels":{"component":"kube-scheduler","tier":"control-plane"},"annotations":{"kubernetes.io/config.hash":"e3e48fd34564ef6993a5357d3bb10a96","kubernetes.io/config.mirror":"e3e48fd34564ef6993a5357d3bb10a96","kubernetes.io/config.seen":"2023-10-04T01:18:12.593444031Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:17Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config.mirror":{},"f:kubernetes.io/config.seen":{},

"f:kubernetes.io/config.source":{}},"f:labels":{".":{},"f:component":{} [truncated 5148 chars]

	I1003 18:21:26.471552   12504 request.go:629] Waited for 195.951912ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:26.471592   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:26.471598   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:26.471608   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:26.471672   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:26.473902   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:26.473912   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:26.473917   12504 round_trippers.go:580]     Audit-Id: d6794825-5ce2-4e95-a0ed-a504200c57f8

	I1003 18:21:26.473922   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:26.473927   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:26.473931   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:26.473936   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:26.473941   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:26 GMT

	I1003 18:21:26.474018   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:26.474212   12504 pod_ready.go:97] node "multinode-528000" hosting pod "kube-scheduler-multinode-528000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000" has status "Ready":"False"

	I1003 18:21:26.474222   12504 pod_ready.go:81] duration metric: took 399.226531ms waiting for pod "kube-scheduler-multinode-528000" in "kube-system" namespace to be "Ready" ...

	E1003 18:21:26.474229   12504 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-528000" hosting pod "kube-scheduler-multinode-528000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000" has status "Ready":"False"

	I1003 18:21:26.474238   12504 pod_ready.go:38] duration metric: took 1.855543692s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1003 18:21:26.474253   12504 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I1003 18:21:26.488165   12504 command_runner.go:130] > -16

	I1003 18:21:26.488607   12504 ops.go:34] apiserver oom_adj: -16

	I1003 18:21:26.488622   12504 kubeadm.go:640] restartCluster took 20.404189051s

	I1003 18:21:26.488628   12504 kubeadm.go:406] StartCluster complete in 20.423682835s

	I1003 18:21:26.488640   12504 settings.go:142] acquiring lock: {Name:mkf02269a45dee1a6eaba9498791af3b04c749e3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 18:21:26.488720   12504 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/17348-9809/kubeconfig

	I1003 18:21:26.489153   12504 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17348-9809/kubeconfig: {Name:mkec8dac3aa4bbce21b67d3eb3832cabc3df6000 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 18:21:26.489454   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I1003 18:21:26.489484   12504 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false]

	I1003 18:21:26.489617   12504 config.go:182] Loaded profile config "multinode-528000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 18:21:26.489949   12504 loader.go:395] Config loaded from file:  /Users/jenkins/minikube-integration/17348-9809/kubeconfig

	I1003 18:21:26.511026   12504 out.go:177] * Enabled addons: 

	I1003 18:21:26.548616   12504 addons.go:502] enable addons completed in 59.141628ms: enabled=[]

	I1003 18:21:26.511250   12504 kapi.go:59] client config for multinode-528000: &rest.Config{Host:"https://192.168.89.41:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/client.key", CAFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Next

Protos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27c7a00), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1003 18:21:26.548905   12504 round_trippers.go:463] GET https://192.168.89.41:8443/apis/apps/v1/namespaces/kube-system/deployments/coredns/scale

	I1003 18:21:26.548915   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:26.548924   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:26.548931   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:26.551526   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:26.551536   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:26.551541   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:26.551546   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:26.551551   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:26.551555   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:26.551560   12504 round_trippers.go:580]     Content-Length: 291

	I1003 18:21:26.551564   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:26 GMT

	I1003 18:21:26.551569   12504 round_trippers.go:580]     Audit-Id: aeb5ea5b-c31e-4fc6-93af-536e0077c8a7

	I1003 18:21:26.551581   12504 request.go:1212] Response Body: {"kind":"Scale","apiVersion":"autoscaling/v1","metadata":{"name":"coredns","namespace":"kube-system","uid":"922fb573-befe-48bc-bc7c-aeeaaee4dd54","resourceVersion":"810","creationTimestamp":"2023-10-04T01:18:19Z"},"spec":{"replicas":1},"status":{"replicas":1,"selector":"k8s-app=kube-dns"}}

	I1003 18:21:26.551675   12504 kapi.go:248] "coredns" deployment in "kube-system" namespace and "multinode-528000" context rescaled to 1 replicas

	I1003 18:21:26.551695   12504 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.89.41 Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1003 18:21:26.572701   12504 out.go:177] * Verifying Kubernetes components...

	I1003 18:21:26.647608   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1003 18:21:26.664523   12504 command_runner.go:130] > apiVersion: v1

	I1003 18:21:26.664535   12504 command_runner.go:130] > data:

	I1003 18:21:26.664539   12504 command_runner.go:130] >   Corefile: |

	I1003 18:21:26.664542   12504 command_runner.go:130] >     .:53 {

	I1003 18:21:26.664546   12504 command_runner.go:130] >         log

	I1003 18:21:26.664550   12504 command_runner.go:130] >         errors

	I1003 18:21:26.664578   12504 command_runner.go:130] >         health {

	I1003 18:21:26.664582   12504 command_runner.go:130] >            lameduck 5s

	I1003 18:21:26.664585   12504 command_runner.go:130] >         }

	I1003 18:21:26.664593   12504 command_runner.go:130] >         ready

	I1003 18:21:26.664598   12504 command_runner.go:130] >         kubernetes cluster.local in-addr.arpa ip6.arpa {

	I1003 18:21:26.664602   12504 command_runner.go:130] >            pods insecure

	I1003 18:21:26.664609   12504 command_runner.go:130] >            fallthrough in-addr.arpa ip6.arpa

	I1003 18:21:26.664613   12504 command_runner.go:130] >            ttl 30

	I1003 18:21:26.664616   12504 command_runner.go:130] >         }

	I1003 18:21:26.664622   12504 command_runner.go:130] >         prometheus :9153

	I1003 18:21:26.664626   12504 command_runner.go:130] >         hosts {

	I1003 18:21:26.664633   12504 command_runner.go:130] >            192.168.89.1 host.minikube.internal

	I1003 18:21:26.664652   12504 command_runner.go:130] >            fallthrough

	I1003 18:21:26.664655   12504 command_runner.go:130] >         }

	I1003 18:21:26.664661   12504 command_runner.go:130] >         forward . /etc/resolv.conf {

	I1003 18:21:26.664667   12504 command_runner.go:130] >            max_concurrent 1000

	I1003 18:21:26.664671   12504 command_runner.go:130] >         }

	I1003 18:21:26.664675   12504 command_runner.go:130] >         cache 30

	I1003 18:21:26.664679   12504 command_runner.go:130] >         loop

	I1003 18:21:26.664684   12504 command_runner.go:130] >         reload

	I1003 18:21:26.664687   12504 command_runner.go:130] >         loadbalance

	I1003 18:21:26.664692   12504 command_runner.go:130] >     }

	I1003 18:21:26.664696   12504 command_runner.go:130] > kind: ConfigMap

	I1003 18:21:26.664700   12504 command_runner.go:130] > metadata:

	I1003 18:21:26.664704   12504 command_runner.go:130] >   creationTimestamp: "2023-10-04T01:18:19Z"

	I1003 18:21:26.664709   12504 command_runner.go:130] >   name: coredns

	I1003 18:21:26.664727   12504 command_runner.go:130] >   namespace: kube-system

	I1003 18:21:26.664734   12504 command_runner.go:130] >   resourceVersion: "398"

	I1003 18:21:26.664738   12504 command_runner.go:130] >   uid: cb6f6791-ee44-4f9b-af52-ece342b3d8a0

	I1003 18:21:26.668145   12504 node_ready.go:35] waiting up to 6m0s for node "multinode-528000" to be "Ready" ...

	I1003 18:21:26.668149   12504 start.go:896] CoreDNS already contains "host.minikube.internal" host record, skipping...

	I1003 18:21:26.671405   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:26.671414   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:26.671421   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:26.671426   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:26.673245   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:26.673257   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:26.673265   12504 round_trippers.go:580]     Audit-Id: 35b81ccd-05b7-4954-9dfb-63109513e6c1

	I1003 18:21:26.673271   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:26.673276   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:26.673281   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:26.673287   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:26.673294   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:26 GMT

	I1003 18:21:26.673435   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:26.871460   12504 request.go:629] Waited for 197.779271ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:26.871494   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:26.871500   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:26.871508   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:26.871517   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:26.873427   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:26.873440   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:26.873449   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:27 GMT

	I1003 18:21:26.873456   12504 round_trippers.go:580]     Audit-Id: 2f9206e2-71ed-469d-898e-253a1df997c7

	I1003 18:21:26.873467   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:26.873475   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:26.873483   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:26.873488   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:26.873692   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:27.374891   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:27.374907   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:27.374914   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:27.374919   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:27.376830   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:27.376839   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:27.376845   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:27.376850   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:27 GMT

	I1003 18:21:27.376855   12504 round_trippers.go:580]     Audit-Id: 1dcc0191-db17-46e4-930f-a81af5b5beb3

	I1003 18:21:27.376860   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:27.376875   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:27.376891   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:27.377035   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:27.875660   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:27.875687   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:27.875699   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:27.875708   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:27.878528   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:27.878547   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:27.878554   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:27.878561   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:27.878567   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:28 GMT

	I1003 18:21:27.878574   12504 round_trippers.go:580]     Audit-Id: 40cf556c-f1ef-4092-99db-409c1bd3ac83

	I1003 18:21:27.878588   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:27.878594   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:27.878662   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:28.374389   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:28.374411   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:28.374423   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:28.374433   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:28.377407   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:28.377422   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:28.377429   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:28.377435   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:28.377441   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:28.377447   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:28.377453   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:28 GMT

	I1003 18:21:28.377477   12504 round_trippers.go:580]     Audit-Id: 0a6dc545-f57e-417e-9808-a3da0d3233fa

	I1003 18:21:28.377572   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:28.874574   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:28.874596   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:28.874608   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:28.874618   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:28.877400   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:28.877414   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:28.877421   12504 round_trippers.go:580]     Audit-Id: 096a7038-12ae-483e-8402-40370160736c

	I1003 18:21:28.877428   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:28.877434   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:28.877444   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:28.877456   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:28.877481   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:29 GMT

	I1003 18:21:28.877668   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:28.877937   12504 node_ready.go:58] node "multinode-528000" has status "Ready":"False"

	I1003 18:21:29.374216   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:29.374235   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:29.374247   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:29.374257   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:29.376593   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:29.376610   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:29.376621   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:29.376633   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:29 GMT

	I1003 18:21:29.376643   12504 round_trippers.go:580]     Audit-Id: 4a942b92-b505-4418-b62a-86700641f1fc

	I1003 18:21:29.376653   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:29.376675   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:29.376686   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:29.376856   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:29.874308   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:29.874328   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:29.874341   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:29.874351   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:29.876828   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:29.876840   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:29.876847   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:29.876852   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:29.876857   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:30 GMT

	I1003 18:21:29.876861   12504 round_trippers.go:580]     Audit-Id: db9845a3-3b0d-4104-a4c3-5179e9cbcd43

	I1003 18:21:29.876866   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:29.876872   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:29.876987   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:30.374134   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:30.374146   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:30.374153   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:30.374158   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:30.376000   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:30.376014   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:30.376022   12504 round_trippers.go:580]     Audit-Id: a71259bd-74ff-4dec-b458-597074486eaf

	I1003 18:21:30.376029   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:30.376036   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:30.376041   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:30.376045   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:30.376051   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:30 GMT

	I1003 18:21:30.376166   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"738","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5300 chars]

	I1003 18:21:30.875343   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:30.875364   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:30.875376   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:30.875386   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:30.878326   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:30.878341   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:30.878348   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:30.878354   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:30.878361   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:31 GMT

	I1003 18:21:30.878367   12504 round_trippers.go:580]     Audit-Id: 63ae463d-8328-4f61-98ef-5dac71de63e9

	I1003 18:21:30.878374   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:30.878381   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:30.878506   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:30.878759   12504 node_ready.go:49] node "multinode-528000" has status "Ready":"True"

	I1003 18:21:30.878774   12504 node_ready.go:38] duration metric: took 4.210484161s waiting for node "multinode-528000" to be "Ready" ...

	I1003 18:21:30.878782   12504 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1003 18:21:30.878823   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods

	I1003 18:21:30.878829   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:30.878837   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:30.878845   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:30.881539   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:30.881547   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:30.881554   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:31 GMT

	I1003 18:21:30.881558   12504 round_trippers.go:580]     Audit-Id: 6a3ce6a3-4ffe-4e0f-9022-839375c1b3cd

	I1003 18:21:30.881563   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:30.881568   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:30.881575   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:30.881583   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:30.882277   12504 request.go:1212] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"830"},"items":[{"metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f

:preferredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{ [truncated 83700 chars]

	I1003 18:21:30.884029   12504 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:30.884064   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:30.884069   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:30.884086   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:30.884094   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:30.885587   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:30.885597   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:30.885604   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:31 GMT

	I1003 18:21:30.885612   12504 round_trippers.go:580]     Audit-Id: da454dcf-8a01-4d07-ac22-a13eb516d0c6

	I1003 18:21:30.885621   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:30.885632   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:30.885641   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:30.885648   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:30.885759   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:30.886014   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:30.886021   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:30.886026   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:30.886030   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:30.887230   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:30.887241   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:30.887249   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:30.887257   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:30.887263   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:30.887268   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:31 GMT

	I1003 18:21:30.887272   12504 round_trippers.go:580]     Audit-Id: 03364104-ca64-4f8a-9de8-de75d0ae14ed

	I1003 18:21:30.887277   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:30.887444   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:30.887646   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:30.887652   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:30.887658   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:30.887663   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:30.888740   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:30.888748   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:30.888753   12504 round_trippers.go:580]     Audit-Id: 3b5fcc25-d93a-4722-9f4b-2759710ac24d

	I1003 18:21:30.888763   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:30.888771   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:30.888778   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:30.888784   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:30.888789   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:31 GMT

	I1003 18:21:30.888925   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:30.889147   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:30.889153   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:30.889159   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:30.889164   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:30.890358   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:30.890365   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:30.890370   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:30.890375   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:30.890380   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:30.890385   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:31 GMT

	I1003 18:21:30.890389   12504 round_trippers.go:580]     Audit-Id: cb9688c1-be60-4d8d-b2a1-56c0441c0710

	I1003 18:21:30.890394   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:30.890678   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:31.391601   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:31.391626   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:31.391640   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:31.391650   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:31.394496   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:31.394508   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:31.394515   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:31.394521   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:31.394527   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:31 GMT

	I1003 18:21:31.394533   12504 round_trippers.go:580]     Audit-Id: 5dd8936c-febd-4e3c-82f5-02bef1039d8c

	I1003 18:21:31.394540   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:31.394545   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:31.394629   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:31.394973   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:31.394982   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:31.394990   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:31.394997   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:31.396783   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:31.396792   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:31.396799   12504 round_trippers.go:580]     Audit-Id: 1e43310f-e13c-4916-be81-9ddf256e9e6b

	I1003 18:21:31.396804   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:31.396808   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:31.396812   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:31.396818   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:31.396822   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:31 GMT

	I1003 18:21:31.397045   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:31.891799   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:31.891821   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:31.891871   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:31.891880   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:31.893860   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:31.893869   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:31.893874   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:31.893880   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:31.893885   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:32 GMT

	I1003 18:21:31.893889   12504 round_trippers.go:580]     Audit-Id: 1498e059-5c69-4461-925f-1710c449b700

	I1003 18:21:31.893894   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:31.893898   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:31.893998   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:31.894272   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:31.894279   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:31.894284   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:31.894289   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:31.895544   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:31.895552   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:31.895558   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:31.895564   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:32 GMT

	I1003 18:21:31.895571   12504 round_trippers.go:580]     Audit-Id: ccbb478c-cb55-46f5-b19a-db50c9cb2e6f

	I1003 18:21:31.895577   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:31.895582   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:31.895588   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:31.895702   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:32.392455   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:32.392527   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:32.392544   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:32.392554   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:32.395769   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:32.395781   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:32.395788   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:32.395795   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:32.395802   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:32 GMT

	I1003 18:21:32.395808   12504 round_trippers.go:580]     Audit-Id: f214596f-e418-46e7-985b-bf3d010c37b8

	I1003 18:21:32.395816   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:32.395823   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:32.395986   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:32.396336   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:32.396345   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:32.396353   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:32.396360   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:32.398018   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:32.398031   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:32.398039   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:32.398046   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:32.398054   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:32 GMT

	I1003 18:21:32.398063   12504 round_trippers.go:580]     Audit-Id: bc2d8109-0357-4efb-8710-daffd6494b96

	I1003 18:21:32.398078   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:32.398086   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:32.398196   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:32.891877   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:32.891903   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:32.891943   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:32.891956   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:32.895225   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:32.895240   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:32.895248   12504 round_trippers.go:580]     Audit-Id: 07570475-c2ac-49a2-b162-8cf720b2da9f

	I1003 18:21:32.895254   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:32.895260   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:32.895269   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:32.895284   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:32.895291   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:33 GMT

	I1003 18:21:32.895421   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:32.895690   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:32.895696   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:32.895702   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:32.895707   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:32.897152   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:32.897163   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:32.897171   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:33 GMT

	I1003 18:21:32.897178   12504 round_trippers.go:580]     Audit-Id: 02e6e6e4-0d27-4eb7-9ea4-87ae856f890a

	I1003 18:21:32.897187   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:32.897193   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:32.897198   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:32.897202   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:32.897378   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:32.897542   12504 pod_ready.go:102] pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace has status "Ready":"False"

	I1003 18:21:33.391901   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:33.391926   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:33.391940   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:33.391950   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:33.395193   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:33.395208   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:33.395216   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:33.395222   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:33 GMT

	I1003 18:21:33.395228   12504 round_trippers.go:580]     Audit-Id: c1bc75cb-2ba5-4390-8a62-bbb7e1186578

	I1003 18:21:33.395236   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:33.395242   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:33.395248   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:33.395530   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:33.395883   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:33.395894   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:33.395903   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:33.395929   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:33.397346   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:33.397355   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:33.397360   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:33.397365   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:33 GMT

	I1003 18:21:33.397370   12504 round_trippers.go:580]     Audit-Id: 846cf09a-fcb1-4f33-95a8-e5813bd3d767

	I1003 18:21:33.397374   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:33.397380   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:33.397390   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:33.397472   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:33.892613   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:33.892639   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:33.892651   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:33.892661   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:33.895734   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:33.895749   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:33.895756   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:34 GMT

	I1003 18:21:33.895763   12504 round_trippers.go:580]     Audit-Id: de2fb9ba-e820-49dd-b94e-f72542e2e218

	I1003 18:21:33.895775   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:33.895782   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:33.895788   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:33.895794   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:33.895861   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:33.896214   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:33.896223   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:33.896231   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:33.896238   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:33.897913   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:33.897923   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:33.897931   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:34 GMT

	I1003 18:21:33.897940   12504 round_trippers.go:580]     Audit-Id: 5d162851-05bb-4db6-9e7b-ff5f003ab3cb

	I1003 18:21:33.897947   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:33.897954   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:33.897961   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:33.897968   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:33.898025   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:34.391084   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:34.391096   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:34.391105   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:34.391111   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:34.392947   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:34.392956   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:34.392961   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:34.392966   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:34.392970   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:34.392977   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:34 GMT

	I1003 18:21:34.392984   12504 round_trippers.go:580]     Audit-Id: d208b0c0-3dbe-4241-80cb-ff6f2ae5eba6

	I1003 18:21:34.392992   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:34.393101   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:34.393384   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:34.393390   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:34.393395   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:34.393400   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:34.394914   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:34.394923   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:34.394928   12504 round_trippers.go:580]     Audit-Id: a1fe4b1f-6803-4da0-82da-4e97fcfbfada

	I1003 18:21:34.394933   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:34.394937   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:34.394946   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:34.394952   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:34.394956   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:34 GMT

	I1003 18:21:34.395027   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:34.891303   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:34.891329   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:34.891340   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:34.891350   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:34.894860   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:34.894876   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:34.894883   12504 round_trippers.go:580]     Audit-Id: d9c2ad43-9957-484a-bfa1-aabeb5738e96

	I1003 18:21:34.894890   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:34.894896   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:34.894905   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:34.894911   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:34.894918   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:35 GMT

	I1003 18:21:34.895014   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:34.895326   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:34.895333   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:34.895338   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:34.895343   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:34.896681   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:34.896691   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:34.896696   12504 round_trippers.go:580]     Audit-Id: 3d3f2ead-b5bf-4a0b-98a9-0ca4dd565888

	I1003 18:21:34.896702   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:34.896707   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:34.896714   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:34.896722   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:34.896730   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:35 GMT

	I1003 18:21:34.896846   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:35.392021   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:35.392044   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:35.392056   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:35.392066   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:35.395328   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:35.395343   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:35.395351   12504 round_trippers.go:580]     Audit-Id: 7fcecf5e-8d0c-4676-99c8-913b47d08fc9

	I1003 18:21:35.395357   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:35.395363   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:35.395368   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:35.395374   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:35.395380   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:35 GMT

	I1003 18:21:35.395508   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:35.395838   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:35.395844   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:35.395850   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:35.395854   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:35.397166   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:35.397176   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:35.397181   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:35.397185   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:35 GMT

	I1003 18:21:35.397190   12504 round_trippers.go:580]     Audit-Id: 1480a73d-afcf-4e45-ac38-939d6dc66c7e

	I1003 18:21:35.397195   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:35.397199   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:35.397204   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:35.397320   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:35.397490   12504 pod_ready.go:102] pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace has status "Ready":"False"

	I1003 18:21:35.891258   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:35.891270   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:35.891276   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:35.891281   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:35.893023   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:35.893032   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:35.893037   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:35.893042   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:35.893047   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:35.893051   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:35.893056   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:36 GMT

	I1003 18:21:35.893062   12504 round_trippers.go:580]     Audit-Id: a8c20599-db4a-4e90-996e-4e1344388940

	I1003 18:21:35.893204   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:35.893470   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:35.893476   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:35.893481   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:35.893486   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:35.895293   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:35.895301   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:35.895306   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:35.895311   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:35.895323   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:35.895328   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:35.895333   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:36 GMT

	I1003 18:21:35.895338   12504 round_trippers.go:580]     Audit-Id: d1a6ba80-7d0b-401e-85ea-6e290165a053

	I1003 18:21:35.895449   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:36.391926   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:36.391947   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:36.391959   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:36.391970   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:36.395373   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:36.395387   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:36.395394   12504 round_trippers.go:580]     Audit-Id: 79456092-8556-4f5c-9620-f39e7c42b8bc

	I1003 18:21:36.395400   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:36.395406   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:36.395413   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:36.395419   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:36.395447   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:36 GMT

	I1003 18:21:36.395579   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:36.395930   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:36.395939   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:36.395946   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:36.395953   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:36.397622   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:36.397631   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:36.397636   12504 round_trippers.go:580]     Audit-Id: c9f784db-14c7-4436-ae64-d751fc31dd3b

	I1003 18:21:36.397640   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:36.397645   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:36.397664   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:36.397671   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:36.397677   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:36 GMT

	I1003 18:21:36.397739   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:36.891135   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:36.891150   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:36.891159   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:36.891166   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:36.893350   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:36.893363   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:36.893372   12504 round_trippers.go:580]     Audit-Id: 417f4d89-803b-497b-82af-c985bfc3c12a

	I1003 18:21:36.893379   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:36.893386   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:36.893393   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:36.893400   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:36.893405   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:37 GMT

	I1003 18:21:36.893564   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:36.893826   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:36.893833   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:36.893839   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:36.893844   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:36.895198   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:36.895208   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:36.895215   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:36.895222   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:36.895231   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:36.895239   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:36.895250   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:37 GMT

	I1003 18:21:36.895254   12504 round_trippers.go:580]     Audit-Id: 440b547a-304b-4a6d-b2db-1d88bce5f8fb

	I1003 18:21:36.895386   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:37.391251   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:37.391271   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:37.391283   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:37.391293   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:37.394273   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:37.394283   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:37.394289   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:37.394302   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:37.394313   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:37.394326   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:37 GMT

	I1003 18:21:37.394335   12504 round_trippers.go:580]     Audit-Id: 0b051f38-8cbc-4b3f-a095-e6eaee9ba9d5

	I1003 18:21:37.394346   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:37.394467   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:37.394736   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:37.394744   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:37.394749   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:37.394761   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:37.396252   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:37.396259   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:37.396264   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:37.396278   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:37.396286   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:37.396292   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:37 GMT

	I1003 18:21:37.396300   12504 round_trippers.go:580]     Audit-Id: 3cff7ea1-7659-4af0-bf27-37b6d8acdda1

	I1003 18:21:37.396308   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:37.396552   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:37.891562   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:37.891594   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:37.891605   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:37.891615   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:37.895051   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:37.895065   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:37.895073   12504 round_trippers.go:580]     Audit-Id: 925fa2fa-21ab-428c-b115-82aa61c7bc52

	I1003 18:21:37.895079   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:37.895085   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:37.895092   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:37.895099   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:37.895107   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:38 GMT

	I1003 18:21:37.895201   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:37.895563   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:37.895572   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:37.895581   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:37.895588   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:37.897026   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:37.897036   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:37.897041   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:37.897047   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:37.897051   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:37.897055   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:37.897061   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:38 GMT

	I1003 18:21:37.897065   12504 round_trippers.go:580]     Audit-Id: 7df34ddd-e72a-4760-8f41-b93bed020ff2

	I1003 18:21:37.897142   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:37.897324   12504 pod_ready.go:102] pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace has status "Ready":"False"

	I1003 18:21:38.392042   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:38.392053   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:38.392060   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:38.392065   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:38.393692   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:38.393701   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:38.393707   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:38.393712   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:38.393716   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:38.393720   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:38.393724   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:38 GMT

	I1003 18:21:38.393729   12504 round_trippers.go:580]     Audit-Id: ec969a43-6c1e-4ba4-b0a4-701cd2703ad4

	I1003 18:21:38.393873   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:38.394173   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:38.394181   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:38.394187   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:38.394193   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:38.395881   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:38.395890   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:38.395896   12504 round_trippers.go:580]     Audit-Id: 5c8fbfed-abfb-4520-9966-2968502f1b9c

	I1003 18:21:38.395901   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:38.395908   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:38.395917   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:38.395927   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:38.395932   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:38 GMT

	I1003 18:21:38.396119   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:38.892357   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:38.892369   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:38.892375   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:38.892395   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:38.895553   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:38.895565   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:38.895585   12504 round_trippers.go:580]     Audit-Id: b03f3e1e-0a2a-4b6f-bedd-ec2095c2cbd8

	I1003 18:21:38.895590   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:38.895614   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:38.895619   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:38.895625   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:38.895631   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:39 GMT

	I1003 18:21:38.895849   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:38.896175   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:38.896182   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:38.896188   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:38.896214   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:38.897727   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:38.897752   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:38.897780   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:38.897788   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:39 GMT

	I1003 18:21:38.897795   12504 round_trippers.go:580]     Audit-Id: 3c8ad78c-3085-409c-af93-a50f4e509154

	I1003 18:21:38.897800   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:38.897816   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:38.897823   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:38.898231   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:39.391664   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:39.391685   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:39.391698   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:39.391707   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:39.394923   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:39.394939   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:39.394947   12504 round_trippers.go:580]     Audit-Id: 6e4f67e1-352f-46bc-92cc-354f7830db2f

	I1003 18:21:39.394953   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:39.394960   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:39.394966   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:39.394973   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:39.394979   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:39 GMT

	I1003 18:21:39.395048   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:39.395401   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:39.395410   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:39.395419   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:39.395426   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:39.396868   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:39.396876   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:39.396881   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:39 GMT

	I1003 18:21:39.396896   12504 round_trippers.go:580]     Audit-Id: 34bb4a44-ece1-409d-ae10-19ec2679da00

	I1003 18:21:39.396902   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:39.396906   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:39.396911   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:39.396915   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:39.397088   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:39.892683   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:39.892700   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:39.892709   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:39.892716   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:39.895186   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:39.895199   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:39.895205   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:39.895216   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:39.895222   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:39.895227   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:39.895231   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:40 GMT

	I1003 18:21:39.895236   12504 round_trippers.go:580]     Audit-Id: 532f0dec-9017-4006-9a55-e0664cf83b75

	I1003 18:21:39.895292   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"744","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6542 chars]

	I1003 18:21:39.895562   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:39.895569   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:39.895574   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:39.895579   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:39.896816   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:39.896837   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:39.896846   12504 round_trippers.go:580]     Audit-Id: 42cca22f-4aa3-4484-8d99-eb5d1ebe8d0a

	I1003 18:21:39.896851   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:39.896857   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:39.896869   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:39.896875   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:39.896879   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:40 GMT

	I1003 18:21:39.897123   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:40.393219   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:40.393258   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:40.393270   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:40.393280   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:40.396360   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:40.396375   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:40.396383   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:40.396389   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:40.396396   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:40.396403   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:40 GMT

	I1003 18:21:40.396410   12504 round_trippers.go:580]     Audit-Id: 342a7a3f-3f3e-432d-b606-b1ce402b8b69

	I1003 18:21:40.396417   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:40.396571   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"856","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6719 chars]

	I1003 18:21:40.396932   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:40.396941   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:40.396949   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:40.396956   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:40.398515   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:40.398528   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:40.398536   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:40 GMT

	I1003 18:21:40.398544   12504 round_trippers.go:580]     Audit-Id: e5349345-ad73-43ba-bc5c-a5b021bccc66

	I1003 18:21:40.398551   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:40.398560   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:40.398567   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:40.398574   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:40.398680   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:40.398847   12504 pod_ready.go:102] pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace has status "Ready":"False"

	I1003 18:21:40.892064   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:40.892086   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:40.892098   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:40.892107   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:40.895177   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:40.895197   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:40.895208   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:40.895218   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:40.895228   12504 round_trippers.go:580]     Audit-Id: dacc5b14-e477-436d-a852-51676401498e

	I1003 18:21:40.895237   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:40.895249   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:40.895259   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:40.895372   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"856","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6719 chars]

	I1003 18:21:40.895742   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:40.895750   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:40.895758   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:40.895766   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:40.897208   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:40.897216   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:40.897222   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:40.897229   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:40.897235   12504 round_trippers.go:580]     Audit-Id: 88a76a8b-0c31-4c10-9e2a-3e05dc884c2d

	I1003 18:21:40.897242   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:40.897249   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:40.897256   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:40.897332   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:41.391178   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:21:41.391206   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:41.391258   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:41.391270   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:41.393957   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:41.393967   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:41.393975   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:41.393994   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:41.394003   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:41.394010   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:41.394019   12504 round_trippers.go:580]     Audit-Id: 42ea76bf-7ac6-4a0e-8fb8-3e450b2501a2

	I1003 18:21:41.394028   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:41.394092   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"862","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6490 chars]

	I1003 18:21:41.394358   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:41.394365   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:41.394371   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:41.394376   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:41.395812   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:41.395819   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:41.395824   12504 round_trippers.go:580]     Audit-Id: 8d355fb5-f4a8-4f66-b0bd-a0aabcb38a60

	I1003 18:21:41.395828   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:41.395834   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:41.395838   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:41.395843   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:41.395848   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:41.396146   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:41.396310   12504 pod_ready.go:92] pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace has status "Ready":"True"

	I1003 18:21:41.396317   12504 pod_ready.go:81] duration metric: took 10.512110846s waiting for pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:41.396323   12504 pod_ready.go:78] waiting up to 6m0s for pod "etcd-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:41.396349   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/etcd-multinode-528000

	I1003 18:21:41.396353   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:41.396359   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:41.396364   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:41.397833   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:41.397845   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:41.397853   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:41.397862   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:41.397871   12504 round_trippers.go:580]     Audit-Id: 53aa3bd8-7616-436c-a98a-2768b49f6c3c

	I1003 18:21:41.397879   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:41.397886   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:41.397891   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:41.398020   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"etcd-multinode-528000","namespace":"kube-system","uid":"a86312b2-3ca5-488d-b5bc-06c3346dc64e","resourceVersion":"847","creationTimestamp":"2023-10-04T01:18:19Z","labels":{"component":"etcd","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/etcd.advertise-client-urls":"https://192.168.89.41:2379","kubernetes.io/config.hash":"ae74302b7aebd7fdcc26eb5602da4836","kubernetes.io/config.mirror":"ae74302b7aebd7fdcc26eb5602da4836","kubernetes.io/config.seen":"2023-10-04T01:18:19.349005085Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:19Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubeadm.kubernetes.io/etcd.advertise-c

lient-urls":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config [truncated 6071 chars]

	I1003 18:21:41.398240   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:41.398247   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:41.398252   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:41.398258   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:41.399629   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:41.399639   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:41.399646   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:41.399653   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:41.399660   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:41.399666   12504 round_trippers.go:580]     Audit-Id: c2b242df-c49e-437b-b2bc-25698993486a

	I1003 18:21:41.399671   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:41.399675   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:41.399780   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:41.399939   12504 pod_ready.go:92] pod "etcd-multinode-528000" in "kube-system" namespace has status "Ready":"True"

	I1003 18:21:41.399945   12504 pod_ready.go:81] duration metric: took 3.616945ms waiting for pod "etcd-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:41.399955   12504 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:41.399981   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-multinode-528000

	I1003 18:21:41.399986   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:41.399991   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:41.399996   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:41.401074   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:41.401084   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:41.401091   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:41.401099   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:41.401105   12504 round_trippers.go:580]     Audit-Id: 2e9e186b-e502-4479-8613-4bec647bffd5

	I1003 18:21:41.401111   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:41.401133   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:41.401142   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:41.401278   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-apiserver-multinode-528000","namespace":"kube-system","uid":"e9361a2b-5db4-4742-9ef6-fbecda9d22a9","resourceVersion":"825","creationTimestamp":"2023-10-04T01:18:19Z","labels":{"component":"kube-apiserver","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint":"192.168.89.41:8443","kubernetes.io/config.hash":"6c45fd2961dfe8d00019d2277ceb95bd","kubernetes.io/config.mirror":"6c45fd2961dfe8d00019d2277ceb95bd","kubernetes.io/config.seen":"2023-10-04T01:18:19.349011685Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:19Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubeadm.kub

ernetes.io/kube-apiserver.advertise-address.endpoint":{},"f:kubernetes. [truncated 7606 chars]

	I1003 18:21:41.401497   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:41.401504   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:41.401509   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:41.401514   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:41.402720   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:41.402728   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:41.402733   12504 round_trippers.go:580]     Audit-Id: 09b47ad4-6f7c-4b69-9bc8-74361ae4f369

	I1003 18:21:41.402739   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:41.402747   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:41.402754   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:41.402762   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:41.402769   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:41.402878   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:41.403035   12504 pod_ready.go:92] pod "kube-apiserver-multinode-528000" in "kube-system" namespace has status "Ready":"True"

	I1003 18:21:41.403044   12504 pod_ready.go:81] duration metric: took 3.082761ms waiting for pod "kube-apiserver-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:41.403050   12504 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:41.403082   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-multinode-528000

	I1003 18:21:41.403087   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:41.403093   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:41.403098   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:41.404226   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:41.404234   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:41.404239   12504 round_trippers.go:580]     Audit-Id: 6fc46fa6-5333-428b-b1ff-2a1daaae6332

	I1003 18:21:41.404244   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:41.404248   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:41.404254   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:41.404260   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:41.404268   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:41.404496   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-controller-manager-multinode-528000","namespace":"kube-system","uid":"54a13f47-e858-461b-afae-d3307752880b","resourceVersion":"845","creationTimestamp":"2023-10-04T01:18:17Z","labels":{"component":"kube-controller-manager","tier":"control-plane"},"annotations":{"kubernetes.io/config.hash":"eeb9be3a2727f46db49245f383b6c839","kubernetes.io/config.mirror":"eeb9be3a2727f46db49245f383b6c839","kubernetes.io/config.seen":"2023-10-04T01:18:12.593443479Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:17Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config.mirror":{},"f:kubernetes.i

o/config.seen":{},"f:kubernetes.io/config.source":{}},"f:labels":{".":{ [truncated 7174 chars]

	I1003 18:21:41.404708   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:41.404715   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:41.404721   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:41.404727   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:41.405905   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:41.405912   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:41.405917   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:41.405925   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:41.405932   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:41.405936   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:41.405941   12504 round_trippers.go:580]     Audit-Id: 7e073fbc-0301-4350-a390-bece117e54ee

	I1003 18:21:41.405946   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:41.406078   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:41.406234   12504 pod_ready.go:92] pod "kube-controller-manager-multinode-528000" in "kube-system" namespace has status "Ready":"True"

	I1003 18:21:41.406241   12504 pod_ready.go:81] duration metric: took 3.179342ms waiting for pod "kube-controller-manager-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:41.406247   12504 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-69bxc" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:41.406272   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-69bxc

	I1003 18:21:41.406276   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:41.406282   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:41.406288   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:41.407320   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:41.407328   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:41.407333   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:41.407338   12504 round_trippers.go:580]     Audit-Id: aa39656a-cf9e-4f37-a127-abe29c2585ef

	I1003 18:21:41.407343   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:41.407347   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:41.407351   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:41.407356   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:41.407524   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-69bxc","generateName":"kube-proxy-","namespace":"kube-system","uid":"f621588e-bd8a-4135-aa5c-94eb292062f8","resourceVersion":"712","creationTimestamp":"2023-10-04T01:19:40Z","labels":{"controller-revision-hash":"5cbdb8dcbd","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"d64f3f20-7d64-423e-8050-9b9944997ed5","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:19:40Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"d64f3f20-7d64-423e-8050-9b9944997ed5\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r

equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5746 chars]

	I1003 18:21:41.407724   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m03

	I1003 18:21:41.407730   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:41.407737   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:41.407743   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:41.408892   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:41.408901   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:41.408907   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:41.408913   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:41.408918   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:41.408924   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:41.408929   12504 round_trippers.go:580]     Audit-Id: 1b0b2768-02b8-4c15-9b79-ec784e966253

	I1003 18:21:41.408934   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:41.409140   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m03","uid":"8b2fb46e-7671-4d24-b736-562f2f0cd353","resourceVersion":"731","creationTimestamp":"2023-10-04T01:20:20Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m03","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:20:20Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{

}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 3083 chars]

	I1003 18:21:41.409264   12504 pod_ready.go:92] pod "kube-proxy-69bxc" in "kube-system" namespace has status "Ready":"True"

	I1003 18:21:41.409270   12504 pod_ready.go:81] duration metric: took 3.018751ms waiting for pod "kube-proxy-69bxc" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:41.409276   12504 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-8bl5p" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:41.592498   12504 request.go:629] Waited for 183.141706ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-8bl5p

	I1003 18:21:41.592543   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-8bl5p

	I1003 18:21:41.592552   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:41.592565   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:41.592574   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:41.595122   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:41.595135   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:41.595142   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:41.595149   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:41.595156   12504 round_trippers.go:580]     Audit-Id: 16600be8-daaa-444b-8d4e-25f5127399a3

	I1003 18:21:41.595162   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:41.595168   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:41.595173   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:41.595424   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-8bl5p","generateName":"kube-proxy-","namespace":"kube-system","uid":"11839b32-7219-414d-a63f-026b1be9ab5c","resourceVersion":"820","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"controller-revision-hash":"5cbdb8dcbd","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"d64f3f20-7d64-423e-8050-9b9944997ed5","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"d64f3f20-7d64-423e-8050-9b9944997ed5\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r

equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5738 chars]

	I1003 18:21:41.792371   12504 request.go:629] Waited for 196.622174ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:41.792433   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:41.792449   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:41.792465   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:41.792490   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:41.794681   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:41.794695   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:41.794702   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:41.794710   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:41.794719   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:41.794731   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:41.794740   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:41 GMT

	I1003 18:21:41.794750   12504 round_trippers.go:580]     Audit-Id: ee48926d-2f28-4825-8280-ee21d13d78a5

	I1003 18:21:41.794869   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:41.795118   12504 pod_ready.go:92] pod "kube-proxy-8bl5p" in "kube-system" namespace has status "Ready":"True"

	I1003 18:21:41.795126   12504 pod_ready.go:81] duration metric: took 385.842789ms waiting for pod "kube-proxy-8bl5p" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:41.795132   12504 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-9pd2m" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:41.992753   12504 request.go:629] Waited for 197.587002ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-9pd2m

	I1003 18:21:41.992883   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-9pd2m

	I1003 18:21:41.992892   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:41.992900   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:41.992907   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:41.995102   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:41.995115   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:41.995120   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:42 GMT

	I1003 18:21:41.995125   12504 round_trippers.go:580]     Audit-Id: e29645ac-1e70-474f-9948-8dcc8d4488a2

	I1003 18:21:41.995129   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:41.995133   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:41.995138   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:41.995142   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:41.995196   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-9pd2m","generateName":"kube-proxy-","namespace":"kube-system","uid":"41452f70-63bc-473d-b7bd-93e2efa7a304","resourceVersion":"517","creationTimestamp":"2023-10-04T01:19:04Z","labels":{"controller-revision-hash":"5cbdb8dcbd","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"d64f3f20-7d64-423e-8050-9b9944997ed5","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:19:04Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"d64f3f20-7d64-423e-8050-9b9944997ed5\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r

equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5541 chars]

	I1003 18:21:42.191532   12504 request.go:629] Waited for 196.083769ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:21:42.191649   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:21:42.191660   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:42.191672   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:42.191683   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:42.194402   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:42.194414   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:42.194422   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:42.194429   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:42.194436   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:42.194443   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:42.194449   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:42 GMT

	I1003 18:21:42.194455   12504 round_trippers.go:580]     Audit-Id: a31a1f53-95a0-4112-aa84-8f845972a88e

	I1003 18:21:42.194574   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m02","uid":"0073defe-0d22-4c69-83ae-9ebd7055fa45","resourceVersion":"582","creationTimestamp":"2023-10-04T01:19:04Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:19:04Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{

}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 3266 chars]

	I1003 18:21:42.194776   12504 pod_ready.go:92] pod "kube-proxy-9pd2m" in "kube-system" namespace has status "Ready":"True"

	I1003 18:21:42.194785   12504 pod_ready.go:81] duration metric: took 399.64712ms waiting for pod "kube-proxy-9pd2m" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:42.194794   12504 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:42.391330   12504 request.go:629] Waited for 196.422488ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-multinode-528000

	I1003 18:21:42.391383   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-multinode-528000

	I1003 18:21:42.391392   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:42.391403   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:42.391426   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:42.394073   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:42.394091   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:42.394099   12504 round_trippers.go:580]     Audit-Id: 1109dfb0-93e1-49dc-997b-49540fadc398

	I1003 18:21:42.394113   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:42.394121   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:42.394129   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:42.394139   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:42.394150   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:42 GMT

	I1003 18:21:42.394292   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-scheduler-multinode-528000","namespace":"kube-system","uid":"ff27b767-6913-4efa-8a1e-8398fba84175","resourceVersion":"846","creationTimestamp":"2023-10-04T01:18:17Z","labels":{"component":"kube-scheduler","tier":"control-plane"},"annotations":{"kubernetes.io/config.hash":"e3e48fd34564ef6993a5357d3bb10a96","kubernetes.io/config.mirror":"e3e48fd34564ef6993a5357d3bb10a96","kubernetes.io/config.seen":"2023-10-04T01:18:12.593444031Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:17Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config.mirror":{},"f:kubernetes.io/config.seen":{},

"f:kubernetes.io/config.source":{}},"f:labels":{".":{},"f:component":{} [truncated 4904 chars]

	I1003 18:21:42.592526   12504 request.go:629] Waited for 197.919743ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:42.592595   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:21:42.592603   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:42.592611   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:42.592619   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:42.594393   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:21:42.594403   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:42.594409   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:42.594413   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:42.594418   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:42 GMT

	I1003 18:21:42.594423   12504 round_trippers.go:580]     Audit-Id: f28bcbd4-2e26-4511-b0c9-b8713a8ce35d

	I1003 18:21:42.594428   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:42.594433   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:42.594531   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:21:42.594721   12504 pod_ready.go:92] pod "kube-scheduler-multinode-528000" in "kube-system" namespace has status "Ready":"True"

	I1003 18:21:42.594729   12504 pod_ready.go:81] duration metric: took 399.927413ms waiting for pod "kube-scheduler-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:21:42.594736   12504 pod_ready.go:38] duration metric: took 11.715773442s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1003 18:21:42.594747   12504 api_server.go:52] waiting for apiserver process to appear ...

	I1003 18:21:42.594800   12504 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1003 18:21:42.603709   12504 command_runner.go:130] > 1660

	I1003 18:21:42.603981   12504 api_server.go:72] duration metric: took 16.051966923s to wait for apiserver process to appear ...

	I1003 18:21:42.603991   12504 api_server.go:88] waiting for apiserver healthz status ...

	I1003 18:21:42.604002   12504 api_server.go:253] Checking apiserver healthz at https://192.168.89.41:8443/healthz ...

	I1003 18:21:42.607681   12504 api_server.go:279] https://192.168.89.41:8443/healthz returned 200:

	ok

	I1003 18:21:42.607721   12504 round_trippers.go:463] GET https://192.168.89.41:8443/version

	I1003 18:21:42.607726   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:42.607733   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:42.607738   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:42.608398   12504 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I1003 18:21:42.608406   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:42.608412   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:42 GMT

	I1003 18:21:42.608417   12504 round_trippers.go:580]     Audit-Id: 8f58ba4b-e14c-40d1-9ad3-dd4560e14af8

	I1003 18:21:42.608422   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:42.608429   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:42.608433   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:42.608438   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:42.608442   12504 round_trippers.go:580]     Content-Length: 263

	I1003 18:21:42.608452   12504 request.go:1212] Response Body: {

	  "major": "1",

	  "minor": "28",

	  "gitVersion": "v1.28.2",

	  "gitCommit": "89a4ea3e1e4ddd7f7572286090359983e0387b2f",

	  "gitTreeState": "clean",

	  "buildDate": "2023-09-13T09:29:07Z",

	  "goVersion": "go1.20.8",

	  "compiler": "gc",

	  "platform": "linux/amd64"

	}

	I1003 18:21:42.608473   12504 api_server.go:141] control plane version: v1.28.2

	I1003 18:21:42.608479   12504 api_server.go:131] duration metric: took 4.483737ms to wait for apiserver health ...

	I1003 18:21:42.608484   12504 system_pods.go:43] waiting for kube-system pods to appear ...

	I1003 18:21:42.792015   12504 request.go:629] Waited for 183.487525ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods

	I1003 18:21:42.792063   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods

	I1003 18:21:42.792094   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:42.792113   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:42.792127   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:42.796488   12504 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1003 18:21:42.796499   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:42.796504   12504 round_trippers.go:580]     Audit-Id: ab6d5ff4-e09a-4f5f-89c8-b41f1c24897f

	I1003 18:21:42.796509   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:42.796514   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:42.796521   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:42.796528   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:42.796533   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:42 GMT

	I1003 18:21:42.797831   12504 request.go:1212] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"868"},"items":[{"metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"862","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f

:preferredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{ [truncated 82918 chars]

	I1003 18:21:42.800367   12504 system_pods.go:59] 12 kube-system pods found

	I1003 18:21:42.800380   12504 system_pods.go:61] "coredns-5dd5756b68-rtwd9" [3da6e23f-9391-4ec9-99aa-db9b421b00ad] Running

	I1003 18:21:42.800384   12504 system_pods.go:61] "etcd-multinode-528000" [a86312b2-3ca5-488d-b5bc-06c3346dc64e] Running

	I1003 18:21:42.800387   12504 system_pods.go:61] "kindnet-nvwhf" [1e450dcf-51ca-4715-a758-2def2e9fa38f] Running

	I1003 18:21:42.800391   12504 system_pods.go:61] "kindnet-nz8t4" [ede223c2-a0e9-4366-ba78-1eb90a1705d3] Running

	I1003 18:21:42.800394   12504 system_pods.go:61] "kindnet-tl478" [037a12f0-6b69-4fac-8cdc-bee5f7247624] Running

	I1003 18:21:42.800401   12504 system_pods.go:61] "kube-apiserver-multinode-528000" [e9361a2b-5db4-4742-9ef6-fbecda9d22a9] Running

	I1003 18:21:42.800404   12504 system_pods.go:61] "kube-controller-manager-multinode-528000" [54a13f47-e858-461b-afae-d3307752880b] Running

	I1003 18:21:42.800408   12504 system_pods.go:61] "kube-proxy-69bxc" [f621588e-bd8a-4135-aa5c-94eb292062f8] Running

	I1003 18:21:42.800412   12504 system_pods.go:61] "kube-proxy-8bl5p" [11839b32-7219-414d-a63f-026b1be9ab5c] Running

	I1003 18:21:42.800415   12504 system_pods.go:61] "kube-proxy-9pd2m" [41452f70-63bc-473d-b7bd-93e2efa7a304] Running

	I1003 18:21:42.800418   12504 system_pods.go:61] "kube-scheduler-multinode-528000" [ff27b767-6913-4efa-8a1e-8398fba84175] Running

	I1003 18:21:42.800422   12504 system_pods.go:61] "storage-provisioner" [874a29bb-bf60-4c95-9bdd-90dbb9c3c115] Running

	I1003 18:21:42.800426   12504 system_pods.go:74] duration metric: took 191.936821ms to wait for pod list to return data ...

	I1003 18:21:42.800431   12504 default_sa.go:34] waiting for default service account to be created ...

	I1003 18:21:42.992576   12504 request.go:629] Waited for 192.055162ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/default/serviceaccounts

	I1003 18:21:42.992625   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/default/serviceaccounts

	I1003 18:21:42.992634   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:42.992645   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:42.992658   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:42.995522   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:21:42.995537   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:42.995544   12504 round_trippers.go:580]     Audit-Id: 330c7f8b-32b6-4f86-9c05-e86cca09546b

	I1003 18:21:42.995550   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:42.995556   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:42.995572   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:42.995580   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:42.995586   12504 round_trippers.go:580]     Content-Length: 261

	I1003 18:21:42.995594   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:43 GMT

	I1003 18:21:42.995609   12504 request.go:1212] Response Body: {"kind":"ServiceAccountList","apiVersion":"v1","metadata":{"resourceVersion":"868"},"items":[{"metadata":{"name":"default","namespace":"default","uid":"a7bb2045-a7cd-485e-8e6a-bf7e59692d5c","resourceVersion":"372","creationTimestamp":"2023-10-04T01:18:32Z"}}]}

	I1003 18:21:42.995749   12504 default_sa.go:45] found service account: "default"

	I1003 18:21:42.995760   12504 default_sa.go:55] duration metric: took 195.322757ms for default service account to be created ...

	I1003 18:21:42.995767   12504 system_pods.go:116] waiting for k8s-apps to be running ...

	I1003 18:21:43.191792   12504 request.go:629] Waited for 195.97729ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods

	I1003 18:21:43.191881   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods

	I1003 18:21:43.191891   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:43.191902   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:43.191912   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:43.196392   12504 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1003 18:21:43.196410   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:43.196419   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:43 GMT

	I1003 18:21:43.196427   12504 round_trippers.go:580]     Audit-Id: fdafd031-c4ae-44f1-a143-6efcea26da9c

	I1003 18:21:43.196443   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:43.196451   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:43.196457   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:43.196462   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:43.196991   12504 request.go:1212] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"868"},"items":[{"metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"862","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f

:preferredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{ [truncated 82918 chars]

	I1003 18:21:43.198724   12504 system_pods.go:86] 12 kube-system pods found

	I1003 18:21:43.198733   12504 system_pods.go:89] "coredns-5dd5756b68-rtwd9" [3da6e23f-9391-4ec9-99aa-db9b421b00ad] Running

	I1003 18:21:43.198737   12504 system_pods.go:89] "etcd-multinode-528000" [a86312b2-3ca5-488d-b5bc-06c3346dc64e] Running

	I1003 18:21:43.198741   12504 system_pods.go:89] "kindnet-nvwhf" [1e450dcf-51ca-4715-a758-2def2e9fa38f] Running

	I1003 18:21:43.198744   12504 system_pods.go:89] "kindnet-nz8t4" [ede223c2-a0e9-4366-ba78-1eb90a1705d3] Running

	I1003 18:21:43.198747   12504 system_pods.go:89] "kindnet-tl478" [037a12f0-6b69-4fac-8cdc-bee5f7247624] Running

	I1003 18:21:43.198751   12504 system_pods.go:89] "kube-apiserver-multinode-528000" [e9361a2b-5db4-4742-9ef6-fbecda9d22a9] Running

	I1003 18:21:43.198755   12504 system_pods.go:89] "kube-controller-manager-multinode-528000" [54a13f47-e858-461b-afae-d3307752880b] Running

	I1003 18:21:43.198758   12504 system_pods.go:89] "kube-proxy-69bxc" [f621588e-bd8a-4135-aa5c-94eb292062f8] Running

	I1003 18:21:43.198761   12504 system_pods.go:89] "kube-proxy-8bl5p" [11839b32-7219-414d-a63f-026b1be9ab5c] Running

	I1003 18:21:43.198764   12504 system_pods.go:89] "kube-proxy-9pd2m" [41452f70-63bc-473d-b7bd-93e2efa7a304] Running

	I1003 18:21:43.198769   12504 system_pods.go:89] "kube-scheduler-multinode-528000" [ff27b767-6913-4efa-8a1e-8398fba84175] Running

	I1003 18:21:43.198772   12504 system_pods.go:89] "storage-provisioner" [874a29bb-bf60-4c95-9bdd-90dbb9c3c115] Running

	I1003 18:21:43.198777   12504 system_pods.go:126] duration metric: took 203.005383ms to wait for k8s-apps to be running ...

	I1003 18:21:43.198782   12504 system_svc.go:44] waiting for kubelet service to be running ....

	I1003 18:21:43.198830   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1003 18:21:43.207979   12504 system_svc.go:56] duration metric: took 9.191615ms WaitForService to wait for kubelet.

	I1003 18:21:43.207990   12504 kubeadm.go:581] duration metric: took 16.655977485s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I1003 18:21:43.208001   12504 node_conditions.go:102] verifying NodePressure condition ...

	I1003 18:21:43.391543   12504 request.go:629] Waited for 183.46057ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes

	I1003 18:21:43.391587   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes

	I1003 18:21:43.391658   12504 round_trippers.go:469] Request Headers:

	I1003 18:21:43.391672   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:21:43.391682   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:21:43.394797   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:21:43.394811   12504 round_trippers.go:577] Response Headers:

	I1003 18:21:43.394819   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:21:43.394827   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:21:43 GMT

	I1003 18:21:43.394833   12504 round_trippers.go:580]     Audit-Id: 8eed91b1-5bc3-4c35-a4d2-165b921a618c

	I1003 18:21:43.394839   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:21:43.394845   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:21:43.394852   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:21:43.395162   12504 request.go:1212] Response Body: {"kind":"NodeList","apiVersion":"v1","metadata":{"resourceVersion":"869"},"items":[{"metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFiel

ds":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time" [truncated 13559 chars]

	I1003 18:21:43.395661   12504 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki

	I1003 18:21:43.395671   12504 node_conditions.go:123] node cpu capacity is 2

	I1003 18:21:43.395677   12504 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki

	I1003 18:21:43.395681   12504 node_conditions.go:123] node cpu capacity is 2

	I1003 18:21:43.395684   12504 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki

	I1003 18:21:43.395687   12504 node_conditions.go:123] node cpu capacity is 2

	I1003 18:21:43.395690   12504 node_conditions.go:105] duration metric: took 187.6854ms to run NodePressure ...

	I1003 18:21:43.395696   12504 start.go:228] waiting for startup goroutines ...

	I1003 18:21:43.395701   12504 start.go:233] waiting for cluster config update ...

	I1003 18:21:43.395707   12504 start.go:242] writing updated cluster config ...

	I1003 18:21:43.396408   12504 config.go:182] Loaded profile config "multinode-528000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 18:21:43.396462   12504 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/config.json ...

	I1003 18:21:43.440296   12504 out.go:177] * Starting worker node multinode-528000-m02 in cluster multinode-528000

	I1003 18:21:43.462206   12504 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime docker

	I1003 18:21:43.462227   12504 cache.go:57] Caching tarball of preloaded images

	I1003 18:21:43.462325   12504 preload.go:174] Found /Users/jenkins/minikube-integration/17348-9809/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I1003 18:21:43.462335   12504 cache.go:60] Finished verifying existence of preloaded tar for  v1.28.2 on docker

	I1003 18:21:43.462398   12504 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/config.json ...

	I1003 18:21:43.463109   12504 start.go:365] acquiring machines lock for multinode-528000-m02: {Name:mk592c6e7c5aa7c823729561bf878fc0544d84d2 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1003 18:21:43.463159   12504 start.go:369] acquired machines lock for "multinode-528000-m02" in 37.941µs

	I1003 18:21:43.463172   12504 start.go:96] Skipping create...Using existing machine configuration

	I1003 18:21:43.463176   12504 fix.go:54] fixHost starting: m02

	I1003 18:21:43.463390   12504 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I1003 18:21:43.463404   12504 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I1003 18:21:43.471301   12504 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59260

	I1003 18:21:43.471642   12504 main.go:141] libmachine: () Calling .GetVersion

	I1003 18:21:43.471964   12504 main.go:141] libmachine: Using API Version  1

	I1003 18:21:43.471977   12504 main.go:141] libmachine: () Calling .SetConfigRaw

	I1003 18:21:43.472210   12504 main.go:141] libmachine: () Calling .GetMachineName

	I1003 18:21:43.472314   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .DriverName

	I1003 18:21:43.472396   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetState

	I1003 18:21:43.472467   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I1003 18:21:43.472540   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | hyperkit pid from json: 12178

	I1003 18:21:43.473459   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | hyperkit pid 12178 missing from process table

	I1003 18:21:43.473477   12504 fix.go:102] recreateIfNeeded on multinode-528000-m02: state=Stopped err=<nil>

	I1003 18:21:43.473485   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .DriverName

	W1003 18:21:43.473562   12504 fix.go:128] unexpected machine state, will restart: <nil>

	I1003 18:21:43.494145   12504 out.go:177] * Restarting existing hyperkit VM for "multinode-528000-m02" ...

	I1003 18:21:43.536202   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .Start

	I1003 18:21:43.536428   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I1003 18:21:43.536503   12504 main.go:141] libmachine: (multinode-528000-m02) minikube might have been shutdown in an unclean way, the hyperkit pid file still exists: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/hyperkit.pid

	I1003 18:21:43.538195   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | hyperkit pid 12178 missing from process table

	I1003 18:21:43.538210   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | pid 12178 is in state "Stopped"

	I1003 18:21:43.538228   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | Removing stale pid file /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/hyperkit.pid...

	I1003 18:21:43.538526   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | Using UUID f6c90a8a-6253-11ee-8906-149d997cd0f1

	I1003 18:21:43.555941   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | Generated MAC 7a:7f:34:e0:d9:d0

	I1003 18:21:43.555980   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | Starting with cmdline: loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-528000

	I1003 18:21:43.556222   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 DEBUG: hyperkit: Start &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"f6c90a8a-6253-11ee-8906-149d997cd0f1", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc000450cc0)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/bzimage", Initrd:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:""

, process:(*os.Process)(nil)}

	I1003 18:21:43.556273   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 DEBUG: hyperkit: check &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"f6c90a8a-6253-11ee-8906-149d997cd0f1", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc000450cc0)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/bzimage", Initrd:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:""

, process:(*os.Process)(nil)}

	I1003 18:21:43.556364   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 DEBUG: hyperkit: Arguments: []string{"-A", "-u", "-F", "/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/hyperkit.pid", "-c", "2", "-m", "2200M", "-s", "0:0,hostbridge", "-s", "31,lpc", "-s", "1:0,virtio-net", "-U", "f6c90a8a-6253-11ee-8906-149d997cd0f1", "-s", "2:0,virtio-blk,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/multinode-528000-m02.rawdisk", "-s", "3,ahci-cd,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/boot2docker.iso", "-s", "4,virtio-rnd", "-l", "com1,autopty=/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/tty,log=/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/console-ring", "-f", "kexec,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/bzimage,/Users/j

enkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-528000"}

	I1003 18:21:43.556435   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 DEBUG: hyperkit: CmdLine: "/usr/local/bin/hyperkit -A -u -F /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/hyperkit.pid -c 2 -m 2200M -s 0:0,hostbridge -s 31,lpc -s 1:0,virtio-net -U f6c90a8a-6253-11ee-8906-149d997cd0f1 -s 2:0,virtio-blk,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/multinode-528000-m02.rawdisk -s 3,ahci-cd,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/boot2docker.iso -s 4,virtio-rnd -l com1,autopty=/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/tty,log=/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/console-ring -f kexec,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/bzimage,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/mult

inode-528000-m02/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-528000"

	I1003 18:21:43.556462   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 DEBUG: hyperkit: Redirecting stdout/stderr to logger

	I1003 18:21:43.557882   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 DEBUG: hyperkit: Pid is 12534

	I1003 18:21:43.558297   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | Attempt 0

	I1003 18:21:43.558322   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I1003 18:21:43.558416   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | hyperkit pid from json: 12534

	I1003 18:21:43.560261   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | Searching for 7a:7f:34:e0:d9:d0 in /var/db/dhcpd_leases ...

	I1003 18:21:43.560420   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | Found 58 entries in /var/db/dhcpd_leases!

	I1003 18:21:43.560447   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.168.89.41 HWAddress:76:a6:64:b1:fb:af ID:1,76:a6:64:b1:fb:af Lease:0x651e0f7a}

	I1003 18:21:43.560464   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.168.89.43 HWAddress:f2:fa:7b:e9:10:aa ID:1,f2:fa:7b:e9:10:aa Lease:0x651cbdf1}

	I1003 18:21:43.560480   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.168.89.42 HWAddress:7a:7f:34:e0:d9:d0 ID:1,7a:7f:34:e0:d9:d0 Lease:0x651e0efe}

	I1003 18:21:43.560494   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | Found match: 7a:7f:34:e0:d9:d0

	I1003 18:21:43.560505   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | IP: 192.168.89.42

	I1003 18:21:43.560523   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetConfigRaw

	I1003 18:21:43.561207   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetIP

	I1003 18:21:43.561423   12504 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/config.json ...

	I1003 18:21:43.561791   12504 machine.go:88] provisioning docker machine ...

	I1003 18:21:43.561802   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .DriverName

	I1003 18:21:43.561925   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetMachineName

	I1003 18:21:43.562034   12504 buildroot.go:166] provisioning hostname "multinode-528000-m02"

	I1003 18:21:43.562045   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetMachineName

	I1003 18:21:43.562143   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHHostname

	I1003 18:21:43.562248   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHPort

	I1003 18:21:43.562368   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:21:43.562506   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:21:43.562625   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHUsername

	I1003 18:21:43.562756   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:21:43.563024   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.42 22 <nil> <nil>}

	I1003 18:21:43.563035   12504 main.go:141] libmachine: About to run SSH command:

	sudo hostname multinode-528000-m02 && echo "multinode-528000-m02" | sudo tee /etc/hostname

	I1003 18:21:43.565689   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 INFO : hyperkit: stderr: Using fd 5 for I/O notifications

	I1003 18:21:43.574251   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 INFO : hyperkit: stderr: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/boot2docker.iso: fcntl(F_PUNCHHOLE) Operation not permitted: block device will not support TRIM/DISCARD

	I1003 18:21:43.575182   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0

	I1003 18:21:43.575205   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0

	I1003 18:21:43.575216   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0

	I1003 18:21:43.575225   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0

	I1003 18:21:43.944339   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 0

	I1003 18:21:43.944355   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:43 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 0

	I1003 18:21:44.048457   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:44 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0

	I1003 18:21:44.048479   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:44 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0

	I1003 18:21:44.048491   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:44 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0

	I1003 18:21:44.048500   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:44 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0

	I1003 18:21:44.049336   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:44 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 1

	I1003 18:21:44.049347   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:44 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 1

	I1003 18:21:48.960822   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:48 INFO : hyperkit: stderr: rdmsr to register 0x64d on vcpu 1

	I1003 18:21:48.960883   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:48 INFO : hyperkit: stderr: rdmsr to register 0x64e on vcpu 1

	I1003 18:21:48.960893   12504 main.go:141] libmachine: (multinode-528000-m02) DBG | 2023/10/03 18:21:48 INFO : hyperkit: stderr: rdmsr to register 0x34 on vcpu 1

	I1003 18:22:18.640540   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-528000-m02

	I1003 18:22:18.640557   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHHostname

	I1003 18:22:18.640683   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHPort

	I1003 18:22:18.640783   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:18.640874   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:18.640956   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHUsername

	I1003 18:22:18.641083   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:22:18.641338   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.42 22 <nil> <nil>}

	I1003 18:22:18.641351   12504 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\smultinode-528000-m02' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 multinode-528000-m02/g' /etc/hosts;

				else 

					echo '127.0.1.1 multinode-528000-m02' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1003 18:22:18.704278   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1003 18:22:18.704294   12504 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/17348-9809/.minikube CaCertPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/17348-9809/.minikube}

	I1003 18:22:18.704307   12504 buildroot.go:174] setting up certificates

	I1003 18:22:18.704313   12504 provision.go:83] configureAuth start

	I1003 18:22:18.704327   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetMachineName

	I1003 18:22:18.704457   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetIP

	I1003 18:22:18.704568   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHHostname

	I1003 18:22:18.704643   12504 provision.go:138] copyHostCerts

	I1003 18:22:18.704670   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/cert.pem -> /Users/jenkins/minikube-integration/17348-9809/.minikube/cert.pem

	I1003 18:22:18.704712   12504 exec_runner.go:144] found /Users/jenkins/minikube-integration/17348-9809/.minikube/cert.pem, removing ...

	I1003 18:22:18.704718   12504 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17348-9809/.minikube/cert.pem

	I1003 18:22:18.704833   12504 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/17348-9809/.minikube/cert.pem (1123 bytes)

	I1003 18:22:18.705024   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/key.pem -> /Users/jenkins/minikube-integration/17348-9809/.minikube/key.pem

	I1003 18:22:18.705050   12504 exec_runner.go:144] found /Users/jenkins/minikube-integration/17348-9809/.minikube/key.pem, removing ...

	I1003 18:22:18.705054   12504 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17348-9809/.minikube/key.pem

	I1003 18:22:18.705126   12504 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/17348-9809/.minikube/key.pem (1679 bytes)

	I1003 18:22:18.705264   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem -> /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.pem

	I1003 18:22:18.705289   12504 exec_runner.go:144] found /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.pem, removing ...

	I1003 18:22:18.705293   12504 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.pem

	I1003 18:22:18.705360   12504 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.pem (1082 bytes)

	I1003 18:22:18.705498   12504 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca-key.pem org=jenkins.multinode-528000-m02 san=[192.168.89.42 192.168.89.42 localhost 127.0.0.1 minikube multinode-528000-m02]

	I1003 18:22:18.913935   12504 provision.go:172] copyRemoteCerts

	I1003 18:22:18.913984   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1003 18:22:18.913999   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHHostname

	I1003 18:22:18.914181   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHPort

	I1003 18:22:18.914383   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:18.914480   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHUsername

	I1003 18:22:18.914666   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.42 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/id_rsa Username:docker}

	I1003 18:22:18.949416   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server.pem -> /etc/docker/server.pem

	I1003 18:22:18.949476   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server.pem --> /etc/docker/server.pem (1237 bytes)

	I1003 18:22:18.964789   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I1003 18:22:18.964843   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I1003 18:22:18.980310   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I1003 18:22:18.980375   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1003 18:22:18.995890   12504 provision.go:86] duration metric: configureAuth took 291.5699ms

	I1003 18:22:18.995902   12504 buildroot.go:189] setting minikube options for container-runtime

	I1003 18:22:18.996081   12504 config.go:182] Loaded profile config "multinode-528000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 18:22:18.996114   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .DriverName

	I1003 18:22:18.996242   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHHostname

	I1003 18:22:18.996350   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHPort

	I1003 18:22:18.996438   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:18.996520   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:18.996595   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHUsername

	I1003 18:22:18.996708   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:22:18.996965   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.42 22 <nil> <nil>}

	I1003 18:22:18.996974   12504 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1003 18:22:19.053901   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I1003 18:22:19.053913   12504 buildroot.go:70] root file system type: tmpfs

	I1003 18:22:19.054001   12504 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I1003 18:22:19.054011   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHHostname

	I1003 18:22:19.054150   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHPort

	I1003 18:22:19.054236   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:19.054336   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:19.054422   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHUsername

	I1003 18:22:19.054563   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:22:19.054820   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.42 22 <nil> <nil>}

	I1003 18:22:19.054870   12504 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	Environment="NO_PROXY=192.168.89.41"

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1003 18:22:19.120819   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	Environment=NO_PROXY=192.168.89.41

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I1003 18:22:19.120838   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHHostname

	I1003 18:22:19.120992   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHPort

	I1003 18:22:19.121099   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:19.121183   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:19.121292   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHUsername

	I1003 18:22:19.121418   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:22:19.121672   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.42 22 <nil> <nil>}

	I1003 18:22:19.121685   12504 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1003 18:22:19.664571   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I1003 18:22:19.664588   12504 machine.go:91] provisioned docker machine in 36.102420899s

	I1003 18:22:19.664595   12504 start.go:300] post-start starting for "multinode-528000-m02" (driver="hyperkit")

	I1003 18:22:19.664606   12504 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1003 18:22:19.664617   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .DriverName

	I1003 18:22:19.664816   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1003 18:22:19.664832   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHHostname

	I1003 18:22:19.664933   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHPort

	I1003 18:22:19.665013   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:19.665109   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHUsername

	I1003 18:22:19.665198   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.42 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/id_rsa Username:docker}

	I1003 18:22:19.699406   12504 ssh_runner.go:195] Run: cat /etc/os-release

	I1003 18:22:19.701837   12504 command_runner.go:130] > NAME=Buildroot

	I1003 18:22:19.701848   12504 command_runner.go:130] > VERSION=2021.02.12-1-gb090841-dirty

	I1003 18:22:19.701852   12504 command_runner.go:130] > ID=buildroot

	I1003 18:22:19.701856   12504 command_runner.go:130] > VERSION_ID=2021.02.12

	I1003 18:22:19.701861   12504 command_runner.go:130] > PRETTY_NAME="Buildroot 2021.02.12"

	I1003 18:22:19.702044   12504 info.go:137] Remote host: Buildroot 2021.02.12

	I1003 18:22:19.702052   12504 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17348-9809/.minikube/addons for local assets ...

	I1003 18:22:19.702126   12504 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17348-9809/.minikube/files for local assets ...

	I1003 18:22:19.702262   12504 filesync.go:149] local asset: /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem -> 102692.pem in /etc/ssl/certs

	I1003 18:22:19.702271   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem -> /etc/ssl/certs/102692.pem

	I1003 18:22:19.702429   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1003 18:22:19.708830   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem --> /etc/ssl/certs/102692.pem (1708 bytes)

	I1003 18:22:19.724301   12504 start.go:303] post-start completed in 59.69839ms

	I1003 18:22:19.724311   12504 fix.go:56] fixHost completed within 36.260766829s

	I1003 18:22:19.724326   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHHostname

	I1003 18:22:19.724453   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHPort

	I1003 18:22:19.724543   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:19.724647   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:19.724735   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHUsername

	I1003 18:22:19.724845   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:22:19.725097   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.42 22 <nil> <nil>}

	I1003 18:22:19.725105   12504 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I1003 18:22:19.782119   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: 1696382539.953585577

	I1003 18:22:19.782133   12504 fix.go:206] guest clock: 1696382539.953585577

	I1003 18:22:19.782138   12504 fix.go:219] Guest: 2023-10-03 18:22:19.953585577 -0700 PDT Remote: 2023-10-03 18:22:19.724316 -0700 PDT m=+89.735411892 (delta=229.269577ms)

	I1003 18:22:19.782156   12504 fix.go:190] guest clock delta is within tolerance: 229.269577ms

	I1003 18:22:19.782161   12504 start.go:83] releasing machines lock for "multinode-528000-m02", held for 36.318628062s

	I1003 18:22:19.782179   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .DriverName

	I1003 18:22:19.782305   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetIP

	I1003 18:22:19.804802   12504 out.go:177] * Found network options:

	I1003 18:22:19.826926   12504 out.go:177]   - NO_PROXY=192.168.89.41

	W1003 18:22:19.848689   12504 proxy.go:119] fail to check proxy env: Error ip not in block

	I1003 18:22:19.848735   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .DriverName

	I1003 18:22:19.849587   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .DriverName

	I1003 18:22:19.849838   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .DriverName

	I1003 18:22:19.849936   12504 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I1003 18:22:19.849980   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHHostname

	W1003 18:22:19.850079   12504 proxy.go:119] fail to check proxy env: Error ip not in block

	I1003 18:22:19.850160   12504 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	I1003 18:22:19.850162   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHPort

	I1003 18:22:19.850183   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHHostname

	I1003 18:22:19.850414   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:19.850458   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHPort

	I1003 18:22:19.850597   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHUsername

	I1003 18:22:19.850674   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHKeyPath

	I1003 18:22:19.850873   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetSSHUsername

	I1003 18:22:19.850886   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.42 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/id_rsa Username:docker}

	I1003 18:22:19.851014   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.42 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m02/id_rsa Username:docker}

	I1003 18:22:19.884397   12504 command_runner.go:130] ! stat: cannot statx '/etc/cni/net.d/*loopback.conf*': No such file or directory

	W1003 18:22:19.884419   12504 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I1003 18:22:19.884475   12504 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1003 18:22:19.932507   12504 command_runner.go:130] > <a href="https://github.com/kubernetes/registry.k8s.io">Temporary Redirect</a>.

	I1003 18:22:19.932547   12504 command_runner.go:139] > /etc/cni/net.d/87-podman-bridge.conflist, 

	I1003 18:22:19.932572   12504 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I1003 18:22:19.932580   12504 start.go:469] detecting cgroup driver to use...

	I1003 18:22:19.932666   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1003 18:22:19.944675   12504 command_runner.go:130] > runtime-endpoint: unix:///run/containerd/containerd.sock

	I1003 18:22:19.944981   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I1003 18:22:19.952444   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I1003 18:22:19.959726   12504 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...

	I1003 18:22:19.959774   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I1003 18:22:19.967021   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1003 18:22:19.974194   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I1003 18:22:19.981325   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1003 18:22:19.988455   12504 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1003 18:22:19.995920   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I1003 18:22:20.002981   12504 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1003 18:22:20.009283   12504 command_runner.go:130] > net.bridge.bridge-nf-call-iptables = 1

	I1003 18:22:20.009387   12504 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1003 18:22:20.015817   12504 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 18:22:20.101017   12504 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I1003 18:22:20.113699   12504 start.go:469] detecting cgroup driver to use...

	I1003 18:22:20.113763   12504 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1003 18:22:20.122299   12504 command_runner.go:130] > # /usr/lib/systemd/system/docker.service

	I1003 18:22:20.122935   12504 command_runner.go:130] > [Unit]

	I1003 18:22:20.122946   12504 command_runner.go:130] > Description=Docker Application Container Engine

	I1003 18:22:20.122950   12504 command_runner.go:130] > Documentation=https://docs.docker.com

	I1003 18:22:20.122955   12504 command_runner.go:130] > After=network.target  minikube-automount.service docker.socket

	I1003 18:22:20.122966   12504 command_runner.go:130] > Requires= minikube-automount.service docker.socket 

	I1003 18:22:20.122970   12504 command_runner.go:130] > StartLimitBurst=3

	I1003 18:22:20.122973   12504 command_runner.go:130] > StartLimitIntervalSec=60

	I1003 18:22:20.122977   12504 command_runner.go:130] > [Service]

	I1003 18:22:20.122981   12504 command_runner.go:130] > Type=notify

	I1003 18:22:20.122985   12504 command_runner.go:130] > Restart=on-failure

	I1003 18:22:20.122989   12504 command_runner.go:130] > Environment=NO_PROXY=192.168.89.41

	I1003 18:22:20.123002   12504 command_runner.go:130] > # This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	I1003 18:22:20.123009   12504 command_runner.go:130] > # The base configuration already specifies an 'ExecStart=...' command. The first directive

	I1003 18:22:20.123014   12504 command_runner.go:130] > # here is to clear out that command inherited from the base configuration. Without this,

	I1003 18:22:20.123022   12504 command_runner.go:130] > # the command from the base configuration and the command specified here are treated as

	I1003 18:22:20.123027   12504 command_runner.go:130] > # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	I1003 18:22:20.123033   12504 command_runner.go:130] > # will catch this invalid input and refuse to start the service with an error like:

	I1003 18:22:20.123039   12504 command_runner.go:130] > #  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	I1003 18:22:20.123052   12504 command_runner.go:130] > # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	I1003 18:22:20.123059   12504 command_runner.go:130] > # container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	I1003 18:22:20.123062   12504 command_runner.go:130] > ExecStart=

	I1003 18:22:20.123073   12504 command_runner.go:130] > ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	I1003 18:22:20.123079   12504 command_runner.go:130] > ExecReload=/bin/kill -s HUP $MAINPID

	I1003 18:22:20.123087   12504 command_runner.go:130] > # Having non-zero Limit*s causes performance problems due to accounting overhead

	I1003 18:22:20.123094   12504 command_runner.go:130] > # in the kernel. We recommend using cgroups to do container-local accounting.

	I1003 18:22:20.123099   12504 command_runner.go:130] > LimitNOFILE=infinity

	I1003 18:22:20.123103   12504 command_runner.go:130] > LimitNPROC=infinity

	I1003 18:22:20.123106   12504 command_runner.go:130] > LimitCORE=infinity

	I1003 18:22:20.123111   12504 command_runner.go:130] > # Uncomment TasksMax if your systemd version supports it.

	I1003 18:22:20.123117   12504 command_runner.go:130] > # Only systemd 226 and above support this version.

	I1003 18:22:20.123122   12504 command_runner.go:130] > TasksMax=infinity

	I1003 18:22:20.123125   12504 command_runner.go:130] > TimeoutStartSec=0

	I1003 18:22:20.123130   12504 command_runner.go:130] > # set delegate yes so that systemd does not reset the cgroups of docker containers

	I1003 18:22:20.123134   12504 command_runner.go:130] > Delegate=yes

	I1003 18:22:20.123140   12504 command_runner.go:130] > # kill only the docker process, not all processes in the cgroup

	I1003 18:22:20.123155   12504 command_runner.go:130] > KillMode=process

	I1003 18:22:20.123162   12504 command_runner.go:130] > [Install]

	I1003 18:22:20.123168   12504 command_runner.go:130] > WantedBy=multi-user.target

	I1003 18:22:20.123242   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1003 18:22:20.132583   12504 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I1003 18:22:20.145250   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1003 18:22:20.154043   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1003 18:22:20.162203   12504 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I1003 18:22:20.184916   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1003 18:22:20.193679   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1003 18:22:20.205492   12504 command_runner.go:130] > runtime-endpoint: unix:///var/run/cri-dockerd.sock

	I1003 18:22:20.205780   12504 ssh_runner.go:195] Run: which cri-dockerd

	I1003 18:22:20.207975   12504 command_runner.go:130] > /usr/bin/cri-dockerd

	I1003 18:22:20.208142   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I1003 18:22:20.214460   12504 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I1003 18:22:20.225379   12504 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I1003 18:22:20.315043   12504 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I1003 18:22:20.405374   12504 docker.go:554] configuring docker to use "cgroupfs" as cgroup driver...

	I1003 18:22:20.405412   12504 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I1003 18:22:20.418156   12504 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 18:22:20.510020   12504 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1003 18:22:21.785431   12504 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.275396662s)

	I1003 18:22:21.785486   12504 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I1003 18:22:21.869825   12504 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I1003 18:22:21.957945   12504 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I1003 18:22:22.046515   12504 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 18:22:22.130489   12504 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I1003 18:22:22.142724   12504 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 18:22:22.231593   12504 ssh_runner.go:195] Run: sudo systemctl restart cri-docker

	I1003 18:22:22.287026   12504 start.go:516] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I1003 18:22:22.287106   12504 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I1003 18:22:22.290950   12504 command_runner.go:130] >   File: /var/run/cri-dockerd.sock

	I1003 18:22:22.290961   12504 command_runner.go:130] >   Size: 0         	Blocks: 0          IO Block: 4096   socket

	I1003 18:22:22.290967   12504 command_runner.go:130] > Device: 16h/22d	Inode: 855         Links: 1

	I1003 18:22:22.290973   12504 command_runner.go:130] > Access: (0660/srw-rw----)  Uid: (    0/    root)   Gid: ( 1000/  docker)

	I1003 18:22:22.290982   12504 command_runner.go:130] > Access: 2023-10-04 01:22:22.413215863 +0000

	I1003 18:22:22.290988   12504 command_runner.go:130] > Modify: 2023-10-04 01:22:22.413215863 +0000

	I1003 18:22:22.290992   12504 command_runner.go:130] > Change: 2023-10-04 01:22:22.416215863 +0000

	I1003 18:22:22.290995   12504 command_runner.go:130] >  Birth: -

	I1003 18:22:22.291062   12504 start.go:537] Will wait 60s for crictl version

	I1003 18:22:22.291107   12504 ssh_runner.go:195] Run: which crictl

	I1003 18:22:22.293457   12504 command_runner.go:130] > /usr/bin/crictl

	I1003 18:22:22.293511   12504 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I1003 18:22:22.331854   12504 command_runner.go:130] > Version:  0.1.0

	I1003 18:22:22.331893   12504 command_runner.go:130] > RuntimeName:  docker

	I1003 18:22:22.331963   12504 command_runner.go:130] > RuntimeVersion:  24.0.6

	I1003 18:22:22.332032   12504 command_runner.go:130] > RuntimeApiVersion:  v1

	I1003 18:22:22.333174   12504 start.go:553] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  24.0.6

	RuntimeApiVersion:  v1

	I1003 18:22:22.333246   12504 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1003 18:22:22.349526   12504 command_runner.go:130] > 24.0.6

	I1003 18:22:22.350471   12504 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1003 18:22:22.366605   12504 command_runner.go:130] > 24.0.6

	I1003 18:22:22.410824   12504 out.go:204] * Preparing Kubernetes v1.28.2 on Docker 24.0.6 ...

	I1003 18:22:22.432694   12504 out.go:177]   - env NO_PROXY=192.168.89.41

	I1003 18:22:22.453427   12504 main.go:141] libmachine: (multinode-528000-m02) Calling .GetIP

	I1003 18:22:22.453702   12504 ssh_runner.go:195] Run: grep 192.168.89.1	host.minikube.internal$ /etc/hosts

	I1003 18:22:22.456888   12504 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.89.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1003 18:22:22.464774   12504 certs.go:56] Setting up /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000 for IP: 192.168.89.42

	I1003 18:22:22.464787   12504 certs.go:190] acquiring lock for shared ca certs: {Name:mk3b53aae05d89faa161c9ed5bb05e7f02553427 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1003 18:22:22.464917   12504 certs.go:199] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.key

	I1003 18:22:22.464965   12504 certs.go:199] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/17348-9809/.minikube/proxy-client-ca.key

	I1003 18:22:22.464974   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I1003 18:22:22.464993   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I1003 18:22:22.465008   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I1003 18:22:22.465025   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I1003 18:22:22.465100   12504 certs.go:437] found cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/10269.pem (1338 bytes)

	W1003 18:22:22.465136   12504 certs.go:433] ignoring /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/10269_empty.pem, impossibly tiny 0 bytes

	I1003 18:22:22.465145   12504 certs.go:437] found cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca-key.pem (1675 bytes)

	I1003 18:22:22.465175   12504 certs.go:437] found cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem (1082 bytes)

	I1003 18:22:22.465210   12504 certs.go:437] found cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/cert.pem (1123 bytes)

	I1003 18:22:22.465239   12504 certs.go:437] found cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/key.pem (1679 bytes)

	I1003 18:22:22.465300   12504 certs.go:437] found cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem (1708 bytes)

	I1003 18:22:22.465332   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem -> /usr/share/ca-certificates/102692.pem

	I1003 18:22:22.465357   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I1003 18:22:22.465373   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/10269.pem -> /usr/share/ca-certificates/10269.pem

	I1003 18:22:22.465623   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1003 18:22:22.481559   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1003 18:22:22.497344   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1003 18:22:22.512869   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I1003 18:22:22.528747   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem --> /usr/share/ca-certificates/102692.pem (1708 bytes)

	I1003 18:22:22.544322   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1003 18:22:22.560185   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/10269.pem --> /usr/share/ca-certificates/10269.pem (1338 bytes)

	I1003 18:22:22.575751   12504 ssh_runner.go:195] Run: openssl version

	I1003 18:22:22.579158   12504 command_runner.go:130] > OpenSSL 1.1.1n  15 Mar 2022

	I1003 18:22:22.579413   12504 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/102692.pem && ln -fs /usr/share/ca-certificates/102692.pem /etc/ssl/certs/102692.pem"

	I1003 18:22:22.586466   12504 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/102692.pem

	I1003 18:22:22.589292   12504 command_runner.go:130] > -rw-r--r-- 1 root root 1708 Oct  4 01:07 /usr/share/ca-certificates/102692.pem

	I1003 18:22:22.589374   12504 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Oct  4 01:07 /usr/share/ca-certificates/102692.pem

	I1003 18:22:22.589406   12504 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/102692.pem

	I1003 18:22:22.592779   12504 command_runner.go:130] > 3ec20f2e

	I1003 18:22:22.593014   12504 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/102692.pem /etc/ssl/certs/3ec20f2e.0"

	I1003 18:22:22.600023   12504 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1003 18:22:22.607257   12504 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1003 18:22:22.610369   12504 command_runner.go:130] > -rw-r--r-- 1 root root 1111 Oct  4 01:03 /usr/share/ca-certificates/minikubeCA.pem

	I1003 18:22:22.610468   12504 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Oct  4 01:03 /usr/share/ca-certificates/minikubeCA.pem

	I1003 18:22:22.610515   12504 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1003 18:22:22.614216   12504 command_runner.go:130] > b5213941

	I1003 18:22:22.614502   12504 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1003 18:22:22.621714   12504 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/10269.pem && ln -fs /usr/share/ca-certificates/10269.pem /etc/ssl/certs/10269.pem"

	I1003 18:22:22.628814   12504 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/10269.pem

	I1003 18:22:22.631853   12504 command_runner.go:130] > -rw-r--r-- 1 root root 1338 Oct  4 01:07 /usr/share/ca-certificates/10269.pem

	I1003 18:22:22.631924   12504 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Oct  4 01:07 /usr/share/ca-certificates/10269.pem

	I1003 18:22:22.631957   12504 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/10269.pem

	I1003 18:22:22.635288   12504 command_runner.go:130] > 51391683

	I1003 18:22:22.635536   12504 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/10269.pem /etc/ssl/certs/51391683.0"

	I1003 18:22:22.642613   12504 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd

	I1003 18:22:22.645167   12504 command_runner.go:130] ! ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory

	I1003 18:22:22.645189   12504 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory

	I1003 18:22:22.645257   12504 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I1003 18:22:22.661598   12504 command_runner.go:130] > cgroupfs

	I1003 18:22:22.662183   12504 cni.go:84] Creating CNI manager for ""

	I1003 18:22:22.662191   12504 cni.go:136] 3 nodes found, recommending kindnet

	I1003 18:22:22.662200   12504 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I1003 18:22:22.662216   12504 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.89.42 APIServerPort:8443 KubernetesVersion:v1.28.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:multinode-528000 NodeName:multinode-528000-m02 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.89.41"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.89.42 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPa

th:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I1003 18:22:22.662824   12504 kubeadm.go:181] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.89.42

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "multinode-528000-m02"

	  kubeletExtraArgs:

	    node-ip: 192.168.89.42

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.89.41"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.28.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1003 18:22:22.662908   12504 kubeadm.go:976] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.28.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=multinode-528000-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.89.42

	[Install]

	 config:

	{KubernetesVersion:v1.28.2 ClusterName:multinode-528000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I1003 18:22:22.662995   12504 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.2

	I1003 18:22:22.669850   12504 command_runner.go:130] > kubeadm

	I1003 18:22:22.669858   12504 command_runner.go:130] > kubectl

	I1003 18:22:22.669862   12504 command_runner.go:130] > kubelet

	I1003 18:22:22.669872   12504 binaries.go:44] Found k8s binaries, skipping transfer

	I1003 18:22:22.669918   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system

	I1003 18:22:22.676131   12504 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (382 bytes)

	I1003 18:22:22.687878   12504 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1003 18:22:22.698914   12504 ssh_runner.go:195] Run: grep 192.168.89.41	control-plane.minikube.internal$ /etc/hosts

	I1003 18:22:22.701240   12504 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.89.41	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1003 18:22:22.710478   12504 host.go:66] Checking if "multinode-528000" exists ...

	I1003 18:22:22.710642   12504 config.go:182] Loaded profile config "multinode-528000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 18:22:22.710720   12504 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I1003 18:22:22.710746   12504 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I1003 18:22:22.718827   12504 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59279

	I1003 18:22:22.719169   12504 main.go:141] libmachine: () Calling .GetVersion

	I1003 18:22:22.719529   12504 main.go:141] libmachine: Using API Version  1

	I1003 18:22:22.719544   12504 main.go:141] libmachine: () Calling .SetConfigRaw

	I1003 18:22:22.719763   12504 main.go:141] libmachine: () Calling .GetMachineName

	I1003 18:22:22.719866   12504 main.go:141] libmachine: (multinode-528000) Calling .DriverName

	I1003 18:22:22.719955   12504 start.go:304] JoinCluster: &{Name:multinode-528000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1696241247-17339@sha256:77c3e98870a99538e39ecb73a5e5230b746fa8c633c297c3d287ad4bba01a880 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersi

on:v1.28.2 ClusterName:multinode-528000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.89.41 Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.89.42 Port:0 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:false Worker:true} {Name:m03 IP:192.168.89.43 Port:0 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingr

ess:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom

QemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I1003 18:22:22.720045   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm token create --print-join-command --ttl=0"

	I1003 18:22:22.720058   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHHostname

	I1003 18:22:22.720136   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHPort

	I1003 18:22:22.720219   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:22:22.720297   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHUsername

	I1003 18:22:22.720377   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.41 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/id_rsa Username:docker}

	I1003 18:22:22.818259   12504 command_runner.go:130] > kubeadm join control-plane.minikube.internal:8443 --token lf0gm8.23fzb7jsawk87iu1 --discovery-token-ca-cert-hash sha256:753473a54c0ba856a4674584dd4dc7e8118c2f06516f2cb2508c67099b9c3a98 

	I1003 18:22:22.818332   12504 start.go:317] removing existing worker node "m02" before attempting to rejoin cluster: &{Name:m02 IP:192.168.89.42 Port:0 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:false Worker:true}

	I1003 18:22:22.818362   12504 host.go:66] Checking if "multinode-528000" exists ...

	I1003 18:22:22.818630   12504 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I1003 18:22:22.818657   12504 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I1003 18:22:22.826991   12504 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59282

	I1003 18:22:22.827355   12504 main.go:141] libmachine: () Calling .GetVersion

	I1003 18:22:22.827720   12504 main.go:141] libmachine: Using API Version  1

	I1003 18:22:22.827735   12504 main.go:141] libmachine: () Calling .SetConfigRaw

	I1003 18:22:22.827956   12504 main.go:141] libmachine: () Calling .GetMachineName

	I1003 18:22:22.828062   12504 main.go:141] libmachine: (multinode-528000) Calling .DriverName

	I1003 18:22:22.828209   12504 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl drain multinode-528000-m02 --force --grace-period=1 --skip-wait-for-delete-timeout=1 --disable-eviction --ignore-daemonsets --delete-emptydir-data --delete-local-data

	I1003 18:22:22.828227   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHHostname

	I1003 18:22:22.828313   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHPort

	I1003 18:22:22.828396   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHKeyPath

	I1003 18:22:22.828469   12504 main.go:141] libmachine: (multinode-528000) Calling .GetSSHUsername

	I1003 18:22:22.828553   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.41 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000/id_rsa Username:docker}

	I1003 18:22:22.920029   12504 command_runner.go:130] ! Flag --delete-local-data has been deprecated, This option is deprecated and will be deleted. Use --delete-emptydir-data.

	I1003 18:22:22.953614   12504 command_runner.go:130] ! Warning: ignoring DaemonSet-managed Pods: kube-system/kindnet-tl478, kube-system/kube-proxy-9pd2m

	I1003 18:22:25.962647   12504 command_runner.go:130] > node/multinode-528000-m02 cordoned

	I1003 18:22:25.962668   12504 command_runner.go:130] > pod "busybox-5bc68d56bd-6b4hh" has DeletionTimestamp older than 1 seconds, skipping

	I1003 18:22:25.962676   12504 command_runner.go:130] > node/multinode-528000-m02 drained

	I1003 18:22:25.962691   12504 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl drain multinode-528000-m02 --force --grace-period=1 --skip-wait-for-delete-timeout=1 --disable-eviction --ignore-daemonsets --delete-emptydir-data --delete-local-data: (3.134483453s)

	I1003 18:22:25.962703   12504 node.go:108] successfully drained node "m02"

	I1003 18:22:25.963001   12504 loader.go:395] Config loaded from file:  /Users/jenkins/minikube-integration/17348-9809/kubeconfig

	I1003 18:22:25.963189   12504 kapi.go:59] client config for multinode-528000: &rest.Config{Host:"https://192.168.89.41:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/client.key", CAFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Next

Protos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27c7a00), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1003 18:22:25.963484   12504 request.go:1212] Request Body: {"kind":"DeleteOptions","apiVersion":"v1"}

	I1003 18:22:25.963517   12504 round_trippers.go:463] DELETE https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:22:25.963521   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:25.963527   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:25.963535   12504 round_trippers.go:473]     Content-Type: application/json

	I1003 18:22:25.963541   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:25.966310   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:22:25.966320   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:25.966325   12504 round_trippers.go:580]     Audit-Id: c6cc682f-1dc8-4578-aa49-26a862c7d4d2

	I1003 18:22:25.966330   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:25.966335   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:25.966343   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:25.966348   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:25.966353   12504 round_trippers.go:580]     Content-Length: 171

	I1003 18:22:25.966358   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:26 GMT

	I1003 18:22:25.966379   12504 request.go:1212] Response Body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"multinode-528000-m02","kind":"nodes","uid":"0073defe-0d22-4c69-83ae-9ebd7055fa45"}}

	I1003 18:22:25.966396   12504 node.go:124] successfully deleted node "m02"

	I1003 18:22:25.966403   12504 start.go:321] successfully removed existing worker node "m02" from cluster: &{Name:m02 IP:192.168.89.42 Port:0 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:false Worker:true}

	I1003 18:22:25.966417   12504 start.go:325] trying to join worker node "m02" to cluster: &{Name:m02 IP:192.168.89.42 Port:0 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:false Worker:true}

	I1003 18:22:25.966428   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm join control-plane.minikube.internal:8443 --token lf0gm8.23fzb7jsawk87iu1 --discovery-token-ca-cert-hash sha256:753473a54c0ba856a4674584dd4dc7e8118c2f06516f2cb2508c67099b9c3a98 --ignore-preflight-errors=all --cri-socket /var/run/cri-dockerd.sock --node-name=multinode-528000-m02"

	I1003 18:22:26.027129   12504 command_runner.go:130] > [preflight] Running pre-flight checks

	I1003 18:22:26.197021   12504 command_runner.go:130] > [preflight] Reading configuration from the cluster...

	I1003 18:22:26.197035   12504 command_runner.go:130] > [preflight] FYI: You can look at this config file with 'kubectl -n kube-system get cm kubeadm-config -o yaml'

	I1003 18:22:26.222784   12504 command_runner.go:130] > [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I1003 18:22:26.222850   12504 command_runner.go:130] > [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I1003 18:22:26.223072   12504 command_runner.go:130] > [kubelet-start] Starting the kubelet

	I1003 18:22:26.315057   12504 command_runner.go:130] > [kubelet-start] Waiting for the kubelet to perform the TLS Bootstrap...

	I1003 18:22:27.829785   12504 command_runner.go:130] > This node has joined the cluster:

	I1003 18:22:27.829801   12504 command_runner.go:130] > * Certificate signing request was sent to apiserver and a response was received.

	I1003 18:22:27.829806   12504 command_runner.go:130] > * The Kubelet was informed of the new secure connection details.

	I1003 18:22:27.829811   12504 command_runner.go:130] > Run 'kubectl get nodes' on the control-plane to see this node join the cluster.

	I1003 18:22:27.831211   12504 command_runner.go:130] ! W1004 01:22:26.203146    1156 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/var/run/cri-dockerd.sock". Please update your configuration!

	I1003 18:22:27.831225   12504 command_runner.go:130] ! 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I1003 18:22:27.831240   12504 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm join control-plane.minikube.internal:8443 --token lf0gm8.23fzb7jsawk87iu1 --discovery-token-ca-cert-hash sha256:753473a54c0ba856a4674584dd4dc7e8118c2f06516f2cb2508c67099b9c3a98 --ignore-preflight-errors=all --cri-socket /var/run/cri-dockerd.sock --node-name=multinode-528000-m02": (1.864791289s)

	I1003 18:22:27.831251   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I1003 18:22:28.099505   12504 command_runner.go:130] ! Created symlink /etc/systemd/system/multi-user.target.wants/kubelet.service → /usr/lib/systemd/system/kubelet.service.

	I1003 18:22:28.099541   12504 start.go:306] JoinCluster complete in 5.379582725s

	I1003 18:22:28.099551   12504 cni.go:84] Creating CNI manager for ""

	I1003 18:22:28.099560   12504 cni.go:136] 3 nodes found, recommending kindnet

	I1003 18:22:28.099633   12504 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap

	I1003 18:22:28.103205   12504 command_runner.go:130] >   File: /opt/cni/bin/portmap

	I1003 18:22:28.103221   12504 command_runner.go:130] >   Size: 2615256   	Blocks: 5112       IO Block: 4096   regular file

	I1003 18:22:28.103226   12504 command_runner.go:130] > Device: 11h/17d	Inode: 3544        Links: 1

	I1003 18:22:28.103231   12504 command_runner.go:130] > Access: (0755/-rwxr-xr-x)  Uid: (    0/    root)   Gid: (    0/    root)

	I1003 18:22:28.103239   12504 command_runner.go:130] > Access: 2023-10-04 01:20:59.445267298 +0000

	I1003 18:22:28.103244   12504 command_runner.go:130] > Modify: 2023-09-19 00:07:45.000000000 +0000

	I1003 18:22:28.103248   12504 command_runner.go:130] > Change: 2023-10-04 01:20:57.047134463 +0000

	I1003 18:22:28.103258   12504 command_runner.go:130] >  Birth: -

	I1003 18:22:28.103343   12504 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.28.2/kubectl ...

	I1003 18:22:28.103354   12504 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)

	I1003 18:22:28.116055   12504 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I1003 18:22:28.368609   12504 command_runner.go:130] > clusterrole.rbac.authorization.k8s.io/kindnet unchanged

	I1003 18:22:28.370857   12504 command_runner.go:130] > clusterrolebinding.rbac.authorization.k8s.io/kindnet unchanged

	I1003 18:22:28.372588   12504 command_runner.go:130] > serviceaccount/kindnet unchanged

	I1003 18:22:28.378768   12504 command_runner.go:130] > daemonset.apps/kindnet configured

	I1003 18:22:28.380827   12504 loader.go:395] Config loaded from file:  /Users/jenkins/minikube-integration/17348-9809/kubeconfig

	I1003 18:22:28.381030   12504 kapi.go:59] client config for multinode-528000: &rest.Config{Host:"https://192.168.89.41:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/client.key", CAFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Next

Protos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27c7a00), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1003 18:22:28.381251   12504 round_trippers.go:463] GET https://192.168.89.41:8443/apis/apps/v1/namespaces/kube-system/deployments/coredns/scale

	I1003 18:22:28.381258   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:28.381264   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:28.381270   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:28.382676   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:28.382684   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:28.382690   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:28.382697   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:28.382712   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:28.382718   12504 round_trippers.go:580]     Content-Length: 291

	I1003 18:22:28.382722   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:28 GMT

	I1003 18:22:28.382727   12504 round_trippers.go:580]     Audit-Id: 44570bbb-e9c2-4477-a3e4-84f6378f3f5b

	I1003 18:22:28.382732   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:28.382743   12504 request.go:1212] Response Body: {"kind":"Scale","apiVersion":"autoscaling/v1","metadata":{"name":"coredns","namespace":"kube-system","uid":"922fb573-befe-48bc-bc7c-aeeaaee4dd54","resourceVersion":"866","creationTimestamp":"2023-10-04T01:18:19Z"},"spec":{"replicas":1},"status":{"replicas":1,"selector":"k8s-app=kube-dns"}}

	I1003 18:22:28.382786   12504 kapi.go:248] "coredns" deployment in "kube-system" namespace and "multinode-528000" context rescaled to 1 replicas

	I1003 18:22:28.382801   12504 start.go:223] Will wait 6m0s for node &{Name:m02 IP:192.168.89.42 Port:0 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:false Worker:true}

	I1003 18:22:28.407309   12504 out.go:177] * Verifying Kubernetes components...

	I1003 18:22:28.448219   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1003 18:22:28.466023   12504 loader.go:395] Config loaded from file:  /Users/jenkins/minikube-integration/17348-9809/kubeconfig

	I1003 18:22:28.466210   12504 kapi.go:59] client config for multinode-528000: &rest.Config{Host:"https://192.168.89.41:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/client.key", CAFile:"/Users/jenkins/minikube-integration/17348-9809/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Next

Protos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27c7a00), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1003 18:22:28.466391   12504 node_ready.go:35] waiting up to 6m0s for node "multinode-528000-m02" to be "Ready" ...

	I1003 18:22:28.466440   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:22:28.466445   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:28.466451   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:28.466457   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:28.468154   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:28.468162   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:28.468167   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:28.468175   12504 round_trippers.go:580]     Content-Length: 4029

	I1003 18:22:28.468185   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:28 GMT

	I1003 18:22:28.468194   12504 round_trippers.go:580]     Audit-Id: 9e486959-f05a-4fad-9d74-8ec7e8e949e4

	I1003 18:22:28.468207   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:28.468216   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:28.468229   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:28.468288   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m02","uid":"9415bef6-fa61-400c-ad0d-fab7e1d71e4c","resourceVersion":"950","creationTimestamp":"2023-10-04T01:22:26Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsT

ype":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:vo [truncated 3005 chars]

	I1003 18:22:28.468452   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:22:28.468458   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:28.468463   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:28.468468   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:28.469769   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:28.469777   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:28.469782   12504 round_trippers.go:580]     Content-Length: 4029

	I1003 18:22:28.469787   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:28 GMT

	I1003 18:22:28.469793   12504 round_trippers.go:580]     Audit-Id: 600176c3-bd65-4fb6-a6b0-9d1736e0a7af

	I1003 18:22:28.469800   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:28.469809   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:28.469813   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:28.469819   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:28.469850   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m02","uid":"9415bef6-fa61-400c-ad0d-fab7e1d71e4c","resourceVersion":"950","creationTimestamp":"2023-10-04T01:22:26Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsT

ype":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:vo [truncated 3005 chars]

	I1003 18:22:28.970457   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:22:28.970471   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:28.970480   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:28.970487   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:28.972364   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:28.972374   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:28.972379   12504 round_trippers.go:580]     Audit-Id: 20f18132-b048-4ec9-b029-9d0426c4e2b1

	I1003 18:22:28.972385   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:28.972392   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:28.972397   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:28.972403   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:28.972407   12504 round_trippers.go:580]     Content-Length: 4029

	I1003 18:22:28.972412   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:29 GMT

	I1003 18:22:28.972470   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m02","uid":"9415bef6-fa61-400c-ad0d-fab7e1d71e4c","resourceVersion":"950","creationTimestamp":"2023-10-04T01:22:26Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsT

ype":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:vo [truncated 3005 chars]

	I1003 18:22:29.471880   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:22:29.471906   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:29.471920   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:29.471985   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:29.474564   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:22:29.474581   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:29.474592   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:29.474604   12504 round_trippers.go:580]     Content-Length: 4029

	I1003 18:22:29.474652   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:29 GMT

	I1003 18:22:29.474668   12504 round_trippers.go:580]     Audit-Id: c857468d-b9fe-4ce1-b1e6-0b2547447025

	I1003 18:22:29.474676   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:29.474687   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:29.474695   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:29.474765   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m02","uid":"9415bef6-fa61-400c-ad0d-fab7e1d71e4c","resourceVersion":"950","creationTimestamp":"2023-10-04T01:22:26Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsT

ype":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:vo [truncated 3005 chars]

	I1003 18:22:29.970801   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:22:29.970845   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:29.970854   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:29.970860   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:29.972930   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:22:29.972939   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:29.972945   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:29.972967   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:30 GMT

	I1003 18:22:29.972976   12504 round_trippers.go:580]     Audit-Id: a87a580a-bd42-4c19-8139-f9d005795826

	I1003 18:22:29.972980   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:29.972987   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:29.972992   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:29.973157   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m02","uid":"9415bef6-fa61-400c-ad0d-fab7e1d71e4c","resourceVersion":"958","creationTimestamp":"2023-10-04T01:22:26Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{

}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 3114 chars]

	I1003 18:22:30.471905   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:22:30.471920   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:30.471977   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:30.471984   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:30.473719   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:30.473729   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:30.473734   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:30.473739   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:30 GMT

	I1003 18:22:30.473758   12504 round_trippers.go:580]     Audit-Id: db132be2-454e-42c3-81f3-86f64bf6ac9c

	I1003 18:22:30.473771   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:30.473787   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:30.473793   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:30.473872   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m02","uid":"9415bef6-fa61-400c-ad0d-fab7e1d71e4c","resourceVersion":"958","creationTimestamp":"2023-10-04T01:22:26Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{

}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 3114 chars]

	I1003 18:22:30.474034   12504 node_ready.go:58] node "multinode-528000-m02" has status "Ready":"False"

	I1003 18:22:30.970509   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:22:30.970523   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:30.970531   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:30.970536   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:30.972528   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:30.972542   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:30.972555   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:30.972561   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:30.972566   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:30.972571   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:30.972576   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:31 GMT

	I1003 18:22:30.972581   12504 round_trippers.go:580]     Audit-Id: bab2f1b3-e272-42a6-9771-caf62b2109aa

	I1003 18:22:30.972645   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m02","uid":"9415bef6-fa61-400c-ad0d-fab7e1d71e4c","resourceVersion":"958","creationTimestamp":"2023-10-04T01:22:26Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{

}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 3114 chars]

	I1003 18:22:31.470821   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:22:31.470846   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:31.470858   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:31.470868   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:31.473746   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:22:31.473762   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:31.473770   12504 round_trippers.go:580]     Audit-Id: 9da862e0-c117-4611-ae5b-41f00ca813cf

	I1003 18:22:31.473776   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:31.473782   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:31.473787   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:31.473798   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:31.473804   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:31 GMT

	I1003 18:22:31.473999   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m02","uid":"9415bef6-fa61-400c-ad0d-fab7e1d71e4c","resourceVersion":"958","creationTimestamp":"2023-10-04T01:22:26Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{

}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 3114 chars]

	I1003 18:22:31.970763   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:22:31.970784   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:31.970795   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:31.970805   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:31.973611   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:22:31.973631   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:31.973643   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:31.973655   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:31.973665   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:32 GMT

	I1003 18:22:31.973676   12504 round_trippers.go:580]     Audit-Id: 46883660-07ab-4d0e-bc25-a9f643b689bb

	I1003 18:22:31.973685   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:31.973694   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:31.973877   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m02","uid":"9415bef6-fa61-400c-ad0d-fab7e1d71e4c","resourceVersion":"958","creationTimestamp":"2023-10-04T01:22:26Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{

}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 3114 chars]

	I1003 18:22:32.471911   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:22:32.471931   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:32.471943   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:32.471953   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:32.474891   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:22:32.474907   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:32.474915   12504 round_trippers.go:580]     Audit-Id: 35920319-6280-42dc-b2ef-88df69ce5fa0

	I1003 18:22:32.474923   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:32.474932   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:32.474941   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:32.474951   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:32.474962   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:32 GMT

	I1003 18:22:32.475109   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m02","uid":"9415bef6-fa61-400c-ad0d-fab7e1d71e4c","resourceVersion":"970","creationTimestamp":"2023-10-04T01:22:26Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{

}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 3372 chars]

	I1003 18:22:32.475325   12504 node_ready.go:49] node "multinode-528000-m02" has status "Ready":"True"

	I1003 18:22:32.475335   12504 node_ready.go:38] duration metric: took 4.008774738s waiting for node "multinode-528000-m02" to be "Ready" ...

	I1003 18:22:32.475342   12504 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1003 18:22:32.475386   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods

	I1003 18:22:32.475394   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:32.475402   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:32.475409   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:32.477866   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:22:32.477875   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:32.477881   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:32 GMT

	I1003 18:22:32.477887   12504 round_trippers.go:580]     Audit-Id: 0991c30a-5d70-4f68-80a8-1f162af03656

	I1003 18:22:32.477895   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:32.477902   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:32.477909   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:32.477916   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:32.478651   12504 request.go:1212] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"972"},"items":[{"metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"862","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f

:preferredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{ [truncated 83778 chars]

	I1003 18:22:32.480541   12504 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:32.480587   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rtwd9

	I1003 18:22:32.480592   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:32.480598   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:32.480603   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:32.481807   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:32.481815   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:32.481820   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:32 GMT

	I1003 18:22:32.481827   12504 round_trippers.go:580]     Audit-Id: 27d787bd-d463-4800-8024-eec0772b387a

	I1003 18:22:32.481832   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:32.481837   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:32.481842   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:32.481846   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:32.481925   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-5dd5756b68-rtwd9","generateName":"coredns-5dd5756b68-","namespace":"kube-system","uid":"3da6e23f-9391-4ec9-99aa-db9b421b00ad","resourceVersion":"862","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"5dd5756b68"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-5dd5756b68","uid":"5150a422-e29d-41ea-9691-9e128e8a532d","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"5150a422-e29d-41ea-9691-9e128e8a532d\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{

}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6490 chars]

	I1003 18:22:32.482169   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:22:32.482176   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:32.482181   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:32.482187   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:32.483299   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:32.483308   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:32.483313   12504 round_trippers.go:580]     Audit-Id: 39ba83ca-ebc4-4df2-bc0d-6ae77339adc1

	I1003 18:22:32.483318   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:32.483323   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:32.483327   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:32.483332   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:32.483338   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:32 GMT

	I1003 18:22:32.483441   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:22:32.483629   12504 pod_ready.go:92] pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace has status "Ready":"True"

	I1003 18:22:32.483636   12504 pod_ready.go:81] duration metric: took 3.086713ms waiting for pod "coredns-5dd5756b68-rtwd9" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:32.483642   12504 pod_ready.go:78] waiting up to 6m0s for pod "etcd-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:32.483672   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/etcd-multinode-528000

	I1003 18:22:32.483677   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:32.483683   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:32.483689   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:32.484874   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:32.484883   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:32.484891   12504 round_trippers.go:580]     Audit-Id: 231a94af-c7fb-49f9-8214-e3457d47da2b

	I1003 18:22:32.484918   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:32.484930   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:32.484935   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:32.484940   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:32.484944   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:32 GMT

	I1003 18:22:32.485045   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"etcd-multinode-528000","namespace":"kube-system","uid":"a86312b2-3ca5-488d-b5bc-06c3346dc64e","resourceVersion":"847","creationTimestamp":"2023-10-04T01:18:19Z","labels":{"component":"etcd","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/etcd.advertise-client-urls":"https://192.168.89.41:2379","kubernetes.io/config.hash":"ae74302b7aebd7fdcc26eb5602da4836","kubernetes.io/config.mirror":"ae74302b7aebd7fdcc26eb5602da4836","kubernetes.io/config.seen":"2023-10-04T01:18:19.349005085Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:19Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubeadm.kubernetes.io/etcd.advertise-c

lient-urls":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config [truncated 6071 chars]

	I1003 18:22:32.485251   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:22:32.485259   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:32.485264   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:32.485269   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:32.486382   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:32.486389   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:32.486394   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:32.486398   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:32.486404   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:32 GMT

	I1003 18:22:32.486411   12504 round_trippers.go:580]     Audit-Id: 9babcfd4-6c93-45ee-9974-a126585686f9

	I1003 18:22:32.486418   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:32.486432   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:32.486550   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:22:32.486724   12504 pod_ready.go:92] pod "etcd-multinode-528000" in "kube-system" namespace has status "Ready":"True"

	I1003 18:22:32.486731   12504 pod_ready.go:81] duration metric: took 3.08423ms waiting for pod "etcd-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:32.486741   12504 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:32.486771   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-multinode-528000

	I1003 18:22:32.486774   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:32.486780   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:32.486785   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:32.488048   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:32.488056   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:32.488061   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:32.488066   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:32.488070   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:32 GMT

	I1003 18:22:32.488075   12504 round_trippers.go:580]     Audit-Id: b1dd0cee-ea6a-46bf-8e13-e60d5b39843b

	I1003 18:22:32.488080   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:32.488085   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:32.488339   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-apiserver-multinode-528000","namespace":"kube-system","uid":"e9361a2b-5db4-4742-9ef6-fbecda9d22a9","resourceVersion":"825","creationTimestamp":"2023-10-04T01:18:19Z","labels":{"component":"kube-apiserver","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint":"192.168.89.41:8443","kubernetes.io/config.hash":"6c45fd2961dfe8d00019d2277ceb95bd","kubernetes.io/config.mirror":"6c45fd2961dfe8d00019d2277ceb95bd","kubernetes.io/config.seen":"2023-10-04T01:18:19.349011685Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:19Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubeadm.kub

ernetes.io/kube-apiserver.advertise-address.endpoint":{},"f:kubernetes. [truncated 7606 chars]

	I1003 18:22:32.488564   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:22:32.488570   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:32.488576   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:32.488581   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:32.489941   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:32.489950   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:32.489955   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:32.489983   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:32 GMT

	I1003 18:22:32.489993   12504 round_trippers.go:580]     Audit-Id: 3dd7536c-4d17-4ac3-a986-6ed5cb16108e

	I1003 18:22:32.490003   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:32.490009   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:32.490014   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:32.490128   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:22:32.490294   12504 pod_ready.go:92] pod "kube-apiserver-multinode-528000" in "kube-system" namespace has status "Ready":"True"

	I1003 18:22:32.490300   12504 pod_ready.go:81] duration metric: took 3.554936ms waiting for pod "kube-apiserver-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:32.490307   12504 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:32.490339   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-multinode-528000

	I1003 18:22:32.490344   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:32.490351   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:32.490357   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:32.491676   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:32.491684   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:32.491689   12504 round_trippers.go:580]     Audit-Id: f3419181-8ba3-423f-9583-2aa90622f28f

	I1003 18:22:32.491694   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:32.491698   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:32.491702   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:32.491707   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:32.491712   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:32 GMT

	I1003 18:22:32.491839   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-controller-manager-multinode-528000","namespace":"kube-system","uid":"54a13f47-e858-461b-afae-d3307752880b","resourceVersion":"845","creationTimestamp":"2023-10-04T01:18:17Z","labels":{"component":"kube-controller-manager","tier":"control-plane"},"annotations":{"kubernetes.io/config.hash":"eeb9be3a2727f46db49245f383b6c839","kubernetes.io/config.mirror":"eeb9be3a2727f46db49245f383b6c839","kubernetes.io/config.seen":"2023-10-04T01:18:12.593443479Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:17Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config.mirror":{},"f:kubernetes.i

o/config.seen":{},"f:kubernetes.io/config.source":{}},"f:labels":{".":{ [truncated 7174 chars]

	I1003 18:22:32.492073   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:22:32.492080   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:32.492085   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:32.492091   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:32.493280   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:32.493289   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:32.493295   12504 round_trippers.go:580]     Audit-Id: 7a4cec93-d075-447e-ad3f-1353b5ae11c2

	I1003 18:22:32.493302   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:32.493307   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:32.493312   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:32.493317   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:32.493322   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:32 GMT

	I1003 18:22:32.493435   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:22:32.493612   12504 pod_ready.go:92] pod "kube-controller-manager-multinode-528000" in "kube-system" namespace has status "Ready":"True"

	I1003 18:22:32.493619   12504 pod_ready.go:81] duration metric: took 3.306951ms waiting for pod "kube-controller-manager-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:32.493625   12504 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-69bxc" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:32.673495   12504 request.go:629] Waited for 179.808177ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-69bxc

	I1003 18:22:32.673550   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-69bxc

	I1003 18:22:32.673555   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:32.673561   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:32.673569   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:32.675247   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:32.675256   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:32.675279   12504 round_trippers.go:580]     Audit-Id: 4d2a9135-eb01-491e-b238-1f0a57542e23

	I1003 18:22:32.675287   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:32.675292   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:32.675297   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:32.675301   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:32.675305   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:32 GMT

	I1003 18:22:32.675398   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-69bxc","generateName":"kube-proxy-","namespace":"kube-system","uid":"f621588e-bd8a-4135-aa5c-94eb292062f8","resourceVersion":"891","creationTimestamp":"2023-10-04T01:19:40Z","labels":{"controller-revision-hash":"5cbdb8dcbd","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"d64f3f20-7d64-423e-8050-9b9944997ed5","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:19:40Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"d64f3f20-7d64-423e-8050-9b9944997ed5\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r

equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5971 chars]

	I1003 18:22:32.873177   12504 request.go:629] Waited for 197.446703ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m03

	I1003 18:22:32.873275   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m03

	I1003 18:22:32.873286   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:32.873297   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:32.873308   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:32.875974   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:22:32.875991   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:32.876001   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:33 GMT

	I1003 18:22:32.876008   12504 round_trippers.go:580]     Audit-Id: d1ccaeee-488a-4bc9-8634-4bdb3ae32ccd

	I1003 18:22:32.876015   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:32.876021   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:32.876026   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:32.876039   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:32.876122   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m03","uid":"8b2fb46e-7671-4d24-b736-562f2f0cd353","resourceVersion":"892","creationTimestamp":"2023-10-04T01:20:20Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m03","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:20:20Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{

}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 3742 chars]

	I1003 18:22:32.876347   12504 pod_ready.go:97] node "multinode-528000-m03" hosting pod "kube-proxy-69bxc" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000-m03" has status "Ready":"Unknown"

	I1003 18:22:32.876363   12504 pod_ready.go:81] duration metric: took 382.719827ms waiting for pod "kube-proxy-69bxc" in "kube-system" namespace to be "Ready" ...

	E1003 18:22:32.876371   12504 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-528000-m03" hosting pod "kube-proxy-69bxc" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-528000-m03" has status "Ready":"Unknown"

	I1003 18:22:32.876380   12504 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-8bl5p" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:33.073456   12504 request.go:629] Waited for 197.023773ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-8bl5p

	I1003 18:22:33.073518   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-8bl5p

	I1003 18:22:33.073524   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:33.073530   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:33.073535   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:33.075270   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:33.075286   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:33.075292   12504 round_trippers.go:580]     Audit-Id: 17bf2a6c-4cd6-4cff-8a0e-50cbfd2f5b6e

	I1003 18:22:33.075297   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:33.075303   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:33.075309   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:33.075314   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:33.075319   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:33 GMT

	I1003 18:22:33.075397   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-8bl5p","generateName":"kube-proxy-","namespace":"kube-system","uid":"11839b32-7219-414d-a63f-026b1be9ab5c","resourceVersion":"820","creationTimestamp":"2023-10-04T01:18:32Z","labels":{"controller-revision-hash":"5cbdb8dcbd","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"d64f3f20-7d64-423e-8050-9b9944997ed5","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:32Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"d64f3f20-7d64-423e-8050-9b9944997ed5\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r

equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5738 chars]

	I1003 18:22:33.272297   12504 request.go:629] Waited for 196.509741ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:22:33.272344   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:22:33.272353   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:33.272365   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:33.272377   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:33.274741   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:22:33.274755   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:33.274762   12504 round_trippers.go:580]     Audit-Id: f7363788-e9d9-458c-a065-0ffaf8329e20

	I1003 18:22:33.274777   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:33.274784   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:33.274791   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:33.274802   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:33.274822   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:33 GMT

	I1003 18:22:33.275154   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:22:33.275412   12504 pod_ready.go:92] pod "kube-proxy-8bl5p" in "kube-system" namespace has status "Ready":"True"

	I1003 18:22:33.275424   12504 pod_ready.go:81] duration metric: took 399.022644ms waiting for pod "kube-proxy-8bl5p" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:33.275432   12504 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-9pd2m" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:33.473921   12504 request.go:629] Waited for 198.439453ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-9pd2m

	I1003 18:22:33.473999   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-9pd2m

	I1003 18:22:33.474007   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:33.474026   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:33.474035   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:33.476123   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:22:33.476132   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:33.476139   12504 round_trippers.go:580]     Audit-Id: 7c89610a-b3ca-4496-a866-44a29cf69914

	I1003 18:22:33.476146   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:33.476153   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:33.476161   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:33.476169   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:33.476178   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:33 GMT

	I1003 18:22:33.476259   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-9pd2m","generateName":"kube-proxy-","namespace":"kube-system","uid":"41452f70-63bc-473d-b7bd-93e2efa7a304","resourceVersion":"961","creationTimestamp":"2023-10-04T01:19:04Z","labels":{"controller-revision-hash":"5cbdb8dcbd","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"d64f3f20-7d64-423e-8050-9b9944997ed5","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:19:04Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"d64f3f20-7d64-423e-8050-9b9944997ed5\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r

equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5746 chars]

	I1003 18:22:33.672393   12504 request.go:629] Waited for 195.739414ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:22:33.672469   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000-m02

	I1003 18:22:33.672478   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:33.672491   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:33.672502   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:33.675689   12504 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1003 18:22:33.675704   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:33.675711   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:33.675722   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:33.675731   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:33.675743   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:33 GMT

	I1003 18:22:33.675751   12504 round_trippers.go:580]     Audit-Id: efca468e-495d-44b2-8d20-6d4fb45d3f15

	I1003 18:22:33.675760   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:33.675931   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000-m02","uid":"9415bef6-fa61-400c-ad0d-fab7e1d71e4c","resourceVersion":"970","creationTimestamp":"2023-10-04T01:22:26Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:22:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{

}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 3372 chars]

	I1003 18:22:33.676147   12504 pod_ready.go:92] pod "kube-proxy-9pd2m" in "kube-system" namespace has status "Ready":"True"

	I1003 18:22:33.676159   12504 pod_ready.go:81] duration metric: took 400.709688ms waiting for pod "kube-proxy-9pd2m" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:33.676175   12504 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:33.872070   12504 request.go:629] Waited for 195.82922ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-multinode-528000

	I1003 18:22:33.872228   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-multinode-528000

	I1003 18:22:33.872239   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:33.872251   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:33.872261   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:33.874827   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:22:33.874838   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:33.874845   12504 round_trippers.go:580]     Audit-Id: cfe74641-13a1-4504-a843-57f217a7de6c

	I1003 18:22:33.874870   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:33.874881   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:33.874887   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:33.874894   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:33.874905   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:34 GMT

	I1003 18:22:33.875039   12504 request.go:1212] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-scheduler-multinode-528000","namespace":"kube-system","uid":"ff27b767-6913-4efa-8a1e-8398fba84175","resourceVersion":"846","creationTimestamp":"2023-10-04T01:18:17Z","labels":{"component":"kube-scheduler","tier":"control-plane"},"annotations":{"kubernetes.io/config.hash":"e3e48fd34564ef6993a5357d3bb10a96","kubernetes.io/config.mirror":"e3e48fd34564ef6993a5357d3bb10a96","kubernetes.io/config.seen":"2023-10-04T01:18:12.593444031Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-10-04T01:18:17Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config.mirror":{},"f:kubernetes.io/config.seen":{},

"f:kubernetes.io/config.source":{}},"f:labels":{".":{},"f:component":{} [truncated 4904 chars]

	I1003 18:22:34.072738   12504 request.go:629] Waited for 197.353239ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:22:34.072795   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes/multinode-528000

	I1003 18:22:34.072803   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:34.072815   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:34.072827   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:34.075726   12504 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1003 18:22:34.075741   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:34.075748   12504 round_trippers.go:580]     Audit-Id: 667d39c6-b9aa-4d01-bf80-8787a20b95f9

	I1003 18:22:34.075755   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:34.075761   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:34.075768   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:34.075777   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:34.075787   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:34 GMT

	I1003 18:22:34.075922   12504 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api

Version":"v1","time":"2023-10-04T01:18:16Z","fieldsType":"FieldsV1","fi [truncated 5173 chars]

	I1003 18:22:34.076177   12504 pod_ready.go:92] pod "kube-scheduler-multinode-528000" in "kube-system" namespace has status "Ready":"True"

	I1003 18:22:34.076187   12504 pod_ready.go:81] duration metric: took 399.994337ms waiting for pod "kube-scheduler-multinode-528000" in "kube-system" namespace to be "Ready" ...

	I1003 18:22:34.076196   12504 pod_ready.go:38] duration metric: took 1.600797883s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1003 18:22:34.076222   12504 system_svc.go:44] waiting for kubelet service to be running ....

	I1003 18:22:34.076282   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1003 18:22:34.085740   12504 system_svc.go:56] duration metric: took 9.5134ms WaitForService to wait for kubelet.

	I1003 18:22:34.085757   12504 kubeadm.go:581] duration metric: took 5.702728843s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I1003 18:22:34.085769   12504 node_conditions.go:102] verifying NodePressure condition ...

	I1003 18:22:34.272064   12504 request.go:629] Waited for 186.203907ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.89.41:8443/api/v1/nodes

	I1003 18:22:34.272106   12504 round_trippers.go:463] GET https://192.168.89.41:8443/api/v1/nodes

	I1003 18:22:34.272111   12504 round_trippers.go:469] Request Headers:

	I1003 18:22:34.272117   12504 round_trippers.go:473]     Accept: application/json, */*

	I1003 18:22:34.272123   12504 round_trippers.go:473]     User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format

	I1003 18:22:34.273859   12504 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I1003 18:22:34.273871   12504 round_trippers.go:577] Response Headers:

	I1003 18:22:34.273878   12504 round_trippers.go:580]     Date: Wed, 04 Oct 2023 01:22:34 GMT

	I1003 18:22:34.273885   12504 round_trippers.go:580]     Audit-Id: 79580fce-80a0-457b-8f0f-9119757e9520

	I1003 18:22:34.273893   12504 round_trippers.go:580]     Cache-Control: no-cache, private

	I1003 18:22:34.273900   12504 round_trippers.go:580]     Content-Type: application/json

	I1003 18:22:34.273906   12504 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d3126faf-9e98-4078-b69d-bc967a1b20ba

	I1003 18:22:34.273911   12504 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d2d2b7d9-0cb1-4333-9473-0a094020a76d

	I1003 18:22:34.274052   12504 request.go:1212] Response Body: {"kind":"NodeList","apiVersion":"v1","metadata":{"resourceVersion":"976"},"items":[{"metadata":{"name":"multinode-528000","uid":"74a484c1-57c2-46cd-83bb-6427036ca41e","resourceVersion":"830","creationTimestamp":"2023-10-04T01:18:16Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-528000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"cacb4070dc820e9f8fe7f94a5c041e95e45c32b1","minikube.k8s.io/name":"multinode-528000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_10_03T18_18_19_0700","minikube.k8s.io/version":"v1.31.2","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFiel

ds":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time" [truncated 14324 chars]

	I1003 18:22:34.274465   12504 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki

	I1003 18:22:34.274475   12504 node_conditions.go:123] node cpu capacity is 2

	I1003 18:22:34.274481   12504 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki

	I1003 18:22:34.274485   12504 node_conditions.go:123] node cpu capacity is 2

	I1003 18:22:34.274489   12504 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki

	I1003 18:22:34.274493   12504 node_conditions.go:123] node cpu capacity is 2

	I1003 18:22:34.274496   12504 node_conditions.go:105] duration metric: took 188.717951ms to run NodePressure ...

	I1003 18:22:34.274503   12504 start.go:228] waiting for startup goroutines ...

	I1003 18:22:34.274521   12504 start.go:242] writing updated cluster config ...

	I1003 18:22:34.275260   12504 config.go:182] Loaded profile config "multinode-528000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 18:22:34.275319   12504 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/config.json ...

	I1003 18:22:34.319252   12504 out.go:177] * Starting worker node multinode-528000-m03 in cluster multinode-528000

	I1003 18:22:34.339940   12504 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime docker

	I1003 18:22:34.340024   12504 cache.go:57] Caching tarball of preloaded images

	I1003 18:22:34.340190   12504 preload.go:174] Found /Users/jenkins/minikube-integration/17348-9809/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I1003 18:22:34.340208   12504 cache.go:60] Finished verifying existence of preloaded tar for  v1.28.2 on docker

	I1003 18:22:34.340328   12504 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/config.json ...

	I1003 18:22:34.341486   12504 start.go:365] acquiring machines lock for multinode-528000-m03: {Name:mk592c6e7c5aa7c823729561bf878fc0544d84d2 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1003 18:22:34.341580   12504 start.go:369] acquired machines lock for "multinode-528000-m03" in 70.293µs

	I1003 18:22:34.341604   12504 start.go:96] Skipping create...Using existing machine configuration

	I1003 18:22:34.341613   12504 fix.go:54] fixHost starting: m03

	I1003 18:22:34.342010   12504 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I1003 18:22:34.342044   12504 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I1003 18:22:34.350841   12504 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59285

	I1003 18:22:34.351207   12504 main.go:141] libmachine: () Calling .GetVersion

	I1003 18:22:34.351555   12504 main.go:141] libmachine: Using API Version  1

	I1003 18:22:34.351566   12504 main.go:141] libmachine: () Calling .SetConfigRaw

	I1003 18:22:34.351807   12504 main.go:141] libmachine: () Calling .GetMachineName

	I1003 18:22:34.351920   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .DriverName

	I1003 18:22:34.352008   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetState

	I1003 18:22:34.352091   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I1003 18:22:34.352175   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | hyperkit pid from json: 12468

	I1003 18:22:34.353114   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | hyperkit pid 12468 missing from process table

	I1003 18:22:34.353164   12504 fix.go:102] recreateIfNeeded on multinode-528000-m03: state=Stopped err=<nil>

	I1003 18:22:34.353183   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .DriverName

	W1003 18:22:34.353264   12504 fix.go:128] unexpected machine state, will restart: <nil>

	I1003 18:22:34.374225   12504 out.go:177] * Restarting existing hyperkit VM for "multinode-528000-m03" ...

	I1003 18:22:34.417944   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .Start

	I1003 18:22:34.418110   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I1003 18:22:34.418137   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/hyperkit.pid

	I1003 18:22:34.418186   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | Using UUID 0d2b803c-6254-11ee-90e2-149d997cd0f1

	I1003 18:22:34.436446   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | Generated MAC f2:fa:7b:e9:10:aa

	I1003 18:22:34.436517   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | Starting with cmdline: loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-528000

	I1003 18:22:34.436705   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 DEBUG: hyperkit: Start &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"0d2b803c-6254-11ee-90e2-149d997cd0f1", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc000096450)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/bzimage", Initrd:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:""

, process:(*os.Process)(nil)}

	I1003 18:22:34.436763   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 DEBUG: hyperkit: check &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"0d2b803c-6254-11ee-90e2-149d997cd0f1", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc000096450)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/bzimage", Initrd:"/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:""

, process:(*os.Process)(nil)}

	I1003 18:22:34.436822   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 DEBUG: hyperkit: Arguments: []string{"-A", "-u", "-F", "/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/hyperkit.pid", "-c", "2", "-m", "2200M", "-s", "0:0,hostbridge", "-s", "31,lpc", "-s", "1:0,virtio-net", "-U", "0d2b803c-6254-11ee-90e2-149d997cd0f1", "-s", "2:0,virtio-blk,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/multinode-528000-m03.rawdisk", "-s", "3,ahci-cd,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/boot2docker.iso", "-s", "4,virtio-rnd", "-l", "com1,autopty=/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/tty,log=/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/console-ring", "-f", "kexec,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/bzimage,/Users/j

enkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-528000"}

	I1003 18:22:34.436880   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 DEBUG: hyperkit: CmdLine: "/usr/local/bin/hyperkit -A -u -F /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/hyperkit.pid -c 2 -m 2200M -s 0:0,hostbridge -s 31,lpc -s 1:0,virtio-net -U 0d2b803c-6254-11ee-90e2-149d997cd0f1 -s 2:0,virtio-blk,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/multinode-528000-m03.rawdisk -s 3,ahci-cd,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/boot2docker.iso -s 4,virtio-rnd -l com1,autopty=/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/tty,log=/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/console-ring -f kexec,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/bzimage,/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/mult

inode-528000-m03/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-528000"

	I1003 18:22:34.436900   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 DEBUG: hyperkit: Redirecting stdout/stderr to logger

	I1003 18:22:34.438454   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 DEBUG: hyperkit: Pid is 12545

	I1003 18:22:34.438897   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | Attempt 0

	I1003 18:22:34.438912   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I1003 18:22:34.439017   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | hyperkit pid from json: 12545

	I1003 18:22:34.441458   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | Searching for f2:fa:7b:e9:10:aa in /var/db/dhcpd_leases ...

	I1003 18:22:34.441579   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | Found 58 entries in /var/db/dhcpd_leases!

	I1003 18:22:34.441602   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.168.89.42 HWAddress:7a:7f:34:e0:d9:d0 ID:1,7a:7f:34:e0:d9:d0 Lease:0x651e0faf}

	I1003 18:22:34.441632   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.168.89.41 HWAddress:76:a6:64:b1:fb:af ID:1,76:a6:64:b1:fb:af Lease:0x651e0f7a}

	I1003 18:22:34.441642   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetConfigRaw

	I1003 18:22:34.441650   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.168.89.43 HWAddress:f2:fa:7b:e9:10:aa ID:1,f2:fa:7b:e9:10:aa Lease:0x651cbdf1}

	I1003 18:22:34.441703   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | Found match: f2:fa:7b:e9:10:aa

	I1003 18:22:34.441717   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | IP: 192.168.89.43

	I1003 18:22:34.442446   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetIP

	I1003 18:22:34.442631   12504 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17348-9809/.minikube/profiles/multinode-528000/config.json ...

	I1003 18:22:34.443008   12504 machine.go:88] provisioning docker machine ...

	I1003 18:22:34.443019   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .DriverName

	I1003 18:22:34.443170   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetMachineName

	I1003 18:22:34.443274   12504 buildroot.go:166] provisioning hostname "multinode-528000-m03"

	I1003 18:22:34.443286   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetMachineName

	I1003 18:22:34.443404   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHHostname

	I1003 18:22:34.443516   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHPort

	I1003 18:22:34.443604   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:34.443708   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:34.443801   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHUsername

	I1003 18:22:34.443936   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:22:34.444260   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.43 22 <nil> <nil>}

	I1003 18:22:34.444289   12504 main.go:141] libmachine: About to run SSH command:

	sudo hostname multinode-528000-m03 && echo "multinode-528000-m03" | sudo tee /etc/hostname

	I1003 18:22:34.446835   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: Using fd 5 for I/O notifications

	I1003 18:22:34.455719   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/boot2docker.iso: fcntl(F_PUNCHHOLE) Operation not permitted: block device will not support TRIM/DISCARD

	I1003 18:22:34.456598   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0

	I1003 18:22:34.456614   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0

	I1003 18:22:34.456622   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0

	I1003 18:22:34.456628   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0

	I1003 18:22:34.828311   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 0

	I1003 18:22:34.828327   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 0

	I1003 18:22:34.932438   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0

	I1003 18:22:34.932466   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0

	I1003 18:22:34.932479   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0

	I1003 18:22:34.932491   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0

	I1003 18:22:34.933309   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 1

	I1003 18:22:34.933328   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:34 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 1

	I1003 18:22:39.877790   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:39 INFO : hyperkit: stderr: rdmsr to register 0x64d on vcpu 1

	I1003 18:22:39.877958   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:39 INFO : hyperkit: stderr: rdmsr to register 0x64e on vcpu 1

	I1003 18:22:39.877987   12504 main.go:141] libmachine: (multinode-528000-m03) DBG | 2023/10/03 18:22:39 INFO : hyperkit: stderr: rdmsr to register 0x34 on vcpu 1

	I1003 18:22:45.534665   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-528000-m03

	I1003 18:22:45.534680   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHHostname

	I1003 18:22:45.534820   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHPort

	I1003 18:22:45.534904   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:45.534987   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:45.535074   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHUsername

	I1003 18:22:45.535197   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:22:45.535482   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.43 22 <nil> <nil>}

	I1003 18:22:45.535495   12504 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\smultinode-528000-m03' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 multinode-528000-m03/g' /etc/hosts;

				else 

					echo '127.0.1.1 multinode-528000-m03' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1003 18:22:45.618997   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1003 18:22:45.619013   12504 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/17348-9809/.minikube CaCertPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/17348-9809/.minikube}

	I1003 18:22:45.619026   12504 buildroot.go:174] setting up certificates

	I1003 18:22:45.619036   12504 provision.go:83] configureAuth start

	I1003 18:22:45.619042   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetMachineName

	I1003 18:22:45.619187   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetIP

	I1003 18:22:45.619278   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHHostname

	I1003 18:22:45.619350   12504 provision.go:138] copyHostCerts

	I1003 18:22:45.619380   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/key.pem -> /Users/jenkins/minikube-integration/17348-9809/.minikube/key.pem

	I1003 18:22:45.619429   12504 exec_runner.go:144] found /Users/jenkins/minikube-integration/17348-9809/.minikube/key.pem, removing ...

	I1003 18:22:45.619435   12504 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17348-9809/.minikube/key.pem

	I1003 18:22:45.619563   12504 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/17348-9809/.minikube/key.pem (1679 bytes)

	I1003 18:22:45.619772   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem -> /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.pem

	I1003 18:22:45.619800   12504 exec_runner.go:144] found /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.pem, removing ...

	I1003 18:22:45.619805   12504 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.pem

	I1003 18:22:45.619869   12504 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/17348-9809/.minikube/ca.pem (1082 bytes)

	I1003 18:22:45.620014   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/cert.pem -> /Users/jenkins/minikube-integration/17348-9809/.minikube/cert.pem

	I1003 18:22:45.620043   12504 exec_runner.go:144] found /Users/jenkins/minikube-integration/17348-9809/.minikube/cert.pem, removing ...

	I1003 18:22:45.620048   12504 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17348-9809/.minikube/cert.pem

	I1003 18:22:45.620111   12504 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/17348-9809/.minikube/cert.pem (1123 bytes)

	I1003 18:22:45.620256   12504 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca-key.pem org=jenkins.multinode-528000-m03 san=[192.168.89.43 192.168.89.43 localhost 127.0.0.1 minikube multinode-528000-m03]

	I1003 18:22:45.772720   12504 provision.go:172] copyRemoteCerts

	I1003 18:22:45.772797   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1003 18:22:45.772811   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHHostname

	I1003 18:22:45.773008   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHPort

	I1003 18:22:45.773154   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:45.773328   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHUsername

	I1003 18:22:45.773478   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.43 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/id_rsa Username:docker}

	I1003 18:22:45.818262   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server.pem -> /etc/docker/server.pem

	I1003 18:22:45.818329   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server.pem --> /etc/docker/server.pem (1237 bytes)

	I1003 18:22:45.833995   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I1003 18:22:45.834060   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I1003 18:22:45.849244   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I1003 18:22:45.849294   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1003 18:22:45.865069   12504 provision.go:86] duration metric: configureAuth took 246.02493ms

	I1003 18:22:45.865082   12504 buildroot.go:189] setting minikube options for container-runtime

	I1003 18:22:45.865240   12504 config.go:182] Loaded profile config "multinode-528000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I1003 18:22:45.865253   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .DriverName

	I1003 18:22:45.865433   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHHostname

	I1003 18:22:45.865555   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHPort

	I1003 18:22:45.865635   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:45.865729   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:45.865808   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHUsername

	I1003 18:22:45.865909   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:22:45.866148   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.43 22 <nil> <nil>}

	I1003 18:22:45.866156   12504 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1003 18:22:45.941993   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I1003 18:22:45.942005   12504 buildroot.go:70] root file system type: tmpfs

	I1003 18:22:45.942084   12504 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I1003 18:22:45.942095   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHHostname

	I1003 18:22:45.942227   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHPort

	I1003 18:22:45.942327   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:45.942407   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:45.942502   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHUsername

	I1003 18:22:45.942643   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:22:45.942900   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.43 22 <nil> <nil>}

	I1003 18:22:45.942970   12504 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	Environment="NO_PROXY=192.168.89.41"

	Environment="NO_PROXY=192.168.89.41,192.168.89.42"

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1003 18:22:46.027483   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	Environment=NO_PROXY=192.168.89.41

	Environment=NO_PROXY=192.168.89.41,192.168.89.42

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I1003 18:22:46.027503   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHHostname

	I1003 18:22:46.027638   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHPort

	I1003 18:22:46.027726   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:46.027818   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:46.027900   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHUsername

	I1003 18:22:46.028026   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:22:46.028285   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.43 22 <nil> <nil>}

	I1003 18:22:46.028298   12504 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1003 18:22:46.588021   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I1003 18:22:46.588050   12504 machine.go:91] provisioned docker machine in 12.14488497s

	I1003 18:22:46.588057   12504 start.go:300] post-start starting for "multinode-528000-m03" (driver="hyperkit")

	I1003 18:22:46.588084   12504 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1003 18:22:46.588096   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .DriverName

	I1003 18:22:46.588403   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1003 18:22:46.588432   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHHostname

	I1003 18:22:46.588613   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHPort

	I1003 18:22:46.588799   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:46.588934   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHUsername

	I1003 18:22:46.589065   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.43 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/id_rsa Username:docker}

	I1003 18:22:46.631718   12504 ssh_runner.go:195] Run: cat /etc/os-release

	I1003 18:22:46.634422   12504 command_runner.go:130] > NAME=Buildroot

	I1003 18:22:46.634435   12504 command_runner.go:130] > VERSION=2021.02.12-1-gb090841-dirty

	I1003 18:22:46.634441   12504 command_runner.go:130] > ID=buildroot

	I1003 18:22:46.634447   12504 command_runner.go:130] > VERSION_ID=2021.02.12

	I1003 18:22:46.634454   12504 command_runner.go:130] > PRETTY_NAME="Buildroot 2021.02.12"

	I1003 18:22:46.634552   12504 info.go:137] Remote host: Buildroot 2021.02.12

	I1003 18:22:46.634562   12504 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17348-9809/.minikube/addons for local assets ...

	I1003 18:22:46.634638   12504 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17348-9809/.minikube/files for local assets ...

	I1003 18:22:46.634770   12504 filesync.go:149] local asset: /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem -> 102692.pem in /etc/ssl/certs

	I1003 18:22:46.634779   12504 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem -> /etc/ssl/certs/102692.pem

	I1003 18:22:46.634947   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1003 18:22:46.641198   12504 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17348-9809/.minikube/files/etc/ssl/certs/102692.pem --> /etc/ssl/certs/102692.pem (1708 bytes)

	I1003 18:22:46.656802   12504 start.go:303] post-start completed in 68.737316ms

	I1003 18:22:46.656813   12504 fix.go:56] fixHost completed within 12.315050535s

	I1003 18:22:46.656829   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHHostname

	I1003 18:22:46.656954   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHPort

	I1003 18:22:46.657042   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:46.657114   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:46.657189   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHUsername

	I1003 18:22:46.657298   12504 main.go:141] libmachine: Using SSH client type: native

	I1003 18:22:46.657554   12504 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f3fc0] 0x13f6ca0 <nil>  [] 0s} 192.168.89.43 22 <nil> <nil>}

	I1003 18:22:46.657562   12504 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I1003 18:22:46.733217   12504 main.go:141] libmachine: SSH cmd err, output: <nil>: 1696382566.907054958

	I1003 18:22:46.733232   12504 fix.go:206] guest clock: 1696382566.907054958

	I1003 18:22:46.733238   12504 fix.go:219] Guest: 2023-10-03 18:22:46.907054958 -0700 PDT Remote: 2023-10-03 18:22:46.656819 -0700 PDT m=+116.667538830 (delta=250.235958ms)

	I1003 18:22:46.733250   12504 fix.go:190] guest clock delta is within tolerance: 250.235958ms

	I1003 18:22:46.733254   12504 start.go:83] releasing machines lock for "multinode-528000-m03", held for 12.391514529s

	I1003 18:22:46.733271   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .DriverName

	I1003 18:22:46.733402   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetIP

	I1003 18:22:46.771942   12504 out.go:177] * Found network options:

	I1003 18:22:46.830764   12504 out.go:177]   - NO_PROXY=192.168.89.41,192.168.89.42

	W1003 18:22:46.852924   12504 proxy.go:119] fail to check proxy env: Error ip not in block

	W1003 18:22:46.852951   12504 proxy.go:119] fail to check proxy env: Error ip not in block

	I1003 18:22:46.852970   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .DriverName

	I1003 18:22:46.853747   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .DriverName

	I1003 18:22:46.853962   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .DriverName

	I1003 18:22:46.854071   12504 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I1003 18:22:46.854116   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHHostname

	W1003 18:22:46.854189   12504 proxy.go:119] fail to check proxy env: Error ip not in block

	W1003 18:22:46.854219   12504 proxy.go:119] fail to check proxy env: Error ip not in block

	I1003 18:22:46.854307   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHPort

	I1003 18:22:46.854309   12504 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	I1003 18:22:46.854332   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHHostname

	I1003 18:22:46.854529   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:46.854570   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHPort

	I1003 18:22:46.854740   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHKeyPath

	I1003 18:22:46.854792   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHUsername

	I1003 18:22:46.854971   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.43 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/id_rsa Username:docker}

	I1003 18:22:46.855081   12504 main.go:141] libmachine: (multinode-528000-m03) Calling .GetSSHUsername

	I1003 18:22:46.855213   12504 sshutil.go:53] new ssh client: &{IP:192.168.89.43 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17348-9809/.minikube/machines/multinode-528000-m03/id_rsa Username:docker}

	I1003 18:22:46.896689   12504 command_runner.go:130] ! stat: cannot statx '/etc/cni/net.d/*loopback.conf*': No such file or directory

	W1003 18:22:46.896882   12504 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I1003 18:22:46.896937   12504 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1003 18:22:46.948860   12504 command_runner.go:130] > <a href="https://github.com/kubernetes/registry.k8s.io">Temporary Redirect</a>.

	I1003 18:22:46.948986   12504 command_runner.go:139] > /etc/cni/net.d/87-podman-bridge.conflist, 

	I1003 18:22:46.949013   12504 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I1003 18:22:46.949024   12504 start.go:469] detecting cgroup driver to use...

	I1003 18:22:46.949146   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1003 18:22:46.961630   12504 command_runner.go:130] > runtime-endpoint: unix:///run/containerd/containerd.sock

	I1003 18:22:46.962060   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I1003 18:22:46.968515   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I1003 18:22:46.974992   12504 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...

	I1003 18:22:46.975035   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I1003 18:22:46.981378   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1003 18:22:46.987739   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I1003 18:22:46.994215   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1003 18:22:47.000611   12504 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1003 18:22:47.007413   12504 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I1003 18:22:47.014702   12504 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1003 18:22:47.021051   12504 command_runner.go:130] > net.bridge.bridge-nf-call-iptables = 1

	I1003 18:22:47.021201   12504 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1003 18:22:47.027286   12504 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 18:22:47.112723   12504 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I1003 18:22:47.125103   12504 start.go:469] detecting cgroup driver to use...

	I1003 18:22:47.125166   12504 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1003 18:22:47.134359   12504 command_runner.go:130] > # /usr/lib/systemd/system/docker.service

	I1003 18:22:47.134960   12504 command_runner.go:130] > [Unit]

	I1003 18:22:47.134969   12504 command_runner.go:130] > Description=Docker Application Container Engine

	I1003 18:22:47.134975   12504 command_runner.go:130] > Documentation=https://docs.docker.com

	I1003 18:22:47.134980   12504 command_runner.go:130] > After=network.target  minikube-automount.service docker.socket

	I1003 18:22:47.134985   12504 command_runner.go:130] > Requires= minikube-automount.service docker.socket 

	I1003 18:22:47.134992   12504 command_runner.go:130] > StartLimitBurst=3

	I1003 18:22:47.134997   12504 command_runner.go:130] > StartLimitIntervalSec=60

	I1003 18:22:47.135001   12504 command_runner.go:130] > [Service]

	I1003 18:22:47.135004   12504 command_runner.go:130] > Type=notify

	I1003 18:22:47.135020   12504 command_runner.go:130] > Restart=on-failure

	I1003 18:22:47.135027   12504 command_runner.go:130] > Environment=NO_PROXY=192.168.89.41

	I1003 18:22:47.135037   12504 command_runner.go:130] > Environment=NO_PROXY=192.168.89.41,192.168.89.42

	I1003 18:22:47.135045   12504 command_runner.go:130] > # This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	I1003 18:22:47.135055   12504 command_runner.go:130] > # The base configuration already specifies an 'ExecStart=...' command. The first directive

	I1003 18:22:47.135062   12504 command_runner.go:130] > # here is to clear out that command inherited from the base configuration. Without this,

	I1003 18:22:47.135069   12504 command_runner.go:130] > # the command from the base configuration and the command specified here are treated as

	I1003 18:22:47.135075   12504 command_runner.go:130] > # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	I1003 18:22:47.135081   12504 command_runner.go:130] > # will catch this invalid input and refuse to start the service with an error like:

	I1003 18:22:47.135090   12504 command_runner.go:130] > #  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	I1003 18:22:47.135096   12504 command_runner.go:130] > # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	I1003 18:22:47.135102   12504 command_runner.go:130] > # container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	I1003 18:22:47.135106   12504 command_runner.go:130] > ExecStart=

	I1003 18:22:47.135118   12504 command_runner.go:130] > ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	I1003 18:22:47.135126   12504 command_runner.go:130] > ExecReload=/bin/kill -s HUP $MAINPID

	I1003 18:22:47.135135   12504 command_runner.go:130] > # Having non-zero Limit*s causes performance problems due to accounting overhead

	I1003 18:22:47.135142   12504 command_runner.go:130] > # in the kernel. We recommend using cgroups to do container-local accounting.

	I1003 18:22:47.135147   12504 command_runner.go:130] > LimitNOFILE=infinity

	I1003 18:22:47.135154   12504 command_runner.go:130] > LimitNPROC=infinity

	I1003 18:22:47.135159   12504 command_runner.go:130] > LimitCORE=infinity

	I1003 18:22:47.135166   12504 command_runner.go:130] > # Uncomment TasksMax if your systemd version supports it.

	I1003 18:22:47.135171   12504 command_runner.go:130] > # Only systemd 226 and above support this version.

	I1003 18:22:47.135175   12504 command_runner.go:130] > TasksMax=infinity

	I1003 18:22:47.135179   12504 command_runner.go:130] > TimeoutStartSec=0

	I1003 18:22:47.135185   12504 command_runner.go:130] > # set delegate yes so that systemd does not reset the cgroups of docker containers

	I1003 18:22:47.135189   12504 command_runner.go:130] > Delegate=yes

	I1003 18:22:47.135202   12504 command_runner.go:130] > # kill only the docker process, not all processes in the cgroup

	I1003 18:22:47.135208   12504 command_runner.go:130] > KillMode=process

	I1003 18:22:47.135213   12504 command_runner.go:130] > [Install]

	I1003 18:22:47.135217   12504 command_runner.go:130] > WantedBy=multi-user.target

	I1003 18:22:47.135357   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1003 18:22:47.145606   12504 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I1003 18:22:47.161133   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1003 18:22:47.170336   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1003 18:22:47.179241   12504 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I1003 18:22:47.203508   12504 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1003 18:22:47.212052   12504 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1003 18:22:47.223785   12504 command_runner.go:130] > runtime-endpoint: unix:///var/run/cri-dockerd.sock

	I1003 18:22:47.224081   12504 ssh_runner.go:195] Run: which cri-dockerd

	I1003 18:22:47.226307   12504 command_runner.go:130] > /usr/bin/cri-dockerd

	I1003 18:22:47.226477   12504 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I1003 18:22:47.232766   12504 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I1003 18:22:47.244440   12504 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I1003 18:22:47.334098   12504 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I1003 18:22:47.433045   12504 docker.go:554] configuring docker to use "cgroupfs" as cgroup driver...

	I1003 18:22:47.433092   12504 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I1003 18:22:47.445115   12504 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 18:22:47.530747   12504 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1003 18:22:47.819138   12504 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I1003 18:22:47.902767   12504 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I1003 18:22:47.995326   12504 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I1003 18:22:48.087657   12504 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1003 18:22:48.189878   12504 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I1003 18:22:48.201358   12504 command_runner.go:130] ! Job failed. See "journalctl -xe" for details.

	I1003 18:22:48.224931   12504 out.go:177] 

	W1003 18:22:48.245989   12504 out.go:239] X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart cri-docker.socket: Process exited with status 1

	stdout:

	stderr:

	Job failed. See "journalctl -xe" for details.

	W1003 18:22:48.246003   12504 out.go:239] * 

	W1003 18:22:48.246581   12504 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I1003 18:22:48.312086   12504 out.go:177] 

	* 

	* ==> Docker <==

	* -- Journal begins at Wed 2023-10-04 01:20:57 UTC, ends at Wed 2023-10-04 01:22:49 UTC. --

	Oct 04 01:21:38 multinode-528000 dockerd[842]: time="2023-10-04T01:21:38.622826771Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 04 01:21:38 multinode-528000 dockerd[842]: time="2023-10-04T01:21:38.623219958Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Oct 04 01:21:38 multinode-528000 dockerd[842]: time="2023-10-04T01:21:38.623255851Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 04 01:21:38 multinode-528000 dockerd[842]: time="2023-10-04T01:21:38.624030872Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Oct 04 01:21:38 multinode-528000 dockerd[842]: time="2023-10-04T01:21:38.624207169Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 04 01:21:38 multinode-528000 dockerd[842]: time="2023-10-04T01:21:38.624318921Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Oct 04 01:21:38 multinode-528000 dockerd[842]: time="2023-10-04T01:21:38.624376324Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 04 01:21:39 multinode-528000 cri-dockerd[1075]: time="2023-10-04T01:21:39Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/1e2be24644e66877f29f952654557bb767efae92c94784683ce341fef19581ae/resolv.conf as [nameserver 192.168.89.1]"

	Oct 04 01:21:39 multinode-528000 dockerd[842]: time="2023-10-04T01:21:39.132457933Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Oct 04 01:21:39 multinode-528000 dockerd[842]: time="2023-10-04T01:21:39.132581400Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 04 01:21:39 multinode-528000 dockerd[842]: time="2023-10-04T01:21:39.132605208Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Oct 04 01:21:39 multinode-528000 dockerd[842]: time="2023-10-04T01:21:39.132698027Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 04 01:21:39 multinode-528000 cri-dockerd[1075]: time="2023-10-04T01:21:39Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/340bb57e99310470708f0dc28479889061f1c9b90cec25f0a6d46a78edd3bebd/resolv.conf as [nameserver 10.96.0.10 search default.svc.cluster.local svc.cluster.local cluster.local options ndots:5]"

	Oct 04 01:21:39 multinode-528000 dockerd[842]: time="2023-10-04T01:21:39.297118551Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Oct 04 01:21:39 multinode-528000 dockerd[842]: time="2023-10-04T01:21:39.297226895Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 04 01:21:39 multinode-528000 dockerd[842]: time="2023-10-04T01:21:39.297237827Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Oct 04 01:21:39 multinode-528000 dockerd[842]: time="2023-10-04T01:21:39.297256183Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 04 01:21:53 multinode-528000 dockerd[836]: time="2023-10-04T01:21:53.854554494Z" level=info msg="ignoring event" container=5ca5841b1877edaa0e1a2cacd2e27d7c2882fcebe277fe1b8a47450ff8f83225 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Oct 04 01:21:53 multinode-528000 dockerd[842]: time="2023-10-04T01:21:53.855247922Z" level=info msg="shim disconnected" id=5ca5841b1877edaa0e1a2cacd2e27d7c2882fcebe277fe1b8a47450ff8f83225 namespace=moby

	Oct 04 01:21:53 multinode-528000 dockerd[842]: time="2023-10-04T01:21:53.855651746Z" level=warning msg="cleaning up after shim disconnected" id=5ca5841b1877edaa0e1a2cacd2e27d7c2882fcebe277fe1b8a47450ff8f83225 namespace=moby

	Oct 04 01:21:53 multinode-528000 dockerd[842]: time="2023-10-04T01:21:53.855788833Z" level=info msg="cleaning up dead shim" namespace=moby

	Oct 04 01:22:09 multinode-528000 dockerd[842]: time="2023-10-04T01:22:09.684177570Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Oct 04 01:22:09 multinode-528000 dockerd[842]: time="2023-10-04T01:22:09.684271631Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 04 01:22:09 multinode-528000 dockerd[842]: time="2023-10-04T01:22:09.684293335Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Oct 04 01:22:09 multinode-528000 dockerd[842]: time="2023-10-04T01:22:09.684306084Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	* 

	* ==> container status <==

	* CONTAINER           IMAGE                                                                                                 CREATED              STATE               NAME                      ATTEMPT             POD ID              POD

	c36eaacdcc39a       6e38f40d628db                                                                                         40 seconds ago       Running             storage-provisioner       2                   ffb0cf3bab0f8       storage-provisioner

	1230ba3e19f09       8c811b4aec35f                                                                                         About a minute ago   Running             busybox                   1                   340bb57e99310       busybox-5bc68d56bd-9pjld

	304d84a9e7393       ead0a4a53df89                                                                                         About a minute ago   Running             coredns                   1                   1e2be24644e66       coredns-5dd5756b68-rtwd9

	91e60d062e8d9       c7d1297425461                                                                                         About a minute ago   Running             kindnet-cni               1                   e5c31ee311fc1       kindnet-nvwhf

	5ca5841b1877e       6e38f40d628db                                                                                         About a minute ago   Exited              storage-provisioner       1                   ffb0cf3bab0f8       storage-provisioner

	3115763194e41       c120fed2beb84                                                                                         About a minute ago   Running             kube-proxy                1                   2acdeb5b951a6       kube-proxy-8bl5p

	22e70d91b1cb0       73deb9a3f7025                                                                                         About a minute ago   Running             etcd                      1                   882b6bc11c3ef       etcd-multinode-528000

	db05f555a6ac2       7a5d9d67a13f6                                                                                         About a minute ago   Running             kube-scheduler            1                   527fec800a429       kube-scheduler-multinode-528000

	6c1b045cb53a7       55f13c92defb1                                                                                         About a minute ago   Running             kube-controller-manager   1                   bbedaadc72815       kube-controller-manager-multinode-528000

	32ad056e0b058       cdcab12b2dd16                                                                                         About a minute ago   Running             kube-apiserver            1                   828579df58890       kube-apiserver-multinode-528000

	2e351a3f72db4       gcr.io/k8s-minikube/busybox@sha256:9afb80db71730dbb303fe00765cbf34bddbdc6b66e49897fc2e1861967584b12   3 minutes ago        Exited              busybox                   0                   35a04ca28953d       busybox-5bc68d56bd-9pjld

	c777e3c5420df       ead0a4a53df89                                                                                         4 minutes ago        Exited              coredns                   0                   7a7ac2be1e04c       coredns-5dd5756b68-rtwd9

	b8024fee3a61b       kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052              4 minutes ago        Exited              kindnet-cni               0                   2791a87427111       kindnet-nvwhf

	d67acc5427bf8       c120fed2beb84                                                                                         4 minutes ago        Exited              kube-proxy                0                   53bbec086effb       kube-proxy-8bl5p

	9dc263cb45fb9       7a5d9d67a13f6                                                                                         4 minutes ago        Exited              kube-scheduler            0                   b88a4172043e9       kube-scheduler-multinode-528000

	ee159c10d5d1d       73deb9a3f7025                                                                                         4 minutes ago        Exited              etcd                      0                   0209621ce1a31       etcd-multinode-528000

	b49c890ba5e9f       cdcab12b2dd16                                                                                         4 minutes ago        Exited              kube-apiserver            0                   f1c546e1f118a       kube-apiserver-multinode-528000

	9e6ae6e7777d3       55f13c92defb1                                                                                         4 minutes ago        Exited              kube-controller-manager   0                   941b6138c42cc       kube-controller-manager-multinode-528000

	* 

	* ==> coredns [304d84a9e739] <==

	* .:53

	[INFO] plugin/reload: Running configuration SHA512 = a3c2413e1f67aed9cdfb305b673ec2853e178cc45a5befebcf47e6c2a01aec4525abbbcaa81cd4fb26cf1899d5318d18288d26a37c56bfc2d3f5371ba9535a0a

	CoreDNS-1.10.1

	linux/amd64, go1.20, 055b2c3

	[INFO] 127.0.0.1:60563 - 35047 "HINFO IN 5415807232480341247.1225636995370269365. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.00445967s

	* 

	* ==> coredns [c777e3c5420d] <==

	* [INFO] 10.244.0.3:39863 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,aa,rd,ra 111 0.000068732s

	[INFO] 10.244.0.3:49020 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.00009595s

	[INFO] 10.244.0.3:40096 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000065633s

	[INFO] 10.244.0.3:54916 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,aa,rd,ra 111 0.000070659s

	[INFO] 10.244.0.3:53979 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000044375s

	[INFO] 10.244.0.3:45782 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000067924s

	[INFO] 10.244.0.3:58514 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000076874s

	[INFO] 10.244.1.2:50342 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000142849s

	[INFO] 10.244.1.2:34721 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000065283s

	[INFO] 10.244.1.2:50049 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000154593s

	[INFO] 10.244.1.2:47732 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000038348s

	[INFO] 10.244.0.3:56301 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000092202s

	[INFO] 10.244.0.3:38618 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000187344s

	[INFO] 10.244.0.3:55999 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000105296s

	[INFO] 10.244.0.3:38354 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000290367s

	[INFO] 10.244.1.2:46908 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000139521s

	[INFO] 10.244.1.2:53999 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000119971s

	[INFO] 10.244.1.2:49192 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000119643s

	[INFO] 10.244.1.2:54289 - 5 "PTR IN 1.89.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000116411s

	[INFO] 10.244.0.3:34604 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000094411s

	[INFO] 10.244.0.3:59370 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000029595s

	[INFO] 10.244.0.3:39346 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000027014s

	[INFO] 10.244.0.3:45041 - 5 "PTR IN 1.89.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000053145s

	[INFO] SIGTERM: Shutting down servers then terminating

	[INFO] plugin/health: Going into lameduck mode for 5s

	* 

	* ==> describe nodes <==

	* Name:               multinode-528000

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=multinode-528000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=cacb4070dc820e9f8fe7f94a5c041e95e45c32b1

	                    minikube.k8s.io/name=multinode-528000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2023_10_03T18_18_19_0700

	                    minikube.k8s.io/version=v1.31.2

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 04 Oct 2023 01:18:16 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  multinode-528000

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 04 Oct 2023 01:22:43 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 04 Oct 2023 01:21:30 +0000   Wed, 04 Oct 2023 01:18:15 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 04 Oct 2023 01:21:30 +0000   Wed, 04 Oct 2023 01:18:15 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 04 Oct 2023 01:21:30 +0000   Wed, 04 Oct 2023 01:18:15 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 04 Oct 2023 01:21:30 +0000   Wed, 04 Oct 2023 01:21:30 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.89.41

	  Hostname:    multinode-528000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17784752Ki

	  hugepages-2Mi:      0

	  memory:             2166052Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17784752Ki

	  hugepages-2Mi:      0

	  memory:             2166052Ki

	  pods:               110

	System Info:

	  Machine ID:                 57d49c1222e642b18a41aac6b05bdf65

	  System UUID:                d3ae11ee-0000-0000-8906-149d997cd0f1

	  Boot ID:                    a7cddd86-ccb0-43a6-922d-4ffa3cd6d9ac

	  Kernel Version:             5.10.57

	  OS Image:                   Buildroot 2021.02.12

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  docker://24.0.6

	  Kubelet Version:            v1.28.2

	  Kube-Proxy Version:         v1.28.2

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (9 in total)

	  Namespace                   Name                                        CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                        ------------  ----------  ---------------  -------------  ---

	  default                     busybox-5bc68d56bd-9pjld                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m32s

	  kube-system                 coredns-5dd5756b68-rtwd9                    100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     4m18s

	  kube-system                 etcd-multinode-528000                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         4m31s

	  kube-system                 kindnet-nvwhf                               100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      4m18s

	  kube-system                 kube-apiserver-multinode-528000             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m31s

	  kube-system                 kube-controller-manager-multinode-528000    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m33s

	  kube-system                 kube-proxy-8bl5p                            0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m18s

	  kube-system                 kube-scheduler-multinode-528000             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m33s

	  kube-system                 storage-provisioner                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m17s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                850m (42%!)(MISSING)   100m (5%!)(MISSING)

	  memory             220Mi (10%!)(MISSING)  220Mi (10%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)       0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)       0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 4m15s                  kube-proxy       

	  Normal  Starting                 86s                    kube-proxy       

	  Normal  NodeAllocatableEnforced  4m38s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  4m37s (x8 over 4m38s)  kubelet          Node multinode-528000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    4m37s (x8 over 4m38s)  kubelet          Node multinode-528000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     4m37s (x7 over 4m38s)  kubelet          Node multinode-528000 status is now: NodeHasSufficientPID

	  Normal  NodeHasSufficientMemory  4m31s                  kubelet          Node multinode-528000 status is now: NodeHasSufficientMemory

	  Normal  NodeAllocatableEnforced  4m31s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasNoDiskPressure    4m31s                  kubelet          Node multinode-528000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     4m31s                  kubelet          Node multinode-528000 status is now: NodeHasSufficientPID

	  Normal  Starting                 4m31s                  kubelet          Starting kubelet.

	  Normal  RegisteredNode           4m19s                  node-controller  Node multinode-528000 event: Registered Node multinode-528000 in Controller

	  Normal  NodeReady                4m9s                   kubelet          Node multinode-528000 status is now: NodeReady

	  Normal  Starting                 93s                    kubelet          Starting kubelet.

	  Normal  NodeHasSufficientMemory  93s (x8 over 93s)      kubelet          Node multinode-528000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    93s (x8 over 93s)      kubelet          Node multinode-528000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     93s (x7 over 93s)      kubelet          Node multinode-528000 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  93s                    kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           76s                    node-controller  Node multinode-528000 event: Registered Node multinode-528000 in Controller

	Name:               multinode-528000-m02

	Roles:              <none>

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=multinode-528000-m02

	                    kubernetes.io/os=linux

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 04 Oct 2023 01:22:26 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  multinode-528000-m02

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 04 Oct 2023 01:22:46 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 04 Oct 2023 01:22:32 +0000   Wed, 04 Oct 2023 01:22:26 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 04 Oct 2023 01:22:32 +0000   Wed, 04 Oct 2023 01:22:26 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 04 Oct 2023 01:22:32 +0000   Wed, 04 Oct 2023 01:22:26 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 04 Oct 2023 01:22:32 +0000   Wed, 04 Oct 2023 01:22:32 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.89.42

	  Hostname:    multinode-528000-m02

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17784752Ki

	  hugepages-2Mi:      0

	  memory:             2166052Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17784752Ki

	  hugepages-2Mi:      0

	  memory:             2166052Ki

	  pods:               110

	System Info:

	  Machine ID:                 9efc726151ff450ab8c59c6928060442

	  System UUID:                f6c911ee-0000-0000-8906-149d997cd0f1

	  Boot ID:                    62994343-4886-4807-bf56-1c0a57226e52

	  Kernel Version:             5.10.57

	  OS Image:                   Buildroot 2021.02.12

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  docker://24.0.6

	  Kubelet Version:            v1.28.2

	  Kube-Proxy Version:         v1.28.2

	PodCIDR:                      10.244.1.0/24

	PodCIDRs:                     10.244.1.0/24

	Non-terminated Pods:          (3 in total)

	  Namespace                   Name                        CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                        ------------  ----------  ---------------  -------------  ---

	  default                     busybox-5bc68d56bd-5w5js    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         27s

	  kube-system                 kindnet-tl478               100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      3m46s

	  kube-system                 kube-proxy-9pd2m            0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m46s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests   Limits

	  --------           --------   ------

	  cpu                100m (5%!)(MISSING)  100m (5%!)(MISSING)

	  memory             50Mi (2%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)     0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)     0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From        Message

	  ----    ------                   ----                   ----        -------

	  Normal  Starting                 21s                    kube-proxy  

	  Normal  Starting                 3m40s                  kube-proxy  

	  Normal  NodeHasSufficientMemory  3m46s (x2 over 3m46s)  kubelet     Node multinode-528000-m02 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    3m46s (x2 over 3m46s)  kubelet     Node multinode-528000-m02 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     3m46s (x2 over 3m46s)  kubelet     Node multinode-528000-m02 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  3m46s                  kubelet     Updated Node Allocatable limit across pods

	  Normal  Starting                 3m46s                  kubelet     Starting kubelet.

	  Normal  NodeReady                3m35s                  kubelet     Node multinode-528000-m02 status is now: NodeReady

	  Normal  NodeHasSufficientMemory  24s (x2 over 24s)      kubelet     Node multinode-528000-m02 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    24s (x2 over 24s)      kubelet     Node multinode-528000-m02 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     24s (x2 over 24s)      kubelet     Node multinode-528000-m02 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  24s                    kubelet     Updated Node Allocatable limit across pods

	  Normal  Starting                 24s                    kubelet     Starting kubelet.

	  Normal  NodeReady                18s                    kubelet     Node multinode-528000-m02 status is now: NodeReady

	Name:               multinode-528000-m03

	Roles:              <none>

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=multinode-528000-m03

	                    kubernetes.io/os=linux

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 04 Oct 2023 01:20:20 +0000

	Taints:             node.kubernetes.io/unreachable:NoExecute

	                    node.kubernetes.io/unreachable:NoSchedule

	Unschedulable:      false

	Lease:

	  HolderIdentity:  multinode-528000-m03

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 04 Oct 2023 01:20:30 +0000

	Conditions:

	  Type             Status    LastHeartbeatTime                 LastTransitionTime                Reason              Message

	  ----             ------    -----------------                 ------------------                ------              -------

	  MemoryPressure   Unknown   Wed, 04 Oct 2023 01:20:29 +0000   Wed, 04 Oct 2023 01:22:14 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  DiskPressure     Unknown   Wed, 04 Oct 2023 01:20:29 +0000   Wed, 04 Oct 2023 01:22:14 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  PIDPressure      Unknown   Wed, 04 Oct 2023 01:20:29 +0000   Wed, 04 Oct 2023 01:22:14 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  Ready            Unknown   Wed, 04 Oct 2023 01:20:29 +0000   Wed, 04 Oct 2023 01:22:14 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	Addresses:

	  InternalIP:  192.168.89.43

	  Hostname:    multinode-528000-m03

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17784752Ki

	  hugepages-2Mi:      0

	  memory:             2166052Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17784752Ki

	  hugepages-2Mi:      0

	  memory:             2166052Ki

	  pods:               110

	System Info:

	  Machine ID:                 7ed83307452642bab55a327caabdd58a

	  System UUID:                0d2b11ee-0000-0000-90e2-149d997cd0f1

	  Boot ID:                    ec4b8b20-894a-4c8c-81af-18f09c620413

	  Kernel Version:             5.10.57

	  OS Image:                   Buildroot 2021.02.12

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  docker://24.0.6

	  Kubelet Version:            v1.28.2

	  Kube-Proxy Version:         v1.28.2

	PodCIDR:                      10.244.3.0/24

	PodCIDRs:                     10.244.3.0/24

	Non-terminated Pods:          (2 in total)

	  Namespace                   Name                CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                ------------  ----------  ---------------  -------------  ---

	  kube-system                 kindnet-nz8t4       100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      3m10s

	  kube-system                 kube-proxy-69bxc    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m10s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests   Limits

	  --------           --------   ------

	  cpu                100m (5%!)(MISSING)  100m (5%!)(MISSING)

	  memory             50Mi (2%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)     0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)     0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 3m5s                   kube-proxy       

	  Normal  Starting                 2m28s                  kube-proxy       

	  Normal  Starting                 3m11s                  kubelet          Starting kubelet.

	  Normal  NodeHasSufficientMemory  3m11s (x2 over 3m11s)  kubelet          Node multinode-528000-m03 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    3m11s (x2 over 3m11s)  kubelet          Node multinode-528000-m03 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     3m11s (x2 over 3m11s)  kubelet          Node multinode-528000-m03 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  3m11s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeReady                2m58s                  kubelet          Node multinode-528000-m03 status is now: NodeReady

	  Normal  Starting                 2m30s                  kubelet          Starting kubelet.

	  Normal  NodeHasSufficientMemory  2m30s (x2 over 2m30s)  kubelet          Node multinode-528000-m03 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    2m30s (x2 over 2m30s)  kubelet          Node multinode-528000-m03 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     2m30s (x2 over 2m30s)  kubelet          Node multinode-528000-m03 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  2m30s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeReady                2m21s                  kubelet          Node multinode-528000-m03 status is now: NodeReady

	  Normal  RegisteredNode           76s                    node-controller  Node multinode-528000-m03 event: Registered Node multinode-528000-m03 in Controller

	  Normal  NodeNotReady             36s                    node-controller  Node multinode-528000-m03 status is now: NodeNotReady

	* 

	* ==> dmesg <==

	* [  +0.029129] ACPI BIOS Warning (bug): Incorrect checksum in table [DSDT] - 0xBE, should be 0x1B (20200925/tbprint-173)

	[  +4.990251] ACPI Error: Could not enable RealTimeClock event (20200925/evxfevnt-182)

	[  +0.000002] ACPI Warning: Could not enable fixed event - RealTimeClock (4) (20200925/evxface-618)

	[  +0.007152] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +2.340911] systemd-fstab-generator[124]: Ignoring "noauto" for root device

	[  +0.042556] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.

	[  +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)

	[Oct 4 01:21] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory

	[  +0.000010] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery

	[  +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)

	[  +2.150530] systemd-fstab-generator[512]: Ignoring "noauto" for root device

	[  +0.089358] systemd-fstab-generator[523]: Ignoring "noauto" for root device

	[  +0.764186] systemd-fstab-generator[734]: Ignoring "noauto" for root device

	[  +0.262342] systemd-fstab-generator[802]: Ignoring "noauto" for root device

	[  +0.092388] systemd-fstab-generator[813]: Ignoring "noauto" for root device

	[  +0.101545] systemd-fstab-generator[826]: Ignoring "noauto" for root device

	[  +1.235690] kauditd_printk_skb: 30 callbacks suppressed

	[  +0.177254] systemd-fstab-generator[989]: Ignoring "noauto" for root device

	[  +0.095231] systemd-fstab-generator[1000]: Ignoring "noauto" for root device

	[  +0.093988] systemd-fstab-generator[1011]: Ignoring "noauto" for root device

	[  +0.080540] systemd-fstab-generator[1022]: Ignoring "noauto" for root device

	[  +0.100771] systemd-fstab-generator[1044]: Ignoring "noauto" for root device

	[ +11.761154] systemd-fstab-generator[1308]: Ignoring "noauto" for root device

	[  +0.242098] kauditd_printk_skb: 29 callbacks suppressed

	[ +16.935401] kauditd_printk_skb: 18 callbacks suppressed

	* 

	* ==> etcd [22e70d91b1cb] <==

	* {"level":"info","ts":"2023-10-04T01:21:19.733532Z","caller":"embed/etcd.go:855","msg":"serving metrics","address":"http://127.0.0.1:2381"}

	{"level":"info","ts":"2023-10-04T01:21:19.733786Z","caller":"etcdserver/server.go:754","msg":"starting initial election tick advance","election-ticks":10}

	{"level":"info","ts":"2023-10-04T01:21:19.733982Z","caller":"embed/etcd.go:597","msg":"serving peer traffic","address":"192.168.89.41:2380"}

	{"level":"info","ts":"2023-10-04T01:21:19.734153Z","caller":"embed/etcd.go:569","msg":"cmux::serve","address":"192.168.89.41:2380"}

	{"level":"info","ts":"2023-10-04T01:21:19.734352Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap.db","max":5,"interval":"30s"}

	{"level":"info","ts":"2023-10-04T01:21:19.734441Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap","max":5,"interval":"30s"}

	{"level":"info","ts":"2023-10-04T01:21:19.734451Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/wal","suffix":"wal","max":5,"interval":"30s"}

	{"level":"info","ts":"2023-10-04T01:21:19.734944Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"1435fd2c0b4e173b switched to configuration voters=(1456348420134278971)"}

	{"level":"info","ts":"2023-10-04T01:21:19.735399Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"c6d7de216ded9a18","local-member-id":"1435fd2c0b4e173b","added-peer-id":"1435fd2c0b4e173b","added-peer-peer-urls":["https://192.168.89.41:2380"]}

	{"level":"info","ts":"2023-10-04T01:21:19.7356Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"c6d7de216ded9a18","local-member-id":"1435fd2c0b4e173b","cluster-version":"3.5"}

	{"level":"info","ts":"2023-10-04T01:21:19.735743Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2023-10-04T01:21:21.20138Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"1435fd2c0b4e173b is starting a new election at term 2"}

	{"level":"info","ts":"2023-10-04T01:21:21.201462Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"1435fd2c0b4e173b became pre-candidate at term 2"}

	{"level":"info","ts":"2023-10-04T01:21:21.201482Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"1435fd2c0b4e173b received MsgPreVoteResp from 1435fd2c0b4e173b at term 2"}

	{"level":"info","ts":"2023-10-04T01:21:21.201496Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"1435fd2c0b4e173b became candidate at term 3"}

	{"level":"info","ts":"2023-10-04T01:21:21.201504Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"1435fd2c0b4e173b received MsgVoteResp from 1435fd2c0b4e173b at term 3"}

	{"level":"info","ts":"2023-10-04T01:21:21.201515Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"1435fd2c0b4e173b became leader at term 3"}

	{"level":"info","ts":"2023-10-04T01:21:21.201524Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 1435fd2c0b4e173b elected leader 1435fd2c0b4e173b at term 3"}

	{"level":"info","ts":"2023-10-04T01:21:21.204122Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"1435fd2c0b4e173b","local-member-attributes":"{Name:multinode-528000 ClientURLs:[https://192.168.89.41:2379]}","request-path":"/0/members/1435fd2c0b4e173b/attributes","cluster-id":"c6d7de216ded9a18","publish-timeout":"7s"}

	{"level":"info","ts":"2023-10-04T01:21:21.204263Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-10-04T01:21:21.204332Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-10-04T01:21:21.205549Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2023-10-04T01:21:21.206146Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.89.41:2379"}

	{"level":"info","ts":"2023-10-04T01:21:21.206265Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2023-10-04T01:21:21.206275Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	* 

	* ==> etcd [ee159c10d5d1] <==

	* {"level":"info","ts":"2023-10-04T01:18:15.122181Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"1435fd2c0b4e173b received MsgVoteResp from 1435fd2c0b4e173b at term 2"}

	{"level":"info","ts":"2023-10-04T01:18:15.122388Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"1435fd2c0b4e173b became leader at term 2"}

	{"level":"info","ts":"2023-10-04T01:18:15.122396Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 1435fd2c0b4e173b elected leader 1435fd2c0b4e173b at term 2"}

	{"level":"info","ts":"2023-10-04T01:18:15.143998Z","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}

	{"level":"info","ts":"2023-10-04T01:18:15.144312Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"1435fd2c0b4e173b","local-member-attributes":"{Name:multinode-528000 ClientURLs:[https://192.168.89.41:2379]}","request-path":"/0/members/1435fd2c0b4e173b/attributes","cluster-id":"c6d7de216ded9a18","publish-timeout":"7s"}

	{"level":"info","ts":"2023-10-04T01:18:15.144508Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-10-04T01:18:15.145284Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.89.41:2379"}

	{"level":"info","ts":"2023-10-04T01:18:15.147303Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-10-04T01:18:15.153501Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2023-10-04T01:18:15.153672Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"c6d7de216ded9a18","local-member-id":"1435fd2c0b4e173b","cluster-version":"3.5"}

	{"level":"info","ts":"2023-10-04T01:18:15.156137Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2023-10-04T01:18:15.156207Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}

	{"level":"info","ts":"2023-10-04T01:18:15.149288Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2023-10-04T01:18:15.156413Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2023-10-04T01:18:32.640906Z","caller":"traceutil/trace.go:171","msg":"trace[361666232] transaction","detail":"{read_only:false; response_revision:378; number_of_response:1; }","duration":"132.074139ms","start":"2023-10-04T01:18:32.508813Z","end":"2023-10-04T01:18:32.640888Z","steps":["trace[361666232] 'process raft request'  (duration: 94.881583ms)","trace[361666232] 'compare'  (duration: 36.957764ms)"],"step_count":2}

	{"level":"info","ts":"2023-10-04T01:20:32.014Z","caller":"osutil/interrupt_unix.go:64","msg":"received signal; shutting down","signal":"terminated"}

	{"level":"info","ts":"2023-10-04T01:20:32.01408Z","caller":"embed/etcd.go:376","msg":"closing etcd server","name":"multinode-528000","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.89.41:2380"],"advertise-client-urls":["https://192.168.89.41:2379"]}

	{"level":"warn","ts":"2023-10-04T01:20:32.014129Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}

	{"level":"warn","ts":"2023-10-04T01:20:32.014181Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}

	{"level":"warn","ts":"2023-10-04T01:20:32.024504Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 192.168.89.41:2379: use of closed network connection"}

	{"level":"warn","ts":"2023-10-04T01:20:32.024524Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 192.168.89.41:2379: use of closed network connection"}

	{"level":"info","ts":"2023-10-04T01:20:32.024552Z","caller":"etcdserver/server.go:1465","msg":"skipped leadership transfer for single voting member cluster","local-member-id":"1435fd2c0b4e173b","current-leader-member-id":"1435fd2c0b4e173b"}

	{"level":"info","ts":"2023-10-04T01:20:32.027117Z","caller":"embed/etcd.go:579","msg":"stopping serving peer traffic","address":"192.168.89.41:2380"}

	{"level":"info","ts":"2023-10-04T01:20:32.027159Z","caller":"embed/etcd.go:584","msg":"stopped serving peer traffic","address":"192.168.89.41:2380"}

	{"level":"info","ts":"2023-10-04T01:20:32.027167Z","caller":"embed/etcd.go:378","msg":"closed etcd server","name":"multinode-528000","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.89.41:2380"],"advertise-client-urls":["https://192.168.89.41:2379"]}

	* 

	* ==> kernel <==

	*  01:22:50 up 1 min,  0 users,  load average: 0.47, 0.24, 0.10

	Linux multinode-528000 5.10.57 #1 SMP Mon Sep 18 23:12:38 UTC 2023 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2021.02.12"

	* 

	* ==> kindnet [91e60d062e8d] <==

	* I1004 01:22:06.458062       1 main.go:250] Node multinode-528000-m02 has CIDR [10.244.1.0/24] 

	I1004 01:22:06.458131       1 main.go:223] Handling node with IPs: map[192.168.89.43:{}]

	I1004 01:22:06.458190       1 main.go:250] Node multinode-528000-m03 has CIDR [10.244.3.0/24] 

	I1004 01:22:16.468646       1 main.go:223] Handling node with IPs: map[192.168.89.41:{}]

	I1004 01:22:16.468826       1 main.go:227] handling current node

	I1004 01:22:16.468909       1 main.go:223] Handling node with IPs: map[192.168.89.42:{}]

	I1004 01:22:16.469005       1 main.go:250] Node multinode-528000-m02 has CIDR [10.244.1.0/24] 

	I1004 01:22:16.469213       1 main.go:223] Handling node with IPs: map[192.168.89.43:{}]

	I1004 01:22:16.469291       1 main.go:250] Node multinode-528000-m03 has CIDR [10.244.3.0/24] 

	I1004 01:22:26.473124       1 main.go:223] Handling node with IPs: map[192.168.89.41:{}]

	I1004 01:22:26.473319       1 main.go:227] handling current node

	I1004 01:22:26.473394       1 main.go:223] Handling node with IPs: map[192.168.89.43:{}]

	I1004 01:22:26.473520       1 main.go:250] Node multinode-528000-m03 has CIDR [10.244.3.0/24] 

	I1004 01:22:36.483778       1 main.go:223] Handling node with IPs: map[192.168.89.41:{}]

	I1004 01:22:36.483859       1 main.go:227] handling current node

	I1004 01:22:36.483923       1 main.go:223] Handling node with IPs: map[192.168.89.42:{}]

	I1004 01:22:36.484032       1 main.go:250] Node multinode-528000-m02 has CIDR [10.244.1.0/24] 

	I1004 01:22:36.484248       1 main.go:223] Handling node with IPs: map[192.168.89.43:{}]

	I1004 01:22:36.484349       1 main.go:250] Node multinode-528000-m03 has CIDR [10.244.3.0/24] 

	I1004 01:22:46.493890       1 main.go:223] Handling node with IPs: map[192.168.89.41:{}]

	I1004 01:22:46.493905       1 main.go:227] handling current node

	I1004 01:22:46.493912       1 main.go:223] Handling node with IPs: map[192.168.89.42:{}]

	I1004 01:22:46.493915       1 main.go:250] Node multinode-528000-m02 has CIDR [10.244.1.0/24] 

	I1004 01:22:46.493979       1 main.go:223] Handling node with IPs: map[192.168.89.43:{}]

	I1004 01:22:46.493983       1 main.go:250] Node multinode-528000-m03 has CIDR [10.244.3.0/24] 

	* 

	* ==> kindnet [b8024fee3a61] <==

	* I1004 01:19:59.114166       1 main.go:223] Handling node with IPs: map[192.168.89.41:{}]

	I1004 01:19:59.114202       1 main.go:227] handling current node

	I1004 01:19:59.114213       1 main.go:223] Handling node with IPs: map[192.168.89.42:{}]

	I1004 01:19:59.114218       1 main.go:250] Node multinode-528000-m02 has CIDR [10.244.1.0/24] 

	I1004 01:19:59.114287       1 main.go:223] Handling node with IPs: map[192.168.89.43:{}]

	I1004 01:19:59.114312       1 main.go:250] Node multinode-528000-m03 has CIDR [10.244.2.0/24] 

	I1004 01:20:09.117277       1 main.go:223] Handling node with IPs: map[192.168.89.41:{}]

	I1004 01:20:09.117312       1 main.go:227] handling current node

	I1004 01:20:09.117329       1 main.go:223] Handling node with IPs: map[192.168.89.42:{}]

	I1004 01:20:09.117336       1 main.go:250] Node multinode-528000-m02 has CIDR [10.244.1.0/24] 

	I1004 01:20:09.117567       1 main.go:223] Handling node with IPs: map[192.168.89.43:{}]

	I1004 01:20:09.117595       1 main.go:250] Node multinode-528000-m03 has CIDR [10.244.2.0/24] 

	I1004 01:20:19.128048       1 main.go:223] Handling node with IPs: map[192.168.89.41:{}]

	I1004 01:20:19.128137       1 main.go:227] handling current node

	I1004 01:20:19.128156       1 main.go:223] Handling node with IPs: map[192.168.89.42:{}]

	I1004 01:20:19.128170       1 main.go:250] Node multinode-528000-m02 has CIDR [10.244.1.0/24] 

	I1004 01:20:19.128245       1 main.go:223] Handling node with IPs: map[192.168.89.43:{}]

	I1004 01:20:19.128288       1 main.go:250] Node multinode-528000-m03 has CIDR [10.244.2.0/24] 

	I1004 01:20:29.135102       1 main.go:223] Handling node with IPs: map[192.168.89.41:{}]

	I1004 01:20:29.135135       1 main.go:227] handling current node

	I1004 01:20:29.135159       1 main.go:223] Handling node with IPs: map[192.168.89.42:{}]

	I1004 01:20:29.135165       1 main.go:250] Node multinode-528000-m02 has CIDR [10.244.1.0/24] 

	I1004 01:20:29.135381       1 main.go:223] Handling node with IPs: map[192.168.89.43:{}]

	I1004 01:20:29.135409       1 main.go:250] Node multinode-528000-m03 has CIDR [10.244.3.0/24] 

	I1004 01:20:29.135524       1 routes.go:62] Adding route {Ifindex: 0 Dst: 10.244.3.0/24 Src: <nil> Gw: 192.168.89.43 Flags: [] Table: 0} 

	* 

	* ==> kube-apiserver [32ad056e0b05] <==

	* I1004 01:21:22.178301       1 crd_finalizer.go:266] Starting CRDFinalizer

	I1004 01:21:22.178582       1 crdregistration_controller.go:111] Starting crd-autoregister controller

	I1004 01:21:22.178652       1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister

	I1004 01:21:22.223525       1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io

	I1004 01:21:22.243676       1 apf_controller.go:377] Running API Priority and Fairness config worker

	I1004 01:21:22.243796       1 apf_controller.go:380] Running API Priority and Fairness periodic rebalancing process

	I1004 01:21:22.244220       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller

	I1004 01:21:22.244946       1 shared_informer.go:318] Caches are synced for configmaps

	I1004 01:21:22.245120       1 cache.go:39] Caches are synced for AvailableConditionController controller

	I1004 01:21:22.246951       1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller

	I1004 01:21:22.278703       1 shared_informer.go:318] Caches are synced for crd-autoregister

	I1004 01:21:22.278737       1 aggregator.go:166] initial CRD sync complete...

	I1004 01:21:22.278742       1 autoregister_controller.go:141] Starting autoregister controller

	I1004 01:21:22.278749       1 cache.go:32] Waiting for caches to sync for autoregister controller

	I1004 01:21:22.278753       1 cache.go:39] Caches are synced for autoregister controller

	I1004 01:21:22.318808       1 shared_informer.go:318] Caches are synced for node_authorizer

	I1004 01:21:23.149110       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.

	W1004 01:21:23.473347       1 lease.go:263] Resetting endpoints for master service "kubernetes" to [192.168.89.41]

	I1004 01:21:23.474120       1 controller.go:624] quota admission added evaluator for: endpoints

	I1004 01:21:23.476988       1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I1004 01:21:24.655002       1 controller.go:624] quota admission added evaluator for: daemonsets.apps

	I1004 01:21:24.741016       1 controller.go:624] quota admission added evaluator for: serviceaccounts

	I1004 01:21:24.749173       1 controller.go:624] quota admission added evaluator for: deployments.apps

	I1004 01:21:24.789834       1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I1004 01:21:24.795316       1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	* 

	* ==> kube-apiserver [b49c890ba5e9] <==

	* }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"

	W1004 01:20:32.023171       1 logging.go:59] [core] [Channel #22 SubChannel #23] grpc: addrConn.createTransport failed to connect to {

	  "Addr": "127.0.0.1:2379",

	  "ServerName": "127.0.0.1",

	  "Attributes": null,

	  "BalancerAttributes": null,

	  "Type": 0,

	  "Metadata": null

	}. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"

	W1004 01:20:32.023192       1 logging.go:59] [core] [Channel #79 SubChannel #80] grpc: addrConn.createTransport failed to connect to {

	  "Addr": "127.0.0.1:2379",

	  "ServerName": "127.0.0.1",

	  "Attributes": null,

	  "BalancerAttributes": null,

	  "Type": 0,

	  "Metadata": null

	}. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"

	W1004 01:20:32.023212       1 logging.go:59] [core] [Channel #115 SubChannel #116] grpc: addrConn.createTransport failed to connect to {

	  "Addr": "127.0.0.1:2379",

	  "ServerName": "127.0.0.1",

	  "Attributes": null,

	  "BalancerAttributes": null,

	  "Type": 0,

	  "Metadata": null

	}. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"

	* 

	* ==> kube-controller-manager [6c1b045cb53a] <==

	* I1004 01:22:14.553345       1 event.go:307] "Event occurred" object="kube-system/kindnet-nz8t4" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1004 01:22:14.572787       1 event.go:307] "Event occurred" object="default/busybox-5bc68d56bd-6b4hh" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1004 01:22:14.575568       1 event.go:307] "Event occurred" object="kube-system/kube-proxy-69bxc" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1004 01:22:14.584351       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5bc68d56bd" duration="24.52304ms"

	I1004 01:22:14.584420       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5bc68d56bd" duration="30.625µs"

	I1004 01:22:14.600825       1 event.go:307] "Event occurred" object="kube-system/kindnet-tl478" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1004 01:22:14.621214       1 event.go:307] "Event occurred" object="kube-system/kube-proxy-9pd2m" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1004 01:22:23.170103       1 event.go:307] "Event occurred" object="default/busybox-5bc68d56bd" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: busybox-5bc68d56bd-5w5js"

	I1004 01:22:23.177317       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5bc68d56bd" duration="13.057717ms"

	I1004 01:22:23.181641       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5bc68d56bd" duration="3.973606ms"

	I1004 01:22:23.181731       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5bc68d56bd" duration="52.846µs"

	I1004 01:22:26.728628       1 actual_state_of_world.go:547] "Failed to update statusUpdateNeeded field in actual state of world" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"multinode-528000-m02\" does not exist"

	I1004 01:22:26.729180       1 event.go:307] "Event occurred" object="default/busybox-5bc68d56bd-6b4hh" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod default/busybox-5bc68d56bd-6b4hh"

	I1004 01:22:26.735578       1 range_allocator.go:380] "Set node PodCIDR" node="multinode-528000-m02" podCIDRs=["10.244.1.0/24"]

	I1004 01:22:27.618659       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5bc68d56bd" duration="121.29µs"

	I1004 01:22:32.550376       1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-528000-m02"

	I1004 01:22:32.559531       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5bc68d56bd" duration="39.117µs"

	I1004 01:22:34.635570       1 event.go:307] "Event occurred" object="default/busybox-5bc68d56bd-6b4hh" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod default/busybox-5bc68d56bd-6b4hh"

	I1004 01:22:39.658316       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5bc68d56bd" duration="37.559µs"

	I1004 01:22:39.661800       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5bc68d56bd" duration="51.022µs"

	I1004 01:22:39.669432       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5bc68d56bd" duration="31.448µs"

	I1004 01:22:40.401457       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5bc68d56bd" duration="33.869µs"

	I1004 01:22:40.402762       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5bc68d56bd" duration="19.477µs"

	I1004 01:22:41.408972       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5bc68d56bd" duration="4.550857ms"

	I1004 01:22:41.409100       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5bc68d56bd" duration="28.686µs"

	* 

	* ==> kube-controller-manager [9e6ae6e7777d] <==

	* I1004 01:19:18.169428       1 event.go:307] "Event occurred" object="default/busybox-5bc68d56bd" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: busybox-5bc68d56bd-6b4hh"

	I1004 01:19:18.176295       1 event.go:307] "Event occurred" object="default/busybox-5bc68d56bd" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: busybox-5bc68d56bd-9pjld"

	I1004 01:19:18.186575       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5bc68d56bd" duration="61.417143ms"

	I1004 01:19:18.197497       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5bc68d56bd" duration="10.80627ms"

	I1004 01:19:18.198708       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5bc68d56bd" duration="34.059µs"

	I1004 01:19:18.205238       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5bc68d56bd" duration="34.839µs"

	I1004 01:19:18.206027       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5bc68d56bd" duration="51.042µs"

	I1004 01:19:20.499954       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5bc68d56bd" duration="3.220009ms"

	I1004 01:19:20.500354       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5bc68d56bd" duration="24.903µs"

	I1004 01:19:21.064092       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5bc68d56bd" duration="3.598983ms"

	I1004 01:19:21.064130       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5bc68d56bd" duration="20.27µs"

	I1004 01:19:40.225216       1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-528000-m02"

	I1004 01:19:40.225898       1 actual_state_of_world.go:547] "Failed to update statusUpdateNeeded field in actual state of world" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"multinode-528000-m03\" does not exist"

	I1004 01:19:40.237054       1 range_allocator.go:380] "Set node PodCIDR" node="multinode-528000-m03" podCIDRs=["10.244.2.0/24"]

	I1004 01:19:40.241089       1 event.go:307] "Event occurred" object="kube-system/kindnet" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-nz8t4"

	I1004 01:19:40.245738       1 event.go:307] "Event occurred" object="kube-system/kube-proxy" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-69bxc"

	I1004 01:19:41.476202       1 node_lifecycle_controller.go:877] "Missing timestamp for Node. Assuming now as a timestamp" node="multinode-528000-m03"

	I1004 01:19:41.476419       1 event.go:307] "Event occurred" object="multinode-528000-m03" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node multinode-528000-m03 event: Registered Node multinode-528000-m03 in Controller"

	I1004 01:19:53.422804       1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-528000-m02"

	I1004 01:20:20.010679       1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-528000-m02"

	I1004 01:20:20.575246       1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-528000-m02"

	I1004 01:20:20.575516       1 actual_state_of_world.go:547] "Failed to update statusUpdateNeeded field in actual state of world" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"multinode-528000-m03\" does not exist"

	I1004 01:20:20.580149       1 range_allocator.go:380] "Set node PodCIDR" node="multinode-528000-m03" podCIDRs=["10.244.3.0/24"]

	I1004 01:20:29.383863       1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-528000-m02"

	I1004 01:20:32.061335       1 garbagecollector.go:818] "failed to discover preferred resources" error="Get \"https://192.168.89.41:8443/api\": dial tcp 192.168.89.41:8443: connect: connection refused"

	* 

	* ==> kube-proxy [3115763194e4] <==

	* I1004 01:21:23.598648       1 server_others.go:69] "Using iptables proxy"

	I1004 01:21:23.616989       1 node.go:141] Successfully retrieved node IP: 192.168.89.41

	I1004 01:21:23.697006       1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"

	I1004 01:21:23.697031       1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I1004 01:21:23.699501       1 server_others.go:152] "Using iptables Proxier"

	I1004 01:21:23.700086       1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I1004 01:21:23.700333       1 server.go:846] "Version info" version="v1.28.2"

	I1004 01:21:23.700361       1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I1004 01:21:23.702634       1 config.go:188] "Starting service config controller"

	I1004 01:21:23.702856       1 shared_informer.go:311] Waiting for caches to sync for service config

	I1004 01:21:23.702914       1 config.go:97] "Starting endpoint slice config controller"

	I1004 01:21:23.702920       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config

	I1004 01:21:23.704758       1 config.go:315] "Starting node config controller"

	I1004 01:21:23.704785       1 shared_informer.go:311] Waiting for caches to sync for node config

	I1004 01:21:23.803622       1 shared_informer.go:318] Caches are synced for endpoint slice config

	I1004 01:21:23.803669       1 shared_informer.go:318] Caches are synced for service config

	I1004 01:21:23.805128       1 shared_informer.go:318] Caches are synced for node config

	* 

	* ==> kube-proxy [d67acc5427bf] <==

	* I1004 01:18:34.291978       1 server_others.go:69] "Using iptables proxy"

	I1004 01:18:34.301698       1 node.go:141] Successfully retrieved node IP: 192.168.89.41

	I1004 01:18:34.322572       1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"

	I1004 01:18:34.322610       1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I1004 01:18:34.324757       1 server_others.go:152] "Using iptables Proxier"

	I1004 01:18:34.324950       1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I1004 01:18:34.325287       1 server.go:846] "Version info" version="v1.28.2"

	I1004 01:18:34.325329       1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I1004 01:18:34.326077       1 config.go:188] "Starting service config controller"

	I1004 01:18:34.326288       1 shared_informer.go:311] Waiting for caches to sync for service config

	I1004 01:18:34.326325       1 config.go:97] "Starting endpoint slice config controller"

	I1004 01:18:34.326330       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config

	I1004 01:18:34.326900       1 config.go:315] "Starting node config controller"

	I1004 01:18:34.326926       1 shared_informer.go:311] Waiting for caches to sync for node config

	I1004 01:18:34.426965       1 shared_informer.go:318] Caches are synced for node config

	I1004 01:18:34.427001       1 shared_informer.go:318] Caches are synced for service config

	I1004 01:18:34.427095       1 shared_informer.go:318] Caches are synced for endpoint slice config

	* 

	* ==> kube-scheduler [9dc263cb45fb] <==

	* W1004 01:18:17.021316       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E1004 01:18:17.021324       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	W1004 01:18:17.021372       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E1004 01:18:17.021381       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W1004 01:18:17.021456       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E1004 01:18:17.021467       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	W1004 01:18:17.022605       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E1004 01:18:17.022639       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	W1004 01:18:17.022678       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E1004 01:18:17.022685       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	W1004 01:18:17.022794       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E1004 01:18:17.022850       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	W1004 01:18:17.022885       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1004 01:18:17.022894       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	W1004 01:18:17.022952       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E1004 01:18:17.022961       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	W1004 01:18:17.022999       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E1004 01:18:17.023006       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	W1004 01:18:17.023084       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E1004 01:18:17.023093       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	W1004 01:18:17.023100       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E1004 01:18:17.023106       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	I1004 01:18:18.112563       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I1004 01:20:32.006837       1 secure_serving.go:255] Stopped listening on 127.0.0.1:10259

	E1004 01:20:32.007562       1 run.go:74] "command failed" err="finished without leader elect"

	* 

	* ==> kube-scheduler [db05f555a6ac] <==

	* I1004 01:21:20.123608       1 serving.go:348] Generated self-signed cert in-memory

	W1004 01:21:22.186458       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W1004 01:21:22.186531       1 authentication.go:368] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W1004 01:21:22.186553       1 authentication.go:369] Continuing without authentication configuration. This may treat all requests as anonymous.

	W1004 01:21:22.186644       1 authentication.go:370] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I1004 01:21:22.240727       1 server.go:154] "Starting Kubernetes Scheduler" version="v1.28.2"

	I1004 01:21:22.240929       1 server.go:156] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I1004 01:21:22.243331       1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I1004 01:21:22.243544       1 shared_informer.go:311] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I1004 01:21:22.244616       1 secure_serving.go:210] Serving securely on 127.0.0.1:10259

	I1004 01:21:22.244901       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"

	I1004 01:21:22.344473       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	* 

	* ==> kubelet <==

	* -- Journal begins at Wed 2023-10-04 01:20:57 UTC, ends at Wed 2023-10-04 01:22:51 UTC. --

	Oct 04 01:21:26 multinode-528000 kubelet[1314]: E1004 01:21:26.237519    1314 configmap.go:199] Couldn't get configMap kube-system/coredns: object "kube-system"/"coredns" not registered

	Oct 04 01:21:26 multinode-528000 kubelet[1314]: E1004 01:21:26.237584    1314 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3da6e23f-9391-4ec9-99aa-db9b421b00ad-config-volume podName:3da6e23f-9391-4ec9-99aa-db9b421b00ad nodeName:}" failed. No retries permitted until 2023-10-04 01:21:30.237571953 +0000 UTC m=+12.778696864 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-volume" (UniqueName: "kubernetes.io/configmap/3da6e23f-9391-4ec9-99aa-db9b421b00ad-config-volume") pod "coredns-5dd5756b68-rtwd9" (UID: "3da6e23f-9391-4ec9-99aa-db9b421b00ad") : object "kube-system"/"coredns" not registered

	Oct 04 01:21:26 multinode-528000 kubelet[1314]: E1004 01:21:26.338451    1314 projected.go:292] Couldn't get configMap default/kube-root-ca.crt: object "default"/"kube-root-ca.crt" not registered

	Oct 04 01:21:26 multinode-528000 kubelet[1314]: E1004 01:21:26.338501    1314 projected.go:198] Error preparing data for projected volume kube-api-access-wkfp2 for pod default/busybox-5bc68d56bd-9pjld: object "default"/"kube-root-ca.crt" not registered

	Oct 04 01:21:26 multinode-528000 kubelet[1314]: E1004 01:21:26.338547    1314 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c95b2373-916f-4083-8a47-909d2b945658-kube-api-access-wkfp2 podName:c95b2373-916f-4083-8a47-909d2b945658 nodeName:}" failed. No retries permitted until 2023-10-04 01:21:30.338532531 +0000 UTC m=+12.879657449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wkfp2" (UniqueName: "kubernetes.io/projected/c95b2373-916f-4083-8a47-909d2b945658-kube-api-access-wkfp2") pod "busybox-5bc68d56bd-9pjld" (UID: "c95b2373-916f-4083-8a47-909d2b945658") : object "default"/"kube-root-ca.crt" not registered

	Oct 04 01:21:27 multinode-528000 kubelet[1314]: E1004 01:21:27.643483    1314 pod_workers.go:1300] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized" pod="kube-system/coredns-5dd5756b68-rtwd9" podUID="3da6e23f-9391-4ec9-99aa-db9b421b00ad"

	Oct 04 01:21:27 multinode-528000 kubelet[1314]: E1004 01:21:27.644304    1314 pod_workers.go:1300] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized" pod="default/busybox-5bc68d56bd-9pjld" podUID="c95b2373-916f-4083-8a47-909d2b945658"

	Oct 04 01:21:29 multinode-528000 kubelet[1314]: E1004 01:21:29.643823    1314 pod_workers.go:1300] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized" pod="kube-system/coredns-5dd5756b68-rtwd9" podUID="3da6e23f-9391-4ec9-99aa-db9b421b00ad"

	Oct 04 01:21:29 multinode-528000 kubelet[1314]: E1004 01:21:29.644246    1314 pod_workers.go:1300] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized" pod="default/busybox-5bc68d56bd-9pjld" podUID="c95b2373-916f-4083-8a47-909d2b945658"

	Oct 04 01:21:30 multinode-528000 kubelet[1314]: E1004 01:21:30.266403    1314 configmap.go:199] Couldn't get configMap kube-system/coredns: object "kube-system"/"coredns" not registered

	Oct 04 01:21:30 multinode-528000 kubelet[1314]: E1004 01:21:30.266456    1314 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3da6e23f-9391-4ec9-99aa-db9b421b00ad-config-volume podName:3da6e23f-9391-4ec9-99aa-db9b421b00ad nodeName:}" failed. No retries permitted until 2023-10-04 01:21:38.266443732 +0000 UTC m=+20.807568648 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-volume" (UniqueName: "kubernetes.io/configmap/3da6e23f-9391-4ec9-99aa-db9b421b00ad-config-volume") pod "coredns-5dd5756b68-rtwd9" (UID: "3da6e23f-9391-4ec9-99aa-db9b421b00ad") : object "kube-system"/"coredns" not registered

	Oct 04 01:21:30 multinode-528000 kubelet[1314]: E1004 01:21:30.366936    1314 projected.go:292] Couldn't get configMap default/kube-root-ca.crt: object "default"/"kube-root-ca.crt" not registered

	Oct 04 01:21:30 multinode-528000 kubelet[1314]: E1004 01:21:30.366977    1314 projected.go:198] Error preparing data for projected volume kube-api-access-wkfp2 for pod default/busybox-5bc68d56bd-9pjld: object "default"/"kube-root-ca.crt" not registered

	Oct 04 01:21:30 multinode-528000 kubelet[1314]: E1004 01:21:30.367032    1314 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c95b2373-916f-4083-8a47-909d2b945658-kube-api-access-wkfp2 podName:c95b2373-916f-4083-8a47-909d2b945658 nodeName:}" failed. No retries permitted until 2023-10-04 01:21:38.367014994 +0000 UTC m=+20.908139923 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wkfp2" (UniqueName: "kubernetes.io/projected/c95b2373-916f-4083-8a47-909d2b945658-kube-api-access-wkfp2") pod "busybox-5bc68d56bd-9pjld" (UID: "c95b2373-916f-4083-8a47-909d2b945658") : object "default"/"kube-root-ca.crt" not registered

	Oct 04 01:21:30 multinode-528000 kubelet[1314]: I1004 01:21:30.797943    1314 kubelet_node_status.go:493] "Fast updating node status as it just became ready"

	Oct 04 01:21:39 multinode-528000 kubelet[1314]: I1004 01:21:39.061459    1314 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e2be24644e66877f29f952654557bb767efae92c94784683ce341fef19581ae"

	Oct 04 01:21:39 multinode-528000 kubelet[1314]: I1004 01:21:39.218404    1314 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="340bb57e99310470708f0dc28479889061f1c9b90cec25f0a6d46a78edd3bebd"

	Oct 04 01:21:54 multinode-528000 kubelet[1314]: I1004 01:21:54.356330    1314 scope.go:117] "RemoveContainer" containerID="ae6170e1c32ece4cddaef20c5a9b72019ffc29e2522e9717e6a507e19edc1734"

	Oct 04 01:21:54 multinode-528000 kubelet[1314]: I1004 01:21:54.356577    1314 scope.go:117] "RemoveContainer" containerID="5ca5841b1877edaa0e1a2cacd2e27d7c2882fcebe277fe1b8a47450ff8f83225"

	Oct 04 01:21:54 multinode-528000 kubelet[1314]: E1004 01:21:54.356699    1314 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"storage-provisioner\" with CrashLoopBackOff: \"back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(874a29bb-bf60-4c95-9bdd-90dbb9c3c115)\"" pod="kube-system/storage-provisioner" podUID="874a29bb-bf60-4c95-9bdd-90dbb9c3c115"

	Oct 04 01:22:09 multinode-528000 kubelet[1314]: I1004 01:22:09.643754    1314 scope.go:117] "RemoveContainer" containerID="5ca5841b1877edaa0e1a2cacd2e27d7c2882fcebe277fe1b8a47450ff8f83225"

	Oct 04 01:22:17 multinode-528000 kubelet[1314]: E1004 01:22:17.672238    1314 iptables.go:575] "Could not set up iptables canary" err=<

	Oct 04 01:22:17 multinode-528000 kubelet[1314]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Oct 04 01:22:17 multinode-528000 kubelet[1314]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Oct 04 01:22:17 multinode-528000 kubelet[1314]:  > table="nat" chain="KUBE-KUBELET-CANARY"

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.APIServer}} -p multinode-528000 -n multinode-528000

helpers_test.go:261: (dbg) Run:  kubectl --context multinode-528000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestMultiNode/serial/RestartKeepsNodes FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestMultiNode/serial/RestartKeepsNodes (140.84s)