=== RUN TestMultiControlPlane/serial/DegradedAfterClusterRestart
ha_test.go:390: (dbg) Run: out/minikube-linux-amd64 profile list --output json
ha_test.go:413: expected profile "ha-590347" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-590347\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-590347\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19044/minikube-v1.33.1-1718047936-19044-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718296336-19068@sha256:b31b1f456eebc10b590403d2cc052bb20a70156f4629e3514cbb38ecd550e2c8\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"kvm2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":
1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.30.1\",\"ClusterName\":\"ha-590347\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"192.168.39.254\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"crio\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"192.168.39.58\",\"Port\":8443,\"Kuber
netesVersion\":\"v1.30.1\",\"ContainerRuntime\":\"crio\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m02\",\"IP\":\"192.168.39.161\",\"Port\":8443,\"KubernetesVersion\":\"v1.30.1\",\"ContainerRuntime\":\"crio\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m04\",\"IP\":\"192.168.39.71\",\"Port\":0,\"KubernetesVersion\":\"v1.30.1\",\"ContainerRuntime\":\"crio\",\"ControlPlane\":false,\"Worker\":true}],\"Addons\":{\"ambassador\":false,\"auto-pause\":false,\"cloud-spanner\":false,\"csi-hostpath-driver\":false,\"dashboard\":false,\"default-storageclass\":false,\"efk\":false,\"freshpod\":false,\"gcp-auth\":false,\"gvisor\":false,\"headlamp\":false,\"helm-tiller\":false,\"inaccel\":false,\"ingress\":false,\"ingress-dns\":false,\"inspektor-gadget\":false,\"istio\":false,\"istio-provisioner\":false,\"kong\":false,\"kubeflow\":false,\"kubevirt\":false,\"logviewer\":false,\"metallb\":false,\"metrics-server\":false,\"nvidia-device-plugin\":false,\"nvidia-driver-installer\":false,\"nvidia-gpu-device-plugin\":
false,\"olm\":false,\"pod-security-policy\":false,\"portainer\":false,\"registry\":false,\"registry-aliases\":false,\"registry-creds\":false,\"storage-provisioner\":false,\"storage-provisioner-gluster\":false,\"storage-provisioner-rancher\":false,\"volcano\":false,\"volumesnapshots\":false,\"yakd\":false},\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/home/jenkins:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\"
:false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":true}]}"*. args: "out/minikube-linux-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p ha-590347 -n ha-590347
helpers_test.go:244: <<< TestMultiControlPlane/serial/DegradedAfterClusterRestart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestMultiControlPlane/serial/DegradedAfterClusterRestart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p ha-590347 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p ha-590347 logs -n 25: (1.569773259s)
helpers_test.go:252: TestMultiControlPlane/serial/DegradedAfterClusterRestart logs:
-- stdout --
==> Audit <==
|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|
| cp | ha-590347 cp ha-590347-m03:/home/docker/cp-test.txt | ha-590347 | jenkins | v1.33.1 | 14 Jun 24 20:34 UTC | 14 Jun 24 20:34 UTC |
| | ha-590347-m04:/home/docker/cp-test_ha-590347-m03_ha-590347-m04.txt | | | | | |
| ssh | ha-590347 ssh -n | ha-590347 | jenkins | v1.33.1 | 14 Jun 24 20:34 UTC | 14 Jun 24 20:34 UTC |
| | ha-590347-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-590347 ssh -n ha-590347-m04 sudo cat | ha-590347 | jenkins | v1.33.1 | 14 Jun 24 20:34 UTC | 14 Jun 24 20:34 UTC |
| | /home/docker/cp-test_ha-590347-m03_ha-590347-m04.txt | | | | | |
| cp | ha-590347 cp testdata/cp-test.txt | ha-590347 | jenkins | v1.33.1 | 14 Jun 24 20:34 UTC | 14 Jun 24 20:34 UTC |
| | ha-590347-m04:/home/docker/cp-test.txt | | | | | |
| ssh | ha-590347 ssh -n | ha-590347 | jenkins | v1.33.1 | 14 Jun 24 20:34 UTC | 14 Jun 24 20:34 UTC |
| | ha-590347-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| cp | ha-590347 cp ha-590347-m04:/home/docker/cp-test.txt | ha-590347 | jenkins | v1.33.1 | 14 Jun 24 20:34 UTC | 14 Jun 24 20:34 UTC |
| | /tmp/TestMultiControlPlaneserialCopyFile3606159199/001/cp-test_ha-590347-m04.txt | | | | | |
| ssh | ha-590347 ssh -n | ha-590347 | jenkins | v1.33.1 | 14 Jun 24 20:34 UTC | 14 Jun 24 20:34 UTC |
| | ha-590347-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| cp | ha-590347 cp ha-590347-m04:/home/docker/cp-test.txt | ha-590347 | jenkins | v1.33.1 | 14 Jun 24 20:34 UTC | 14 Jun 24 20:34 UTC |
| | ha-590347:/home/docker/cp-test_ha-590347-m04_ha-590347.txt | | | | | |
| ssh | ha-590347 ssh -n | ha-590347 | jenkins | v1.33.1 | 14 Jun 24 20:34 UTC | 14 Jun 24 20:34 UTC |
| | ha-590347-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-590347 ssh -n ha-590347 sudo cat | ha-590347 | jenkins | v1.33.1 | 14 Jun 24 20:34 UTC | 14 Jun 24 20:34 UTC |
| | /home/docker/cp-test_ha-590347-m04_ha-590347.txt | | | | | |
| cp | ha-590347 cp ha-590347-m04:/home/docker/cp-test.txt | ha-590347 | jenkins | v1.33.1 | 14 Jun 24 20:34 UTC | 14 Jun 24 20:34 UTC |
| | ha-590347-m02:/home/docker/cp-test_ha-590347-m04_ha-590347-m02.txt | | | | | |
| ssh | ha-590347 ssh -n | ha-590347 | jenkins | v1.33.1 | 14 Jun 24 20:34 UTC | 14 Jun 24 20:34 UTC |
| | ha-590347-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-590347 ssh -n ha-590347-m02 sudo cat | ha-590347 | jenkins | v1.33.1 | 14 Jun 24 20:34 UTC | 14 Jun 24 20:34 UTC |
| | /home/docker/cp-test_ha-590347-m04_ha-590347-m02.txt | | | | | |
| cp | ha-590347 cp ha-590347-m04:/home/docker/cp-test.txt | ha-590347 | jenkins | v1.33.1 | 14 Jun 24 20:34 UTC | 14 Jun 24 20:34 UTC |
| | ha-590347-m03:/home/docker/cp-test_ha-590347-m04_ha-590347-m03.txt | | | | | |
| ssh | ha-590347 ssh -n | ha-590347 | jenkins | v1.33.1 | 14 Jun 24 20:34 UTC | 14 Jun 24 20:34 UTC |
| | ha-590347-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-590347 ssh -n ha-590347-m03 sudo cat | ha-590347 | jenkins | v1.33.1 | 14 Jun 24 20:34 UTC | 14 Jun 24 20:34 UTC |
| | /home/docker/cp-test_ha-590347-m04_ha-590347-m03.txt | | | | | |
| node | ha-590347 node stop m02 -v=7 | ha-590347 | jenkins | v1.33.1 | 14 Jun 24 20:34 UTC | |
| | --alsologtostderr | | | | | |
| node | ha-590347 node start m02 -v=7 | ha-590347 | jenkins | v1.33.1 | 14 Jun 24 20:37 UTC | |
| | --alsologtostderr | | | | | |
| node | list -p ha-590347 -v=7 | ha-590347 | jenkins | v1.33.1 | 14 Jun 24 20:38 UTC | |
| | --alsologtostderr | | | | | |
| stop | -p ha-590347 -v=7 | ha-590347 | jenkins | v1.33.1 | 14 Jun 24 20:38 UTC | |
| | --alsologtostderr | | | | | |
| start | -p ha-590347 --wait=true -v=7 | ha-590347 | jenkins | v1.33.1 | 14 Jun 24 20:40 UTC | 14 Jun 24 20:44 UTC |
| | --alsologtostderr | | | | | |
| node | list -p ha-590347 | ha-590347 | jenkins | v1.33.1 | 14 Jun 24 20:44 UTC | |
| node | ha-590347 node delete m03 -v=7 | ha-590347 | jenkins | v1.33.1 | 14 Jun 24 20:44 UTC | 14 Jun 24 20:44 UTC |
| | --alsologtostderr | | | | | |
| stop | ha-590347 stop -v=7 | ha-590347 | jenkins | v1.33.1 | 14 Jun 24 20:44 UTC | |
| | --alsologtostderr | | | | | |
| start | -p ha-590347 --wait=true | ha-590347 | jenkins | v1.33.1 | 14 Jun 24 20:47 UTC | |
| | -v=7 --alsologtostderr | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/06/14 20:47:10
Running on machine: ubuntu-20-agent-8
Binary: Built with gc go1.22.3 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0614 20:47:10.982221 41642 out.go:291] Setting OutFile to fd 1 ...
I0614 20:47:10.982317 41642 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0614 20:47:10.982325 41642 out.go:304] Setting ErrFile to fd 2...
I0614 20:47:10.982329 41642 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0614 20:47:10.982798 41642 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19068-14811/.minikube/bin
I0614 20:47:10.983930 41642 out.go:298] Setting JSON to false
I0614 20:47:10.984923 41642 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":5377,"bootTime":1718392654,"procs":203,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0614 20:47:10.984994 41642 start.go:139] virtualization: kvm guest
I0614 20:47:10.986887 41642 out.go:177] * [ha-590347] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0614 20:47:10.988153 41642 out.go:177] - MINIKUBE_LOCATION=19068
I0614 20:47:10.988180 41642 notify.go:220] Checking for updates...
I0614 20:47:10.989557 41642 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0614 20:47:10.990775 41642 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19068-14811/kubeconfig
I0614 20:47:10.992037 41642 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19068-14811/.minikube
I0614 20:47:10.993221 41642 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0614 20:47:10.994370 41642 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0614 20:47:10.995978 41642 config.go:182] Loaded profile config "ha-590347": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.1
I0614 20:47:10.996496 41642 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0614 20:47:10.996587 41642 main.go:141] libmachine: Launching plugin server for driver kvm2
I0614 20:47:11.011990 41642 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40245
I0614 20:47:11.012357 41642 main.go:141] libmachine: () Calling .GetVersion
I0614 20:47:11.012965 41642 main.go:141] libmachine: Using API Version 1
I0614 20:47:11.012981 41642 main.go:141] libmachine: () Calling .SetConfigRaw
I0614 20:47:11.013292 41642 main.go:141] libmachine: () Calling .GetMachineName
I0614 20:47:11.013477 41642 main.go:141] libmachine: (ha-590347) Calling .DriverName
I0614 20:47:11.013725 41642 driver.go:392] Setting default libvirt URI to qemu:///system
I0614 20:47:11.014025 41642 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0614 20:47:11.014063 41642 main.go:141] libmachine: Launching plugin server for driver kvm2
I0614 20:47:11.028164 41642 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33449
I0614 20:47:11.028561 41642 main.go:141] libmachine: () Calling .GetVersion
I0614 20:47:11.029050 41642 main.go:141] libmachine: Using API Version 1
I0614 20:47:11.029071 41642 main.go:141] libmachine: () Calling .SetConfigRaw
I0614 20:47:11.029385 41642 main.go:141] libmachine: () Calling .GetMachineName
I0614 20:47:11.029536 41642 main.go:141] libmachine: (ha-590347) Calling .DriverName
I0614 20:47:11.064550 41642 out.go:177] * Using the kvm2 driver based on existing profile
I0614 20:47:11.065926 41642 start.go:297] selected driver: kvm2
I0614 20:47:11.065961 41642 start.go:901] validating driver "kvm2" against &{Name:ha-590347 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19044/minikube-v1.33.1-1718047936-19044-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718296336-19068@sha256:b31b1f456eebc10b590403d2cc052bb20a70156f4629e3514cbb38ecd550e2c8 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVer
sion:v1.30.1 ClusterName:ha-590347 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.58 Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.161 Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.71 Port:0 KubernetesVersion:v1.30.1 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingres
s-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirr
or: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0614 20:47:11.066126 41642 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0614 20:47:11.066455 41642 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0614 20:47:11.066523 41642 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19068-14811/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0614 20:47:11.081130 41642 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0614 20:47:11.081874 41642 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0614 20:47:11.081969 41642 cni.go:84] Creating CNI manager for ""
I0614 20:47:11.081984 41642 cni.go:136] multinode detected (3 nodes found), recommending kindnet
I0614 20:47:11.082041 41642 start.go:340] cluster config:
{Name:ha-590347 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19044/minikube-v1.33.1-1718047936-19044-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718296336-19068@sha256:b31b1f456eebc10b590403d2cc052bb20a70156f4629e3514cbb38ecd550e2c8 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.1 ClusterName:ha-590347 Namespace:default APIServerHAVIP:192.168.39
.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.58 Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.161 Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.71 Port:0 KubernetesVersion:v1.30.1 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kon
g:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath
: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0614 20:47:11.082185 41642 iso.go:125] acquiring lock: {Name:mkf0b65c8b7be390fdbd2800c521c78eeb0bdead Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0614 20:47:11.084607 41642 out.go:177] * Starting "ha-590347" primary control-plane node in "ha-590347" cluster
I0614 20:47:11.085977 41642 preload.go:132] Checking if preload exists for k8s version v1.30.1 and runtime crio
I0614 20:47:11.086021 41642 preload.go:147] Found local preload: /home/jenkins/minikube-integration/19068-14811/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.1-cri-o-overlay-amd64.tar.lz4
I0614 20:47:11.086034 41642 cache.go:56] Caching tarball of preloaded images
I0614 20:47:11.086122 41642 preload.go:173] Found /home/jenkins/minikube-integration/19068-14811/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.1-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0614 20:47:11.086136 41642 cache.go:59] Finished verifying existence of preloaded tar for v1.30.1 on crio
I0614 20:47:11.086305 41642 profile.go:143] Saving config to /home/jenkins/minikube-integration/19068-14811/.minikube/profiles/ha-590347/config.json ...
I0614 20:47:11.086599 41642 start.go:360] acquireMachinesLock for ha-590347: {Name:mkf3e79f128a55e0a698ff6395067c398f907f69 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0614 20:47:11.086657 41642 start.go:364] duration metric: took 32.221µs to acquireMachinesLock for "ha-590347"
I0614 20:47:11.086673 41642 start.go:96] Skipping create...Using existing machine configuration
I0614 20:47:11.086682 41642 fix.go:54] fixHost starting:
I0614 20:47:11.087094 41642 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0614 20:47:11.087138 41642 main.go:141] libmachine: Launching plugin server for driver kvm2
I0614 20:47:11.104438 41642 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35045
I0614 20:47:11.104905 41642 main.go:141] libmachine: () Calling .GetVersion
I0614 20:47:11.105383 41642 main.go:141] libmachine: Using API Version 1
I0614 20:47:11.105408 41642 main.go:141] libmachine: () Calling .SetConfigRaw
I0614 20:47:11.105783 41642 main.go:141] libmachine: () Calling .GetMachineName
I0614 20:47:11.105958 41642 main.go:141] libmachine: (ha-590347) Calling .DriverName
I0614 20:47:11.106124 41642 main.go:141] libmachine: (ha-590347) Calling .GetState
I0614 20:47:11.107803 41642 fix.go:112] recreateIfNeeded on ha-590347: state=Running err=<nil>
W0614 20:47:11.107825 41642 fix.go:138] unexpected machine state, will restart: <nil>
I0614 20:47:11.110644 41642 out.go:177] * Updating the running kvm2 "ha-590347" VM ...
I0614 20:47:11.112166 41642 machine.go:94] provisionDockerMachine start ...
I0614 20:47:11.112184 41642 main.go:141] libmachine: (ha-590347) Calling .DriverName
I0614 20:47:11.112417 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHHostname
I0614 20:47:11.115121 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:47:11.115568 41642 main.go:141] libmachine: (ha-590347) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:9c:48", ip: ""} in network mk-ha-590347: {Iface:virbr1 ExpiryTime:2024-06-14 21:30:51 +0000 UTC Type:0 Mac:52:54:00:f2:9c:48 Iaid: IPaddr:192.168.39.58 Prefix:24 Hostname:ha-590347 Clientid:01:52:54:00:f2:9c:48}
I0614 20:47:11.115592 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined IP address 192.168.39.58 and MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:47:11.115736 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHPort
I0614 20:47:11.115920 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHKeyPath
I0614 20:47:11.116079 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHKeyPath
I0614 20:47:11.116213 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHUsername
I0614 20:47:11.116420 41642 main.go:141] libmachine: Using SSH client type: native
I0614 20:47:11.116653 41642 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d880] 0x8305e0 <nil> [] 0s} 192.168.39.58 22 <nil> <nil>}
I0614 20:47:11.116670 41642 main.go:141] libmachine: About to run SSH command:
hostname
I0614 20:47:11.226884 41642 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-590347
I0614 20:47:11.226917 41642 main.go:141] libmachine: (ha-590347) Calling .GetMachineName
I0614 20:47:11.227198 41642 buildroot.go:166] provisioning hostname "ha-590347"
I0614 20:47:11.227221 41642 main.go:141] libmachine: (ha-590347) Calling .GetMachineName
I0614 20:47:11.227451 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHHostname
I0614 20:47:11.230045 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:47:11.230418 41642 main.go:141] libmachine: (ha-590347) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:9c:48", ip: ""} in network mk-ha-590347: {Iface:virbr1 ExpiryTime:2024-06-14 21:30:51 +0000 UTC Type:0 Mac:52:54:00:f2:9c:48 Iaid: IPaddr:192.168.39.58 Prefix:24 Hostname:ha-590347 Clientid:01:52:54:00:f2:9c:48}
I0614 20:47:11.230445 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined IP address 192.168.39.58 and MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:47:11.230594 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHPort
I0614 20:47:11.230763 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHKeyPath
I0614 20:47:11.230923 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHKeyPath
I0614 20:47:11.231058 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHUsername
I0614 20:47:11.231273 41642 main.go:141] libmachine: Using SSH client type: native
I0614 20:47:11.231440 41642 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d880] 0x8305e0 <nil> [] 0s} 192.168.39.58 22 <nil> <nil>}
I0614 20:47:11.231451 41642 main.go:141] libmachine: About to run SSH command:
sudo hostname ha-590347 && echo "ha-590347" | sudo tee /etc/hostname
I0614 20:47:11.360658 41642 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-590347
I0614 20:47:11.360685 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHHostname
I0614 20:47:11.363346 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:47:11.363731 41642 main.go:141] libmachine: (ha-590347) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:9c:48", ip: ""} in network mk-ha-590347: {Iface:virbr1 ExpiryTime:2024-06-14 21:30:51 +0000 UTC Type:0 Mac:52:54:00:f2:9c:48 Iaid: IPaddr:192.168.39.58 Prefix:24 Hostname:ha-590347 Clientid:01:52:54:00:f2:9c:48}
I0614 20:47:11.363763 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined IP address 192.168.39.58 and MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:47:11.363878 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHPort
I0614 20:47:11.364092 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHKeyPath
I0614 20:47:11.364313 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHKeyPath
I0614 20:47:11.364484 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHUsername
I0614 20:47:11.364660 41642 main.go:141] libmachine: Using SSH client type: native
I0614 20:47:11.364863 41642 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d880] 0x8305e0 <nil> [] 0s} 192.168.39.58 22 <nil> <nil>}
I0614 20:47:11.364888 41642 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sha-590347' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-590347/g' /etc/hosts;
else
echo '127.0.1.1 ha-590347' | sudo tee -a /etc/hosts;
fi
fi
I0614 20:47:11.470607 41642 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0614 20:47:11.470643 41642 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19068-14811/.minikube CaCertPath:/home/jenkins/minikube-integration/19068-14811/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19068-14811/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19068-14811/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19068-14811/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19068-14811/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19068-14811/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19068-14811/.minikube}
I0614 20:47:11.470699 41642 buildroot.go:174] setting up certificates
I0614 20:47:11.470712 41642 provision.go:84] configureAuth start
I0614 20:47:11.470728 41642 main.go:141] libmachine: (ha-590347) Calling .GetMachineName
I0614 20:47:11.471010 41642 main.go:141] libmachine: (ha-590347) Calling .GetIP
I0614 20:47:11.473689 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:47:11.474229 41642 main.go:141] libmachine: (ha-590347) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:9c:48", ip: ""} in network mk-ha-590347: {Iface:virbr1 ExpiryTime:2024-06-14 21:30:51 +0000 UTC Type:0 Mac:52:54:00:f2:9c:48 Iaid: IPaddr:192.168.39.58 Prefix:24 Hostname:ha-590347 Clientid:01:52:54:00:f2:9c:48}
I0614 20:47:11.474259 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined IP address 192.168.39.58 and MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:47:11.474462 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHHostname
I0614 20:47:11.477301 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:47:11.477721 41642 main.go:141] libmachine: (ha-590347) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:9c:48", ip: ""} in network mk-ha-590347: {Iface:virbr1 ExpiryTime:2024-06-14 21:30:51 +0000 UTC Type:0 Mac:52:54:00:f2:9c:48 Iaid: IPaddr:192.168.39.58 Prefix:24 Hostname:ha-590347 Clientid:01:52:54:00:f2:9c:48}
I0614 20:47:11.477747 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined IP address 192.168.39.58 and MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:47:11.477852 41642 provision.go:143] copyHostCerts
I0614 20:47:11.477900 41642 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19068-14811/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19068-14811/.minikube/ca.pem
I0614 20:47:11.477945 41642 exec_runner.go:144] found /home/jenkins/minikube-integration/19068-14811/.minikube/ca.pem, removing ...
I0614 20:47:11.477955 41642 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19068-14811/.minikube/ca.pem
I0614 20:47:11.478020 41642 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19068-14811/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19068-14811/.minikube/ca.pem (1082 bytes)
I0614 20:47:11.478118 41642 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19068-14811/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19068-14811/.minikube/cert.pem
I0614 20:47:11.478149 41642 exec_runner.go:144] found /home/jenkins/minikube-integration/19068-14811/.minikube/cert.pem, removing ...
I0614 20:47:11.478157 41642 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19068-14811/.minikube/cert.pem
I0614 20:47:11.478184 41642 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19068-14811/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19068-14811/.minikube/cert.pem (1123 bytes)
I0614 20:47:11.478227 41642 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19068-14811/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19068-14811/.minikube/key.pem
I0614 20:47:11.478243 41642 exec_runner.go:144] found /home/jenkins/minikube-integration/19068-14811/.minikube/key.pem, removing ...
I0614 20:47:11.478249 41642 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19068-14811/.minikube/key.pem
I0614 20:47:11.478272 41642 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19068-14811/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19068-14811/.minikube/key.pem (1675 bytes)
I0614 20:47:11.478325 41642 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19068-14811/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19068-14811/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19068-14811/.minikube/certs/ca-key.pem org=jenkins.ha-590347 san=[127.0.0.1 192.168.39.58 ha-590347 localhost minikube]
I0614 20:47:11.669654 41642 provision.go:177] copyRemoteCerts
I0614 20:47:11.669705 41642 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0614 20:47:11.669732 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHHostname
I0614 20:47:11.672764 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:47:11.673222 41642 main.go:141] libmachine: (ha-590347) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:9c:48", ip: ""} in network mk-ha-590347: {Iface:virbr1 ExpiryTime:2024-06-14 21:30:51 +0000 UTC Type:0 Mac:52:54:00:f2:9c:48 Iaid: IPaddr:192.168.39.58 Prefix:24 Hostname:ha-590347 Clientid:01:52:54:00:f2:9c:48}
I0614 20:47:11.673250 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined IP address 192.168.39.58 and MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:47:11.673445 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHPort
I0614 20:47:11.673659 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHKeyPath
I0614 20:47:11.673819 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHUsername
I0614 20:47:11.673968 41642 sshutil.go:53] new ssh client: &{IP:192.168.39.58 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19068-14811/.minikube/machines/ha-590347/id_rsa Username:docker}
I0614 20:47:11.755655 41642 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19068-14811/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I0614 20:47:11.755735 41642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19068-14811/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0614 20:47:11.782150 41642 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19068-14811/.minikube/machines/server.pem -> /etc/docker/server.pem
I0614 20:47:11.782233 41642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19068-14811/.minikube/machines/server.pem --> /etc/docker/server.pem (1200 bytes)
I0614 20:47:11.808677 41642 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19068-14811/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I0614 20:47:11.808764 41642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19068-14811/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0614 20:47:11.836054 41642 provision.go:87] duration metric: took 365.325765ms to configureAuth
I0614 20:47:11.836090 41642 buildroot.go:189] setting minikube options for container-runtime
I0614 20:47:11.836402 41642 config.go:182] Loaded profile config "ha-590347": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.1
I0614 20:47:11.836512 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHHostname
I0614 20:47:11.839354 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:47:11.839773 41642 main.go:141] libmachine: (ha-590347) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:9c:48", ip: ""} in network mk-ha-590347: {Iface:virbr1 ExpiryTime:2024-06-14 21:30:51 +0000 UTC Type:0 Mac:52:54:00:f2:9c:48 Iaid: IPaddr:192.168.39.58 Prefix:24 Hostname:ha-590347 Clientid:01:52:54:00:f2:9c:48}
I0614 20:47:11.839803 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined IP address 192.168.39.58 and MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:47:11.839947 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHPort
I0614 20:47:11.840161 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHKeyPath
I0614 20:47:11.840341 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHKeyPath
I0614 20:47:11.840449 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHUsername
I0614 20:47:11.840596 41642 main.go:141] libmachine: Using SSH client type: native
I0614 20:47:11.840757 41642 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d880] 0x8305e0 <nil> [] 0s} 192.168.39.58 22 <nil> <nil>}
I0614 20:47:11.840772 41642 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0614 20:48:46.566817 41642 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0614 20:48:46.566855 41642 machine.go:97] duration metric: took 1m35.454675845s to provisionDockerMachine
I0614 20:48:46.566871 41642 start.go:293] postStartSetup for "ha-590347" (driver="kvm2")
I0614 20:48:46.566884 41642 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0614 20:48:46.566904 41642 main.go:141] libmachine: (ha-590347) Calling .DriverName
I0614 20:48:46.567292 41642 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0614 20:48:46.567332 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHHostname
I0614 20:48:46.570906 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:48:46.571511 41642 main.go:141] libmachine: (ha-590347) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:9c:48", ip: ""} in network mk-ha-590347: {Iface:virbr1 ExpiryTime:2024-06-14 21:30:51 +0000 UTC Type:0 Mac:52:54:00:f2:9c:48 Iaid: IPaddr:192.168.39.58 Prefix:24 Hostname:ha-590347 Clientid:01:52:54:00:f2:9c:48}
I0614 20:48:46.571538 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined IP address 192.168.39.58 and MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:48:46.571714 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHPort
I0614 20:48:46.571888 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHKeyPath
I0614 20:48:46.572068 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHUsername
I0614 20:48:46.572221 41642 sshutil.go:53] new ssh client: &{IP:192.168.39.58 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19068-14811/.minikube/machines/ha-590347/id_rsa Username:docker}
I0614 20:48:46.656984 41642 ssh_runner.go:195] Run: cat /etc/os-release
I0614 20:48:46.660940 41642 info.go:137] Remote host: Buildroot 2023.02.9
I0614 20:48:46.660960 41642 filesync.go:126] Scanning /home/jenkins/minikube-integration/19068-14811/.minikube/addons for local assets ...
I0614 20:48:46.661023 41642 filesync.go:126] Scanning /home/jenkins/minikube-integration/19068-14811/.minikube/files for local assets ...
I0614 20:48:46.661090 41642 filesync.go:149] local asset: /home/jenkins/minikube-integration/19068-14811/.minikube/files/etc/ssl/certs/220192.pem -> 220192.pem in /etc/ssl/certs
I0614 20:48:46.661099 41642 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19068-14811/.minikube/files/etc/ssl/certs/220192.pem -> /etc/ssl/certs/220192.pem
I0614 20:48:46.661174 41642 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0614 20:48:46.670215 41642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19068-14811/.minikube/files/etc/ssl/certs/220192.pem --> /etc/ssl/certs/220192.pem (1708 bytes)
I0614 20:48:46.693556 41642 start.go:296] duration metric: took 126.672073ms for postStartSetup
I0614 20:48:46.693599 41642 main.go:141] libmachine: (ha-590347) Calling .DriverName
I0614 20:48:46.693932 41642 ssh_runner.go:195] Run: sudo ls --almost-all -1 /var/lib/minikube/backup
I0614 20:48:46.693980 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHHostname
I0614 20:48:46.696851 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:48:46.697236 41642 main.go:141] libmachine: (ha-590347) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:9c:48", ip: ""} in network mk-ha-590347: {Iface:virbr1 ExpiryTime:2024-06-14 21:30:51 +0000 UTC Type:0 Mac:52:54:00:f2:9c:48 Iaid: IPaddr:192.168.39.58 Prefix:24 Hostname:ha-590347 Clientid:01:52:54:00:f2:9c:48}
I0614 20:48:46.697264 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined IP address 192.168.39.58 and MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:48:46.697456 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHPort
I0614 20:48:46.697682 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHKeyPath
I0614 20:48:46.697888 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHUsername
I0614 20:48:46.698055 41642 sshutil.go:53] new ssh client: &{IP:192.168.39.58 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19068-14811/.minikube/machines/ha-590347/id_rsa Username:docker}
W0614 20:48:46.789011 41642 fix.go:99] cannot read backup folder, skipping restore: read dir: sudo ls --almost-all -1 /var/lib/minikube/backup: Process exited with status 2
stdout:
stderr:
ls: cannot access '/var/lib/minikube/backup': No such file or directory
I0614 20:48:46.789040 41642 fix.go:56] duration metric: took 1m35.70235911s for fixHost
I0614 20:48:46.789061 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHHostname
I0614 20:48:46.791935 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:48:46.792351 41642 main.go:141] libmachine: (ha-590347) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:9c:48", ip: ""} in network mk-ha-590347: {Iface:virbr1 ExpiryTime:2024-06-14 21:30:51 +0000 UTC Type:0 Mac:52:54:00:f2:9c:48 Iaid: IPaddr:192.168.39.58 Prefix:24 Hostname:ha-590347 Clientid:01:52:54:00:f2:9c:48}
I0614 20:48:46.792380 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined IP address 192.168.39.58 and MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:48:46.792530 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHPort
I0614 20:48:46.792751 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHKeyPath
I0614 20:48:46.792968 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHKeyPath
I0614 20:48:46.793125 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHUsername
I0614 20:48:46.793272 41642 main.go:141] libmachine: Using SSH client type: native
I0614 20:48:46.793441 41642 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d880] 0x8305e0 <nil> [] 0s} 192.168.39.58 22 <nil> <nil>}
I0614 20:48:46.793453 41642 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0614 20:48:46.906533 41642 main.go:141] libmachine: SSH cmd err, output: <nil>: 1718398126.875991010
I0614 20:48:46.906560 41642 fix.go:216] guest clock: 1718398126.875991010
I0614 20:48:46.906572 41642 fix.go:229] Guest: 2024-06-14 20:48:46.87599101 +0000 UTC Remote: 2024-06-14 20:48:46.789047737 +0000 UTC m=+95.841675078 (delta=86.943273ms)
I0614 20:48:46.906600 41642 fix.go:200] guest clock delta is within tolerance: 86.943273ms
I0614 20:48:46.906608 41642 start.go:83] releasing machines lock for "ha-590347", held for 1m35.819941589s
I0614 20:48:46.906638 41642 main.go:141] libmachine: (ha-590347) Calling .DriverName
I0614 20:48:46.906903 41642 main.go:141] libmachine: (ha-590347) Calling .GetIP
I0614 20:48:46.909565 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:48:46.909932 41642 main.go:141] libmachine: (ha-590347) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:9c:48", ip: ""} in network mk-ha-590347: {Iface:virbr1 ExpiryTime:2024-06-14 21:30:51 +0000 UTC Type:0 Mac:52:54:00:f2:9c:48 Iaid: IPaddr:192.168.39.58 Prefix:24 Hostname:ha-590347 Clientid:01:52:54:00:f2:9c:48}
I0614 20:48:46.909956 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined IP address 192.168.39.58 and MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:48:46.910106 41642 main.go:141] libmachine: (ha-590347) Calling .DriverName
I0614 20:48:46.910605 41642 main.go:141] libmachine: (ha-590347) Calling .DriverName
I0614 20:48:46.910763 41642 main.go:141] libmachine: (ha-590347) Calling .DriverName
I0614 20:48:46.910853 41642 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0614 20:48:46.910893 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHHostname
I0614 20:48:46.910948 41642 ssh_runner.go:195] Run: cat /version.json
I0614 20:48:46.910992 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHHostname
I0614 20:48:46.913612 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:48:46.913673 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:48:46.914155 41642 main.go:141] libmachine: (ha-590347) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:9c:48", ip: ""} in network mk-ha-590347: {Iface:virbr1 ExpiryTime:2024-06-14 21:30:51 +0000 UTC Type:0 Mac:52:54:00:f2:9c:48 Iaid: IPaddr:192.168.39.58 Prefix:24 Hostname:ha-590347 Clientid:01:52:54:00:f2:9c:48}
I0614 20:48:46.914186 41642 main.go:141] libmachine: (ha-590347) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:9c:48", ip: ""} in network mk-ha-590347: {Iface:virbr1 ExpiryTime:2024-06-14 21:30:51 +0000 UTC Type:0 Mac:52:54:00:f2:9c:48 Iaid: IPaddr:192.168.39.58 Prefix:24 Hostname:ha-590347 Clientid:01:52:54:00:f2:9c:48}
I0614 20:48:46.914208 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined IP address 192.168.39.58 and MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:48:46.914224 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined IP address 192.168.39.58 and MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:48:46.914369 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHPort
I0614 20:48:46.914462 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHPort
I0614 20:48:46.914572 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHKeyPath
I0614 20:48:46.914633 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHKeyPath
I0614 20:48:46.914755 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHUsername
I0614 20:48:46.914804 41642 main.go:141] libmachine: (ha-590347) Calling .GetSSHUsername
I0614 20:48:46.914894 41642 sshutil.go:53] new ssh client: &{IP:192.168.39.58 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19068-14811/.minikube/machines/ha-590347/id_rsa Username:docker}
I0614 20:48:46.914931 41642 sshutil.go:53] new ssh client: &{IP:192.168.39.58 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19068-14811/.minikube/machines/ha-590347/id_rsa Username:docker}
I0614 20:48:46.990984 41642 ssh_runner.go:195] Run: systemctl --version
I0614 20:48:47.028671 41642 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0614 20:48:47.191902 41642 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0614 20:48:47.201599 41642 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0614 20:48:47.201687 41642 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0614 20:48:47.211185 41642 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0614 20:48:47.211207 41642 start.go:494] detecting cgroup driver to use...
I0614 20:48:47.211270 41642 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0614 20:48:47.228568 41642 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0614 20:48:47.249129 41642 docker.go:217] disabling cri-docker service (if available) ...
I0614 20:48:47.249228 41642 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0614 20:48:47.265349 41642 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0614 20:48:47.286709 41642 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0614 20:48:47.444360 41642 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0614 20:48:47.602068 41642 docker.go:233] disabling docker service ...
I0614 20:48:47.602144 41642 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0614 20:48:47.618969 41642 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0614 20:48:47.632787 41642 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0614 20:48:47.797847 41642 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0614 20:48:47.945579 41642 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0614 20:48:47.960446 41642 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0614 20:48:47.980052 41642 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0614 20:48:47.980109 41642 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0614 20:48:47.990363 41642 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0614 20:48:47.990449 41642 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0614 20:48:48.000652 41642 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0614 20:48:48.010669 41642 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0614 20:48:48.020604 41642 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0614 20:48:48.030872 41642 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I0614 20:48:48.041358 41642 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I0614 20:48:48.052203 41642 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I0614 20:48:48.062893 41642 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0614 20:48:48.072608 41642 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0614 20:48:48.081507 41642 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0614 20:48:48.232821 41642 ssh_runner.go:195] Run: sudo systemctl restart crio
I0614 20:48:54.621390 41642 ssh_runner.go:235] Completed: sudo systemctl restart crio: (6.388527137s)
I0614 20:48:54.621425 41642 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0614 20:48:54.621495 41642 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0614 20:48:54.626263 41642 start.go:562] Will wait 60s for crictl version
I0614 20:48:54.626310 41642 ssh_runner.go:195] Run: which crictl
I0614 20:48:54.630271 41642 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0614 20:48:54.667012 41642 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0614 20:48:54.667099 41642 ssh_runner.go:195] Run: crio --version
I0614 20:48:54.694845 41642 ssh_runner.go:195] Run: crio --version
I0614 20:48:54.725770 41642 out.go:177] * Preparing Kubernetes v1.30.1 on CRI-O 1.29.1 ...
I0614 20:48:54.727658 41642 main.go:141] libmachine: (ha-590347) Calling .GetIP
I0614 20:48:54.730542 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:48:54.731013 41642 main.go:141] libmachine: (ha-590347) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f2:9c:48", ip: ""} in network mk-ha-590347: {Iface:virbr1 ExpiryTime:2024-06-14 21:30:51 +0000 UTC Type:0 Mac:52:54:00:f2:9c:48 Iaid: IPaddr:192.168.39.58 Prefix:24 Hostname:ha-590347 Clientid:01:52:54:00:f2:9c:48}
I0614 20:48:54.731045 41642 main.go:141] libmachine: (ha-590347) DBG | domain ha-590347 has defined IP address 192.168.39.58 and MAC address 52:54:00:f2:9c:48 in network mk-ha-590347
I0614 20:48:54.731244 41642 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0614 20:48:54.736502 41642 kubeadm.go:877] updating cluster {Name:ha-590347 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19044/minikube-v1.33.1-1718047936-19044-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718296336-19068@sha256:b31b1f456eebc10b590403d2cc052bb20a70156f4629e3514cbb38ecd550e2c8 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.1 Cl
usterName:ha-590347 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.58 Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.161 Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.71 Port:0 KubernetesVersion:v1.30.1 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false
inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disable
Optimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0614 20:48:54.736678 41642 preload.go:132] Checking if preload exists for k8s version v1.30.1 and runtime crio
I0614 20:48:54.736732 41642 ssh_runner.go:195] Run: sudo crictl images --output json
I0614 20:48:54.785257 41642 crio.go:514] all images are preloaded for cri-o runtime.
I0614 20:48:54.785283 41642 crio.go:433] Images already preloaded, skipping extraction
I0614 20:48:54.785334 41642 ssh_runner.go:195] Run: sudo crictl images --output json
I0614 20:48:54.822397 41642 crio.go:514] all images are preloaded for cri-o runtime.
I0614 20:48:54.822421 41642 cache_images.go:84] Images are preloaded, skipping loading
I0614 20:48:54.822432 41642 kubeadm.go:928] updating node { 192.168.39.58 8443 v1.30.1 crio true true} ...
I0614 20:48:54.822548 41642 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.30.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-590347 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.58
[Install]
config:
{KubernetesVersion:v1.30.1 ClusterName:ha-590347 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0614 20:48:54.822643 41642 ssh_runner.go:195] Run: crio config
I0614 20:48:54.875879 41642 cni.go:84] Creating CNI manager for ""
I0614 20:48:54.875908 41642 cni.go:136] multinode detected (3 nodes found), recommending kindnet
I0614 20:48:54.875920 41642 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0614 20:48:54.875945 41642 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.58 APIServerPort:8443 KubernetesVersion:v1.30.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-590347 NodeName:ha-590347 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.58"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.58 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/m
anifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0614 20:48:54.876112 41642 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.58
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "ha-590347"
kubeletExtraArgs:
node-ip: 192.168.39.58
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.58"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.30.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0614 20:48:54.876135 41642 kube-vip.go:115] generating kube-vip config ...
I0614 20:48:54.876185 41642 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"
I0614 20:48:54.887155 41642 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip
I0614 20:48:54.887239 41642 kube-vip.go:137] kube-vip config:
apiVersion: v1
kind: Pod
metadata:
creationTimestamp: null
name: kube-vip
namespace: kube-system
spec:
containers:
- args:
- manager
env:
- name: vip_arp
value: "true"
- name: port
value: "8443"
- name: vip_nodename
valueFrom:
fieldRef:
fieldPath: spec.nodeName
- name: vip_interface
value: eth0
- name: vip_cidr
value: "32"
- name: dns_mode
value: first
- name: cp_enable
value: "true"
- name: cp_namespace
value: kube-system
- name: vip_leaderelection
value: "true"
- name: vip_leasename
value: plndr-cp-lock
- name: vip_leaseduration
value: "5"
- name: vip_renewdeadline
value: "3"
- name: vip_retryperiod
value: "1"
- name: address
value: 192.168.39.254
- name: prometheus_server
value: :2112
- name : lb_enable
value: "true"
- name: lb_port
value: "8443"
image: ghcr.io/kube-vip/kube-vip:v0.8.0
imagePullPolicy: IfNotPresent
name: kube-vip
resources: {}
securityContext:
capabilities:
add:
- NET_ADMIN
- NET_RAW
volumeMounts:
- mountPath: /etc/kubernetes/admin.conf
name: kubeconfig
hostAliases:
- hostnames:
- kubernetes
ip: 127.0.0.1
hostNetwork: true
volumes:
- hostPath:
path: "/etc/kubernetes/admin.conf"
name: kubeconfig
status: {}
I0614 20:48:54.887284 41642 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.1
I0614 20:48:54.895991 41642 binaries.go:44] Found k8s binaries, skipping transfer
I0614 20:48:54.896051 41642 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests
I0614 20:48:54.904868 41642 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (308 bytes)
I0614 20:48:54.920968 41642 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0614 20:48:54.938899 41642 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2150 bytes)
I0614 20:48:54.955355 41642 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1441 bytes)
I0614 20:48:54.971390 41642 ssh_runner.go:195] Run: grep 192.168.39.254 control-plane.minikube.internal$ /etc/hosts
I0614 20:48:54.975976 41642 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0614 20:48:55.121076 41642 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0614 20:48:55.136305 41642 certs.go:68] Setting up /home/jenkins/minikube-integration/19068-14811/.minikube/profiles/ha-590347 for IP: 192.168.39.58
I0614 20:48:55.136331 41642 certs.go:194] generating shared ca certs ...
I0614 20:48:55.136347 41642 certs.go:226] acquiring lock for ca certs: {Name:mka4ffcfe901e69ba470e1b97840659e560a4082 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0614 20:48:55.136557 41642 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19068-14811/.minikube/ca.key
I0614 20:48:55.136617 41642 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19068-14811/.minikube/proxy-client-ca.key
I0614 20:48:55.136633 41642 certs.go:256] generating profile certs ...
I0614 20:48:55.136739 41642 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19068-14811/.minikube/profiles/ha-590347/client.key
I0614 20:48:55.136778 41642 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19068-14811/.minikube/profiles/ha-590347/apiserver.key.eb70f4ea
I0614 20:48:55.136800 41642 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19068-14811/.minikube/profiles/ha-590347/apiserver.crt.eb70f4ea with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.58 192.168.39.161 192.168.39.254]
I0614 20:48:55.493707 41642 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19068-14811/.minikube/profiles/ha-590347/apiserver.crt.eb70f4ea ...
I0614 20:48:55.493739 41642 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19068-14811/.minikube/profiles/ha-590347/apiserver.crt.eb70f4ea: {Name:mk0f619e4f77d88a450988335ddf9b1ecc5391ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0614 20:48:55.493933 41642 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19068-14811/.minikube/profiles/ha-590347/apiserver.key.eb70f4ea ...
I0614 20:48:55.493949 41642 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19068-14811/.minikube/profiles/ha-590347/apiserver.key.eb70f4ea: {Name:mkf3040a51ff79a2c4468a74c09c12ad760038e4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0614 20:48:55.494044 41642 certs.go:381] copying /home/jenkins/minikube-integration/19068-14811/.minikube/profiles/ha-590347/apiserver.crt.eb70f4ea -> /home/jenkins/minikube-integration/19068-14811/.minikube/profiles/ha-590347/apiserver.crt
I0614 20:48:55.494236 41642 certs.go:385] copying /home/jenkins/minikube-integration/19068-14811/.minikube/profiles/ha-590347/apiserver.key.eb70f4ea -> /home/jenkins/minikube-integration/19068-14811/.minikube/profiles/ha-590347/apiserver.key
I0614 20:48:55.494423 41642 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19068-14811/.minikube/profiles/ha-590347/proxy-client.key
I0614 20:48:55.494446 41642 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19068-14811/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I0614 20:48:55.494467 41642 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19068-14811/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I0614 20:48:55.494484 41642 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19068-14811/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I0614 20:48:55.494502 41642 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19068-14811/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I0614 20:48:55.494517 41642 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19068-14811/.minikube/profiles/ha-590347/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
I0614 20:48:55.494527 41642 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19068-14811/.minikube/profiles/ha-590347/apiserver.key -> /var/lib/minikube/certs/apiserver.key
I0614 20:48:55.494546 41642 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19068-14811/.minikube/profiles/ha-590347/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
I0614 20:48:55.494556 41642 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19068-14811/.minikube/profiles/ha-590347/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
I0614 20:48:55.494613 41642 certs.go:484] found cert: /home/jenkins/minikube-integration/19068-14811/.minikube/certs/22019.pem (1338 bytes)
W0614 20:48:55.494648 41642 certs.go:480] ignoring /home/jenkins/minikube-integration/19068-14811/.minikube/certs/22019_empty.pem, impossibly tiny 0 bytes
I0614 20:48:55.494658 41642 certs.go:484] found cert: /home/jenkins/minikube-integration/19068-14811/.minikube/certs/ca-key.pem (1679 bytes)
I0614 20:48:55.494680 41642 certs.go:484] found cert: /home/jenkins/minikube-integration/19068-14811/.minikube/certs/ca.pem (1082 bytes)
I0614 20:48:55.494703 41642 certs.go:484] found cert: /home/jenkins/minikube-integration/19068-14811/.minikube/certs/cert.pem (1123 bytes)
I0614 20:48:55.494723 41642 certs.go:484] found cert: /home/jenkins/minikube-integration/19068-14811/.minikube/certs/key.pem (1675 bytes)
I0614 20:48:55.494759 41642 certs.go:484] found cert: /home/jenkins/minikube-integration/19068-14811/.minikube/files/etc/ssl/certs/220192.pem (1708 bytes)
I0614 20:48:55.494788 41642 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19068-14811/.minikube/files/etc/ssl/certs/220192.pem -> /usr/share/ca-certificates/220192.pem
I0614 20:48:55.494808 41642 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19068-14811/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I0614 20:48:55.494826 41642 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19068-14811/.minikube/certs/22019.pem -> /usr/share/ca-certificates/22019.pem
I0614 20:48:55.495508 41642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19068-14811/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0614 20:48:55.520921 41642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19068-14811/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0614 20:48:55.545034 41642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19068-14811/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0614 20:48:55.594435 41642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19068-14811/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0614 20:48:55.620883 41642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19068-14811/.minikube/profiles/ha-590347/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0614 20:48:55.645532 41642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19068-14811/.minikube/profiles/ha-590347/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0614 20:48:55.667744 41642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19068-14811/.minikube/profiles/ha-590347/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0614 20:48:55.690744 41642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19068-14811/.minikube/profiles/ha-590347/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0614 20:48:55.714657 41642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19068-14811/.minikube/files/etc/ssl/certs/220192.pem --> /usr/share/ca-certificates/220192.pem (1708 bytes)
I0614 20:48:55.737547 41642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19068-14811/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0614 20:48:55.760822 41642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19068-14811/.minikube/certs/22019.pem --> /usr/share/ca-certificates/22019.pem (1338 bytes)
I0614 20:48:55.783305 41642 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0614 20:48:55.800055 41642 ssh_runner.go:195] Run: openssl version
I0614 20:48:55.805654 41642 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/220192.pem && ln -fs /usr/share/ca-certificates/220192.pem /etc/ssl/certs/220192.pem"
I0614 20:48:55.815975 41642 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/220192.pem
I0614 20:48:55.820163 41642 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jun 14 20:26 /usr/share/ca-certificates/220192.pem
I0614 20:48:55.820221 41642 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/220192.pem
I0614 20:48:55.825874 41642 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/220192.pem /etc/ssl/certs/3ec20f2e.0"
I0614 20:48:55.835030 41642 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0614 20:48:55.847448 41642 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0614 20:48:55.851581 41642 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jun 14 20:15 /usr/share/ca-certificates/minikubeCA.pem
I0614 20:48:55.851625 41642 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0614 20:48:55.856999 41642 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0614 20:48:55.865577 41642 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/22019.pem && ln -fs /usr/share/ca-certificates/22019.pem /etc/ssl/certs/22019.pem"
I0614 20:48:55.875731 41642 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/22019.pem
I0614 20:48:55.880076 41642 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jun 14 20:26 /usr/share/ca-certificates/22019.pem
I0614 20:48:55.880125 41642 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/22019.pem
I0614 20:48:55.885337 41642 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/22019.pem /etc/ssl/certs/51391683.0"
I0614 20:48:55.894108 41642 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0614 20:48:55.898450 41642 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0614 20:48:55.903784 41642 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0614 20:48:55.909105 41642 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0614 20:48:55.914868 41642 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0614 20:48:55.920095 41642 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0614 20:48:55.925320 41642 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0614 20:48:55.930553 41642 kubeadm.go:391] StartCluster: {Name:ha-590347 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19044/minikube-v1.33.1-1718047936-19044-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718296336-19068@sha256:b31b1f456eebc10b590403d2cc052bb20a70156f4629e3514cbb38ecd550e2c8 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.1 Clust
erName:ha-590347 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.58 Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.161 Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.71 Port:0 KubernetesVersion:v1.30.1 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false in
spektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOpt
imizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0614 20:48:55.930659 41642 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0614 20:48:55.930714 41642 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0614 20:48:55.969248 41642 cri.go:89] found id: "4c5e9b90a493d00ad7fb68bf1ff55001415b88a31ebba3a69603118058cdb1be"
I0614 20:48:55.969276 41642 cri.go:89] found id: "78078b5fc599ca09e856dc26d54157c98697c4f41f33859fdcabed49dc65283c"
I0614 20:48:55.969281 41642 cri.go:89] found id: "ab58cda0f7e3511508e52f606dfdaa2759a861505b3afb68e6147224a8670226"
I0614 20:48:55.969286 41642 cri.go:89] found id: "1ec107d83075c4e79fab615819a8e81f29f3ca284733cff50b6434d28fb59bd9"
I0614 20:48:55.969291 41642 cri.go:89] found id: "e15fb60a5bb5c3abe61382efe592d1c494610c763465abdaff9a1da8c512fb7b"
I0614 20:48:55.969296 41642 cri.go:89] found id: "c3476e7d64f44d7903e697c06e7866ea8fc10a7d9347baa387e9b99288d64b36"
I0614 20:48:55.969300 41642 cri.go:89] found id: "dc92518a3b5d2ed6049815f099f855d96efbe469826a2fb36a83de9eb99d65ff"
I0614 20:48:55.969304 41642 cri.go:89] found id: "4364fe0e76115044db80275913e1ef56935884669cf1ab490cc0bc3f0b2e3785"
I0614 20:48:55.969308 41642 cri.go:89] found id: "512f658ebb61c7bb855ea0c39f15481bcad9e332f43ff5bb32e92ca76ad8c205"
I0614 20:48:55.969314 41642 cri.go:89] found id: "912d9c2d9fdbd83e87f2f558d929abeae4002c26244be28eae6aef679f56613f"
I0614 20:48:55.969318 41642 cri.go:89] found id: "2e515bac5b6b62803f6121418270f9dcff3146106492da9c6d96773063f5894e"
I0614 20:48:55.969322 41642 cri.go:89] found id: "c241c2b38d2cacc7a5f37ba88817249dd5dd73a2e91930d1c8d2a443efccaa90"
I0614 20:48:55.969327 41642 cri.go:89] found id: "148ff4475e5734bfa4edde4bd9c3b04b6470feff683de19280cb7e7abdd88044"
I0614 20:48:55.969335 41642 cri.go:89] found id: "b7ba582fd7f20fdfc839479c2b3658f492d631c33d6b9451b78d3269d6f150f8"
I0614 20:48:55.969341 41642 cri.go:89] found id: "5feee61142324689f0d92877e80d59a308bca5f46d29959cc6ccff6c0fc1eef2"
I0614 20:48:55.969345 41642 cri.go:89] found id: "7e56d6d070637e7c8f1435ebba9694e81f6a7ac49be186e1fc336119dcf57272"
I0614 20:48:55.969350 41642 cri.go:89] found id: "e2d7c78e50602de9cdb8138672e634b6317271469aa4a51aada54d400f17722a"
I0614 20:48:55.969356 41642 cri.go:89] found id: "5b197ff9fb21d641103faecfb358414b4d71fc07413ecf0c633f6c9dfeaf4fb2"
I0614 20:48:55.969363 41642 cri.go:89] found id: "82b878f49e33ee1e25244a288eb75c3ea200d62cd39c0efb92c71a3760d8e66c"
I0614 20:48:55.969368 41642 cri.go:89] found id: ""
I0614 20:48:55.969410 41642 ssh_runner.go:195] Run: sudo runc list -f json
==> CRI-O <==
Jun 14 20:58:08 ha-590347 crio[6602]: time="2024-06-14 20:58:08.043145509Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1718398688043120830,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:154742,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=976f8fd5-f73f-4bcb-b879-13900aa763a1 name=/runtime.v1.ImageService/ImageFsInfo
Jun 14 20:58:08 ha-590347 crio[6602]: time="2024-06-14 20:58:08.043520315Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=44d7521c-e8fe-4ba7-a412-8576146da565 name=/runtime.v1.RuntimeService/ListContainers
Jun 14 20:58:08 ha-590347 crio[6602]: time="2024-06-14 20:58:08.043590501Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=44d7521c-e8fe-4ba7-a412-8576146da565 name=/runtime.v1.RuntimeService/ListContainers
Jun 14 20:58:08 ha-590347 crio[6602]: time="2024-06-14 20:58:08.044059503Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:5941feb85375a1366faacd0cec33d9d24de68e40f5cb954c3dacc2d2be72836f,PodSandboxId:7f11bfb8ed7f7420d5ceaefda4db83c814e45cd53593355dd572ef231b0acd26,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:7,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1718398613848426950,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1b75c63e-e65e-49b9-9c91-67031efc4821,},Annotations:map[string]string{io.kubernetes.container.hash: 19d398b2,io.kubernetes.container.restartCount: 7,io.kubernetes.container.t
erminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:489c0113cf348c2fd3db81c511291ad8068889ee7f8129da37dd6a073e2063b2,PodSandboxId:cb873895f231354e68e4d7633f5b9152e1c8b16c970add93ada16bcc572dae26,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:6,},Image:&ImageSpec{Image:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,State:CONTAINER_RUNNING,CreatedAt:1718398329847713911,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-p6csv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e8378c85-f69e-4604-8f5a-e70029d6042d,},Annotations:map[string]string{io.kubernetes.container.hash: 73958612,io.kubernetes.container.restartCount: 6,io.kubernetes.container.terminationMessagePath: /dev/termin
ation-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ff4164efa00d93fa8cae7dbd88a995c377cf954af5c40f7e73000425e8ae9730,PodSandboxId:48fe4cb79fd7a710b611844f86435e598c91f708130cf8e515723d1ca66b8286,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:5,},Image:&ImageSpec{Image:25a1387cdab82166df829c0b70761c10e2d2afce21a7bcf9ae4e9d71fe34ef2c,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:25a1387cdab82166df829c0b70761c10e2d2afce21a7bcf9ae4e9d71fe34ef2c,State:CONTAINER_RUNNING,CreatedAt:1718398319858052991,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 87f6813f3f2fdd5caddc4dd9a44c1590,},Annotations:map[string]string{io.kubernetes.container.hash: ac6c6b5e,io.kubernetes.container.restartCount: 5,io.kubernetes.container.terminationMessagePath: /dev/
termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:57d46e9f8df4c64f5f749ec31b3cad079a7bcd478174719bb2e0cdb82236f41b,PodSandboxId:9905a10f28d89d50a173dc05f4fd1bd6f7344a4c9386fa4459e6180cc7c50a72,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:6,},Image:&ImageSpec{Image:91be9408031725d89ff709fdf75a7666cedbf0d8831be4581310a879a096c71a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:91be9408031725d89ff709fdf75a7666cedbf0d8831be4581310a879a096c71a,State:CONTAINER_RUNNING,CreatedAt:1718398313848530131,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1fde40dbf4c4f8e0c9d5bc67972eef32,},Annotations:map[string]string{io.kubernetes.container.hash: 3740b3cc,io.kubernetes.container.restartCount: 6,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.ku
bernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:258f0013a53c0c104aab676912e938c829e322786e96757ccc78501a8f8c2100,PodSandboxId:7f11bfb8ed7f7420d5ceaefda4db83c814e45cd53593355dd572ef231b0acd26,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:6,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_EXITED,CreatedAt:1718398308844822025,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1b75c63e-e65e-49b9-9c91-67031efc4821,},Annotations:map[string]string{io.kubernetes.container.hash: 19d398b2,io.kubernetes.container.restartCount: 6,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.cont
ainer.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4fad0593a4a60a75e970a33b345baefaa70de47ee2b9d21609286c4a49e8cc86,PodSandboxId:9905a10f28d89d50a173dc05f4fd1bd6f7344a4c9386fa4459e6180cc7c50a72,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:5,},Image:&ImageSpec{Image:91be9408031725d89ff709fdf75a7666cedbf0d8831be4581310a879a096c71a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:91be9408031725d89ff709fdf75a7666cedbf0d8831be4581310a879a096c71a,State:CONTAINER_EXITED,CreatedAt:1718398208852575923,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1fde40dbf4c4f8e0c9d5bc67972eef32,},Annotations:map[string]string{io.kubernetes.container.hash: 3740b3cc,io.kubernetes.container.restartCount: 5,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessa
gePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6743f3d9185f1656db5f7ce3fdee03cba39b5644352ea310366574f7d895aa0c,PodSandboxId:48fe4cb79fd7a710b611844f86435e598c91f708130cf8e515723d1ca66b8286,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:4,},Image:&ImageSpec{Image:25a1387cdab82166df829c0b70761c10e2d2afce21a7bcf9ae4e9d71fe34ef2c,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:25a1387cdab82166df829c0b70761c10e2d2afce21a7bcf9ae4e9d71fe34ef2c,State:CONTAINER_EXITED,CreatedAt:1718398204846625898,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 87f6813f3f2fdd5caddc4dd9a44c1590,},Annotations:map[string]string{io.kubernetes.container.hash: ac6c6b5e,io.kubernetes.container.restartCount: 4,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.termination
MessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:b9c35df45a9e01c92ca6e150ee10b31a2b6f7363916de41951131fa994976baf,PodSandboxId:57ddfc43bad84ba7c3f69a256afef88d7c3fef61154df47d4055a0b76b23e289,Metadata:&ContainerMetadata{Name:busybox,Attempt:2,},Image:&ImageSpec{Image:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1718398172145587034,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-7tkrn,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: e6254ba8-cb7d-43e6-a18c-ba7ece6c1a42,},Annotations:map[string]string{io.kubernetes.container.hash: f3b01e9,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod
.terminationGracePeriod: 30,},},&Container{Id:3fba739a0c9e701b34877059fd1d343516d3f4f25ab42a9d5f7c4944d3e80ff2,PodSandboxId:84d2625b63c87d62346b428059a4f3a640b4d5279e57ca53e02b274690512f54,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:2,},Image:&ImageSpec{Image:747097150317f99937cabea484cff90097a2dbd79e7eb348b71dc0af879883cd,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:747097150317f99937cabea484cff90097a2dbd79e7eb348b71dc0af879883cd,State:CONTAINER_RUNNING,CreatedAt:1718398139030188800,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-76fzk,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 38c5e42d-ed30-4db8-957e-b21c9fba4211,},Annotations:map[string]string{io.kubernetes.container.hash: 2e031400,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&
Container{Id:826143e4f559535d523ee37cb59be6e1b84e9f6f75aecb76d2b5e20e4f1e84f1,PodSandboxId:cb873895f231354e68e4d7633f5b9152e1c8b16c970add93ada16bcc572dae26,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:5,},Image:&ImageSpec{Image:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,State:CONTAINER_EXITED,CreatedAt:1718398139126091787,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-p6csv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e8378c85-f69e-4604-8f5a-e70029d6042d,},Annotations:map[string]string{io.kubernetes.container.hash: 73958612,io.kubernetes.container.restartCount: 5,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:039c6aea832809f374c92b
35e9ceb26ad6f121a13b5ce4a10893296c1b219625,PodSandboxId:2b43eeadfaabc778150e18556df1aeaed451dcd566291010c4def5efb4cf122c,Metadata:&ContainerMetadata{Name:coredns,Attempt:3,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1718398139216548085,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-mxql8,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d34e9a32-d685-4c8a-bb7e-57697551eea5,},Annotations:map[string]string{io.kubernetes.container.hash: 1adc570b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 3,io.kubernetes.
container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3155701527e32e48e1508247609701a35c13dd6c1694dda719d388a9f49b6294,PodSandboxId:991ff13cf96f5bff630a6265d77a952e42431c58839faf9a2efab8c4d0408286,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1718398138902658646,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e4fa1a7f34d580bed663ee03f716216a,},Annotations:map[string]string{io.kubernetes.container.hash: 1bf7dfd2,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-
log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:13892e0b84e7487e0040a292b209ce39b460933e0c13381b95b50d9bb9af19d3,PodSandboxId:d0966f34a58a5a856eeb06b8724460a619090bf3ec11530a43f14a2b787aa912,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:1,},Image:&ImageSpec{Image:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:1718398138839208601,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 13410303e6cbf4a6ced051c92303490e,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.termination
MessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1eee7f7fcc163b3f63070d55b0309f33e2a1d6b0bc0d3244641ae78ad4a74a8b,PodSandboxId:66b0bdda5b2b8f3e03b0874f85bf3b14b1a1dc225611585f353e35389f696020,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:2,},Image:&ImageSpec{Image:a52dc94f0a91256bde86a1c3027a16336bb8fea9304f9311987066307996f035,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a52dc94f0a91256bde86a1c3027a16336bb8fea9304f9311987066307996f035,State:CONTAINER_RUNNING,CreatedAt:1718398138698529200,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5d5551206f21a968da5a45786306a508,},Annotations:map[string]string{io.kubernetes.container.hash: 200064a4,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,i
o.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:60528041f3a4740437f32e068e233d964fb10fc91790a10e43f4437be4d0b9ec,PodSandboxId:b8264cc3e018ae94211a8ebf40c294ddef51fdf9d42ef3513e3b1427a5be0714,Metadata:&ContainerMetadata{Name:coredns,Attempt:2,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1718398138743338844,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-ppprf,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9f28fd0f-7f46-4ed2-a413-82e4afa8e64f,},Annotations:map[string]string{io.kubernetes.container.hash: fbd3931f,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\
":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:766600eff171286fdeefbdfcefcc2506883b7b88beb7030a874c8c4cde9df6b0,PodSandboxId:e69d703e22294f9ae69e025b04fddb7c1c90a7e53a53d043a3f9923e808bccd5,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_EXITED,CreatedAt:1718397762134263921,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-7tkrn,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: e6254ba8-cb7d-43e6-a18c-ba7ece6c1a42,},Annotations:map[string]string{io.kubernetes.container.hash: f3b01e9,io.kuber
netes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e15fb60a5bb5c3abe61382efe592d1c494610c763465abdaff9a1da8c512fb7b,PodSandboxId:cfe4b78e708e5d01557b8cf128cb598a8f5f76eabbb0582078e5a0b8ce8627a5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_EXITED,CreatedAt:1718397745334993835,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 13410303e6cbf4a6ced051c92303490e,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 0,io.kuber
netes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c3476e7d64f44d7903e697c06e7866ea8fc10a7d9347baa387e9b99288d64b36,PodSandboxId:0091e85918084ef12004f041b6ad19c8aa34d99def47a210200d600f8c6c002d,Metadata:&ContainerMetadata{Name:coredns,Attempt:2,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_EXITED,CreatedAt:1718397734930214481,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-mxql8,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d34e9a32-d685-4c8a-bb7e-57697551eea5,},Annotations:map[string]string{io.kubernetes.container.hash: 1adc570b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protoco
l\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:512f658ebb61c7bb855ea0c39f15481bcad9e332f43ff5bb32e92ca76ad8c205,PodSandboxId:e326c543355186944aef1d3e0b4a50305bf5275547e222a375b739bef983fc2b,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:747097150317f99937cabea484cff90097a2dbd79e7eb348b71dc0af879883cd,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:747097150317f99937cabea484cff90097a2dbd79e7eb348b71dc0af879883cd,State:CONTAINER_EXITED,CreatedAt:1718397728855751837,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-76fzk,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.u
id: 38c5e42d-ed30-4db8-957e-b21c9fba4211,},Annotations:map[string]string{io.kubernetes.container.hash: 2e031400,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:dc92518a3b5d2ed6049815f099f855d96efbe469826a2fb36a83de9eb99d65ff,PodSandboxId:2051404cbfd0f3dac9f79686e09c0de634b44ec56aaeb79a417a6c13aa778d05,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_EXITED,CreatedAt:1718397729086661194,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-ppprf,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9f28fd0f-7f46-4ed2-a413-82e4
afa8e64f,},Annotations:map[string]string{io.kubernetes.container.hash: fbd3931f,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:148ff4475e5734bfa4edde4bd9c3b04b6470feff683de19280cb7e7abdd88044,PodSandboxId:ef1d27b8a86b43dc85d6ce8406caea0445738ec9059d67f19d7399ce2e6f6cca,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_EXITED,CreatedAt:1718397728662016710,Labels:map[st
ring]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e4fa1a7f34d580bed663ee03f716216a,},Annotations:map[string]string{io.kubernetes.container.hash: 1bf7dfd2,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:b7ba582fd7f20fdfc839479c2b3658f492d631c33d6b9451b78d3269d6f150f8,PodSandboxId:cc038a44afee458615347760bf0975fff987f4950ab55861a3e208fd2dcbda62,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:a52dc94f0a91256bde86a1c3027a16336bb8fea9304f9311987066307996f035,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a52dc94f0a91256bde86a1c3027a16336bb8fea9304f9311987066307996f035,State:CONTAINER_EXITED,CreatedAt:1718397728610334559,Labels:map[string]string{io.kubernetes.container.name:
kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5d5551206f21a968da5a45786306a508,},Annotations:map[string]string{io.kubernetes.container.hash: 200064a4,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=44d7521c-e8fe-4ba7-a412-8576146da565 name=/runtime.v1.RuntimeService/ListContainers
Jun 14 20:58:08 ha-590347 crio[6602]: time="2024-06-14 20:58:08.087313032Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=f3cd63aa-478a-4cb9-869d-303dd40b55f6 name=/runtime.v1.RuntimeService/Version
Jun 14 20:58:08 ha-590347 crio[6602]: time="2024-06-14 20:58:08.087626093Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=f3cd63aa-478a-4cb9-869d-303dd40b55f6 name=/runtime.v1.RuntimeService/Version
Jun 14 20:58:08 ha-590347 crio[6602]: time="2024-06-14 20:58:08.088712640Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=7ea77874-22f7-4612-887b-a9e30760e3e5 name=/runtime.v1.ImageService/ImageFsInfo
Jun 14 20:58:08 ha-590347 crio[6602]: time="2024-06-14 20:58:08.089242841Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1718398688089220051,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:154742,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=7ea77874-22f7-4612-887b-a9e30760e3e5 name=/runtime.v1.ImageService/ImageFsInfo
Jun 14 20:58:08 ha-590347 crio[6602]: time="2024-06-14 20:58:08.089650829Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=8e7cb8f2-930c-4717-ad2d-8583fec1e4a3 name=/runtime.v1.RuntimeService/ListContainers
Jun 14 20:58:08 ha-590347 crio[6602]: time="2024-06-14 20:58:08.089709170Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=8e7cb8f2-930c-4717-ad2d-8583fec1e4a3 name=/runtime.v1.RuntimeService/ListContainers
Jun 14 20:58:08 ha-590347 crio[6602]: time="2024-06-14 20:58:08.090170173Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:5941feb85375a1366faacd0cec33d9d24de68e40f5cb954c3dacc2d2be72836f,PodSandboxId:7f11bfb8ed7f7420d5ceaefda4db83c814e45cd53593355dd572ef231b0acd26,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:7,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1718398613848426950,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1b75c63e-e65e-49b9-9c91-67031efc4821,},Annotations:map[string]string{io.kubernetes.container.hash: 19d398b2,io.kubernetes.container.restartCount: 7,io.kubernetes.container.t
erminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:489c0113cf348c2fd3db81c511291ad8068889ee7f8129da37dd6a073e2063b2,PodSandboxId:cb873895f231354e68e4d7633f5b9152e1c8b16c970add93ada16bcc572dae26,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:6,},Image:&ImageSpec{Image:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,State:CONTAINER_RUNNING,CreatedAt:1718398329847713911,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-p6csv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e8378c85-f69e-4604-8f5a-e70029d6042d,},Annotations:map[string]string{io.kubernetes.container.hash: 73958612,io.kubernetes.container.restartCount: 6,io.kubernetes.container.terminationMessagePath: /dev/termin
ation-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ff4164efa00d93fa8cae7dbd88a995c377cf954af5c40f7e73000425e8ae9730,PodSandboxId:48fe4cb79fd7a710b611844f86435e598c91f708130cf8e515723d1ca66b8286,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:5,},Image:&ImageSpec{Image:25a1387cdab82166df829c0b70761c10e2d2afce21a7bcf9ae4e9d71fe34ef2c,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:25a1387cdab82166df829c0b70761c10e2d2afce21a7bcf9ae4e9d71fe34ef2c,State:CONTAINER_RUNNING,CreatedAt:1718398319858052991,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 87f6813f3f2fdd5caddc4dd9a44c1590,},Annotations:map[string]string{io.kubernetes.container.hash: ac6c6b5e,io.kubernetes.container.restartCount: 5,io.kubernetes.container.terminationMessagePath: /dev/
termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:57d46e9f8df4c64f5f749ec31b3cad079a7bcd478174719bb2e0cdb82236f41b,PodSandboxId:9905a10f28d89d50a173dc05f4fd1bd6f7344a4c9386fa4459e6180cc7c50a72,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:6,},Image:&ImageSpec{Image:91be9408031725d89ff709fdf75a7666cedbf0d8831be4581310a879a096c71a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:91be9408031725d89ff709fdf75a7666cedbf0d8831be4581310a879a096c71a,State:CONTAINER_RUNNING,CreatedAt:1718398313848530131,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1fde40dbf4c4f8e0c9d5bc67972eef32,},Annotations:map[string]string{io.kubernetes.container.hash: 3740b3cc,io.kubernetes.container.restartCount: 6,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.ku
bernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:258f0013a53c0c104aab676912e938c829e322786e96757ccc78501a8f8c2100,PodSandboxId:7f11bfb8ed7f7420d5ceaefda4db83c814e45cd53593355dd572ef231b0acd26,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:6,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_EXITED,CreatedAt:1718398308844822025,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1b75c63e-e65e-49b9-9c91-67031efc4821,},Annotations:map[string]string{io.kubernetes.container.hash: 19d398b2,io.kubernetes.container.restartCount: 6,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.cont
ainer.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4fad0593a4a60a75e970a33b345baefaa70de47ee2b9d21609286c4a49e8cc86,PodSandboxId:9905a10f28d89d50a173dc05f4fd1bd6f7344a4c9386fa4459e6180cc7c50a72,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:5,},Image:&ImageSpec{Image:91be9408031725d89ff709fdf75a7666cedbf0d8831be4581310a879a096c71a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:91be9408031725d89ff709fdf75a7666cedbf0d8831be4581310a879a096c71a,State:CONTAINER_EXITED,CreatedAt:1718398208852575923,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1fde40dbf4c4f8e0c9d5bc67972eef32,},Annotations:map[string]string{io.kubernetes.container.hash: 3740b3cc,io.kubernetes.container.restartCount: 5,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessa
gePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6743f3d9185f1656db5f7ce3fdee03cba39b5644352ea310366574f7d895aa0c,PodSandboxId:48fe4cb79fd7a710b611844f86435e598c91f708130cf8e515723d1ca66b8286,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:4,},Image:&ImageSpec{Image:25a1387cdab82166df829c0b70761c10e2d2afce21a7bcf9ae4e9d71fe34ef2c,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:25a1387cdab82166df829c0b70761c10e2d2afce21a7bcf9ae4e9d71fe34ef2c,State:CONTAINER_EXITED,CreatedAt:1718398204846625898,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 87f6813f3f2fdd5caddc4dd9a44c1590,},Annotations:map[string]string{io.kubernetes.container.hash: ac6c6b5e,io.kubernetes.container.restartCount: 4,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.termination
MessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:b9c35df45a9e01c92ca6e150ee10b31a2b6f7363916de41951131fa994976baf,PodSandboxId:57ddfc43bad84ba7c3f69a256afef88d7c3fef61154df47d4055a0b76b23e289,Metadata:&ContainerMetadata{Name:busybox,Attempt:2,},Image:&ImageSpec{Image:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1718398172145587034,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-7tkrn,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: e6254ba8-cb7d-43e6-a18c-ba7ece6c1a42,},Annotations:map[string]string{io.kubernetes.container.hash: f3b01e9,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod
.terminationGracePeriod: 30,},},&Container{Id:3fba739a0c9e701b34877059fd1d343516d3f4f25ab42a9d5f7c4944d3e80ff2,PodSandboxId:84d2625b63c87d62346b428059a4f3a640b4d5279e57ca53e02b274690512f54,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:2,},Image:&ImageSpec{Image:747097150317f99937cabea484cff90097a2dbd79e7eb348b71dc0af879883cd,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:747097150317f99937cabea484cff90097a2dbd79e7eb348b71dc0af879883cd,State:CONTAINER_RUNNING,CreatedAt:1718398139030188800,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-76fzk,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 38c5e42d-ed30-4db8-957e-b21c9fba4211,},Annotations:map[string]string{io.kubernetes.container.hash: 2e031400,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&
Container{Id:826143e4f559535d523ee37cb59be6e1b84e9f6f75aecb76d2b5e20e4f1e84f1,PodSandboxId:cb873895f231354e68e4d7633f5b9152e1c8b16c970add93ada16bcc572dae26,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:5,},Image:&ImageSpec{Image:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,State:CONTAINER_EXITED,CreatedAt:1718398139126091787,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-p6csv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e8378c85-f69e-4604-8f5a-e70029d6042d,},Annotations:map[string]string{io.kubernetes.container.hash: 73958612,io.kubernetes.container.restartCount: 5,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:039c6aea832809f374c92b
35e9ceb26ad6f121a13b5ce4a10893296c1b219625,PodSandboxId:2b43eeadfaabc778150e18556df1aeaed451dcd566291010c4def5efb4cf122c,Metadata:&ContainerMetadata{Name:coredns,Attempt:3,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1718398139216548085,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-mxql8,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d34e9a32-d685-4c8a-bb7e-57697551eea5,},Annotations:map[string]string{io.kubernetes.container.hash: 1adc570b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 3,io.kubernetes.
container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3155701527e32e48e1508247609701a35c13dd6c1694dda719d388a9f49b6294,PodSandboxId:991ff13cf96f5bff630a6265d77a952e42431c58839faf9a2efab8c4d0408286,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1718398138902658646,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e4fa1a7f34d580bed663ee03f716216a,},Annotations:map[string]string{io.kubernetes.container.hash: 1bf7dfd2,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-
log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:13892e0b84e7487e0040a292b209ce39b460933e0c13381b95b50d9bb9af19d3,PodSandboxId:d0966f34a58a5a856eeb06b8724460a619090bf3ec11530a43f14a2b787aa912,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:1,},Image:&ImageSpec{Image:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:1718398138839208601,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 13410303e6cbf4a6ced051c92303490e,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.termination
MessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1eee7f7fcc163b3f63070d55b0309f33e2a1d6b0bc0d3244641ae78ad4a74a8b,PodSandboxId:66b0bdda5b2b8f3e03b0874f85bf3b14b1a1dc225611585f353e35389f696020,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:2,},Image:&ImageSpec{Image:a52dc94f0a91256bde86a1c3027a16336bb8fea9304f9311987066307996f035,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a52dc94f0a91256bde86a1c3027a16336bb8fea9304f9311987066307996f035,State:CONTAINER_RUNNING,CreatedAt:1718398138698529200,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5d5551206f21a968da5a45786306a508,},Annotations:map[string]string{io.kubernetes.container.hash: 200064a4,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,i
o.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:60528041f3a4740437f32e068e233d964fb10fc91790a10e43f4437be4d0b9ec,PodSandboxId:b8264cc3e018ae94211a8ebf40c294ddef51fdf9d42ef3513e3b1427a5be0714,Metadata:&ContainerMetadata{Name:coredns,Attempt:2,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1718398138743338844,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-ppprf,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9f28fd0f-7f46-4ed2-a413-82e4afa8e64f,},Annotations:map[string]string{io.kubernetes.container.hash: fbd3931f,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\
":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:766600eff171286fdeefbdfcefcc2506883b7b88beb7030a874c8c4cde9df6b0,PodSandboxId:e69d703e22294f9ae69e025b04fddb7c1c90a7e53a53d043a3f9923e808bccd5,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_EXITED,CreatedAt:1718397762134263921,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-7tkrn,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: e6254ba8-cb7d-43e6-a18c-ba7ece6c1a42,},Annotations:map[string]string{io.kubernetes.container.hash: f3b01e9,io.kuber
netes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e15fb60a5bb5c3abe61382efe592d1c494610c763465abdaff9a1da8c512fb7b,PodSandboxId:cfe4b78e708e5d01557b8cf128cb598a8f5f76eabbb0582078e5a0b8ce8627a5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_EXITED,CreatedAt:1718397745334993835,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 13410303e6cbf4a6ced051c92303490e,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 0,io.kuber
netes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c3476e7d64f44d7903e697c06e7866ea8fc10a7d9347baa387e9b99288d64b36,PodSandboxId:0091e85918084ef12004f041b6ad19c8aa34d99def47a210200d600f8c6c002d,Metadata:&ContainerMetadata{Name:coredns,Attempt:2,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_EXITED,CreatedAt:1718397734930214481,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-mxql8,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d34e9a32-d685-4c8a-bb7e-57697551eea5,},Annotations:map[string]string{io.kubernetes.container.hash: 1adc570b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protoco
l\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:512f658ebb61c7bb855ea0c39f15481bcad9e332f43ff5bb32e92ca76ad8c205,PodSandboxId:e326c543355186944aef1d3e0b4a50305bf5275547e222a375b739bef983fc2b,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:747097150317f99937cabea484cff90097a2dbd79e7eb348b71dc0af879883cd,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:747097150317f99937cabea484cff90097a2dbd79e7eb348b71dc0af879883cd,State:CONTAINER_EXITED,CreatedAt:1718397728855751837,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-76fzk,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.u
id: 38c5e42d-ed30-4db8-957e-b21c9fba4211,},Annotations:map[string]string{io.kubernetes.container.hash: 2e031400,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:dc92518a3b5d2ed6049815f099f855d96efbe469826a2fb36a83de9eb99d65ff,PodSandboxId:2051404cbfd0f3dac9f79686e09c0de634b44ec56aaeb79a417a6c13aa778d05,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_EXITED,CreatedAt:1718397729086661194,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-ppprf,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9f28fd0f-7f46-4ed2-a413-82e4
afa8e64f,},Annotations:map[string]string{io.kubernetes.container.hash: fbd3931f,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:148ff4475e5734bfa4edde4bd9c3b04b6470feff683de19280cb7e7abdd88044,PodSandboxId:ef1d27b8a86b43dc85d6ce8406caea0445738ec9059d67f19d7399ce2e6f6cca,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_EXITED,CreatedAt:1718397728662016710,Labels:map[st
ring]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e4fa1a7f34d580bed663ee03f716216a,},Annotations:map[string]string{io.kubernetes.container.hash: 1bf7dfd2,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:b7ba582fd7f20fdfc839479c2b3658f492d631c33d6b9451b78d3269d6f150f8,PodSandboxId:cc038a44afee458615347760bf0975fff987f4950ab55861a3e208fd2dcbda62,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:a52dc94f0a91256bde86a1c3027a16336bb8fea9304f9311987066307996f035,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a52dc94f0a91256bde86a1c3027a16336bb8fea9304f9311987066307996f035,State:CONTAINER_EXITED,CreatedAt:1718397728610334559,Labels:map[string]string{io.kubernetes.container.name:
kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5d5551206f21a968da5a45786306a508,},Annotations:map[string]string{io.kubernetes.container.hash: 200064a4,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=8e7cb8f2-930c-4717-ad2d-8583fec1e4a3 name=/runtime.v1.RuntimeService/ListContainers
Jun 14 20:58:08 ha-590347 crio[6602]: time="2024-06-14 20:58:08.132635647Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=ab46d9a9-e369-4605-a56b-d74a0c2fadca name=/runtime.v1.RuntimeService/Version
Jun 14 20:58:08 ha-590347 crio[6602]: time="2024-06-14 20:58:08.132713522Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=ab46d9a9-e369-4605-a56b-d74a0c2fadca name=/runtime.v1.RuntimeService/Version
Jun 14 20:58:08 ha-590347 crio[6602]: time="2024-06-14 20:58:08.134033640Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=a727f608-4b2b-4965-8c64-498758665322 name=/runtime.v1.ImageService/ImageFsInfo
Jun 14 20:58:08 ha-590347 crio[6602]: time="2024-06-14 20:58:08.134507459Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1718398688134483357,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:154742,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=a727f608-4b2b-4965-8c64-498758665322 name=/runtime.v1.ImageService/ImageFsInfo
Jun 14 20:58:08 ha-590347 crio[6602]: time="2024-06-14 20:58:08.135097885Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=5b2f4f0d-efae-490e-b3fd-643611a4fb5c name=/runtime.v1.RuntimeService/ListContainers
Jun 14 20:58:08 ha-590347 crio[6602]: time="2024-06-14 20:58:08.135163257Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=5b2f4f0d-efae-490e-b3fd-643611a4fb5c name=/runtime.v1.RuntimeService/ListContainers
Jun 14 20:58:08 ha-590347 crio[6602]: time="2024-06-14 20:58:08.136351168Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:5941feb85375a1366faacd0cec33d9d24de68e40f5cb954c3dacc2d2be72836f,PodSandboxId:7f11bfb8ed7f7420d5ceaefda4db83c814e45cd53593355dd572ef231b0acd26,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:7,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1718398613848426950,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1b75c63e-e65e-49b9-9c91-67031efc4821,},Annotations:map[string]string{io.kubernetes.container.hash: 19d398b2,io.kubernetes.container.restartCount: 7,io.kubernetes.container.t
erminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:489c0113cf348c2fd3db81c511291ad8068889ee7f8129da37dd6a073e2063b2,PodSandboxId:cb873895f231354e68e4d7633f5b9152e1c8b16c970add93ada16bcc572dae26,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:6,},Image:&ImageSpec{Image:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,State:CONTAINER_RUNNING,CreatedAt:1718398329847713911,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-p6csv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e8378c85-f69e-4604-8f5a-e70029d6042d,},Annotations:map[string]string{io.kubernetes.container.hash: 73958612,io.kubernetes.container.restartCount: 6,io.kubernetes.container.terminationMessagePath: /dev/termin
ation-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ff4164efa00d93fa8cae7dbd88a995c377cf954af5c40f7e73000425e8ae9730,PodSandboxId:48fe4cb79fd7a710b611844f86435e598c91f708130cf8e515723d1ca66b8286,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:5,},Image:&ImageSpec{Image:25a1387cdab82166df829c0b70761c10e2d2afce21a7bcf9ae4e9d71fe34ef2c,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:25a1387cdab82166df829c0b70761c10e2d2afce21a7bcf9ae4e9d71fe34ef2c,State:CONTAINER_RUNNING,CreatedAt:1718398319858052991,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 87f6813f3f2fdd5caddc4dd9a44c1590,},Annotations:map[string]string{io.kubernetes.container.hash: ac6c6b5e,io.kubernetes.container.restartCount: 5,io.kubernetes.container.terminationMessagePath: /dev/
termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:57d46e9f8df4c64f5f749ec31b3cad079a7bcd478174719bb2e0cdb82236f41b,PodSandboxId:9905a10f28d89d50a173dc05f4fd1bd6f7344a4c9386fa4459e6180cc7c50a72,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:6,},Image:&ImageSpec{Image:91be9408031725d89ff709fdf75a7666cedbf0d8831be4581310a879a096c71a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:91be9408031725d89ff709fdf75a7666cedbf0d8831be4581310a879a096c71a,State:CONTAINER_RUNNING,CreatedAt:1718398313848530131,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1fde40dbf4c4f8e0c9d5bc67972eef32,},Annotations:map[string]string{io.kubernetes.container.hash: 3740b3cc,io.kubernetes.container.restartCount: 6,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.ku
bernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:258f0013a53c0c104aab676912e938c829e322786e96757ccc78501a8f8c2100,PodSandboxId:7f11bfb8ed7f7420d5ceaefda4db83c814e45cd53593355dd572ef231b0acd26,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:6,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_EXITED,CreatedAt:1718398308844822025,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1b75c63e-e65e-49b9-9c91-67031efc4821,},Annotations:map[string]string{io.kubernetes.container.hash: 19d398b2,io.kubernetes.container.restartCount: 6,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.cont
ainer.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4fad0593a4a60a75e970a33b345baefaa70de47ee2b9d21609286c4a49e8cc86,PodSandboxId:9905a10f28d89d50a173dc05f4fd1bd6f7344a4c9386fa4459e6180cc7c50a72,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:5,},Image:&ImageSpec{Image:91be9408031725d89ff709fdf75a7666cedbf0d8831be4581310a879a096c71a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:91be9408031725d89ff709fdf75a7666cedbf0d8831be4581310a879a096c71a,State:CONTAINER_EXITED,CreatedAt:1718398208852575923,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1fde40dbf4c4f8e0c9d5bc67972eef32,},Annotations:map[string]string{io.kubernetes.container.hash: 3740b3cc,io.kubernetes.container.restartCount: 5,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessa
gePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6743f3d9185f1656db5f7ce3fdee03cba39b5644352ea310366574f7d895aa0c,PodSandboxId:48fe4cb79fd7a710b611844f86435e598c91f708130cf8e515723d1ca66b8286,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:4,},Image:&ImageSpec{Image:25a1387cdab82166df829c0b70761c10e2d2afce21a7bcf9ae4e9d71fe34ef2c,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:25a1387cdab82166df829c0b70761c10e2d2afce21a7bcf9ae4e9d71fe34ef2c,State:CONTAINER_EXITED,CreatedAt:1718398204846625898,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 87f6813f3f2fdd5caddc4dd9a44c1590,},Annotations:map[string]string{io.kubernetes.container.hash: ac6c6b5e,io.kubernetes.container.restartCount: 4,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.termination
MessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:b9c35df45a9e01c92ca6e150ee10b31a2b6f7363916de41951131fa994976baf,PodSandboxId:57ddfc43bad84ba7c3f69a256afef88d7c3fef61154df47d4055a0b76b23e289,Metadata:&ContainerMetadata{Name:busybox,Attempt:2,},Image:&ImageSpec{Image:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1718398172145587034,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-7tkrn,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: e6254ba8-cb7d-43e6-a18c-ba7ece6c1a42,},Annotations:map[string]string{io.kubernetes.container.hash: f3b01e9,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod
.terminationGracePeriod: 30,},},&Container{Id:3fba739a0c9e701b34877059fd1d343516d3f4f25ab42a9d5f7c4944d3e80ff2,PodSandboxId:84d2625b63c87d62346b428059a4f3a640b4d5279e57ca53e02b274690512f54,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:2,},Image:&ImageSpec{Image:747097150317f99937cabea484cff90097a2dbd79e7eb348b71dc0af879883cd,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:747097150317f99937cabea484cff90097a2dbd79e7eb348b71dc0af879883cd,State:CONTAINER_RUNNING,CreatedAt:1718398139030188800,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-76fzk,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 38c5e42d-ed30-4db8-957e-b21c9fba4211,},Annotations:map[string]string{io.kubernetes.container.hash: 2e031400,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&
Container{Id:826143e4f559535d523ee37cb59be6e1b84e9f6f75aecb76d2b5e20e4f1e84f1,PodSandboxId:cb873895f231354e68e4d7633f5b9152e1c8b16c970add93ada16bcc572dae26,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:5,},Image:&ImageSpec{Image:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,State:CONTAINER_EXITED,CreatedAt:1718398139126091787,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-p6csv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e8378c85-f69e-4604-8f5a-e70029d6042d,},Annotations:map[string]string{io.kubernetes.container.hash: 73958612,io.kubernetes.container.restartCount: 5,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:039c6aea832809f374c92b
35e9ceb26ad6f121a13b5ce4a10893296c1b219625,PodSandboxId:2b43eeadfaabc778150e18556df1aeaed451dcd566291010c4def5efb4cf122c,Metadata:&ContainerMetadata{Name:coredns,Attempt:3,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1718398139216548085,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-mxql8,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d34e9a32-d685-4c8a-bb7e-57697551eea5,},Annotations:map[string]string{io.kubernetes.container.hash: 1adc570b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 3,io.kubernetes.
container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3155701527e32e48e1508247609701a35c13dd6c1694dda719d388a9f49b6294,PodSandboxId:991ff13cf96f5bff630a6265d77a952e42431c58839faf9a2efab8c4d0408286,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1718398138902658646,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e4fa1a7f34d580bed663ee03f716216a,},Annotations:map[string]string{io.kubernetes.container.hash: 1bf7dfd2,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-
log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:13892e0b84e7487e0040a292b209ce39b460933e0c13381b95b50d9bb9af19d3,PodSandboxId:d0966f34a58a5a856eeb06b8724460a619090bf3ec11530a43f14a2b787aa912,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:1,},Image:&ImageSpec{Image:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:1718398138839208601,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 13410303e6cbf4a6ced051c92303490e,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.termination
MessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1eee7f7fcc163b3f63070d55b0309f33e2a1d6b0bc0d3244641ae78ad4a74a8b,PodSandboxId:66b0bdda5b2b8f3e03b0874f85bf3b14b1a1dc225611585f353e35389f696020,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:2,},Image:&ImageSpec{Image:a52dc94f0a91256bde86a1c3027a16336bb8fea9304f9311987066307996f035,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a52dc94f0a91256bde86a1c3027a16336bb8fea9304f9311987066307996f035,State:CONTAINER_RUNNING,CreatedAt:1718398138698529200,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5d5551206f21a968da5a45786306a508,},Annotations:map[string]string{io.kubernetes.container.hash: 200064a4,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,i
o.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:60528041f3a4740437f32e068e233d964fb10fc91790a10e43f4437be4d0b9ec,PodSandboxId:b8264cc3e018ae94211a8ebf40c294ddef51fdf9d42ef3513e3b1427a5be0714,Metadata:&ContainerMetadata{Name:coredns,Attempt:2,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1718398138743338844,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-ppprf,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9f28fd0f-7f46-4ed2-a413-82e4afa8e64f,},Annotations:map[string]string{io.kubernetes.container.hash: fbd3931f,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\
":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:766600eff171286fdeefbdfcefcc2506883b7b88beb7030a874c8c4cde9df6b0,PodSandboxId:e69d703e22294f9ae69e025b04fddb7c1c90a7e53a53d043a3f9923e808bccd5,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_EXITED,CreatedAt:1718397762134263921,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-7tkrn,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: e6254ba8-cb7d-43e6-a18c-ba7ece6c1a42,},Annotations:map[string]string{io.kubernetes.container.hash: f3b01e9,io.kuber
netes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e15fb60a5bb5c3abe61382efe592d1c494610c763465abdaff9a1da8c512fb7b,PodSandboxId:cfe4b78e708e5d01557b8cf128cb598a8f5f76eabbb0582078e5a0b8ce8627a5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_EXITED,CreatedAt:1718397745334993835,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 13410303e6cbf4a6ced051c92303490e,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 0,io.kuber
netes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c3476e7d64f44d7903e697c06e7866ea8fc10a7d9347baa387e9b99288d64b36,PodSandboxId:0091e85918084ef12004f041b6ad19c8aa34d99def47a210200d600f8c6c002d,Metadata:&ContainerMetadata{Name:coredns,Attempt:2,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_EXITED,CreatedAt:1718397734930214481,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-mxql8,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d34e9a32-d685-4c8a-bb7e-57697551eea5,},Annotations:map[string]string{io.kubernetes.container.hash: 1adc570b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protoco
l\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:512f658ebb61c7bb855ea0c39f15481bcad9e332f43ff5bb32e92ca76ad8c205,PodSandboxId:e326c543355186944aef1d3e0b4a50305bf5275547e222a375b739bef983fc2b,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:747097150317f99937cabea484cff90097a2dbd79e7eb348b71dc0af879883cd,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:747097150317f99937cabea484cff90097a2dbd79e7eb348b71dc0af879883cd,State:CONTAINER_EXITED,CreatedAt:1718397728855751837,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-76fzk,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.u
id: 38c5e42d-ed30-4db8-957e-b21c9fba4211,},Annotations:map[string]string{io.kubernetes.container.hash: 2e031400,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:dc92518a3b5d2ed6049815f099f855d96efbe469826a2fb36a83de9eb99d65ff,PodSandboxId:2051404cbfd0f3dac9f79686e09c0de634b44ec56aaeb79a417a6c13aa778d05,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_EXITED,CreatedAt:1718397729086661194,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-ppprf,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9f28fd0f-7f46-4ed2-a413-82e4
afa8e64f,},Annotations:map[string]string{io.kubernetes.container.hash: fbd3931f,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:148ff4475e5734bfa4edde4bd9c3b04b6470feff683de19280cb7e7abdd88044,PodSandboxId:ef1d27b8a86b43dc85d6ce8406caea0445738ec9059d67f19d7399ce2e6f6cca,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_EXITED,CreatedAt:1718397728662016710,Labels:map[st
ring]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e4fa1a7f34d580bed663ee03f716216a,},Annotations:map[string]string{io.kubernetes.container.hash: 1bf7dfd2,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:b7ba582fd7f20fdfc839479c2b3658f492d631c33d6b9451b78d3269d6f150f8,PodSandboxId:cc038a44afee458615347760bf0975fff987f4950ab55861a3e208fd2dcbda62,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:a52dc94f0a91256bde86a1c3027a16336bb8fea9304f9311987066307996f035,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a52dc94f0a91256bde86a1c3027a16336bb8fea9304f9311987066307996f035,State:CONTAINER_EXITED,CreatedAt:1718397728610334559,Labels:map[string]string{io.kubernetes.container.name:
kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5d5551206f21a968da5a45786306a508,},Annotations:map[string]string{io.kubernetes.container.hash: 200064a4,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=5b2f4f0d-efae-490e-b3fd-643611a4fb5c name=/runtime.v1.RuntimeService/ListContainers
Jun 14 20:58:08 ha-590347 crio[6602]: time="2024-06-14 20:58:08.196439626Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=4b84649f-7d4a-464f-a8dc-2fc5f8caa26e name=/runtime.v1.RuntimeService/Version
Jun 14 20:58:08 ha-590347 crio[6602]: time="2024-06-14 20:58:08.196521072Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=4b84649f-7d4a-464f-a8dc-2fc5f8caa26e name=/runtime.v1.RuntimeService/Version
Jun 14 20:58:08 ha-590347 crio[6602]: time="2024-06-14 20:58:08.199546726Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=0bc4beda-d5ac-44b2-adc1-7fc525b0baf0 name=/runtime.v1.ImageService/ImageFsInfo
Jun 14 20:58:08 ha-590347 crio[6602]: time="2024-06-14 20:58:08.200066202Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1718398688200040666,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:154742,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=0bc4beda-d5ac-44b2-adc1-7fc525b0baf0 name=/runtime.v1.ImageService/ImageFsInfo
Jun 14 20:58:08 ha-590347 crio[6602]: time="2024-06-14 20:58:08.203135634Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=11933110-299c-4ca0-95e3-8b0c7a694183 name=/runtime.v1.RuntimeService/ListContainers
Jun 14 20:58:08 ha-590347 crio[6602]: time="2024-06-14 20:58:08.203197440Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=11933110-299c-4ca0-95e3-8b0c7a694183 name=/runtime.v1.RuntimeService/ListContainers
Jun 14 20:58:08 ha-590347 crio[6602]: time="2024-06-14 20:58:08.203625112Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:5941feb85375a1366faacd0cec33d9d24de68e40f5cb954c3dacc2d2be72836f,PodSandboxId:7f11bfb8ed7f7420d5ceaefda4db83c814e45cd53593355dd572ef231b0acd26,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:7,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1718398613848426950,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1b75c63e-e65e-49b9-9c91-67031efc4821,},Annotations:map[string]string{io.kubernetes.container.hash: 19d398b2,io.kubernetes.container.restartCount: 7,io.kubernetes.container.t
erminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:489c0113cf348c2fd3db81c511291ad8068889ee7f8129da37dd6a073e2063b2,PodSandboxId:cb873895f231354e68e4d7633f5b9152e1c8b16c970add93ada16bcc572dae26,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:6,},Image:&ImageSpec{Image:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,State:CONTAINER_RUNNING,CreatedAt:1718398329847713911,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-p6csv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e8378c85-f69e-4604-8f5a-e70029d6042d,},Annotations:map[string]string{io.kubernetes.container.hash: 73958612,io.kubernetes.container.restartCount: 6,io.kubernetes.container.terminationMessagePath: /dev/termin
ation-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ff4164efa00d93fa8cae7dbd88a995c377cf954af5c40f7e73000425e8ae9730,PodSandboxId:48fe4cb79fd7a710b611844f86435e598c91f708130cf8e515723d1ca66b8286,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:5,},Image:&ImageSpec{Image:25a1387cdab82166df829c0b70761c10e2d2afce21a7bcf9ae4e9d71fe34ef2c,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:25a1387cdab82166df829c0b70761c10e2d2afce21a7bcf9ae4e9d71fe34ef2c,State:CONTAINER_RUNNING,CreatedAt:1718398319858052991,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 87f6813f3f2fdd5caddc4dd9a44c1590,},Annotations:map[string]string{io.kubernetes.container.hash: ac6c6b5e,io.kubernetes.container.restartCount: 5,io.kubernetes.container.terminationMessagePath: /dev/
termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:57d46e9f8df4c64f5f749ec31b3cad079a7bcd478174719bb2e0cdb82236f41b,PodSandboxId:9905a10f28d89d50a173dc05f4fd1bd6f7344a4c9386fa4459e6180cc7c50a72,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:6,},Image:&ImageSpec{Image:91be9408031725d89ff709fdf75a7666cedbf0d8831be4581310a879a096c71a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:91be9408031725d89ff709fdf75a7666cedbf0d8831be4581310a879a096c71a,State:CONTAINER_RUNNING,CreatedAt:1718398313848530131,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1fde40dbf4c4f8e0c9d5bc67972eef32,},Annotations:map[string]string{io.kubernetes.container.hash: 3740b3cc,io.kubernetes.container.restartCount: 6,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.ku
bernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:258f0013a53c0c104aab676912e938c829e322786e96757ccc78501a8f8c2100,PodSandboxId:7f11bfb8ed7f7420d5ceaefda4db83c814e45cd53593355dd572ef231b0acd26,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:6,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_EXITED,CreatedAt:1718398308844822025,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1b75c63e-e65e-49b9-9c91-67031efc4821,},Annotations:map[string]string{io.kubernetes.container.hash: 19d398b2,io.kubernetes.container.restartCount: 6,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.cont
ainer.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4fad0593a4a60a75e970a33b345baefaa70de47ee2b9d21609286c4a49e8cc86,PodSandboxId:9905a10f28d89d50a173dc05f4fd1bd6f7344a4c9386fa4459e6180cc7c50a72,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:5,},Image:&ImageSpec{Image:91be9408031725d89ff709fdf75a7666cedbf0d8831be4581310a879a096c71a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:91be9408031725d89ff709fdf75a7666cedbf0d8831be4581310a879a096c71a,State:CONTAINER_EXITED,CreatedAt:1718398208852575923,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1fde40dbf4c4f8e0c9d5bc67972eef32,},Annotations:map[string]string{io.kubernetes.container.hash: 3740b3cc,io.kubernetes.container.restartCount: 5,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessa
gePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6743f3d9185f1656db5f7ce3fdee03cba39b5644352ea310366574f7d895aa0c,PodSandboxId:48fe4cb79fd7a710b611844f86435e598c91f708130cf8e515723d1ca66b8286,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:4,},Image:&ImageSpec{Image:25a1387cdab82166df829c0b70761c10e2d2afce21a7bcf9ae4e9d71fe34ef2c,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:25a1387cdab82166df829c0b70761c10e2d2afce21a7bcf9ae4e9d71fe34ef2c,State:CONTAINER_EXITED,CreatedAt:1718398204846625898,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 87f6813f3f2fdd5caddc4dd9a44c1590,},Annotations:map[string]string{io.kubernetes.container.hash: ac6c6b5e,io.kubernetes.container.restartCount: 4,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.termination
MessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:b9c35df45a9e01c92ca6e150ee10b31a2b6f7363916de41951131fa994976baf,PodSandboxId:57ddfc43bad84ba7c3f69a256afef88d7c3fef61154df47d4055a0b76b23e289,Metadata:&ContainerMetadata{Name:busybox,Attempt:2,},Image:&ImageSpec{Image:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1718398172145587034,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-7tkrn,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: e6254ba8-cb7d-43e6-a18c-ba7ece6c1a42,},Annotations:map[string]string{io.kubernetes.container.hash: f3b01e9,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod
.terminationGracePeriod: 30,},},&Container{Id:3fba739a0c9e701b34877059fd1d343516d3f4f25ab42a9d5f7c4944d3e80ff2,PodSandboxId:84d2625b63c87d62346b428059a4f3a640b4d5279e57ca53e02b274690512f54,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:2,},Image:&ImageSpec{Image:747097150317f99937cabea484cff90097a2dbd79e7eb348b71dc0af879883cd,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:747097150317f99937cabea484cff90097a2dbd79e7eb348b71dc0af879883cd,State:CONTAINER_RUNNING,CreatedAt:1718398139030188800,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-76fzk,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 38c5e42d-ed30-4db8-957e-b21c9fba4211,},Annotations:map[string]string{io.kubernetes.container.hash: 2e031400,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&
Container{Id:826143e4f559535d523ee37cb59be6e1b84e9f6f75aecb76d2b5e20e4f1e84f1,PodSandboxId:cb873895f231354e68e4d7633f5b9152e1c8b16c970add93ada16bcc572dae26,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:5,},Image:&ImageSpec{Image:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,State:CONTAINER_EXITED,CreatedAt:1718398139126091787,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-p6csv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e8378c85-f69e-4604-8f5a-e70029d6042d,},Annotations:map[string]string{io.kubernetes.container.hash: 73958612,io.kubernetes.container.restartCount: 5,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:039c6aea832809f374c92b
35e9ceb26ad6f121a13b5ce4a10893296c1b219625,PodSandboxId:2b43eeadfaabc778150e18556df1aeaed451dcd566291010c4def5efb4cf122c,Metadata:&ContainerMetadata{Name:coredns,Attempt:3,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1718398139216548085,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-mxql8,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d34e9a32-d685-4c8a-bb7e-57697551eea5,},Annotations:map[string]string{io.kubernetes.container.hash: 1adc570b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 3,io.kubernetes.
container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3155701527e32e48e1508247609701a35c13dd6c1694dda719d388a9f49b6294,PodSandboxId:991ff13cf96f5bff630a6265d77a952e42431c58839faf9a2efab8c4d0408286,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1718398138902658646,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e4fa1a7f34d580bed663ee03f716216a,},Annotations:map[string]string{io.kubernetes.container.hash: 1bf7dfd2,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-
log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:13892e0b84e7487e0040a292b209ce39b460933e0c13381b95b50d9bb9af19d3,PodSandboxId:d0966f34a58a5a856eeb06b8724460a619090bf3ec11530a43f14a2b787aa912,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:1,},Image:&ImageSpec{Image:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:1718398138839208601,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 13410303e6cbf4a6ced051c92303490e,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.termination
MessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1eee7f7fcc163b3f63070d55b0309f33e2a1d6b0bc0d3244641ae78ad4a74a8b,PodSandboxId:66b0bdda5b2b8f3e03b0874f85bf3b14b1a1dc225611585f353e35389f696020,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:2,},Image:&ImageSpec{Image:a52dc94f0a91256bde86a1c3027a16336bb8fea9304f9311987066307996f035,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a52dc94f0a91256bde86a1c3027a16336bb8fea9304f9311987066307996f035,State:CONTAINER_RUNNING,CreatedAt:1718398138698529200,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5d5551206f21a968da5a45786306a508,},Annotations:map[string]string{io.kubernetes.container.hash: 200064a4,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,i
o.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:60528041f3a4740437f32e068e233d964fb10fc91790a10e43f4437be4d0b9ec,PodSandboxId:b8264cc3e018ae94211a8ebf40c294ddef51fdf9d42ef3513e3b1427a5be0714,Metadata:&ContainerMetadata{Name:coredns,Attempt:2,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1718398138743338844,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-ppprf,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9f28fd0f-7f46-4ed2-a413-82e4afa8e64f,},Annotations:map[string]string{io.kubernetes.container.hash: fbd3931f,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\
":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:766600eff171286fdeefbdfcefcc2506883b7b88beb7030a874c8c4cde9df6b0,PodSandboxId:e69d703e22294f9ae69e025b04fddb7c1c90a7e53a53d043a3f9923e808bccd5,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_EXITED,CreatedAt:1718397762134263921,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-7tkrn,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: e6254ba8-cb7d-43e6-a18c-ba7ece6c1a42,},Annotations:map[string]string{io.kubernetes.container.hash: f3b01e9,io.kuber
netes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e15fb60a5bb5c3abe61382efe592d1c494610c763465abdaff9a1da8c512fb7b,PodSandboxId:cfe4b78e708e5d01557b8cf128cb598a8f5f76eabbb0582078e5a0b8ce8627a5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_EXITED,CreatedAt:1718397745334993835,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 13410303e6cbf4a6ced051c92303490e,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 0,io.kuber
netes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c3476e7d64f44d7903e697c06e7866ea8fc10a7d9347baa387e9b99288d64b36,PodSandboxId:0091e85918084ef12004f041b6ad19c8aa34d99def47a210200d600f8c6c002d,Metadata:&ContainerMetadata{Name:coredns,Attempt:2,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_EXITED,CreatedAt:1718397734930214481,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-mxql8,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d34e9a32-d685-4c8a-bb7e-57697551eea5,},Annotations:map[string]string{io.kubernetes.container.hash: 1adc570b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protoco
l\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:512f658ebb61c7bb855ea0c39f15481bcad9e332f43ff5bb32e92ca76ad8c205,PodSandboxId:e326c543355186944aef1d3e0b4a50305bf5275547e222a375b739bef983fc2b,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:747097150317f99937cabea484cff90097a2dbd79e7eb348b71dc0af879883cd,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:747097150317f99937cabea484cff90097a2dbd79e7eb348b71dc0af879883cd,State:CONTAINER_EXITED,CreatedAt:1718397728855751837,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-76fzk,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.u
id: 38c5e42d-ed30-4db8-957e-b21c9fba4211,},Annotations:map[string]string{io.kubernetes.container.hash: 2e031400,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:dc92518a3b5d2ed6049815f099f855d96efbe469826a2fb36a83de9eb99d65ff,PodSandboxId:2051404cbfd0f3dac9f79686e09c0de634b44ec56aaeb79a417a6c13aa778d05,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_EXITED,CreatedAt:1718397729086661194,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-ppprf,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9f28fd0f-7f46-4ed2-a413-82e4
afa8e64f,},Annotations:map[string]string{io.kubernetes.container.hash: fbd3931f,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:148ff4475e5734bfa4edde4bd9c3b04b6470feff683de19280cb7e7abdd88044,PodSandboxId:ef1d27b8a86b43dc85d6ce8406caea0445738ec9059d67f19d7399ce2e6f6cca,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_EXITED,CreatedAt:1718397728662016710,Labels:map[st
ring]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e4fa1a7f34d580bed663ee03f716216a,},Annotations:map[string]string{io.kubernetes.container.hash: 1bf7dfd2,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:b7ba582fd7f20fdfc839479c2b3658f492d631c33d6b9451b78d3269d6f150f8,PodSandboxId:cc038a44afee458615347760bf0975fff987f4950ab55861a3e208fd2dcbda62,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:a52dc94f0a91256bde86a1c3027a16336bb8fea9304f9311987066307996f035,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a52dc94f0a91256bde86a1c3027a16336bb8fea9304f9311987066307996f035,State:CONTAINER_EXITED,CreatedAt:1718397728610334559,Labels:map[string]string{io.kubernetes.container.name:
kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-590347,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5d5551206f21a968da5a45786306a508,},Annotations:map[string]string{io.kubernetes.container.hash: 200064a4,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=11933110-299c-4ca0-95e3-8b0c7a694183 name=/runtime.v1.RuntimeService/ListContainers
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
5941feb85375a 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 About a minute ago Running storage-provisioner 7 7f11bfb8ed7f7 storage-provisioner
489c0113cf348 ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f 5 minutes ago Running kindnet-cni 6 cb873895f2313 kindnet-p6csv
ff4164efa00d9 25a1387cdab82166df829c0b70761c10e2d2afce21a7bcf9ae4e9d71fe34ef2c 6 minutes ago Running kube-controller-manager 5 48fe4cb79fd7a kube-controller-manager-ha-590347
57d46e9f8df4c 91be9408031725d89ff709fdf75a7666cedbf0d8831be4581310a879a096c71a 6 minutes ago Running kube-apiserver 6 9905a10f28d89 kube-apiserver-ha-590347
258f0013a53c0 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 6 minutes ago Exited storage-provisioner 6 7f11bfb8ed7f7 storage-provisioner
4fad0593a4a60 91be9408031725d89ff709fdf75a7666cedbf0d8831be4581310a879a096c71a 7 minutes ago Exited kube-apiserver 5 9905a10f28d89 kube-apiserver-ha-590347
6743f3d9185f1 25a1387cdab82166df829c0b70761c10e2d2afce21a7bcf9ae4e9d71fe34ef2c 8 minutes ago Exited kube-controller-manager 4 48fe4cb79fd7a kube-controller-manager-ha-590347
b9c35df45a9e0 8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a 8 minutes ago Running busybox 2 57ddfc43bad84 busybox-fc5497c4f-7tkrn
039c6aea83280 cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4 9 minutes ago Running coredns 3 2b43eeadfaabc coredns-7db6d8ff4d-mxql8
826143e4f5595 ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f 9 minutes ago Exited kindnet-cni 5 cb873895f2313 kindnet-p6csv
3fba739a0c9e7 747097150317f99937cabea484cff90097a2dbd79e7eb348b71dc0af879883cd 9 minutes ago Running kube-proxy 2 84d2625b63c87 kube-proxy-76fzk
3155701527e32 3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899 9 minutes ago Running etcd 2 991ff13cf96f5 etcd-ha-590347
13892e0b84e74 38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12 9 minutes ago Running kube-vip 1 d0966f34a58a5 kube-vip-ha-590347
60528041f3a47 cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4 9 minutes ago Running coredns 2 b8264cc3e018a coredns-7db6d8ff4d-ppprf
1eee7f7fcc163 a52dc94f0a91256bde86a1c3027a16336bb8fea9304f9311987066307996f035 9 minutes ago Running kube-scheduler 2 66b0bdda5b2b8 kube-scheduler-ha-590347
766600eff1712 8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a 15 minutes ago Exited busybox 1 e69d703e22294 busybox-fc5497c4f-7tkrn
e15fb60a5bb5c 38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12 15 minutes ago Exited kube-vip 0 cfe4b78e708e5 kube-vip-ha-590347
c3476e7d64f44 cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4 15 minutes ago Exited coredns 2 0091e85918084 coredns-7db6d8ff4d-mxql8
dc92518a3b5d2 cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4 15 minutes ago Exited coredns 1 2051404cbfd0f coredns-7db6d8ff4d-ppprf
512f658ebb61c 747097150317f99937cabea484cff90097a2dbd79e7eb348b71dc0af879883cd 15 minutes ago Exited kube-proxy 1 e326c54335518 kube-proxy-76fzk
148ff4475e573 3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899 15 minutes ago Exited etcd 1 ef1d27b8a86b4 etcd-ha-590347
b7ba582fd7f20 a52dc94f0a91256bde86a1c3027a16336bb8fea9304f9311987066307996f035 15 minutes ago Exited kube-scheduler 1 cc038a44afee4 kube-scheduler-ha-590347
==> coredns [039c6aea832809f374c92b35e9ceb26ad6f121a13b5ce4a10893296c1b219625] <==
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
==> coredns [60528041f3a4740437f32e068e233d964fb10fc91790a10e43f4437be4d0b9ec] <==
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused - error from a previous attempt: read tcp 10.244.0.9:35804->10.96.0.1:443: read: connection reset by peer
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused - error from a previous attempt: read tcp 10.244.0.9:35804->10.96.0.1:443: read: connection reset by peer
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
==> coredns [c3476e7d64f44d7903e697c06e7866ea8fc10a7d9347baa387e9b99288d64b36] <==
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused - error from a previous attempt: read tcp 10.244.0.6:46724->10.96.0.1:443: read: connection reset by peer
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused - error from a previous attempt: read tcp 10.244.0.6:46724->10.96.0.1:443: read: connection reset by peer
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: no route to host
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: no route to host
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: no route to host
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: no route to host
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: no route to host
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: no route to host
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: no route to host
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: no route to host
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
==> coredns [dc92518a3b5d2ed6049815f099f855d96efbe469826a2fb36a83de9eb99d65ff] <==
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: no route to host
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: no route to host
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: no route to host
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: no route to host
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused - error from a previous attempt: read tcp 10.244.0.7:44962->10.96.0.1:443: read: connection reset by peer
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused - error from a previous attempt: read tcp 10.244.0.7:44962->10.96.0.1:443: read: connection reset by peer
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused - error from a previous attempt: read tcp 10.244.0.7:52386->10.96.0.1:443: read: connection reset by peer
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused - error from a previous attempt: read tcp 10.244.0.7:52386->10.96.0.1:443: read: connection reset by peer
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: no route to host
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: no route to host
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: no route to host
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: no route to host
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
==> describe nodes <==
Name: ha-590347
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=ha-590347
kubernetes.io/os=linux
minikube.k8s.io/commit=f69233ed138daadce45cabb33ad12149032cfeab
minikube.k8s.io/name=ha-590347
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_06_14T20_31_16_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Fri, 14 Jun 2024 20:31:15 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: ha-590347
AcquireTime: <unset>
RenewTime: Fri, 14 Jun 2024 20:58:00 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Fri, 14 Jun 2024 20:57:26 +0000 Fri, 14 Jun 2024 20:31:15 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Fri, 14 Jun 2024 20:57:26 +0000 Fri, 14 Jun 2024 20:31:15 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Fri, 14 Jun 2024 20:57:26 +0000 Fri, 14 Jun 2024 20:31:15 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Fri, 14 Jun 2024 20:57:26 +0000 Fri, 14 Jun 2024 20:31:34 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.58
Hostname: ha-590347
Capacity:
cpu: 2
ephemeral-storage: 17734596Ki
hugepages-2Mi: 0
memory: 2164184Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17734596Ki
hugepages-2Mi: 0
memory: 2164184Ki
pods: 110
System Info:
Machine ID: 7a742ac8d83440f9addc0537f10088ba
System UUID: 7a742ac8-d834-40f9-addc-0537f10088ba
Boot ID: 7ad6ba50-9685-4826-b43f-6f6a9b3ed285
Kernel Version: 5.10.207
OS Image: Buildroot 2023.02.9
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.29.1
Kubelet Version: v1.30.1
Kube-Proxy Version: v1.30.1
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (11 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-fc5497c4f-7tkrn 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 24m
kube-system coredns-7db6d8ff4d-mxql8 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 26m
kube-system coredns-7db6d8ff4d-ppprf 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 26m
kube-system etcd-ha-590347 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (4%!)(MISSING) 0 (0%!)(MISSING) 26m
kube-system kindnet-p6csv 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 26m
kube-system kube-apiserver-ha-590347 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 26m
kube-system kube-controller-manager-ha-590347 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 26m
kube-system kube-proxy-76fzk 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 26m
kube-system kube-scheduler-ha-590347 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 26m
kube-system kube-vip-ha-590347 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 14m
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 26m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 290Mi (13%!)(MISSING) 390Mi (18%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 15m kube-proxy
Normal Starting 26m kube-proxy
Normal Starting 27m kubelet Starting kubelet.
Normal NodeAllocatableEnforced 27m kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientPID 27m (x4 over 27m) kubelet Node ha-590347 status is now: NodeHasSufficientPID
Normal NodeHasNoDiskPressure 27m (x4 over 27m) kubelet Node ha-590347 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientMemory 27m (x5 over 27m) kubelet Node ha-590347 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 26m kubelet Node ha-590347 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 26m kubelet Node ha-590347 status is now: NodeHasSufficientPID
Normal Starting 26m kubelet Starting kubelet.
Normal NodeAllocatableEnforced 26m kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 26m kubelet Node ha-590347 status is now: NodeHasSufficientMemory
Normal RegisteredNode 26m node-controller Node ha-590347 event: Registered Node ha-590347 in Controller
Normal NodeReady 26m kubelet Node ha-590347 status is now: NodeReady
Normal RegisteredNode 25m node-controller Node ha-590347 event: Registered Node ha-590347 in Controller
Normal RegisteredNode 24m node-controller Node ha-590347 event: Registered Node ha-590347 in Controller
Normal RegisteredNode 15m node-controller Node ha-590347 event: Registered Node ha-590347 in Controller
Normal RegisteredNode 14m node-controller Node ha-590347 event: Registered Node ha-590347 in Controller
Normal RegisteredNode 14m node-controller Node ha-590347 event: Registered Node ha-590347 in Controller
Warning ContainerGCFailed 9m52s (x3 over 16m) kubelet rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory"
Normal RegisteredNode 5m53s node-controller Node ha-590347 event: Registered Node ha-590347 in Controller
Name: ha-590347-m02
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=ha-590347-m02
kubernetes.io/os=linux
minikube.k8s.io/commit=f69233ed138daadce45cabb33ad12149032cfeab
minikube.k8s.io/name=ha-590347
minikube.k8s.io/primary=false
minikube.k8s.io/updated_at=2024_06_14T20_32_19_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Fri, 14 Jun 2024 20:32:15 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: ha-590347-m02
AcquireTime: <unset>
RenewTime: Fri, 14 Jun 2024 20:58:07 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Fri, 14 Jun 2024 20:57:25 +0000 Fri, 14 Jun 2024 20:42:51 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Fri, 14 Jun 2024 20:57:25 +0000 Fri, 14 Jun 2024 20:42:51 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Fri, 14 Jun 2024 20:57:25 +0000 Fri, 14 Jun 2024 20:42:51 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Fri, 14 Jun 2024 20:57:25 +0000 Fri, 14 Jun 2024 20:43:01 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.161
Hostname: ha-590347-m02
Capacity:
cpu: 2
ephemeral-storage: 17734596Ki
hugepages-2Mi: 0
memory: 2164184Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17734596Ki
hugepages-2Mi: 0
memory: 2164184Ki
pods: 110
System Info:
Machine ID: f5da33343ad64e8480dc03ed6d765ff3
System UUID: f5da3334-3ad6-4e84-80dc-03ed6d765ff3
Boot ID: bc4d14c6-a650-404c-ae30-27d61578581f
Kernel Version: 5.10.207
OS Image: Buildroot 2023.02.9
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.29.1
Kubelet Version: v1.30.1
Kube-Proxy Version: v1.30.1
PodCIDR: 10.244.1.0/24
PodCIDRs: 10.244.1.0/24
Non-terminated Pods: (8 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-fc5497c4f-wv7wf 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 24m
kube-system etcd-ha-590347-m02 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (4%!)(MISSING) 0 (0%!)(MISSING) 25m
kube-system kindnet-tpr5k 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 25m
kube-system kube-apiserver-ha-590347-m02 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 25m
kube-system kube-controller-manager-ha-590347-m02 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 25m
kube-system kube-proxy-2nqjn 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 25m
kube-system kube-scheduler-ha-590347-m02 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 25m
kube-system kube-vip-ha-590347-m02 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 25m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 750m (37%!)(MISSING) 100m (5%!)(MISSING)
memory 150Mi (7%!)(MISSING) 50Mi (2%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 5m55s kube-proxy
Normal Starting 14m kube-proxy
Normal Starting 25m kube-proxy
Normal NodeAllocatableEnforced 25m kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 25m (x8 over 25m) kubelet Node ha-590347-m02 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 25m (x8 over 25m) kubelet Node ha-590347-m02 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 25m (x7 over 25m) kubelet Node ha-590347-m02 status is now: NodeHasSufficientPID
Normal RegisteredNode 25m node-controller Node ha-590347-m02 event: Registered Node ha-590347-m02 in Controller
Normal RegisteredNode 25m node-controller Node ha-590347-m02 event: Registered Node ha-590347-m02 in Controller
Normal RegisteredNode 24m node-controller Node ha-590347-m02 event: Registered Node ha-590347-m02 in Controller
Normal NodeNotReady 22m node-controller Node ha-590347-m02 status is now: NodeNotReady
Normal NodeHasNoDiskPressure 15m (x8 over 15m) kubelet Node ha-590347-m02 status is now: NodeHasNoDiskPressure
Normal Starting 15m kubelet Starting kubelet.
Normal NodeHasSufficientMemory 15m (x8 over 15m) kubelet Node ha-590347-m02 status is now: NodeHasSufficientMemory
Normal NodeHasSufficientPID 15m (x7 over 15m) kubelet Node ha-590347-m02 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 15m kubelet Updated Node Allocatable limit across pods
Normal RegisteredNode 15m node-controller Node ha-590347-m02 event: Registered Node ha-590347-m02 in Controller
Normal RegisteredNode 14m node-controller Node ha-590347-m02 event: Registered Node ha-590347-m02 in Controller
Normal RegisteredNode 14m node-controller Node ha-590347-m02 event: Registered Node ha-590347-m02 in Controller
Warning ContainerGCFailed 8m45s kubelet rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory"
Normal RegisteredNode 5m53s node-controller Node ha-590347-m02 event: Registered Node ha-590347-m02 in Controller
Name: ha-590347-m04
Roles: <none>
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=ha-590347-m04
kubernetes.io/os=linux
minikube.k8s.io/commit=f69233ed138daadce45cabb33ad12149032cfeab
minikube.k8s.io/name=ha-590347
minikube.k8s.io/primary=false
minikube.k8s.io/updated_at=2024_06_14T20_34_28_0700
minikube.k8s.io/version=v1.33.1
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Fri, 14 Jun 2024 20:34:27 +0000
Taints: node.kubernetes.io/unreachable:NoExecute
node.kubernetes.io/unreachable:NoSchedule
Unschedulable: false
Lease:
HolderIdentity: ha-590347-m04
AcquireTime: <unset>
RenewTime: Fri, 14 Jun 2024 20:44:43 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure Unknown Fri, 14 Jun 2024 20:44:23 +0000 Fri, 14 Jun 2024 20:45:25 +0000 NodeStatusUnknown Kubelet stopped posting node status.
DiskPressure Unknown Fri, 14 Jun 2024 20:44:23 +0000 Fri, 14 Jun 2024 20:45:25 +0000 NodeStatusUnknown Kubelet stopped posting node status.
PIDPressure Unknown Fri, 14 Jun 2024 20:44:23 +0000 Fri, 14 Jun 2024 20:45:25 +0000 NodeStatusUnknown Kubelet stopped posting node status.
Ready Unknown Fri, 14 Jun 2024 20:44:23 +0000 Fri, 14 Jun 2024 20:45:25 +0000 NodeStatusUnknown Kubelet stopped posting node status.
Addresses:
InternalIP: 192.168.39.71
Hostname: ha-590347-m04
Capacity:
cpu: 2
ephemeral-storage: 17734596Ki
hugepages-2Mi: 0
memory: 2164184Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17734596Ki
hugepages-2Mi: 0
memory: 2164184Ki
pods: 110
System Info:
Machine ID: ca1e7d92da2c4769a100f59f206c84b3
System UUID: ca1e7d92-da2c-4769-a100-f59f206c84b3
Boot ID: 68fd3368-894f-42d9-8acc-b680bda16689
Kernel Version: 5.10.207
OS Image: Buildroot 2023.02.9
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.29.1
Kubelet Version: v1.30.1
Kube-Proxy Version: v1.30.1
PodCIDR: 10.244.3.0/24
PodCIDRs: 10.244.3.0/24
Non-terminated Pods: (3 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-fc5497c4f-rt8pp 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 13m
kube-system kindnet-nz2gc 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 23m
kube-system kube-proxy-bjr7r 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 23m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 100m (5%!)(MISSING) 100m (5%!)(MISSING)
memory 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 13m kube-proxy
Normal Starting 23m kube-proxy
Normal NodeAllocatableEnforced 23m kubelet Updated Node Allocatable limit across pods
Normal RegisteredNode 23m node-controller Node ha-590347-m04 event: Registered Node ha-590347-m04 in Controller
Normal NodeHasSufficientMemory 23m (x2 over 23m) kubelet Node ha-590347-m04 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 23m (x2 over 23m) kubelet Node ha-590347-m04 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 23m (x2 over 23m) kubelet Node ha-590347-m04 status is now: NodeHasSufficientPID
Normal RegisteredNode 23m node-controller Node ha-590347-m04 event: Registered Node ha-590347-m04 in Controller
Normal RegisteredNode 23m node-controller Node ha-590347-m04 event: Registered Node ha-590347-m04 in Controller
Normal NodeReady 23m kubelet Node ha-590347-m04 status is now: NodeReady
Normal RegisteredNode 15m node-controller Node ha-590347-m04 event: Registered Node ha-590347-m04 in Controller
Normal RegisteredNode 14m node-controller Node ha-590347-m04 event: Registered Node ha-590347-m04 in Controller
Normal NodeNotReady 14m node-controller Node ha-590347-m04 status is now: NodeNotReady
Normal RegisteredNode 14m node-controller Node ha-590347-m04 event: Registered Node ha-590347-m04 in Controller
Normal Starting 13m kubelet Starting kubelet.
Normal NodeAllocatableEnforced 13m kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 13m (x3 over 13m) kubelet Node ha-590347-m04 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 13m (x3 over 13m) kubelet Node ha-590347-m04 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 13m (x3 over 13m) kubelet Node ha-590347-m04 status is now: NodeHasSufficientPID
Warning Rebooted 13m (x2 over 13m) kubelet Node ha-590347-m04 has been rebooted, boot id: 68fd3368-894f-42d9-8acc-b680bda16689
Normal NodeReady 13m (x2 over 13m) kubelet Node ha-590347-m04 status is now: NodeReady
Normal NodeNotReady 12m node-controller Node ha-590347-m04 status is now: NodeNotReady
Normal RegisteredNode 5m53s node-controller Node ha-590347-m04 event: Registered Node ha-590347-m04 in Controller
==> dmesg <==
[ +5.024593] kauditd_printk_skb: 74 callbacks suppressed
[ +2.203601] systemd-fstab-generator[1354]: Ignoring "noauto" option for root device
[ +6.491647] kauditd_printk_skb: 23 callbacks suppressed
[ +12.923227] kauditd_printk_skb: 38 callbacks suppressed
[Jun14 20:32] kauditd_printk_skb: 24 callbacks suppressed
[Jun14 20:38] kauditd_printk_skb: 1 callbacks suppressed
[Jun14 20:41] systemd-fstab-generator[3882]: Ignoring "noauto" option for root device
[ +0.191317] systemd-fstab-generator[3950]: Ignoring "noauto" option for root device
[ +0.178862] systemd-fstab-generator[3967]: Ignoring "noauto" option for root device
[ +0.157002] systemd-fstab-generator[3979]: Ignoring "noauto" option for root device
[ +0.272003] systemd-fstab-generator[4007]: Ignoring "noauto" option for root device
[ +10.086646] systemd-fstab-generator[4129]: Ignoring "noauto" option for root device
[Jun14 20:42] kauditd_printk_skb: 110 callbacks suppressed
[ +8.038513] kauditd_printk_skb: 12 callbacks suppressed
[ +5.098499] kauditd_printk_skb: 82 callbacks suppressed
[ +44.261835] kauditd_printk_skb: 9 callbacks suppressed
[Jun14 20:48] systemd-fstab-generator[6517]: Ignoring "noauto" option for root device
[ +0.147266] systemd-fstab-generator[6529]: Ignoring "noauto" option for root device
[ +0.198583] systemd-fstab-generator[6543]: Ignoring "noauto" option for root device
[ +0.154394] systemd-fstab-generator[6555]: Ignoring "noauto" option for root device
[ +0.289997] systemd-fstab-generator[6583]: Ignoring "noauto" option for root device
[ +6.887222] systemd-fstab-generator[6700]: Ignoring "noauto" option for root device
[ +0.089926] kauditd_printk_skb: 100 callbacks suppressed
[Jun14 20:49] kauditd_printk_skb: 122 callbacks suppressed
[Jun14 20:51] kauditd_printk_skb: 1 callbacks suppressed
==> etcd [148ff4475e5734bfa4edde4bd9c3b04b6470feff683de19280cb7e7abdd88044] <==
{"level":"info","ts":"2024-06-14T20:47:11.997511Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ded7f9817c909548 [term 3] starts to transfer leadership to 9510f7a2c3a1b76a"}
{"level":"info","ts":"2024-06-14T20:47:11.997548Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ded7f9817c909548 sends MsgTimeoutNow to 9510f7a2c3a1b76a immediately as 9510f7a2c3a1b76a already has up-to-date log"}
{"level":"info","ts":"2024-06-14T20:47:11.999785Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ded7f9817c909548 [term: 3] received a MsgVote message with higher term from 9510f7a2c3a1b76a [term: 4]"}
{"level":"info","ts":"2024-06-14T20:47:11.999856Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ded7f9817c909548 became follower at term 4"}
{"level":"info","ts":"2024-06-14T20:47:11.999875Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ded7f9817c909548 [logterm: 3, index: 3445, vote: 0] cast MsgVote for 9510f7a2c3a1b76a [logterm: 3, index: 3445] at term 4"}
{"level":"info","ts":"2024-06-14T20:47:11.999889Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: ded7f9817c909548 lost leader ded7f9817c909548 at term 4"}
{"level":"info","ts":"2024-06-14T20:47:12.002087Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: ded7f9817c909548 elected leader 9510f7a2c3a1b76a at term 4"}
{"level":"info","ts":"2024-06-14T20:47:12.0976Z","caller":"etcdserver/server.go:1448","msg":"leadership transfer finished","local-member-id":"ded7f9817c909548","old-leader-member-id":"ded7f9817c909548","new-leader-member-id":"9510f7a2c3a1b76a","took":"100.142497ms"}
{"level":"info","ts":"2024-06-14T20:47:12.097804Z","caller":"rafthttp/peer.go:330","msg":"stopping remote peer","remote-peer-id":"9510f7a2c3a1b76a"}
{"level":"warn","ts":"2024-06-14T20:47:12.099065Z","caller":"rafthttp/stream.go:286","msg":"closed TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","remote-peer-id":"9510f7a2c3a1b76a"}
{"level":"info","ts":"2024-06-14T20:47:12.099115Z","caller":"rafthttp/stream.go:294","msg":"stopped TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","remote-peer-id":"9510f7a2c3a1b76a"}
{"level":"warn","ts":"2024-06-14T20:47:12.10458Z","caller":"rafthttp/stream.go:286","msg":"closed TCP streaming connection with remote peer","stream-writer-type":"stream Message","remote-peer-id":"9510f7a2c3a1b76a"}
{"level":"info","ts":"2024-06-14T20:47:12.10467Z","caller":"rafthttp/stream.go:294","msg":"stopped TCP streaming connection with remote peer","stream-writer-type":"stream Message","remote-peer-id":"9510f7a2c3a1b76a"}
{"level":"info","ts":"2024-06-14T20:47:12.10474Z","caller":"rafthttp/pipeline.go:85","msg":"stopped HTTP pipelining with remote peer","local-member-id":"ded7f9817c909548","remote-peer-id":"9510f7a2c3a1b76a"}
{"level":"warn","ts":"2024-06-14T20:47:12.104898Z","caller":"rafthttp/stream.go:421","msg":"lost TCP streaming connection with remote peer","stream-reader-type":"stream MsgApp v2","local-member-id":"ded7f9817c909548","remote-peer-id":"9510f7a2c3a1b76a","error":"context canceled"}
{"level":"warn","ts":"2024-06-14T20:47:12.105004Z","caller":"rafthttp/peer_status.go:66","msg":"peer became inactive (message send to peer failed)","peer-id":"9510f7a2c3a1b76a","error":"failed to read 9510f7a2c3a1b76a on stream MsgApp v2 (context canceled)"}
{"level":"info","ts":"2024-06-14T20:47:12.105091Z","caller":"rafthttp/stream.go:442","msg":"stopped stream reader with remote peer","stream-reader-type":"stream MsgApp v2","local-member-id":"ded7f9817c909548","remote-peer-id":"9510f7a2c3a1b76a"}
{"level":"warn","ts":"2024-06-14T20:47:12.10521Z","caller":"rafthttp/stream.go:421","msg":"lost TCP streaming connection with remote peer","stream-reader-type":"stream Message","local-member-id":"ded7f9817c909548","remote-peer-id":"9510f7a2c3a1b76a","error":"context canceled"}
{"level":"info","ts":"2024-06-14T20:47:12.105248Z","caller":"rafthttp/stream.go:442","msg":"stopped stream reader with remote peer","stream-reader-type":"stream Message","local-member-id":"ded7f9817c909548","remote-peer-id":"9510f7a2c3a1b76a"}
{"level":"info","ts":"2024-06-14T20:47:12.10528Z","caller":"rafthttp/peer.go:335","msg":"stopped remote peer","remote-peer-id":"9510f7a2c3a1b76a"}
{"level":"warn","ts":"2024-06-14T20:47:12.108417Z","caller":"rafthttp/http.go:413","msg":"failed to find remote peer in cluster","local-member-id":"ded7f9817c909548","remote-peer-id-stream-handler":"ded7f9817c909548","remote-peer-id-from":"9510f7a2c3a1b76a","cluster-id":"91c640bc00cd2aea"}
{"level":"info","ts":"2024-06-14T20:47:12.109833Z","caller":"embed/etcd.go:579","msg":"stopping serving peer traffic","address":"192.168.39.58:2380"}
{"level":"warn","ts":"2024-06-14T20:47:12.109989Z","caller":"embed/config_logging.go:169","msg":"rejected connection","remote-addr":"192.168.39.161:36420","server-name":"","error":"read tcp 192.168.39.58:2380->192.168.39.161:36420: use of closed network connection"}
{"level":"info","ts":"2024-06-14T20:47:13.111034Z","caller":"embed/etcd.go:584","msg":"stopped serving peer traffic","address":"192.168.39.58:2380"}
{"level":"info","ts":"2024-06-14T20:47:13.111111Z","caller":"embed/etcd.go:377","msg":"closed etcd server","name":"ha-590347","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.39.58:2380"],"advertise-client-urls":["https://192.168.39.58:2379"]}
==> etcd [3155701527e32e48e1508247609701a35c13dd6c1694dda719d388a9f49b6294] <==
{"level":"info","ts":"2024-06-14T20:52:02.076913Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ded7f9817c909548 became pre-candidate at term 4"}
{"level":"info","ts":"2024-06-14T20:52:02.07707Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ded7f9817c909548 received MsgPreVoteResp from ded7f9817c909548 at term 4"}
{"level":"info","ts":"2024-06-14T20:52:02.077117Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ded7f9817c909548 [logterm: 4, index: 3446] sent MsgPreVote request to 9510f7a2c3a1b76a at term 4"}
{"level":"info","ts":"2024-06-14T20:52:02.079251Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ded7f9817c909548 received MsgPreVoteResp from 9510f7a2c3a1b76a at term 4"}
{"level":"info","ts":"2024-06-14T20:52:02.079294Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ded7f9817c909548 has received 2 MsgPreVoteResp votes and 0 vote rejections"}
{"level":"info","ts":"2024-06-14T20:52:02.079328Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ded7f9817c909548 became candidate at term 5"}
{"level":"info","ts":"2024-06-14T20:52:02.079341Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ded7f9817c909548 received MsgVoteResp from ded7f9817c909548 at term 5"}
{"level":"info","ts":"2024-06-14T20:52:02.079353Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ded7f9817c909548 [logterm: 4, index: 3446] sent MsgVote request to 9510f7a2c3a1b76a at term 5"}
{"level":"info","ts":"2024-06-14T20:52:02.084006Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ded7f9817c909548 received MsgVoteResp from 9510f7a2c3a1b76a at term 5"}
{"level":"info","ts":"2024-06-14T20:52:02.084112Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ded7f9817c909548 has received 2 MsgVoteResp votes and 0 vote rejections"}
{"level":"info","ts":"2024-06-14T20:52:02.08417Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ded7f9817c909548 became leader at term 5"}
{"level":"info","ts":"2024-06-14T20:52:02.084223Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: ded7f9817c909548 elected leader ded7f9817c909548 at term 5"}
{"level":"info","ts":"2024-06-14T20:52:02.092468Z","caller":"etcdserver/server.go:2068","msg":"published local member to cluster through raft","local-member-id":"ded7f9817c909548","local-member-attributes":"{Name:ha-590347 ClientURLs:[https://192.168.39.58:2379]}","request-path":"/0/members/ded7f9817c909548/attributes","cluster-id":"91c640bc00cd2aea","publish-timeout":"7s"}
{"level":"info","ts":"2024-06-14T20:52:02.092793Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-06-14T20:52:02.093642Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-06-14T20:52:02.093901Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-06-14T20:52:02.093989Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-06-14T20:52:02.095751Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.39.58:2379"}
{"level":"info","ts":"2024-06-14T20:52:02.097277Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"warn","ts":"2024-06-14T20:52:02.108054Z","caller":"embed/config_logging.go:169","msg":"rejected connection","remote-addr":"127.0.0.1:36504","server-name":"","error":"write tcp 127.0.0.1:2379->127.0.0.1:36504: write: broken pipe"}
{"level":"warn","ts":"2024-06-14T20:52:02.110877Z","caller":"embed/config_logging.go:169","msg":"rejected connection","remote-addr":"127.0.0.1:36514","server-name":"","error":"write tcp 127.0.0.1:2379->127.0.0.1:36514: write: broken pipe"}
{"level":"warn","ts":"2024-06-14T20:52:02.113568Z","caller":"embed/config_logging.go:169","msg":"rejected connection","remote-addr":"127.0.0.1:36516","server-name":"","error":"write tcp 127.0.0.1:2379->127.0.0.1:36516: write: broken pipe"}
{"level":"warn","ts":"2024-06-14T20:52:02.116261Z","caller":"embed/config_logging.go:169","msg":"rejected connection","remote-addr":"127.0.0.1:58872","server-name":"","error":"write tcp 127.0.0.1:2379->127.0.0.1:58872: write: broken pipe"}
{"level":"warn","ts":"2024-06-14T20:52:02.119597Z","caller":"embed/config_logging.go:169","msg":"rejected connection","remote-addr":"127.0.0.1:58884","server-name":"","error":"write tcp 127.0.0.1:2379->127.0.0.1:58884: write: broken pipe"}
{"level":"warn","ts":"2024-06-14T20:52:02.122268Z","caller":"embed/config_logging.go:169","msg":"rejected connection","remote-addr":"127.0.0.1:58894","server-name":"","error":"write tcp 127.0.0.1:2379->127.0.0.1:58894: write: broken pipe"}
==> kernel <==
20:58:08 up 27 min, 0 users, load average: 0.08, 0.16, 0.20
Linux ha-590347 5.10.207 #1 SMP Tue Jun 11 00:16:05 UTC 2024 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2023.02.9"
==> kindnet [489c0113cf348c2fd3db81c511291ad8068889ee7f8129da37dd6a073e2063b2] <==
I0614 20:57:21.088794 1 main.go:250] Node ha-590347-m04 has CIDR [10.244.3.0/24]
I0614 20:57:31.101650 1 main.go:223] Handling node with IPs: map[192.168.39.58:{}]
I0614 20:57:31.101726 1 main.go:227] handling current node
I0614 20:57:31.101737 1 main.go:223] Handling node with IPs: map[192.168.39.161:{}]
I0614 20:57:31.101742 1 main.go:250] Node ha-590347-m02 has CIDR [10.244.1.0/24]
I0614 20:57:31.101892 1 main.go:223] Handling node with IPs: map[192.168.39.71:{}]
I0614 20:57:31.101984 1 main.go:250] Node ha-590347-m04 has CIDR [10.244.3.0/24]
I0614 20:57:41.116539 1 main.go:223] Handling node with IPs: map[192.168.39.58:{}]
I0614 20:57:41.116680 1 main.go:227] handling current node
I0614 20:57:41.116712 1 main.go:223] Handling node with IPs: map[192.168.39.161:{}]
I0614 20:57:41.116729 1 main.go:250] Node ha-590347-m02 has CIDR [10.244.1.0/24]
I0614 20:57:41.116895 1 main.go:223] Handling node with IPs: map[192.168.39.71:{}]
I0614 20:57:41.116995 1 main.go:250] Node ha-590347-m04 has CIDR [10.244.3.0/24]
I0614 20:57:51.123490 1 main.go:223] Handling node with IPs: map[192.168.39.58:{}]
I0614 20:57:51.123535 1 main.go:227] handling current node
I0614 20:57:51.123555 1 main.go:223] Handling node with IPs: map[192.168.39.161:{}]
I0614 20:57:51.123560 1 main.go:250] Node ha-590347-m02 has CIDR [10.244.1.0/24]
I0614 20:57:51.123719 1 main.go:223] Handling node with IPs: map[192.168.39.71:{}]
I0614 20:57:51.123740 1 main.go:250] Node ha-590347-m04 has CIDR [10.244.3.0/24]
I0614 20:58:01.135231 1 main.go:223] Handling node with IPs: map[192.168.39.58:{}]
I0614 20:58:01.135291 1 main.go:227] handling current node
I0614 20:58:01.135315 1 main.go:223] Handling node with IPs: map[192.168.39.161:{}]
I0614 20:58:01.135322 1 main.go:250] Node ha-590347-m02 has CIDR [10.244.1.0/24]
I0614 20:58:01.135468 1 main.go:223] Handling node with IPs: map[192.168.39.71:{}]
I0614 20:58:01.135495 1 main.go:250] Node ha-590347-m04 has CIDR [10.244.3.0/24]
==> kindnet [826143e4f559535d523ee37cb59be6e1b84e9f6f75aecb76d2b5e20e4f1e84f1] <==
I0614 20:48:59.652615 1 main.go:150] noMask IPv4 subnets: [10.244.0.0/16]
I0614 20:48:59.873027 1 main.go:191] Failed to get nodes, retrying after error: Get "https://10.96.0.1:443/api/v1/nodes": dial tcp 10.96.0.1:443: connect: connection refused
I0614 20:49:09.873676 1 main.go:191] Failed to get nodes, retrying after error: Get "https://10.96.0.1:443/api/v1/nodes": net/http: TLS handshake timeout
I0614 20:49:10.874617 1 main.go:191] Failed to get nodes, retrying after error: Get "https://10.96.0.1:443/api/v1/nodes": dial tcp 10.96.0.1:443: connect: connection refused
I0614 20:49:12.875564 1 main.go:191] Failed to get nodes, retrying after error: Get "https://10.96.0.1:443/api/v1/nodes": dial tcp 10.96.0.1:443: connect: connection refused
I0614 20:49:15.877825 1 main.go:191] Failed to get nodes, retrying after error: Get "https://10.96.0.1:443/api/v1/nodes": dial tcp 10.96.0.1:443: connect: connection refused
panic: Reached maximum retries obtaining node list: Get "https://10.96.0.1:443/api/v1/nodes": dial tcp 10.96.0.1:443: connect: connection refused
goroutine 1 [running]:
main.main()
/go/src/cmd/kindnetd/main.go:195 +0xe3b
==> kube-apiserver [4fad0593a4a60a75e970a33b345baefaa70de47ee2b9d21609286c4a49e8cc86] <==
I0614 20:50:09.010384 1 options.go:221] external host was not specified, using 192.168.39.58
I0614 20:50:09.011327 1 server.go:148] Version: v1.30.1
I0614 20:50:09.011360 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0614 20:50:09.342590 1 shared_informer.go:313] Waiting for caches to sync for node_authorizer
I0614 20:50:09.344556 1 shared_informer.go:313] Waiting for caches to sync for *generic.policySource[*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicy,*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicyBinding,k8s.io/apiserver/pkg/admission/plugin/policy/validating.Validator]
I0614 20:50:09.345904 1 plugins.go:157] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.
I0614 20:50:09.346014 1 plugins.go:160] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota.
I0614 20:50:09.346181 1 instance.go:299] Using reconciler: lease
W0614 20:50:29.341538 1 logging.go:59] [core] [Channel #1 SubChannel #2] grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: authentication handshake failed: context canceled"
W0614 20:50:29.342437 1 logging.go:59] [core] [Channel #3 SubChannel #4] grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: authentication handshake failed: context deadline exceeded"
W0614 20:50:29.347105 1 logging.go:59] [core] [Channel #5 SubChannel #6] grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: authentication handshake failed: context deadline exceeded"
F0614 20:50:29.347115 1 instance.go:292] Error creating leases: error creating storage factory: context deadline exceeded
==> kube-apiserver [57d46e9f8df4c64f5f749ec31b3cad079a7bcd478174719bb2e0cdb82236f41b] <==
I0614 20:52:03.420273 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController
I0614 20:52:03.420359 1 crd_finalizer.go:266] Starting CRDFinalizer
I0614 20:52:03.508576 1 cache.go:39] Caches are synced for AvailableConditionController controller
I0614 20:52:03.510395 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I0614 20:52:03.541401 1 shared_informer.go:320] Caches are synced for configmaps
I0614 20:52:03.541557 1 shared_informer.go:320] Caches are synced for cluster_authentication_trust_controller
I0614 20:52:03.541622 1 apf_controller.go:379] Running API Priority and Fairness config worker
I0614 20:52:03.541646 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process
I0614 20:52:03.541807 1 shared_informer.go:320] Caches are synced for crd-autoregister
I0614 20:52:03.544223 1 handler_discovery.go:447] Starting ResourceDiscoveryManager
I0614 20:52:03.544344 1 aggregator.go:165] initial CRD sync complete...
I0614 20:52:03.544386 1 autoregister_controller.go:141] Starting autoregister controller
I0614 20:52:03.544395 1 cache.go:32] Waiting for caches to sync for autoregister controller
I0614 20:52:03.544403 1 cache.go:39] Caches are synced for autoregister controller
W0614 20:52:03.571996 1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.39.161]
I0614 20:52:03.588891 1 shared_informer.go:320] Caches are synced for node_authorizer
I0614 20:52:03.590612 1 shared_informer.go:320] Caches are synced for *generic.policySource[*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicy,*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicyBinding,k8s.io/apiserver/pkg/admission/plugin/policy/validating.Validator]
I0614 20:52:03.590706 1 policy_source.go:224] refreshing policies
I0614 20:52:03.652609 1 controller.go:615] quota admission added evaluator for: leases.coordination.k8s.io
I0614 20:52:03.674902 1 controller.go:615] quota admission added evaluator for: endpoints
I0614 20:52:03.683238 1 controller.go:615] quota admission added evaluator for: endpointslices.discovery.k8s.io
E0614 20:52:03.686744 1 controller.go:95] Found stale data, removed previous endpoints on kubernetes service, apiserver didn't exit successfully previously
I0614 20:52:04.417292 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
W0614 20:52:04.806059 1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.39.161 192.168.39.58]
W0614 20:52:24.811043 1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.39.58]
==> kube-controller-manager [6743f3d9185f1656db5f7ce3fdee03cba39b5644352ea310366574f7d895aa0c] <==
I0614 20:50:05.152059 1 serving.go:380] Generated self-signed cert in-memory
I0614 20:50:05.405312 1 controllermanager.go:189] "Starting" version="v1.30.1"
I0614 20:50:05.405353 1 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0614 20:50:05.406905 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/var/lib/minikube/certs/front-proxy-ca.crt"
I0614 20:50:05.407183 1 secure_serving.go:213] Serving securely on 127.0.0.1:10257
I0614 20:50:05.407276 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"
I0614 20:50:05.407486 1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
E0614 20:50:30.352180 1 controllermanager.go:234] "Error building controller context" err="failed to wait for apiserver being healthy: timed out waiting for the condition: failed to get apiserver /healthz status: Get \"https://192.168.39.58:8443/healthz\": dial tcp 192.168.39.58:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.58:38792->192.168.39.58:8443: read: connection reset by peer"
==> kube-controller-manager [ff4164efa00d93fa8cae7dbd88a995c377cf954af5c40f7e73000425e8ae9730] <==
I0614 20:52:15.854476 1 shared_informer.go:320] Caches are synced for resource quota
I0614 20:52:15.863861 1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-590347"
I0614 20:52:15.864000 1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-590347-m04"
I0614 20:52:15.864048 1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-590347-m02"
I0614 20:52:15.864109 1 node_lifecycle_controller.go:1073] "Controller detected that zone is now in new state" logger="node-lifecycle-controller" zone="" newState="Normal"
I0614 20:52:15.874445 1 shared_informer.go:320] Caches are synced for namespace
I0614 20:52:15.888088 1 shared_informer.go:320] Caches are synced for stateful set
I0614 20:52:15.896491 1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="136.456524ms"
I0614 20:52:15.901792 1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="40.856µs"
I0614 20:52:15.942344 1 shared_informer.go:320] Caches are synced for service account
I0614 20:52:15.989382 1 shared_informer.go:320] Caches are synced for attach detach
I0614 20:52:16.426092 1 shared_informer.go:320] Caches are synced for garbage collector
I0614 20:52:16.426127 1 garbagecollector.go:157] "All resource monitors have synced. Proceeding to collect garbage" logger="garbage-collector-controller"
I0614 20:52:16.445579 1 shared_informer.go:320] Caches are synced for garbage collector
I0614 20:52:34.942400 1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="15.622307ms"
I0614 20:52:34.942503 1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="53.56µs"
I0614 20:52:38.206221 1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="60.359µs"
I0614 20:52:44.953318 1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="17.191896ms"
I0614 20:52:44.953490 1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="51.589µs"
I0614 20:57:15.959098 1 taint_eviction.go:113] "Deleting pod" logger="taint-eviction-controller" controller="taint-eviction-controller" pod="default/busybox-fc5497c4f-rt8pp"
I0614 20:57:15.977566 1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="58.929µs"
I0614 20:57:16.024098 1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="35.921649ms"
I0614 20:57:16.024533 1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="94.49µs"
I0614 20:57:16.045694 1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="20.056707ms"
I0614 20:57:16.046033 1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="146.083µs"
==> kube-proxy [3fba739a0c9e701b34877059fd1d343516d3f4f25ab42a9d5f7c4944d3e80ff2] <==
E0614 20:50:31.504516 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host
E0614 20:50:37.648023 1 event_broadcaster.go:279] "Unable to write event (may retry after sleeping)" err="Post \"https://control-plane.minikube.internal:8443/apis/events.k8s.io/v1/namespaces/default/events\": dial tcp 192.168.39.254:8443: connect: no route to host"
E0614 20:50:49.935418 1 event_broadcaster.go:279] "Unable to write event (may retry after sleeping)" err="Post \"https://control-plane.minikube.internal:8443/apis/events.k8s.io/v1/namespaces/default/events\": dial tcp 192.168.39.254:8443: connect: no route to host"
E0614 20:51:02.225279 1 event_broadcaster.go:279] "Unable to write event (may retry after sleeping)" err="Post \"https://control-plane.minikube.internal:8443/apis/events.k8s.io/v1/namespaces/default/events\": dial tcp 192.168.39.254:8443: connect: no route to host"
W0614 20:51:11.439886 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.EndpointSlice: Get "https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host
E0614 20:51:11.440475 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host
E0614 20:51:14.512180 1 event_broadcaster.go:279] "Unable to write event (may retry after sleeping)" err="Post \"https://control-plane.minikube.internal:8443/apis/events.k8s.io/v1/namespaces/default/events\": dial tcp 192.168.39.254:8443: connect: no route to host"
W0614 20:51:17.584487 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)ha-590347&limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host
E0614 20:51:17.584568 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)ha-590347&limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host
W0614 20:51:23.728068 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host
E0614 20:51:23.728311 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host
E0614 20:51:26.800020 1 event_broadcaster.go:279] "Unable to write event (may retry after sleeping)" err="Post \"https://control-plane.minikube.internal:8443/apis/events.k8s.io/v1/namespaces/default/events\": dial tcp 192.168.39.254:8443: connect: no route to host"
E0614 20:51:39.087460 1 event_broadcaster.go:279] "Unable to write event (may retry after sleeping)" err="Post \"https://control-plane.minikube.internal:8443/apis/events.k8s.io/v1/namespaces/default/events\": dial tcp 192.168.39.254:8443: connect: no route to host"
W0614 20:51:45.231688 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.EndpointSlice: Get "https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host
E0614 20:51:45.231861 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host
E0614 20:51:51.375356 1 event_broadcaster.go:279] "Unable to write event (may retry after sleeping)" err="Post \"https://control-plane.minikube.internal:8443/apis/events.k8s.io/v1/namespaces/default/events\": dial tcp 192.168.39.254:8443: connect: no route to host"
E0614 20:52:03.664427 1 event_broadcaster.go:279] "Unable to write event (may retry after sleeping)" err="Post \"https://control-plane.minikube.internal:8443/apis/events.k8s.io/v1/namespaces/default/events\": dial tcp 192.168.39.254:8443: connect: no route to host"
E0614 20:52:03.664660 1 event_broadcaster.go:216] "Unable to write event (retry limit exceeded!)" event="&Event{ObjectMeta:{ha-590347.17d8fa0adc0ccd8a default 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},EventTime:2024-06-14 20:49:42.390281857 +0000 UTC m=+42.800116477,Series:nil,ReportingController:kube-proxy,ReportingInstance:kube-proxy-ha-590347,Action:StartKubeProxy,Reason:Starting,Regarding:{Node ha-590347 ha-590347 },Related:nil,Note:,Type:Normal,DeprecatedSource:{ },DeprecatedFirstTimestamp:0001-01-01 00:00:00 +0000 UTC,DeprecatedLastTimestamp:0001-01-01 00:00:00 +0000 UTC,DeprecatedCount:0,}"
W0614 20:52:06.736190 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host
E0614 20:52:06.736467 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host
W0614 20:52:06.736750 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)ha-590347&limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host
E0614 20:52:06.736865 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)ha-590347&limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host
I0614 20:52:26.891612 1 shared_informer.go:320] Caches are synced for endpoint slice config
I0614 20:52:40.691745 1 shared_informer.go:320] Caches are synced for node config
I0614 20:52:41.590902 1 shared_informer.go:320] Caches are synced for service config
==> kube-proxy [512f658ebb61c7bb855ea0c39f15481bcad9e332f43ff5bb32e92ca76ad8c205] <==
I0614 20:42:10.532146 1 server_linux.go:69] "Using iptables proxy"
E0614 20:42:12.943530 1 server.go:1051] "Failed to retrieve node info" err="Get \"https://control-plane.minikube.internal:8443/api/v1/nodes/ha-590347\": dial tcp 192.168.39.254:8443: connect: no route to host"
E0614 20:42:16.015370 1 server.go:1051] "Failed to retrieve node info" err="Get \"https://control-plane.minikube.internal:8443/api/v1/nodes/ha-590347\": dial tcp 192.168.39.254:8443: connect: no route to host"
E0614 20:42:19.088203 1 server.go:1051] "Failed to retrieve node info" err="Get \"https://control-plane.minikube.internal:8443/api/v1/nodes/ha-590347\": dial tcp 192.168.39.254:8443: connect: no route to host"
E0614 20:42:25.233355 1 server.go:1051] "Failed to retrieve node info" err="Get \"https://control-plane.minikube.internal:8443/api/v1/nodes/ha-590347\": dial tcp 192.168.39.254:8443: connect: no route to host"
E0614 20:42:34.448290 1 server.go:1051] "Failed to retrieve node info" err="Get \"https://control-plane.minikube.internal:8443/api/v1/nodes/ha-590347\": dial tcp 192.168.39.254:8443: connect: no route to host"
I0614 20:42:50.864904 1 server.go:1062] "Successfully retrieved node IP(s)" IPs=["192.168.39.58"]
I0614 20:42:50.911385 1 server_linux.go:143] "No iptables support for family" ipFamily="IPv6"
I0614 20:42:50.911499 1 server.go:661] "kube-proxy running in single-stack mode" ipFamily="IPv4"
I0614 20:42:50.911520 1 server_linux.go:165] "Using iptables Proxier"
I0614 20:42:50.916905 1 proxier.go:243] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I0614 20:42:50.917495 1 server.go:872] "Version info" version="v1.30.1"
I0614 20:42:50.917535 1 server.go:874] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0614 20:42:50.919826 1 config.go:192] "Starting service config controller"
I0614 20:42:50.919902 1 shared_informer.go:313] Waiting for caches to sync for service config
I0614 20:42:50.921273 1 config.go:101] "Starting endpoint slice config controller"
I0614 20:42:50.921346 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0614 20:42:50.923222 1 config.go:319] "Starting node config controller"
I0614 20:42:50.923261 1 shared_informer.go:313] Waiting for caches to sync for node config
I0614 20:42:51.021003 1 shared_informer.go:320] Caches are synced for service config
I0614 20:42:51.022308 1 shared_informer.go:320] Caches are synced for endpoint slice config
I0614 20:42:51.023636 1 shared_informer.go:320] Caches are synced for node config
==> kube-scheduler [1eee7f7fcc163b3f63070d55b0309f33e2a1d6b0bc0d3244641ae78ad4a74a8b] <==
W0614 20:51:26.309405 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: Get "https://192.168.39.58:8443/apis/apps/v1/replicasets?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
E0614 20:51:26.309488 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: Get "https://192.168.39.58:8443/apis/apps/v1/replicasets?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
W0614 20:51:26.775617 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://192.168.39.58:8443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
E0614 20:51:26.775701 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get "https://192.168.39.58:8443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
W0614 20:51:35.487466 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: Get "https://192.168.39.58:8443/api/v1/replicationcontrollers?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
E0614 20:51:35.487599 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: Get "https://192.168.39.58:8443/api/v1/replicationcontrollers?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
W0614 20:51:36.325589 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://192.168.39.58:8443/api/v1/services?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
E0614 20:51:36.325681 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://192.168.39.58:8443/api/v1/services?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
W0614 20:51:42.169389 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: Get "https://192.168.39.58:8443/api/v1/persistentvolumeclaims?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
E0614 20:51:42.169457 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: Get "https://192.168.39.58:8443/api/v1/persistentvolumeclaims?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
W0614 20:51:45.111188 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: Get "https://192.168.39.58:8443/apis/apps/v1/statefulsets?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
E0614 20:51:45.111330 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: Get "https://192.168.39.58:8443/apis/apps/v1/statefulsets?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
W0614 20:51:45.603918 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: Get "https://192.168.39.58:8443/apis/storage.k8s.io/v1/csinodes?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
E0614 20:51:45.604018 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: Get "https://192.168.39.58:8443/apis/storage.k8s.io/v1/csinodes?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
W0614 20:51:53.320338 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: Get "https://192.168.39.58:8443/api/v1/nodes?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
E0614 20:51:53.320478 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://192.168.39.58:8443/api/v1/nodes?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
W0614 20:52:03.452737 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0614 20:52:03.452917 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
W0614 20:52:03.453216 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0614 20:52:03.453292 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
W0614 20:52:03.453434 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0614 20:52:03.453496 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
W0614 20:52:03.453602 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0614 20:52:03.453651 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
I0614 20:52:08.901115 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [b7ba582fd7f20fdfc839479c2b3658f492d631c33d6b9451b78d3269d6f150f8] <==
E0614 20:42:48.293342 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://192.168.39.58:8443/api/v1/services?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
W0614 20:42:48.818662 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: Get "https://192.168.39.58:8443/api/v1/replicationcontrollers?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
E0614 20:42:48.818776 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: Get "https://192.168.39.58:8443/api/v1/replicationcontrollers?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
W0614 20:42:49.300719 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: Get "https://192.168.39.58:8443/api/v1/persistentvolumeclaims?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
E0614 20:42:49.300830 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: Get "https://192.168.39.58:8443/api/v1/persistentvolumeclaims?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
W0614 20:42:50.318620 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: Get "https://192.168.39.58:8443/apis/policy/v1/poddisruptionbudgets?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
E0614 20:42:50.318724 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: Get "https://192.168.39.58:8443/apis/policy/v1/poddisruptionbudgets?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
W0614 20:42:50.782670 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://192.168.39.58:8443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
E0614 20:42:50.782779 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get "https://192.168.39.58:8443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
W0614 20:42:50.839255 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: Get "https://192.168.39.58:8443/api/v1/persistentvolumes?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
E0614 20:42:50.839396 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: Get "https://192.168.39.58:8443/api/v1/persistentvolumes?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
W0614 20:42:50.927364 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: Get "https://192.168.39.58:8443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
E0614 20:42:50.927457 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://192.168.39.58:8443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
W0614 20:42:50.943786 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: Get "https://192.168.39.58:8443/api/v1/nodes?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
E0614 20:42:50.943853 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://192.168.39.58:8443/api/v1/nodes?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
W0614 20:42:51.751071 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: Get "https://192.168.39.58:8443/apis/storage.k8s.io/v1/csistoragecapacities?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
E0614 20:42:51.751143 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: Get "https://192.168.39.58:8443/apis/storage.k8s.io/v1/csistoragecapacities?limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
W0614 20:42:51.998037 1 reflector.go:547] runtime/asm_amd64.s:1695: failed to list *v1.ConfigMap: Get "https://192.168.39.58:8443/api/v1/namespaces/kube-system/configmaps?fieldSelector=metadata.name%!D(MISSING)extension-apiserver-authentication&limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
E0614 20:42:51.998161 1 reflector.go:150] runtime/asm_amd64.s:1695: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: Get "https://192.168.39.58:8443/api/v1/namespaces/kube-system/configmaps?fieldSelector=metadata.name%!D(MISSING)extension-apiserver-authentication&limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
W0614 20:42:52.204173 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: Get "https://192.168.39.58:8443/api/v1/pods?fieldSelector=status.phase%3DSucceeded%!C(MISSING)status.phase%3DFailed&limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
E0614 20:42:52.204270 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: Get "https://192.168.39.58:8443/api/v1/pods?fieldSelector=status.phase%3DSucceeded%!C(MISSING)status.phase%3DFailed&limit=500&resourceVersion=0": dial tcp 192.168.39.58:8443: connect: connection refused
I0614 20:43:09.632015 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0614 20:47:11.948766 1 secure_serving.go:258] Stopped listening on 127.0.0.1:10259
I0614 20:47:11.948908 1 tlsconfig.go:255] "Shutting down DynamicServingCertificateController"
E0614 20:47:11.949117 1 run.go:74] "command failed" err="finished without leader elect"
==> kubelet <==
Jun 14 20:55:24 ha-590347 kubelet[1362]: I0614 20:55:24.835407 1362 scope.go:117] "RemoveContainer" containerID="258f0013a53c0c104aab676912e938c829e322786e96757ccc78501a8f8c2100"
Jun 14 20:55:24 ha-590347 kubelet[1362]: E0614 20:55:24.835963 1362 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"storage-provisioner\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(1b75c63e-e65e-49b9-9c91-67031efc4821)\"" pod="kube-system/storage-provisioner" podUID="1b75c63e-e65e-49b9-9c91-67031efc4821"
Jun 14 20:55:39 ha-590347 kubelet[1362]: I0614 20:55:39.835359 1362 scope.go:117] "RemoveContainer" containerID="258f0013a53c0c104aab676912e938c829e322786e96757ccc78501a8f8c2100"
Jun 14 20:55:39 ha-590347 kubelet[1362]: E0614 20:55:39.836308 1362 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"storage-provisioner\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(1b75c63e-e65e-49b9-9c91-67031efc4821)\"" pod="kube-system/storage-provisioner" podUID="1b75c63e-e65e-49b9-9c91-67031efc4821"
Jun 14 20:55:50 ha-590347 kubelet[1362]: I0614 20:55:50.835371 1362 scope.go:117] "RemoveContainer" containerID="258f0013a53c0c104aab676912e938c829e322786e96757ccc78501a8f8c2100"
Jun 14 20:55:50 ha-590347 kubelet[1362]: E0614 20:55:50.835579 1362 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"storage-provisioner\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(1b75c63e-e65e-49b9-9c91-67031efc4821)\"" pod="kube-system/storage-provisioner" podUID="1b75c63e-e65e-49b9-9c91-67031efc4821"
Jun 14 20:56:04 ha-590347 kubelet[1362]: I0614 20:56:04.835469 1362 scope.go:117] "RemoveContainer" containerID="258f0013a53c0c104aab676912e938c829e322786e96757ccc78501a8f8c2100"
Jun 14 20:56:04 ha-590347 kubelet[1362]: E0614 20:56:04.836124 1362 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"storage-provisioner\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(1b75c63e-e65e-49b9-9c91-67031efc4821)\"" pod="kube-system/storage-provisioner" podUID="1b75c63e-e65e-49b9-9c91-67031efc4821"
Jun 14 20:56:15 ha-590347 kubelet[1362]: E0614 20:56:15.871713 1362 iptables.go:577] "Could not set up iptables canary" err=<
Jun 14 20:56:15 ha-590347 kubelet[1362]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.
Jun 14 20:56:15 ha-590347 kubelet[1362]: ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Jun 14 20:56:15 ha-590347 kubelet[1362]: Perhaps ip6tables or your kernel needs to be upgraded.
Jun 14 20:56:15 ha-590347 kubelet[1362]: > table="nat" chain="KUBE-KUBELET-CANARY"
Jun 14 20:56:16 ha-590347 kubelet[1362]: I0614 20:56:16.835557 1362 scope.go:117] "RemoveContainer" containerID="258f0013a53c0c104aab676912e938c829e322786e96757ccc78501a8f8c2100"
Jun 14 20:56:16 ha-590347 kubelet[1362]: E0614 20:56:16.835836 1362 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"storage-provisioner\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(1b75c63e-e65e-49b9-9c91-67031efc4821)\"" pod="kube-system/storage-provisioner" podUID="1b75c63e-e65e-49b9-9c91-67031efc4821"
Jun 14 20:56:30 ha-590347 kubelet[1362]: I0614 20:56:30.835061 1362 scope.go:117] "RemoveContainer" containerID="258f0013a53c0c104aab676912e938c829e322786e96757ccc78501a8f8c2100"
Jun 14 20:56:30 ha-590347 kubelet[1362]: E0614 20:56:30.835835 1362 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"storage-provisioner\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(1b75c63e-e65e-49b9-9c91-67031efc4821)\"" pod="kube-system/storage-provisioner" podUID="1b75c63e-e65e-49b9-9c91-67031efc4821"
Jun 14 20:56:41 ha-590347 kubelet[1362]: I0614 20:56:41.835031 1362 scope.go:117] "RemoveContainer" containerID="258f0013a53c0c104aab676912e938c829e322786e96757ccc78501a8f8c2100"
Jun 14 20:56:41 ha-590347 kubelet[1362]: E0614 20:56:41.835309 1362 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"storage-provisioner\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(1b75c63e-e65e-49b9-9c91-67031efc4821)\"" pod="kube-system/storage-provisioner" podUID="1b75c63e-e65e-49b9-9c91-67031efc4821"
Jun 14 20:56:53 ha-590347 kubelet[1362]: I0614 20:56:53.835155 1362 scope.go:117] "RemoveContainer" containerID="258f0013a53c0c104aab676912e938c829e322786e96757ccc78501a8f8c2100"
Jun 14 20:57:15 ha-590347 kubelet[1362]: E0614 20:57:15.874609 1362 iptables.go:577] "Could not set up iptables canary" err=<
Jun 14 20:57:15 ha-590347 kubelet[1362]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.
Jun 14 20:57:15 ha-590347 kubelet[1362]: ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Jun 14 20:57:15 ha-590347 kubelet[1362]: Perhaps ip6tables or your kernel needs to be upgraded.
Jun 14 20:57:15 ha-590347 kubelet[1362]: > table="nat" chain="KUBE-KUBELET-CANARY"
-- /stdout --
** stderr **
E0614 20:58:07.777451 44291 logs.go:258] failed to output last start logs: failed to read file /home/jenkins/minikube-integration/19068-14811/.minikube/logs/lastStart.txt: bufio.Scanner: token too long
** /stderr **
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-590347 -n ha-590347
helpers_test.go:261: (dbg) Run: kubectl --context ha-590347 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: busybox-fc5497c4f-t2wnd
helpers_test.go:274: ======> post-mortem[TestMultiControlPlane/serial/DegradedAfterClusterRestart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context ha-590347 describe pod busybox-fc5497c4f-t2wnd
helpers_test.go:282: (dbg) kubectl --context ha-590347 describe pod busybox-fc5497c4f-t2wnd:
-- stdout --
Name: busybox-fc5497c4f-t2wnd
Namespace: default
Priority: 0
Service Account: default
Node: <none>
Labels: app=busybox
pod-template-hash=fc5497c4f
Annotations: <none>
Status: Pending
IP:
IPs: <none>
Controlled By: ReplicaSet/busybox-fc5497c4f
Containers:
busybox:
Image: gcr.io/k8s-minikube/busybox:1.28
Port: <none>
Host Port: <none>
Command:
sleep
3600
Environment: <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-7mnrt (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
kube-api-access-7mnrt:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling 53s default-scheduler 0/3 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/unreachable: }, 2 node(s) didn't match pod anti-affinity rules. preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.
-- /stdout --
helpers_test.go:285: <<< TestMultiControlPlane/serial/DegradedAfterClusterRestart FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestMultiControlPlane/serial/DegradedAfterClusterRestart (2.57s)