=== RUN TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress
=== CONT TestAddons/parallel/Ingress
addons_test.go:207: (dbg) Run: kubectl --context addons-357468 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:232: (dbg) Run: kubectl --context addons-357468 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:245: (dbg) Run: kubectl --context addons-357468 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:250: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [87f5b89f-50aa-4374-b4de-f14b987a8435] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [87f5b89f-50aa-4374-b4de-f14b987a8435] Running
addons_test.go:250: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 18.004486602s
I0401 19:50:10.636092 16301 kapi.go:150] Service nginx in namespace default found.
addons_test.go:262: (dbg) Run: out/minikube-linux-amd64 -p addons-357468 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:262: (dbg) Non-zero exit: out/minikube-linux-amd64 -p addons-357468 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'": exit status 1 (2m10.256464121s)
** stderr **
ssh: Process exited with status 28
** /stderr **
addons_test.go:278: failed to get expected response from http://127.0.0.1/ within minikube: exit status 1
addons_test.go:286: (dbg) Run: kubectl --context addons-357468 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:291: (dbg) Run: out/minikube-linux-amd64 -p addons-357468 ip
addons_test.go:297: (dbg) Run: nslookup hello-john.test 192.168.39.65
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p addons-357468 -n addons-357468
helpers_test.go:244: <<< TestAddons/parallel/Ingress FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/parallel/Ingress]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p addons-357468 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p addons-357468 logs -n 25: (1.284252775s)
helpers_test.go:252: TestAddons/parallel/Ingress logs:
-- stdout --
==> Audit <==
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| delete | -p download-only-774044 | download-only-774044 | jenkins | v1.35.0 | 01 Apr 25 19:45 UTC | 01 Apr 25 19:45 UTC |
| delete | -p download-only-944346 | download-only-944346 | jenkins | v1.35.0 | 01 Apr 25 19:45 UTC | 01 Apr 25 19:45 UTC |
| delete | -p download-only-774044 | download-only-774044 | jenkins | v1.35.0 | 01 Apr 25 19:45 UTC | 01 Apr 25 19:45 UTC |
| start | --download-only -p | binary-mirror-856518 | jenkins | v1.35.0 | 01 Apr 25 19:45 UTC | |
| | binary-mirror-856518 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:41083 | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| delete | -p binary-mirror-856518 | binary-mirror-856518 | jenkins | v1.35.0 | 01 Apr 25 19:45 UTC | 01 Apr 25 19:45 UTC |
| addons | enable dashboard -p | addons-357468 | jenkins | v1.35.0 | 01 Apr 25 19:45 UTC | |
| | addons-357468 | | | | | |
| addons | disable dashboard -p | addons-357468 | jenkins | v1.35.0 | 01 Apr 25 19:45 UTC | |
| | addons-357468 | | | | | |
| start | -p addons-357468 --wait=true | addons-357468 | jenkins | v1.35.0 | 01 Apr 25 19:45 UTC | 01 Apr 25 19:49 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --addons=amd-gpu-device-plugin | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| addons | addons-357468 addons disable | addons-357468 | jenkins | v1.35.0 | 01 Apr 25 19:49 UTC | 01 Apr 25 19:49 UTC |
| | volcano --alsologtostderr -v=1 | | | | | |
| addons | addons-357468 addons disable | addons-357468 | jenkins | v1.35.0 | 01 Apr 25 19:49 UTC | 01 Apr 25 19:49 UTC |
| | gcp-auth --alsologtostderr | | | | | |
| | -v=1 | | | | | |
| addons | enable headlamp | addons-357468 | jenkins | v1.35.0 | 01 Apr 25 19:49 UTC | 01 Apr 25 19:49 UTC |
| | -p addons-357468 | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | addons-357468 addons | addons-357468 | jenkins | v1.35.0 | 01 Apr 25 19:49 UTC | 01 Apr 25 19:49 UTC |
| | disable metrics-server | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | addons-357468 addons | addons-357468 | jenkins | v1.35.0 | 01 Apr 25 19:49 UTC | 01 Apr 25 19:49 UTC |
| | disable nvidia-device-plugin | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | addons-357468 addons disable | addons-357468 | jenkins | v1.35.0 | 01 Apr 25 19:49 UTC | 01 Apr 25 19:49 UTC |
| | yakd --alsologtostderr -v=1 | | | | | |
| addons | addons-357468 addons disable | addons-357468 | jenkins | v1.35.0 | 01 Apr 25 19:49 UTC | 01 Apr 25 19:49 UTC |
| | headlamp --alsologtostderr | | | | | |
| | -v=1 | | | | | |
| ip | addons-357468 ip | addons-357468 | jenkins | v1.35.0 | 01 Apr 25 19:49 UTC | 01 Apr 25 19:49 UTC |
| addons | addons-357468 addons disable | addons-357468 | jenkins | v1.35.0 | 01 Apr 25 19:49 UTC | 01 Apr 25 19:49 UTC |
| | registry --alsologtostderr | | | | | |
| | -v=1 | | | | | |
| addons | addons-357468 addons | addons-357468 | jenkins | v1.35.0 | 01 Apr 25 19:49 UTC | 01 Apr 25 19:49 UTC |
| | disable cloud-spanner | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | addons-357468 addons | addons-357468 | jenkins | v1.35.0 | 01 Apr 25 19:49 UTC | 01 Apr 25 19:50 UTC |
| | disable inspektor-gadget | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| ssh | addons-357468 ssh cat | addons-357468 | jenkins | v1.35.0 | 01 Apr 25 19:50 UTC | 01 Apr 25 19:50 UTC |
| | /opt/local-path-provisioner/pvc-0afaf634-c3c1-425b-9181-27260ba53259_default_test-pvc/file1 | | | | | |
| addons | addons-357468 addons disable | addons-357468 | jenkins | v1.35.0 | 01 Apr 25 19:50 UTC | 01 Apr 25 19:50 UTC |
| | storage-provisioner-rancher | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| ssh | addons-357468 ssh curl -s | addons-357468 | jenkins | v1.35.0 | 01 Apr 25 19:50 UTC | |
| | http://127.0.0.1/ -H 'Host: | | | | | |
| | nginx.example.com' | | | | | |
| addons | addons-357468 addons | addons-357468 | jenkins | v1.35.0 | 01 Apr 25 19:50 UTC | 01 Apr 25 19:50 UTC |
| | disable volumesnapshots | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | addons-357468 addons | addons-357468 | jenkins | v1.35.0 | 01 Apr 25 19:50 UTC | 01 Apr 25 19:50 UTC |
| | disable csi-hostpath-driver | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| ip | addons-357468 ip | addons-357468 | jenkins | v1.35.0 | 01 Apr 25 19:52 UTC | 01 Apr 25 19:52 UTC |
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2025/04/01 19:45:41
Running on machine: ubuntu-20-agent-11
Binary: Built with gc go1.24.0 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0401 19:45:41.909987 16998 out.go:345] Setting OutFile to fd 1 ...
I0401 19:45:41.910088 16998 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0401 19:45:41.910093 16998 out.go:358] Setting ErrFile to fd 2...
I0401 19:45:41.910099 16998 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0401 19:45:41.910286 16998 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20506-9129/.minikube/bin
I0401 19:45:41.910885 16998 out.go:352] Setting JSON to false
I0401 19:45:41.911646 16998 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-11","uptime":1686,"bootTime":1743535056,"procs":171,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1078-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0401 19:45:41.911699 16998 start.go:139] virtualization: kvm guest
I0401 19:45:41.913636 16998 out.go:177] * [addons-357468] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0401 19:45:41.915110 16998 out.go:177] - MINIKUBE_LOCATION=20506
I0401 19:45:41.915121 16998 notify.go:220] Checking for updates...
I0401 19:45:41.917786 16998 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0401 19:45:41.919745 16998 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20506-9129/kubeconfig
I0401 19:45:41.921014 16998 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20506-9129/.minikube
I0401 19:45:41.922178 16998 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0401 19:45:41.923356 16998 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0401 19:45:41.924638 16998 driver.go:394] Setting default libvirt URI to qemu:///system
I0401 19:45:41.956003 16998 out.go:177] * Using the kvm2 driver based on user configuration
I0401 19:45:41.957404 16998 start.go:297] selected driver: kvm2
I0401 19:45:41.957424 16998 start.go:901] validating driver "kvm2" against <nil>
I0401 19:45:41.957438 16998 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0401 19:45:41.958139 16998 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0401 19:45:41.958245 16998 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20506-9129/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0401 19:45:41.973196 16998 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.35.0
I0401 19:45:41.973261 16998 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0401 19:45:41.973557 16998 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0401 19:45:41.973598 16998 cni.go:84] Creating CNI manager for ""
I0401 19:45:41.973651 16998 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0401 19:45:41.973659 16998 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0401 19:45:41.973723 16998 start.go:340] cluster config:
{Name:addons-357468 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.2 ClusterName:addons-357468 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:c
rio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.32.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAg
entPID:0 GPUs: AutoPauseInterval:1m0s}
I0401 19:45:41.973837 16998 iso.go:125] acquiring lock: {Name:mkb4d16c66b9a96e560351dc0c0ad5272b583791 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0401 19:45:41.975750 16998 out.go:177] * Starting "addons-357468" primary control-plane node in "addons-357468" cluster
I0401 19:45:41.976922 16998 preload.go:131] Checking if preload exists for k8s version v1.32.2 and runtime crio
I0401 19:45:41.976968 16998 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20506-9129/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.32.2-cri-o-overlay-amd64.tar.lz4
I0401 19:45:41.976981 16998 cache.go:56] Caching tarball of preloaded images
I0401 19:45:41.977080 16998 preload.go:172] Found /home/jenkins/minikube-integration/20506-9129/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.32.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0401 19:45:41.977092 16998 cache.go:59] Finished verifying existence of preloaded tar for v1.32.2 on crio
I0401 19:45:41.977398 16998 profile.go:143] Saving config to /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/config.json ...
I0401 19:45:41.977421 16998 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/config.json: {Name:mkd18620016566f2989e07932c3fbccb92721f65 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 19:45:41.977608 16998 start.go:360] acquireMachinesLock for addons-357468: {Name:mk0a84ef580ee5c540e424c8d0c10ea2dd8b59a9 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0401 19:45:41.977677 16998 start.go:364] duration metric: took 48.957µs to acquireMachinesLock for "addons-357468"
I0401 19:45:41.977697 16998 start.go:93] Provisioning new machine with config: &{Name:addons-357468 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.2 ClusterNa
me:addons-357468 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.32.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker Bi
naryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.32.2 ContainerRuntime:crio ControlPlane:true Worker:true}
I0401 19:45:41.977769 16998 start.go:125] createHost starting for "" (driver="kvm2")
I0401 19:45:41.979968 16998 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
I0401 19:45:41.980096 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:45:41.980149 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:45:41.994389 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35193
I0401 19:45:41.994852 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:45:41.995314 16998 main.go:141] libmachine: Using API Version 1
I0401 19:45:41.995339 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:45:41.995723 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:45:41.995889 16998 main.go:141] libmachine: (addons-357468) Calling .GetMachineName
I0401 19:45:41.996050 16998 main.go:141] libmachine: (addons-357468) Calling .DriverName
I0401 19:45:41.996186 16998 start.go:159] libmachine.API.Create for "addons-357468" (driver="kvm2")
I0401 19:45:41.996220 16998 client.go:168] LocalClient.Create starting
I0401 19:45:41.996263 16998 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/20506-9129/.minikube/certs/ca.pem
I0401 19:45:42.125590 16998 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/20506-9129/.minikube/certs/cert.pem
I0401 19:45:42.444031 16998 main.go:141] libmachine: Running pre-create checks...
I0401 19:45:42.444057 16998 main.go:141] libmachine: (addons-357468) Calling .PreCreateCheck
I0401 19:45:42.444598 16998 main.go:141] libmachine: (addons-357468) Calling .GetConfigRaw
I0401 19:45:42.445017 16998 main.go:141] libmachine: Creating machine...
I0401 19:45:42.445032 16998 main.go:141] libmachine: (addons-357468) Calling .Create
I0401 19:45:42.445175 16998 main.go:141] libmachine: (addons-357468) creating KVM machine...
I0401 19:45:42.445187 16998 main.go:141] libmachine: (addons-357468) creating network...
I0401 19:45:42.446602 16998 main.go:141] libmachine: (addons-357468) DBG | found existing default KVM network
I0401 19:45:42.447371 16998 main.go:141] libmachine: (addons-357468) DBG | I0401 19:45:42.447192 17021 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000123560}
I0401 19:45:42.447410 16998 main.go:141] libmachine: (addons-357468) DBG | created network xml:
I0401 19:45:42.447428 16998 main.go:141] libmachine: (addons-357468) DBG | <network>
I0401 19:45:42.447435 16998 main.go:141] libmachine: (addons-357468) DBG | <name>mk-addons-357468</name>
I0401 19:45:42.447445 16998 main.go:141] libmachine: (addons-357468) DBG | <dns enable='no'/>
I0401 19:45:42.447456 16998 main.go:141] libmachine: (addons-357468) DBG |
I0401 19:45:42.447468 16998 main.go:141] libmachine: (addons-357468) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0401 19:45:42.447479 16998 main.go:141] libmachine: (addons-357468) DBG | <dhcp>
I0401 19:45:42.447488 16998 main.go:141] libmachine: (addons-357468) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0401 19:45:42.447494 16998 main.go:141] libmachine: (addons-357468) DBG | </dhcp>
I0401 19:45:42.447498 16998 main.go:141] libmachine: (addons-357468) DBG | </ip>
I0401 19:45:42.447512 16998 main.go:141] libmachine: (addons-357468) DBG |
I0401 19:45:42.447531 16998 main.go:141] libmachine: (addons-357468) DBG | </network>
I0401 19:45:42.447554 16998 main.go:141] libmachine: (addons-357468) DBG |
I0401 19:45:42.452904 16998 main.go:141] libmachine: (addons-357468) DBG | trying to create private KVM network mk-addons-357468 192.168.39.0/24...
I0401 19:45:42.514487 16998 main.go:141] libmachine: (addons-357468) DBG | private KVM network mk-addons-357468 192.168.39.0/24 created
I0401 19:45:42.514534 16998 main.go:141] libmachine: (addons-357468) DBG | I0401 19:45:42.514409 17021 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20506-9129/.minikube
I0401 19:45:42.514548 16998 main.go:141] libmachine: (addons-357468) setting up store path in /home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468 ...
I0401 19:45:42.514565 16998 main.go:141] libmachine: (addons-357468) building disk image from file:///home/jenkins/minikube-integration/20506-9129/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso
I0401 19:45:42.514588 16998 main.go:141] libmachine: (addons-357468) Downloading /home/jenkins/minikube-integration/20506-9129/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20506-9129/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso...
I0401 19:45:42.791225 16998 main.go:141] libmachine: (addons-357468) DBG | I0401 19:45:42.791107 17021 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468/id_rsa...
I0401 19:45:42.934775 16998 main.go:141] libmachine: (addons-357468) DBG | I0401 19:45:42.934560 17021 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468/addons-357468.rawdisk...
I0401 19:45:42.934812 16998 main.go:141] libmachine: (addons-357468) DBG | Writing magic tar header
I0401 19:45:42.934823 16998 main.go:141] libmachine: (addons-357468) setting executable bit set on /home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468 (perms=drwx------)
I0401 19:45:42.934837 16998 main.go:141] libmachine: (addons-357468) setting executable bit set on /home/jenkins/minikube-integration/20506-9129/.minikube/machines (perms=drwxr-xr-x)
I0401 19:45:42.934846 16998 main.go:141] libmachine: (addons-357468) setting executable bit set on /home/jenkins/minikube-integration/20506-9129/.minikube (perms=drwxr-xr-x)
I0401 19:45:42.934861 16998 main.go:141] libmachine: (addons-357468) setting executable bit set on /home/jenkins/minikube-integration/20506-9129 (perms=drwxrwxr-x)
I0401 19:45:42.934868 16998 main.go:141] libmachine: (addons-357468) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0401 19:45:42.934879 16998 main.go:141] libmachine: (addons-357468) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0401 19:45:42.934884 16998 main.go:141] libmachine: (addons-357468) creating domain...
I0401 19:45:42.934914 16998 main.go:141] libmachine: (addons-357468) DBG | Writing SSH key tar header
I0401 19:45:42.934946 16998 main.go:141] libmachine: (addons-357468) DBG | I0401 19:45:42.934669 17021 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468 ...
I0401 19:45:42.934976 16998 main.go:141] libmachine: (addons-357468) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468
I0401 19:45:42.934987 16998 main.go:141] libmachine: (addons-357468) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20506-9129/.minikube/machines
I0401 19:45:42.935000 16998 main.go:141] libmachine: (addons-357468) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20506-9129/.minikube
I0401 19:45:42.935014 16998 main.go:141] libmachine: (addons-357468) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20506-9129
I0401 19:45:42.935027 16998 main.go:141] libmachine: (addons-357468) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0401 19:45:42.935038 16998 main.go:141] libmachine: (addons-357468) DBG | checking permissions on dir: /home/jenkins
I0401 19:45:42.935049 16998 main.go:141] libmachine: (addons-357468) DBG | checking permissions on dir: /home
I0401 19:45:42.935060 16998 main.go:141] libmachine: (addons-357468) DBG | skipping /home - not owner
I0401 19:45:42.935847 16998 main.go:141] libmachine: (addons-357468) define libvirt domain using xml:
I0401 19:45:42.935874 16998 main.go:141] libmachine: (addons-357468) <domain type='kvm'>
I0401 19:45:42.935884 16998 main.go:141] libmachine: (addons-357468) <name>addons-357468</name>
I0401 19:45:42.935893 16998 main.go:141] libmachine: (addons-357468) <memory unit='MiB'>4000</memory>
I0401 19:45:42.935904 16998 main.go:141] libmachine: (addons-357468) <vcpu>2</vcpu>
I0401 19:45:42.935913 16998 main.go:141] libmachine: (addons-357468) <features>
I0401 19:45:42.935924 16998 main.go:141] libmachine: (addons-357468) <acpi/>
I0401 19:45:42.935932 16998 main.go:141] libmachine: (addons-357468) <apic/>
I0401 19:45:42.935943 16998 main.go:141] libmachine: (addons-357468) <pae/>
I0401 19:45:42.935957 16998 main.go:141] libmachine: (addons-357468)
I0401 19:45:42.935968 16998 main.go:141] libmachine: (addons-357468) </features>
I0401 19:45:42.935975 16998 main.go:141] libmachine: (addons-357468) <cpu mode='host-passthrough'>
I0401 19:45:42.935998 16998 main.go:141] libmachine: (addons-357468)
I0401 19:45:42.936016 16998 main.go:141] libmachine: (addons-357468) </cpu>
I0401 19:45:42.936043 16998 main.go:141] libmachine: (addons-357468) <os>
I0401 19:45:42.936065 16998 main.go:141] libmachine: (addons-357468) <type>hvm</type>
I0401 19:45:42.936076 16998 main.go:141] libmachine: (addons-357468) <boot dev='cdrom'/>
I0401 19:45:42.936087 16998 main.go:141] libmachine: (addons-357468) <boot dev='hd'/>
I0401 19:45:42.936096 16998 main.go:141] libmachine: (addons-357468) <bootmenu enable='no'/>
I0401 19:45:42.936105 16998 main.go:141] libmachine: (addons-357468) </os>
I0401 19:45:42.936112 16998 main.go:141] libmachine: (addons-357468) <devices>
I0401 19:45:42.936123 16998 main.go:141] libmachine: (addons-357468) <disk type='file' device='cdrom'>
I0401 19:45:42.936138 16998 main.go:141] libmachine: (addons-357468) <source file='/home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468/boot2docker.iso'/>
I0401 19:45:42.936147 16998 main.go:141] libmachine: (addons-357468) <target dev='hdc' bus='scsi'/>
I0401 19:45:42.936155 16998 main.go:141] libmachine: (addons-357468) <readonly/>
I0401 19:45:42.936169 16998 main.go:141] libmachine: (addons-357468) </disk>
I0401 19:45:42.936181 16998 main.go:141] libmachine: (addons-357468) <disk type='file' device='disk'>
I0401 19:45:42.936191 16998 main.go:141] libmachine: (addons-357468) <driver name='qemu' type='raw' cache='default' io='threads' />
I0401 19:45:42.936206 16998 main.go:141] libmachine: (addons-357468) <source file='/home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468/addons-357468.rawdisk'/>
I0401 19:45:42.936216 16998 main.go:141] libmachine: (addons-357468) <target dev='hda' bus='virtio'/>
I0401 19:45:42.936226 16998 main.go:141] libmachine: (addons-357468) </disk>
I0401 19:45:42.936231 16998 main.go:141] libmachine: (addons-357468) <interface type='network'>
I0401 19:45:42.936253 16998 main.go:141] libmachine: (addons-357468) <source network='mk-addons-357468'/>
I0401 19:45:42.936268 16998 main.go:141] libmachine: (addons-357468) <model type='virtio'/>
I0401 19:45:42.936276 16998 main.go:141] libmachine: (addons-357468) </interface>
I0401 19:45:42.936290 16998 main.go:141] libmachine: (addons-357468) <interface type='network'>
I0401 19:45:42.936307 16998 main.go:141] libmachine: (addons-357468) <source network='default'/>
I0401 19:45:42.936325 16998 main.go:141] libmachine: (addons-357468) <model type='virtio'/>
I0401 19:45:42.936339 16998 main.go:141] libmachine: (addons-357468) </interface>
I0401 19:45:42.936353 16998 main.go:141] libmachine: (addons-357468) <serial type='pty'>
I0401 19:45:42.936368 16998 main.go:141] libmachine: (addons-357468) <target port='0'/>
I0401 19:45:42.936377 16998 main.go:141] libmachine: (addons-357468) </serial>
I0401 19:45:42.936391 16998 main.go:141] libmachine: (addons-357468) <console type='pty'>
I0401 19:45:42.936402 16998 main.go:141] libmachine: (addons-357468) <target type='serial' port='0'/>
I0401 19:45:42.936413 16998 main.go:141] libmachine: (addons-357468) </console>
I0401 19:45:42.936423 16998 main.go:141] libmachine: (addons-357468) <rng model='virtio'>
I0401 19:45:42.936433 16998 main.go:141] libmachine: (addons-357468) <backend model='random'>/dev/random</backend>
I0401 19:45:42.936446 16998 main.go:141] libmachine: (addons-357468) </rng>
I0401 19:45:42.936462 16998 main.go:141] libmachine: (addons-357468)
I0401 19:45:42.936479 16998 main.go:141] libmachine: (addons-357468)
I0401 19:45:42.936499 16998 main.go:141] libmachine: (addons-357468) </devices>
I0401 19:45:42.936511 16998 main.go:141] libmachine: (addons-357468) </domain>
I0401 19:45:42.936520 16998 main.go:141] libmachine: (addons-357468)
I0401 19:45:42.942120 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:d8:ac:e9 in network default
I0401 19:45:42.942608 16998 main.go:141] libmachine: (addons-357468) starting domain...
I0401 19:45:42.942624 16998 main.go:141] libmachine: (addons-357468) ensuring networks are active...
I0401 19:45:42.942631 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:45:42.943169 16998 main.go:141] libmachine: (addons-357468) Ensuring network default is active
I0401 19:45:42.943530 16998 main.go:141] libmachine: (addons-357468) Ensuring network mk-addons-357468 is active
I0401 19:45:42.943966 16998 main.go:141] libmachine: (addons-357468) getting domain XML...
I0401 19:45:42.944541 16998 main.go:141] libmachine: (addons-357468) creating domain...
I0401 19:45:44.352767 16998 main.go:141] libmachine: (addons-357468) waiting for IP...
I0401 19:45:44.353654 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:45:44.354019 16998 main.go:141] libmachine: (addons-357468) DBG | unable to find current IP address of domain addons-357468 in network mk-addons-357468
I0401 19:45:44.354109 16998 main.go:141] libmachine: (addons-357468) DBG | I0401 19:45:44.354022 17021 retry.go:31] will retry after 252.629289ms: waiting for domain to come up
I0401 19:45:44.608573 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:45:44.609055 16998 main.go:141] libmachine: (addons-357468) DBG | unable to find current IP address of domain addons-357468 in network mk-addons-357468
I0401 19:45:44.609084 16998 main.go:141] libmachine: (addons-357468) DBG | I0401 19:45:44.609013 17021 retry.go:31] will retry after 285.762447ms: waiting for domain to come up
I0401 19:45:44.896308 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:45:44.896823 16998 main.go:141] libmachine: (addons-357468) DBG | unable to find current IP address of domain addons-357468 in network mk-addons-357468
I0401 19:45:44.896850 16998 main.go:141] libmachine: (addons-357468) DBG | I0401 19:45:44.896787 17021 retry.go:31] will retry after 477.162899ms: waiting for domain to come up
I0401 19:45:45.375561 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:45:45.376081 16998 main.go:141] libmachine: (addons-357468) DBG | unable to find current IP address of domain addons-357468 in network mk-addons-357468
I0401 19:45:45.376107 16998 main.go:141] libmachine: (addons-357468) DBG | I0401 19:45:45.376026 17021 retry.go:31] will retry after 468.290613ms: waiting for domain to come up
I0401 19:45:45.845566 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:45:45.845963 16998 main.go:141] libmachine: (addons-357468) DBG | unable to find current IP address of domain addons-357468 in network mk-addons-357468
I0401 19:45:45.845990 16998 main.go:141] libmachine: (addons-357468) DBG | I0401 19:45:45.845937 17021 retry.go:31] will retry after 726.480302ms: waiting for domain to come up
I0401 19:45:46.573779 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:45:46.574189 16998 main.go:141] libmachine: (addons-357468) DBG | unable to find current IP address of domain addons-357468 in network mk-addons-357468
I0401 19:45:46.574227 16998 main.go:141] libmachine: (addons-357468) DBG | I0401 19:45:46.574163 17021 retry.go:31] will retry after 683.910527ms: waiting for domain to come up
I0401 19:45:47.259729 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:45:47.260178 16998 main.go:141] libmachine: (addons-357468) DBG | unable to find current IP address of domain addons-357468 in network mk-addons-357468
I0401 19:45:47.260203 16998 main.go:141] libmachine: (addons-357468) DBG | I0401 19:45:47.260145 17021 retry.go:31] will retry after 905.581274ms: waiting for domain to come up
I0401 19:45:48.167145 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:45:48.167593 16998 main.go:141] libmachine: (addons-357468) DBG | unable to find current IP address of domain addons-357468 in network mk-addons-357468
I0401 19:45:48.167621 16998 main.go:141] libmachine: (addons-357468) DBG | I0401 19:45:48.167559 17021 retry.go:31] will retry after 1.185315168s: waiting for domain to come up
I0401 19:45:49.354919 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:45:49.355385 16998 main.go:141] libmachine: (addons-357468) DBG | unable to find current IP address of domain addons-357468 in network mk-addons-357468
I0401 19:45:49.355437 16998 main.go:141] libmachine: (addons-357468) DBG | I0401 19:45:49.355359 17021 retry.go:31] will retry after 1.278133314s: waiting for domain to come up
I0401 19:45:50.635134 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:45:50.635577 16998 main.go:141] libmachine: (addons-357468) DBG | unable to find current IP address of domain addons-357468 in network mk-addons-357468
I0401 19:45:50.635631 16998 main.go:141] libmachine: (addons-357468) DBG | I0401 19:45:50.635549 17021 retry.go:31] will retry after 2.316004299s: waiting for domain to come up
I0401 19:45:52.952802 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:45:52.953214 16998 main.go:141] libmachine: (addons-357468) DBG | unable to find current IP address of domain addons-357468 in network mk-addons-357468
I0401 19:45:52.953241 16998 main.go:141] libmachine: (addons-357468) DBG | I0401 19:45:52.953191 17021 retry.go:31] will retry after 2.686916478s: waiting for domain to come up
I0401 19:45:55.642977 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:45:55.643323 16998 main.go:141] libmachine: (addons-357468) DBG | unable to find current IP address of domain addons-357468 in network mk-addons-357468
I0401 19:45:55.643362 16998 main.go:141] libmachine: (addons-357468) DBG | I0401 19:45:55.643292 17021 retry.go:31] will retry after 2.440580858s: waiting for domain to come up
I0401 19:45:58.085568 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:45:58.086098 16998 main.go:141] libmachine: (addons-357468) DBG | unable to find current IP address of domain addons-357468 in network mk-addons-357468
I0401 19:45:58.086123 16998 main.go:141] libmachine: (addons-357468) DBG | I0401 19:45:58.086081 17021 retry.go:31] will retry after 3.468058976s: waiting for domain to come up
I0401 19:46:01.558745 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:01.559231 16998 main.go:141] libmachine: (addons-357468) DBG | unable to find current IP address of domain addons-357468 in network mk-addons-357468
I0401 19:46:01.559252 16998 main.go:141] libmachine: (addons-357468) DBG | I0401 19:46:01.559197 17021 retry.go:31] will retry after 4.259113337s: waiting for domain to come up
I0401 19:46:05.823119 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:05.823542 16998 main.go:141] libmachine: (addons-357468) found domain IP: 192.168.39.65
I0401 19:46:05.823577 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has current primary IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:05.823586 16998 main.go:141] libmachine: (addons-357468) reserving static IP address...
I0401 19:46:05.823947 16998 main.go:141] libmachine: (addons-357468) DBG | unable to find host DHCP lease matching {name: "addons-357468", mac: "52:54:00:2b:c8:c2", ip: "192.168.39.65"} in network mk-addons-357468
I0401 19:46:05.893906 16998 main.go:141] libmachine: (addons-357468) DBG | Getting to WaitForSSH function...
I0401 19:46:05.893936 16998 main.go:141] libmachine: (addons-357468) reserved static IP address 192.168.39.65 for domain addons-357468
I0401 19:46:05.893948 16998 main.go:141] libmachine: (addons-357468) waiting for SSH...
I0401 19:46:05.896388 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:05.896728 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:minikube Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:05.896758 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:05.896911 16998 main.go:141] libmachine: (addons-357468) DBG | Using SSH client type: external
I0401 19:46:05.896938 16998 main.go:141] libmachine: (addons-357468) DBG | Using SSH private key: /home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468/id_rsa (-rw-------)
I0401 19:46:05.896966 16998 main.go:141] libmachine: (addons-357468) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.65 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468/id_rsa -p 22] /usr/bin/ssh <nil>}
I0401 19:46:05.896983 16998 main.go:141] libmachine: (addons-357468) DBG | About to run SSH command:
I0401 19:46:05.896995 16998 main.go:141] libmachine: (addons-357468) DBG | exit 0
I0401 19:46:06.030473 16998 main.go:141] libmachine: (addons-357468) DBG | SSH cmd err, output: <nil>:
I0401 19:46:06.030719 16998 main.go:141] libmachine: (addons-357468) KVM machine creation complete
I0401 19:46:06.031015 16998 main.go:141] libmachine: (addons-357468) Calling .GetConfigRaw
I0401 19:46:06.031555 16998 main.go:141] libmachine: (addons-357468) Calling .DriverName
I0401 19:46:06.031735 16998 main.go:141] libmachine: (addons-357468) Calling .DriverName
I0401 19:46:06.031882 16998 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0401 19:46:06.031895 16998 main.go:141] libmachine: (addons-357468) Calling .GetState
I0401 19:46:06.033076 16998 main.go:141] libmachine: Detecting operating system of created instance...
I0401 19:46:06.033089 16998 main.go:141] libmachine: Waiting for SSH to be available...
I0401 19:46:06.033096 16998 main.go:141] libmachine: Getting to WaitForSSH function...
I0401 19:46:06.033103 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:06.035272 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:06.035584 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:06.035602 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:06.035739 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHPort
I0401 19:46:06.035916 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:06.036035 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:06.036130 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHUsername
I0401 19:46:06.036303 16998 main.go:141] libmachine: Using SSH client type: native
I0401 19:46:06.036494 16998 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.39.65 22 <nil> <nil>}
I0401 19:46:06.036505 16998 main.go:141] libmachine: About to run SSH command:
exit 0
I0401 19:46:06.145652 16998 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0401 19:46:06.145677 16998 main.go:141] libmachine: Detecting the provisioner...
I0401 19:46:06.145688 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:06.148440 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:06.148810 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:06.148850 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:06.149003 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHPort
I0401 19:46:06.149257 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:06.149448 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:06.149611 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHUsername
I0401 19:46:06.149789 16998 main.go:141] libmachine: Using SSH client type: native
I0401 19:46:06.150043 16998 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.39.65 22 <nil> <nil>}
I0401 19:46:06.150057 16998 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0401 19:46:06.263053 16998 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0401 19:46:06.263128 16998 main.go:141] libmachine: found compatible host: buildroot
I0401 19:46:06.263142 16998 main.go:141] libmachine: Provisioning with buildroot...
I0401 19:46:06.263155 16998 main.go:141] libmachine: (addons-357468) Calling .GetMachineName
I0401 19:46:06.263412 16998 buildroot.go:166] provisioning hostname "addons-357468"
I0401 19:46:06.263439 16998 main.go:141] libmachine: (addons-357468) Calling .GetMachineName
I0401 19:46:06.263630 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:06.266043 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:06.266380 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:06.266412 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:06.266557 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHPort
I0401 19:46:06.266714 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:06.266882 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:06.267005 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHUsername
I0401 19:46:06.267169 16998 main.go:141] libmachine: Using SSH client type: native
I0401 19:46:06.267375 16998 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.39.65 22 <nil> <nil>}
I0401 19:46:06.267389 16998 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-357468 && echo "addons-357468" | sudo tee /etc/hostname
I0401 19:46:06.393135 16998 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-357468
I0401 19:46:06.393175 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:06.395743 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:06.396042 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:06.396096 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:06.396266 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHPort
I0401 19:46:06.396440 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:06.396608 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:06.396698 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHUsername
I0401 19:46:06.396821 16998 main.go:141] libmachine: Using SSH client type: native
I0401 19:46:06.397096 16998 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.39.65 22 <nil> <nil>}
I0401 19:46:06.397120 16998 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-357468' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-357468/g' /etc/hosts;
else
echo '127.0.1.1 addons-357468' | sudo tee -a /etc/hosts;
fi
fi
I0401 19:46:06.520043 16998 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0401 19:46:06.520074 16998 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20506-9129/.minikube CaCertPath:/home/jenkins/minikube-integration/20506-9129/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20506-9129/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20506-9129/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20506-9129/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20506-9129/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20506-9129/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20506-9129/.minikube}
I0401 19:46:06.520096 16998 buildroot.go:174] setting up certificates
I0401 19:46:06.520107 16998 provision.go:84] configureAuth start
I0401 19:46:06.520119 16998 main.go:141] libmachine: (addons-357468) Calling .GetMachineName
I0401 19:46:06.520427 16998 main.go:141] libmachine: (addons-357468) Calling .GetIP
I0401 19:46:06.523145 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:06.523571 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:06.523595 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:06.523787 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:06.525759 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:06.526054 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:06.526075 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:06.526152 16998 provision.go:143] copyHostCerts
I0401 19:46:06.526246 16998 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20506-9129/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20506-9129/.minikube/ca.pem (1078 bytes)
I0401 19:46:06.526391 16998 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20506-9129/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20506-9129/.minikube/cert.pem (1123 bytes)
I0401 19:46:06.526490 16998 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20506-9129/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20506-9129/.minikube/key.pem (1675 bytes)
I0401 19:46:06.526575 16998 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20506-9129/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20506-9129/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20506-9129/.minikube/certs/ca-key.pem org=jenkins.addons-357468 san=[127.0.0.1 192.168.39.65 addons-357468 localhost minikube]
I0401 19:46:06.727557 16998 provision.go:177] copyRemoteCerts
I0401 19:46:06.727615 16998 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0401 19:46:06.727640 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:06.730443 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:06.730830 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:06.730857 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:06.731011 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHPort
I0401 19:46:06.731173 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:06.731345 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHUsername
I0401 19:46:06.731500 16998 sshutil.go:53] new ssh client: &{IP:192.168.39.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468/id_rsa Username:docker}
I0401 19:46:06.816869 16998 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-9129/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0401 19:46:06.840973 16998 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-9129/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0401 19:46:06.864983 16998 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-9129/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0401 19:46:06.889179 16998 provision.go:87] duration metric: took 369.057155ms to configureAuth
I0401 19:46:06.889214 16998 buildroot.go:189] setting minikube options for container-runtime
I0401 19:46:06.889451 16998 config.go:182] Loaded profile config "addons-357468": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0401 19:46:06.889530 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:06.892626 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:06.892945 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:06.892974 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:06.893101 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHPort
I0401 19:46:06.893301 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:06.893503 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:06.893637 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHUsername
I0401 19:46:06.893825 16998 main.go:141] libmachine: Using SSH client type: native
I0401 19:46:06.894098 16998 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.39.65 22 <nil> <nil>}
I0401 19:46:06.894114 16998 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0401 19:46:07.126608 16998 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0401 19:46:07.126644 16998 main.go:141] libmachine: Checking connection to Docker...
I0401 19:46:07.126657 16998 main.go:141] libmachine: (addons-357468) Calling .GetURL
I0401 19:46:07.128059 16998 main.go:141] libmachine: (addons-357468) DBG | using libvirt version 6000000
I0401 19:46:07.130623 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:07.130943 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:07.130964 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:07.131122 16998 main.go:141] libmachine: Docker is up and running!
I0401 19:46:07.131143 16998 main.go:141] libmachine: Reticulating splines...
I0401 19:46:07.131153 16998 client.go:171] duration metric: took 25.134921462s to LocalClient.Create
I0401 19:46:07.131188 16998 start.go:167] duration metric: took 25.135003129s to libmachine.API.Create "addons-357468"
I0401 19:46:07.131208 16998 start.go:293] postStartSetup for "addons-357468" (driver="kvm2")
I0401 19:46:07.131219 16998 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0401 19:46:07.131234 16998 main.go:141] libmachine: (addons-357468) Calling .DriverName
I0401 19:46:07.131485 16998 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0401 19:46:07.131515 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:07.133516 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:07.133786 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:07.133824 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:07.133952 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHPort
I0401 19:46:07.134134 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:07.134285 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHUsername
I0401 19:46:07.134407 16998 sshutil.go:53] new ssh client: &{IP:192.168.39.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468/id_rsa Username:docker}
I0401 19:46:07.221062 16998 ssh_runner.go:195] Run: cat /etc/os-release
I0401 19:46:07.225321 16998 info.go:137] Remote host: Buildroot 2023.02.9
I0401 19:46:07.225348 16998 filesync.go:126] Scanning /home/jenkins/minikube-integration/20506-9129/.minikube/addons for local assets ...
I0401 19:46:07.225422 16998 filesync.go:126] Scanning /home/jenkins/minikube-integration/20506-9129/.minikube/files for local assets ...
I0401 19:46:07.225448 16998 start.go:296] duration metric: took 94.233561ms for postStartSetup
I0401 19:46:07.225476 16998 main.go:141] libmachine: (addons-357468) Calling .GetConfigRaw
I0401 19:46:07.226050 16998 main.go:141] libmachine: (addons-357468) Calling .GetIP
I0401 19:46:07.228657 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:07.228950 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:07.228979 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:07.229246 16998 profile.go:143] Saving config to /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/config.json ...
I0401 19:46:07.229432 16998 start.go:128] duration metric: took 25.251651972s to createHost
I0401 19:46:07.229457 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:07.231851 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:07.232102 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:07.232127 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:07.232276 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHPort
I0401 19:46:07.232436 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:07.232572 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:07.232716 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHUsername
I0401 19:46:07.232862 16998 main.go:141] libmachine: Using SSH client type: native
I0401 19:46:07.233074 16998 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.39.65 22 <nil> <nil>}
I0401 19:46:07.233087 16998 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0401 19:46:07.347227 16998 main.go:141] libmachine: SSH cmd err, output: <nil>: 1743536767.322610800
I0401 19:46:07.347253 16998 fix.go:216] guest clock: 1743536767.322610800
I0401 19:46:07.347262 16998 fix.go:229] Guest: 2025-04-01 19:46:07.3226108 +0000 UTC Remote: 2025-04-01 19:46:07.229442914 +0000 UTC m=+25.354370372 (delta=93.167886ms)
I0401 19:46:07.347284 16998 fix.go:200] guest clock delta is within tolerance: 93.167886ms
I0401 19:46:07.347291 16998 start.go:83] releasing machines lock for "addons-357468", held for 25.369601805s
I0401 19:46:07.347339 16998 main.go:141] libmachine: (addons-357468) Calling .DriverName
I0401 19:46:07.347658 16998 main.go:141] libmachine: (addons-357468) Calling .GetIP
I0401 19:46:07.350423 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:07.350823 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:07.350857 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:07.350997 16998 main.go:141] libmachine: (addons-357468) Calling .DriverName
I0401 19:46:07.351491 16998 main.go:141] libmachine: (addons-357468) Calling .DriverName
I0401 19:46:07.351675 16998 main.go:141] libmachine: (addons-357468) Calling .DriverName
I0401 19:46:07.351805 16998 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0401 19:46:07.351849 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:07.351921 16998 ssh_runner.go:195] Run: cat /version.json
I0401 19:46:07.351946 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:07.355641 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:07.355719 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:07.355994 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:07.356022 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:07.356120 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:07.356140 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHPort
I0401 19:46:07.356142 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:07.356328 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHPort
I0401 19:46:07.356342 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:07.356519 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:07.356522 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHUsername
I0401 19:46:07.356700 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHUsername
I0401 19:46:07.356696 16998 sshutil.go:53] new ssh client: &{IP:192.168.39.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468/id_rsa Username:docker}
I0401 19:46:07.356845 16998 sshutil.go:53] new ssh client: &{IP:192.168.39.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468/id_rsa Username:docker}
I0401 19:46:07.439329 16998 ssh_runner.go:195] Run: systemctl --version
I0401 19:46:07.472074 16998 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0401 19:46:07.637929 16998 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0401 19:46:07.644981 16998 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0401 19:46:07.645043 16998 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0401 19:46:07.661405 16998 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0401 19:46:07.661435 16998 start.go:495] detecting cgroup driver to use...
I0401 19:46:07.661523 16998 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0401 19:46:07.678509 16998 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0401 19:46:07.692555 16998 docker.go:217] disabling cri-docker service (if available) ...
I0401 19:46:07.692611 16998 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0401 19:46:07.707799 16998 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0401 19:46:07.722982 16998 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0401 19:46:07.835279 16998 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0401 19:46:07.967186 16998 docker.go:233] disabling docker service ...
I0401 19:46:07.967264 16998 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0401 19:46:07.983226 16998 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0401 19:46:07.996181 16998 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0401 19:46:08.135190 16998 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0401 19:46:08.259443 16998 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0401 19:46:08.274402 16998 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0401 19:46:08.293202 16998 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...
I0401 19:46:08.293269 16998 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"
I0401 19:46:08.304813 16998 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0401 19:46:08.304870 16998 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0401 19:46:08.316681 16998 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0401 19:46:08.327826 16998 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0401 19:46:08.338966 16998 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0401 19:46:08.350237 16998 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I0401 19:46:08.360830 16998 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I0401 19:46:08.378356 16998 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I0401 19:46:08.389062 16998 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0401 19:46:08.398983 16998 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0401 19:46:08.399035 16998 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0401 19:46:08.412797 16998 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0401 19:46:08.423321 16998 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0401 19:46:08.540947 16998 ssh_runner.go:195] Run: sudo systemctl restart crio
I0401 19:46:08.639327 16998 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0401 19:46:08.639410 16998 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0401 19:46:08.644120 16998 start.go:563] Will wait 60s for crictl version
I0401 19:46:08.644199 16998 ssh_runner.go:195] Run: which crictl
I0401 19:46:08.647949 16998 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0401 19:46:08.688225 16998 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0401 19:46:08.688340 16998 ssh_runner.go:195] Run: crio --version
I0401 19:46:08.717010 16998 ssh_runner.go:195] Run: crio --version
I0401 19:46:08.746894 16998 out.go:177] * Preparing Kubernetes v1.32.2 on CRI-O 1.29.1 ...
I0401 19:46:08.748217 16998 main.go:141] libmachine: (addons-357468) Calling .GetIP
I0401 19:46:08.751040 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:08.751311 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:08.751334 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:08.751576 16998 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0401 19:46:08.755999 16998 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0401 19:46:08.769350 16998 kubeadm.go:883] updating cluster {Name:addons-357468 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.2 ClusterName:addons-357468 Na
mespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.65 Port:8443 KubernetesVersion:v1.32.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMi
rror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0401 19:46:08.769438 16998 preload.go:131] Checking if preload exists for k8s version v1.32.2 and runtime crio
I0401 19:46:08.769475 16998 ssh_runner.go:195] Run: sudo crictl images --output json
I0401 19:46:08.800640 16998 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.32.2". assuming images are not preloaded.
I0401 19:46:08.800717 16998 ssh_runner.go:195] Run: which lz4
I0401 19:46:08.804874 16998 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0401 19:46:08.809004 16998 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0401 19:46:08.809030 16998 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-9129/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.32.2-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (399124012 bytes)
I0401 19:46:10.158631 16998 crio.go:462] duration metric: took 1.353778721s to copy over tarball
I0401 19:46:10.158696 16998 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0401 19:46:12.464390 16998 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.305630564s)
I0401 19:46:12.464440 16998 crio.go:469] duration metric: took 2.305781709s to extract the tarball
I0401 19:46:12.464450 16998 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0401 19:46:12.502110 16998 ssh_runner.go:195] Run: sudo crictl images --output json
I0401 19:46:12.551872 16998 crio.go:514] all images are preloaded for cri-o runtime.
I0401 19:46:12.551894 16998 cache_images.go:84] Images are preloaded, skipping loading
I0401 19:46:12.551901 16998 kubeadm.go:934] updating node { 192.168.39.65 8443 v1.32.2 crio true true} ...
I0401 19:46:12.552008 16998 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.32.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-357468 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.65
[Install]
config:
{KubernetesVersion:v1.32.2 ClusterName:addons-357468 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0401 19:46:12.552065 16998 ssh_runner.go:195] Run: crio config
I0401 19:46:12.597742 16998 cni.go:84] Creating CNI manager for ""
I0401 19:46:12.597765 16998 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0401 19:46:12.597774 16998 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0401 19:46:12.597793 16998 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.65 APIServerPort:8443 KubernetesVersion:v1.32.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-357468 NodeName:addons-357468 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.65"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.65 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kube
rnetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0401 19:46:12.597906 16998 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.65
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "addons-357468"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.39.65"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.65"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
- name: "proxy-refresh-interval"
value: "70000"
kubernetesVersion: v1.32.2
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0401 19:46:12.597963 16998 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.32.2
I0401 19:46:12.610140 16998 binaries.go:44] Found k8s binaries, skipping transfer
I0401 19:46:12.610224 16998 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0401 19:46:12.621855 16998 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (312 bytes)
I0401 19:46:12.643137 16998 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0401 19:46:12.663485 16998 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2290 bytes)
I0401 19:46:12.682513 16998 ssh_runner.go:195] Run: grep 192.168.39.65 control-plane.minikube.internal$ /etc/hosts
I0401 19:46:12.686889 16998 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.65 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0401 19:46:12.702138 16998 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0401 19:46:12.844811 16998 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0401 19:46:12.861129 16998 certs.go:68] Setting up /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468 for IP: 192.168.39.65
I0401 19:46:12.861152 16998 certs.go:194] generating shared ca certs ...
I0401 19:46:12.861165 16998 certs.go:226] acquiring lock for ca certs: {Name:mk0c623f4e6ad9759b5056c3a8d35decb04e9dd6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 19:46:12.861299 16998 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/20506-9129/.minikube/ca.key
I0401 19:46:13.043489 16998 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20506-9129/.minikube/ca.crt ...
I0401 19:46:13.043525 16998 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-9129/.minikube/ca.crt: {Name:mkd7c7c2baba64b0187ea5172027e869ac2af429 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 19:46:13.043706 16998 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20506-9129/.minikube/ca.key ...
I0401 19:46:13.043727 16998 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-9129/.minikube/ca.key: {Name:mk75f3a8f3d5a6a1c71a0993d3a2bbfb17013fb5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 19:46:13.043830 16998 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20506-9129/.minikube/proxy-client-ca.key
I0401 19:46:13.251084 16998 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20506-9129/.minikube/proxy-client-ca.crt ...
I0401 19:46:13.251111 16998 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-9129/.minikube/proxy-client-ca.crt: {Name:mk16b0244cf000c8b0a277bdb2060208af436726 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 19:46:13.251271 16998 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20506-9129/.minikube/proxy-client-ca.key ...
I0401 19:46:13.251283 16998 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-9129/.minikube/proxy-client-ca.key: {Name:mkbcc9b770d38d1903366dc0ffc2a4621535f051 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 19:46:13.251373 16998 certs.go:256] generating profile certs ...
I0401 19:46:13.251456 16998 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/client.key
I0401 19:46:13.251473 16998 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/client.crt with IP's: []
I0401 19:46:13.378351 16998 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/client.crt ...
I0401 19:46:13.378383 16998 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/client.crt: {Name:mk6238cc3e388b703b09c212154c5b9ccc3b3f6d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 19:46:13.378554 16998 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/client.key ...
I0401 19:46:13.378570 16998 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/client.key: {Name:mk3a931dcb55a474560944963b2eebcb39c04dbc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 19:46:13.378663 16998 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/apiserver.key.63182778
I0401 19:46:13.378686 16998 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/apiserver.crt.63182778 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.65]
I0401 19:46:13.995712 16998 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/apiserver.crt.63182778 ...
I0401 19:46:13.995744 16998 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/apiserver.crt.63182778: {Name:mk7fc2d86f0cc85a1f9b56ba604ab79e4ba7ecc1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 19:46:13.995931 16998 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/apiserver.key.63182778 ...
I0401 19:46:13.995947 16998 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/apiserver.key.63182778: {Name:mkac749f475b476bbb5dab157fcc9d4d556eeed8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 19:46:13.996049 16998 certs.go:381] copying /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/apiserver.crt.63182778 -> /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/apiserver.crt
I0401 19:46:13.996124 16998 certs.go:385] copying /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/apiserver.key.63182778 -> /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/apiserver.key
I0401 19:46:13.996180 16998 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/proxy-client.key
I0401 19:46:13.996199 16998 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/proxy-client.crt with IP's: []
I0401 19:46:14.279006 16998 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/proxy-client.crt ...
I0401 19:46:14.279039 16998 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/proxy-client.crt: {Name:mk1afffa409882b2bbfdcc4149146f46f0ca0be7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 19:46:14.279219 16998 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/proxy-client.key ...
I0401 19:46:14.279233 16998 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/proxy-client.key: {Name:mk680e6668afcc74fcdc5f465055838e804baf75 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 19:46:14.279423 16998 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-9129/.minikube/certs/ca-key.pem (1679 bytes)
I0401 19:46:14.279457 16998 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-9129/.minikube/certs/ca.pem (1078 bytes)
I0401 19:46:14.279488 16998 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-9129/.minikube/certs/cert.pem (1123 bytes)
I0401 19:46:14.279510 16998 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-9129/.minikube/certs/key.pem (1675 bytes)
I0401 19:46:14.280016 16998 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-9129/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0401 19:46:14.314477 16998 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-9129/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0401 19:46:14.342297 16998 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-9129/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0401 19:46:14.367328 16998 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-9129/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0401 19:46:14.391080 16998 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0401 19:46:14.415309 16998 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0401 19:46:14.457853 16998 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0401 19:46:14.485174 16998 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-9129/.minikube/profiles/addons-357468/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0401 19:46:14.512350 16998 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-9129/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0401 19:46:14.535770 16998 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0401 19:46:14.552816 16998 ssh_runner.go:195] Run: openssl version
I0401 19:46:14.558894 16998 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0401 19:46:14.569842 16998 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0401 19:46:14.574467 16998 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 1 19:46 /usr/share/ca-certificates/minikubeCA.pem
I0401 19:46:14.574526 16998 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0401 19:46:14.580432 16998 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0401 19:46:14.591652 16998 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0401 19:46:14.595926 16998 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0401 19:46:14.595975 16998 kubeadm.go:392] StartCluster: {Name:addons-357468 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.2 ClusterName:addons-357468 Names
pace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.65 Port:8443 KubernetesVersion:v1.32.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirro
r: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0401 19:46:14.596053 16998 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0401 19:46:14.596141 16998 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0401 19:46:14.635781 16998 cri.go:89] found id: ""
I0401 19:46:14.635849 16998 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0401 19:46:14.645818 16998 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0401 19:46:14.655696 16998 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0401 19:46:14.665234 16998 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0401 19:46:14.665254 16998 kubeadm.go:157] found existing configuration files:
I0401 19:46:14.665299 16998 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0401 19:46:14.674350 16998 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0401 19:46:14.674430 16998 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0401 19:46:14.683824 16998 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0401 19:46:14.693019 16998 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0401 19:46:14.693083 16998 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0401 19:46:14.703902 16998 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0401 19:46:14.713360 16998 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0401 19:46:14.713430 16998 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0401 19:46:14.723088 16998 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0401 19:46:14.732138 16998 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0401 19:46:14.732205 16998 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0401 19:46:14.741589 16998 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.32.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0401 19:46:14.909311 16998 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0401 19:46:24.704405 16998 kubeadm.go:310] [init] Using Kubernetes version: v1.32.2
I0401 19:46:24.704492 16998 kubeadm.go:310] [preflight] Running pre-flight checks
I0401 19:46:24.704624 16998 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0401 19:46:24.704708 16998 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0401 19:46:24.704788 16998 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0401 19:46:24.704879 16998 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0401 19:46:24.706598 16998 out.go:235] - Generating certificates and keys ...
I0401 19:46:24.706701 16998 kubeadm.go:310] [certs] Using existing ca certificate authority
I0401 19:46:24.706798 16998 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0401 19:46:24.706905 16998 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0401 19:46:24.706996 16998 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0401 19:46:24.707086 16998 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0401 19:46:24.707159 16998 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0401 19:46:24.707236 16998 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0401 19:46:24.707373 16998 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-357468 localhost] and IPs [192.168.39.65 127.0.0.1 ::1]
I0401 19:46:24.707461 16998 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0401 19:46:24.707594 16998 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-357468 localhost] and IPs [192.168.39.65 127.0.0.1 ::1]
I0401 19:46:24.707685 16998 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0401 19:46:24.707804 16998 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0401 19:46:24.707883 16998 kubeadm.go:310] [certs] Generating "sa" key and public key
I0401 19:46:24.707967 16998 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0401 19:46:24.708037 16998 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0401 19:46:24.708119 16998 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0401 19:46:24.708193 16998 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0401 19:46:24.708279 16998 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0401 19:46:24.708367 16998 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0401 19:46:24.708470 16998 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0401 19:46:24.708561 16998 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0401 19:46:24.709903 16998 out.go:235] - Booting up control plane ...
I0401 19:46:24.710021 16998 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0401 19:46:24.710096 16998 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0401 19:46:24.710157 16998 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0401 19:46:24.710268 16998 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0401 19:46:24.710357 16998 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0401 19:46:24.710410 16998 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0401 19:46:24.710562 16998 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0401 19:46:24.710671 16998 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0401 19:46:24.710742 16998 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.001052288s
I0401 19:46:24.710806 16998 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0401 19:46:24.710859 16998 kubeadm.go:310] [api-check] The API server is healthy after 5.00216367s
I0401 19:46:24.710949 16998 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0401 19:46:24.711080 16998 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0401 19:46:24.711157 16998 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0401 19:46:24.711318 16998 kubeadm.go:310] [mark-control-plane] Marking the node addons-357468 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0401 19:46:24.711383 16998 kubeadm.go:310] [bootstrap-token] Using token: t0cqmq.snz0vt75i8gyoye9
I0401 19:46:24.713224 16998 out.go:235] - Configuring RBAC rules ...
I0401 19:46:24.713320 16998 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0401 19:46:24.713409 16998 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0401 19:46:24.713559 16998 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0401 19:46:24.713685 16998 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0401 19:46:24.713786 16998 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0401 19:46:24.713893 16998 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0401 19:46:24.714065 16998 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0401 19:46:24.714132 16998 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0401 19:46:24.714200 16998 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0401 19:46:24.714228 16998 kubeadm.go:310]
I0401 19:46:24.714287 16998 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0401 19:46:24.714294 16998 kubeadm.go:310]
I0401 19:46:24.714387 16998 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0401 19:46:24.714398 16998 kubeadm.go:310]
I0401 19:46:24.714430 16998 kubeadm.go:310] mkdir -p $HOME/.kube
I0401 19:46:24.714506 16998 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0401 19:46:24.714552 16998 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0401 19:46:24.714557 16998 kubeadm.go:310]
I0401 19:46:24.714623 16998 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0401 19:46:24.714635 16998 kubeadm.go:310]
I0401 19:46:24.714699 16998 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0401 19:46:24.714706 16998 kubeadm.go:310]
I0401 19:46:24.714779 16998 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0401 19:46:24.714884 16998 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0401 19:46:24.714966 16998 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0401 19:46:24.714978 16998 kubeadm.go:310]
I0401 19:46:24.715071 16998 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0401 19:46:24.715142 16998 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0401 19:46:24.715152 16998 kubeadm.go:310]
I0401 19:46:24.715236 16998 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token t0cqmq.snz0vt75i8gyoye9 \
I0401 19:46:24.715336 16998 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:62423b8ff17ebf3fa36d8d6f31523e02318938efef17617f484eab44db851c38 \
I0401 19:46:24.715377 16998 kubeadm.go:310] --control-plane
I0401 19:46:24.715386 16998 kubeadm.go:310]
I0401 19:46:24.715509 16998 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0401 19:46:24.715523 16998 kubeadm.go:310]
I0401 19:46:24.715657 16998 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token t0cqmq.snz0vt75i8gyoye9 \
I0401 19:46:24.715814 16998 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:62423b8ff17ebf3fa36d8d6f31523e02318938efef17617f484eab44db851c38
I0401 19:46:24.715841 16998 cni.go:84] Creating CNI manager for ""
I0401 19:46:24.715853 16998 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0401 19:46:24.718075 16998 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0401 19:46:24.719330 16998 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0401 19:46:24.731129 16998 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)
I0401 19:46:24.751879 16998 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0401 19:46:24.751965 16998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 19:46:24.752008 16998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-357468 minikube.k8s.io/updated_at=2025_04_01T19_46_24_0700 minikube.k8s.io/version=v1.35.0 minikube.k8s.io/commit=73c6e1c927350a51068882397e0642f8dfb63f2a minikube.k8s.io/name=addons-357468 minikube.k8s.io/primary=true
I0401 19:46:24.901745 16998 ops.go:34] apiserver oom_adj: -16
I0401 19:46:24.901915 16998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 19:46:25.402596 16998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 19:46:25.902985 16998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 19:46:26.402803 16998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 19:46:26.902883 16998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 19:46:27.402295 16998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 19:46:27.902317 16998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 19:46:28.402000 16998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 19:46:28.903033 16998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 19:46:29.025879 16998 kubeadm.go:1113] duration metric: took 4.273984332s to wait for elevateKubeSystemPrivileges
I0401 19:46:29.025921 16998 kubeadm.go:394] duration metric: took 14.429948905s to StartCluster
I0401 19:46:29.025943 16998 settings.go:142] acquiring lock: {Name:mk730f122b2ca6461d1332a4ce407be8655dd967 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 19:46:29.026073 16998 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/20506-9129/kubeconfig
I0401 19:46:29.026434 16998 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-9129/kubeconfig: {Name:mkf811d7585652ae33be30f87691fb2de9aa1785 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 19:46:29.026651 16998 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.32.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0401 19:46:29.026660 16998 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.39.65 Port:8443 KubernetesVersion:v1.32.2 ContainerRuntime:crio ControlPlane:true Worker:true}
I0401 19:46:29.026762 16998 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:true auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I0401 19:46:29.026902 16998 addons.go:69] Setting yakd=true in profile "addons-357468"
I0401 19:46:29.026933 16998 addons.go:69] Setting default-storageclass=true in profile "addons-357468"
I0401 19:46:29.026957 16998 addons.go:69] Setting amd-gpu-device-plugin=true in profile "addons-357468"
I0401 19:46:29.026971 16998 addons.go:69] Setting storage-provisioner=true in profile "addons-357468"
I0401 19:46:29.026979 16998 addons.go:238] Setting addon amd-gpu-device-plugin=true in "addons-357468"
I0401 19:46:29.026983 16998 addons.go:69] Setting metrics-server=true in profile "addons-357468"
I0401 19:46:29.026950 16998 addons.go:69] Setting ingress=true in profile "addons-357468"
I0401 19:46:29.026979 16998 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-357468"
I0401 19:46:29.026996 16998 addons.go:69] Setting registry=true in profile "addons-357468"
I0401 19:46:29.027002 16998 addons.go:69] Setting volumesnapshots=true in profile "addons-357468"
I0401 19:46:29.027004 16998 addons.go:238] Setting addon ingress=true in "addons-357468"
I0401 19:46:29.027009 16998 addons.go:238] Setting addon registry=true in "addons-357468"
I0401 19:46:29.027013 16998 addons.go:238] Setting addon volumesnapshots=true in "addons-357468"
I0401 19:46:29.027015 16998 host.go:66] Checking if "addons-357468" exists ...
I0401 19:46:29.027037 16998 host.go:66] Checking if "addons-357468" exists ...
I0401 19:46:29.026923 16998 addons.go:69] Setting inspektor-gadget=true in profile "addons-357468"
I0401 19:46:29.027043 16998 host.go:66] Checking if "addons-357468" exists ...
I0401 19:46:29.027050 16998 addons.go:238] Setting addon inspektor-gadget=true in "addons-357468"
I0401 19:46:29.027066 16998 host.go:66] Checking if "addons-357468" exists ...
I0401 19:46:29.027037 16998 host.go:66] Checking if "addons-357468" exists ...
I0401 19:46:29.027263 16998 addons.go:238] Setting addon storage-provisioner=true in "addons-357468"
I0401 19:46:29.026957 16998 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-357468"
I0401 19:46:29.027508 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.027527 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.026973 16998 addons.go:238] Setting addon yakd=true in "addons-357468"
I0401 19:46:29.026952 16998 addons.go:69] Setting ingress-dns=true in profile "addons-357468"
I0401 19:46:29.027547 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.027552 16998 host.go:66] Checking if "addons-357468" exists ...
I0401 19:46:29.026942 16998 addons.go:69] Setting gcp-auth=true in profile "addons-357468"
I0401 19:46:29.026983 16998 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-357468"
I0401 19:46:29.027573 16998 mustload.go:65] Loading cluster: addons-357468
I0401 19:46:29.027530 16998 addons.go:238] Setting addon csi-hostpath-driver=true in "addons-357468"
I0401 19:46:29.027598 16998 host.go:66] Checking if "addons-357468" exists ...
I0401 19:46:29.027618 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.026947 16998 addons.go:69] Setting cloud-spanner=true in profile "addons-357468"
I0401 19:46:29.027649 16998 addons.go:238] Setting addon cloud-spanner=true in "addons-357468"
I0401 19:46:29.027663 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.027671 16998 host.go:66] Checking if "addons-357468" exists ...
I0401 19:46:29.027721 16998 config.go:182] Loaded profile config "addons-357468": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0401 19:46:29.027901 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.027926 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.027938 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.027961 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.028005 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.028027 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.028066 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.028094 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.028146 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.028178 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.028241 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.028287 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.027552 16998 addons.go:238] Setting addon ingress-dns=true in "addons-357468"
I0401 19:46:29.028485 16998 host.go:66] Checking if "addons-357468" exists ...
I0401 19:46:29.028853 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.028884 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.027573 16998 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-357468"
I0401 19:46:29.026973 16998 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-357468"
I0401 19:46:29.028961 16998 addons.go:238] Setting addon nvidia-device-plugin=true in "addons-357468"
I0401 19:46:29.028986 16998 host.go:66] Checking if "addons-357468" exists ...
I0401 19:46:29.029344 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.029377 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.030901 16998 out.go:177] * Verifying Kubernetes components...
I0401 19:46:29.028107 16998 host.go:66] Checking if "addons-357468" exists ...
I0401 19:46:29.026920 16998 config.go:182] Loaded profile config "addons-357468": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0401 19:46:29.027556 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.026995 16998 addons.go:238] Setting addon metrics-server=true in "addons-357468"
I0401 19:46:29.031298 16998 host.go:66] Checking if "addons-357468" exists ...
I0401 19:46:29.038346 16998 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0401 19:46:29.027531 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.026992 16998 addons.go:69] Setting volcano=true in profile "addons-357468"
I0401 19:46:29.038473 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.038529 16998 addons.go:238] Setting addon volcano=true in "addons-357468"
I0401 19:46:29.038581 16998 host.go:66] Checking if "addons-357468" exists ...
I0401 19:46:29.047732 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34501
I0401 19:46:29.047750 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35049
I0401 19:46:29.048198 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.048250 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.048508 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38041
I0401 19:46:29.048789 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.048802 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.048805 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.048817 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.048816 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.049152 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.049225 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.049246 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.049322 16998 main.go:141] libmachine: (addons-357468) Calling .GetState
I0401 19:46:29.049768 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.049926 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.050342 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.050386 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.050518 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.050548 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.051823 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34681
I0401 19:46:29.052177 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.052605 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.052622 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.052997 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.053377 16998 addons.go:238] Setting addon default-storageclass=true in "addons-357468"
I0401 19:46:29.053413 16998 host.go:66] Checking if "addons-357468" exists ...
I0401 19:46:29.053546 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.053571 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.053736 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.053766 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.054268 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38235
I0401 19:46:29.062725 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.062777 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.062789 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.062822 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.063124 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40213
I0401 19:46:29.062789 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.063226 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.065508 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.065615 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.066673 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.066715 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.069084 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.069107 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.069259 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.069271 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.078662 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.078753 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.078831 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36713
I0401 19:46:29.078941 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42411
I0401 19:46:29.079337 16998 main.go:141] libmachine: (addons-357468) Calling .GetState
I0401 19:46:29.079686 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.079729 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.079740 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.080230 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.080252 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.080632 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.081150 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.081167 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.081610 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.081666 16998 host.go:66] Checking if "addons-357468" exists ...
I0401 19:46:29.082049 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.082082 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.082807 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.082847 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.084887 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37405
I0401 19:46:29.085346 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.085450 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.085978 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.085998 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.086059 16998 main.go:141] libmachine: (addons-357468) Calling .GetState
I0401 19:46:29.087104 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.087715 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.087768 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.087995 16998 main.go:141] libmachine: (addons-357468) Calling .DriverName
I0401 19:46:29.088070 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37959
I0401 19:46:29.089280 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.089803 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.089832 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.090200 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.090979 16998 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.4
I0401 19:46:29.091286 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.091323 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.093031 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35231
I0401 19:46:29.093998 16998 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.3
I0401 19:46:29.095307 16998 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.4
I0401 19:46:29.096699 16998 addons.go:435] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0401 19:46:29.096717 16998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I0401 19:46:29.096745 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:29.100588 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.100983 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:29.101009 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.101245 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHPort
I0401 19:46:29.101403 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:29.101514 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHUsername
I0401 19:46:29.101610 16998 sshutil.go:53] new ssh client: &{IP:192.168.39.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468/id_rsa Username:docker}
I0401 19:46:29.107055 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43969
I0401 19:46:29.107387 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.107819 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.107843 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.108199 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.108702 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.108740 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.112240 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42111
I0401 19:46:29.112801 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.113397 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.113414 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.113804 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.114018 16998 main.go:141] libmachine: (addons-357468) Calling .GetState
I0401 19:46:29.116049 16998 main.go:141] libmachine: (addons-357468) Calling .DriverName
I0401 19:46:29.118553 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44609
I0401 19:46:29.118698 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35965
I0401 19:46:29.119197 16998 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.37.0
I0401 19:46:29.119493 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.120231 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38917
I0401 19:46:29.120494 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.120515 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.120634 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38885
I0401 19:46:29.120688 16998 addons.go:435] installing /etc/kubernetes/addons/ig-crd.yaml
I0401 19:46:29.120704 16998 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5248 bytes)
I0401 19:46:29.120733 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:29.121154 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.121648 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.121668 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.122116 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.122336 16998 main.go:141] libmachine: (addons-357468) Calling .GetState
I0401 19:46:29.123031 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.124009 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.124028 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.124099 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.124154 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.124186 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:29.124199 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.124214 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.124486 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHPort
I0401 19:46:29.124565 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39107
I0401 19:46:29.124635 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43101
I0401 19:46:29.124719 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.124930 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:29.125303 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.125321 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.125390 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHUsername
I0401 19:46:29.125447 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.126083 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.126382 16998 addons.go:238] Setting addon storage-provisioner-rancher=true in "addons-357468"
I0401 19:46:29.126423 16998 host.go:66] Checking if "addons-357468" exists ...
I0401 19:46:29.126504 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.126536 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.126759 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.126800 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.126832 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.127056 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.127166 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.127204 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.127246 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.127260 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.127612 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.127625 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.127695 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.127733 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.128047 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.128111 16998 sshutil.go:53] new ssh client: &{IP:192.168.39.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468/id_rsa Username:docker}
I0401 19:46:29.128515 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.128920 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.128948 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.129148 16998 main.go:141] libmachine: (addons-357468) Calling .GetState
I0401 19:46:29.129646 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.129663 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.130274 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.130522 16998 main.go:141] libmachine: (addons-357468) Calling .GetState
I0401 19:46:29.132149 16998 main.go:141] libmachine: (addons-357468) Calling .DriverName
I0401 19:46:29.132677 16998 main.go:141] libmachine: (addons-357468) Calling .DriverName
I0401 19:46:29.133567 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36089
I0401 19:46:29.134277 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.134697 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.134716 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.135108 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.135229 16998 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I0401 19:46:29.135288 16998 out.go:177] - Using image docker.io/rocm/k8s-device-plugin:1.25.2.8
I0401 19:46:29.135377 16998 main.go:141] libmachine: (addons-357468) Calling .DriverName
I0401 19:46:29.136600 16998 addons.go:435] installing /etc/kubernetes/addons/yakd-ns.yaml
I0401 19:46:29.136617 16998 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0401 19:46:29.136634 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:29.137415 16998 addons.go:435] installing /etc/kubernetes/addons/amd-gpu-device-plugin.yaml
I0401 19:46:29.137430 16998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/amd-gpu-device-plugin.yaml (1868 bytes)
I0401 19:46:29.137448 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:29.139518 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46413
I0401 19:46:29.139954 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.140391 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35277
I0401 19:46:29.141127 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.141140 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.141189 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.142140 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40761
I0401 19:46:29.142151 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHPort
I0401 19:46:29.142228 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.142257 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.142262 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:29.142277 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.142307 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.142609 16998 main.go:141] libmachine: (addons-357468) Calling .GetState
I0401 19:46:29.142659 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:29.142774 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHUsername
I0401 19:46:29.142893 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.142910 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.142960 16998 sshutil.go:53] new ssh client: &{IP:192.168.39.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468/id_rsa Username:docker}
I0401 19:46:29.143166 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:29.143184 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.143238 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39019
I0401 19:46:29.143550 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHPort
I0401 19:46:29.143946 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.144128 16998 main.go:141] libmachine: (addons-357468) Calling .GetState
I0401 19:46:29.144192 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.144638 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.144654 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.145423 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:29.145430 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.145478 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.145510 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34683
I0401 19:46:29.145650 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHUsername
I0401 19:46:29.146030 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.146053 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.146275 16998 main.go:141] libmachine: (addons-357468) Calling .DriverName
I0401 19:46:29.146533 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.146576 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.146671 16998 main.go:141] libmachine: (addons-357468) Calling .DriverName
I0401 19:46:29.146928 16998 sshutil.go:53] new ssh client: &{IP:192.168.39.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468/id_rsa Username:docker}
I0401 19:46:29.147235 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.147841 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.147881 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.148088 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.148182 16998 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0401 19:46:29.148242 16998 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I0401 19:46:29.148610 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.148624 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.149005 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.149123 16998 main.go:141] libmachine: (addons-357468) Calling .GetState
I0401 19:46:29.150016 16998 addons.go:435] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0401 19:46:29.150038 16998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0401 19:46:29.150056 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:29.150463 16998 main.go:141] libmachine: (addons-357468) Calling .DriverName
I0401 19:46:29.151515 16998 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0401 19:46:29.152318 16998 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.30
I0401 19:46:29.153182 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.153549 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:29.153711 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHPort
I0401 19:46:29.153738 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.153857 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:29.153986 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHUsername
I0401 19:46:29.154141 16998 sshutil.go:53] new ssh client: &{IP:192.168.39.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468/id_rsa Username:docker}
I0401 19:46:29.154260 16998 addons.go:435] installing /etc/kubernetes/addons/deployment.yaml
I0401 19:46:29.154276 16998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0401 19:46:29.154292 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:29.154971 16998 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0401 19:46:29.156315 16998 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0401 19:46:29.157180 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.157625 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:29.157709 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.157864 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHPort
I0401 19:46:29.158018 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:29.158194 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHUsername
I0401 19:46:29.158377 16998 sshutil.go:53] new ssh client: &{IP:192.168.39.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468/id_rsa Username:docker}
I0401 19:46:29.158885 16998 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0401 19:46:29.160063 16998 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0401 19:46:29.161217 16998 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0401 19:46:29.162399 16998 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0401 19:46:29.163885 16998 addons.go:435] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0401 19:46:29.163913 16998 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0401 19:46:29.163937 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:29.164634 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36837
I0401 19:46:29.165088 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.165585 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.165609 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.166513 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.166876 16998 main.go:141] libmachine: (addons-357468) Calling .GetState
I0401 19:46:29.169011 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.169063 16998 main.go:141] libmachine: (addons-357468) Calling .DriverName
I0401 19:46:29.169163 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46585
I0401 19:46:29.169180 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34585
I0401 19:46:29.169802 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.170529 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.170866 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.170882 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.170959 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:29.170981 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.171182 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHPort
I0401 19:46:29.171246 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.171414 16998 main.go:141] libmachine: (addons-357468) Calling .GetState
I0401 19:46:29.171468 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:29.171525 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37809
I0401 19:46:29.171768 16998 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0401 19:46:29.171988 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHUsername
I0401 19:46:29.172289 16998 sshutil.go:53] new ssh client: &{IP:192.168.39.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468/id_rsa Username:docker}
I0401 19:46:29.172600 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.172776 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.172893 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43461
I0401 19:46:29.172971 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.173046 16998 main.go:141] libmachine: (addons-357468) Calling .DriverName
I0401 19:46:29.173191 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.173207 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.173338 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.173991 16998 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0401 19:46:29.174008 16998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0401 19:46:29.174026 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:29.174097 16998 main.go:141] libmachine: (addons-357468) Calling .GetState
I0401 19:46:29.174099 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.174310 16998 main.go:141] libmachine: (addons-357468) Calling .GetState
I0401 19:46:29.174594 16998 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.17.0
I0401 19:46:29.175749 16998 addons.go:435] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0401 19:46:29.175767 16998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0401 19:46:29.175794 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:29.175913 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.176017 16998 main.go:141] libmachine: (addons-357468) Calling .DriverName
I0401 19:46:29.176644 16998 main.go:141] libmachine: (addons-357468) Calling .DriverName
I0401 19:46:29.176812 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.176825 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.177212 16998 addons.go:435] installing /etc/kubernetes/addons/storageclass.yaml
I0401 19:46:29.177244 16998 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0401 19:46:29.177260 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:29.177950 16998 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.8
I0401 19:46:29.178108 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.178492 16998 main.go:141] libmachine: (addons-357468) Calling .GetState
I0401 19:46:29.179656 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.179984 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36525
I0401 19:46:29.180013 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:29.180030 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.180272 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHPort
I0401 19:46:29.180317 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.180485 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:29.180650 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHUsername
I0401 19:46:29.180663 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.181126 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.181145 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.181208 16998 sshutil.go:53] new ssh client: &{IP:192.168.39.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468/id_rsa Username:docker}
I0401 19:46:29.181491 16998 main.go:141] libmachine: (addons-357468) Calling .DriverName
I0401 19:46:29.181540 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.181758 16998 out.go:177] - Using image docker.io/registry:2.8.3
I0401 19:46:29.182028 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:29.182057 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:29.182055 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:29.182074 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.182647 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.182847 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHPort
I0401 19:46:29.183038 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:29.183148 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:29.183167 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.183199 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHUsername
I0401 19:46:29.183209 16998 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2
I0401 19:46:29.183340 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHPort
I0401 19:46:29.183372 16998 addons.go:435] installing /etc/kubernetes/addons/registry-rc.yaml
I0401 19:46:29.183384 16998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I0401 19:46:29.183400 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:29.184364 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:29.184416 16998 sshutil.go:53] new ssh client: &{IP:192.168.39.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468/id_rsa Username:docker}
I0401 19:46:29.184621 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHUsername
I0401 19:46:29.184774 16998 sshutil.go:53] new ssh client: &{IP:192.168.39.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468/id_rsa Username:docker}
I0401 19:46:29.184900 16998 addons.go:435] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0401 19:46:29.184915 16998 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0401 19:46:29.184930 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:29.188611 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.189192 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:29.189228 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.189246 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34143
I0401 19:46:29.189915 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHPort
I0401 19:46:29.189920 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.190185 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.190302 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:29.190669 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHUsername
I0401 19:46:29.190690 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.190703 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.190776 16998 sshutil.go:53] new ssh client: &{IP:192.168.39.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468/id_rsa Username:docker}
I0401 19:46:29.191038 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.191279 16998 main.go:141] libmachine: (addons-357468) Calling .GetState
I0401 19:46:29.191706 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:29.191728 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.191882 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44515
I0401 19:46:29.192238 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHPort
I0401 19:46:29.192279 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.192446 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:29.192682 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHUsername
I0401 19:46:29.192844 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.192869 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.193018 16998 sshutil.go:53] new ssh client: &{IP:192.168.39.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468/id_rsa Username:docker}
I0401 19:46:29.193152 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.193211 16998 main.go:141] libmachine: (addons-357468) Calling .DriverName
I0401 19:46:29.193308 16998 main.go:141] libmachine: (addons-357468) Calling .GetState
W0401 19:46:29.194688 16998 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 192.168.39.1:57146->192.168.39.65:22: read: connection reset by peer
I0401 19:46:29.194750 16998 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0401 19:46:29.194789 16998 retry.go:31] will retry after 199.487422ms: ssh: handshake failed: read tcp 192.168.39.1:57146->192.168.39.65:22: read: connection reset by peer
I0401 19:46:29.194864 16998 main.go:141] libmachine: (addons-357468) Calling .DriverName
I0401 19:46:29.195087 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:29.195097 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:29.195246 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:29.195258 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:29.195259 16998 main.go:141] libmachine: (addons-357468) DBG | Closing plugin on server side
I0401 19:46:29.195265 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:29.195284 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:29.195450 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:29.195463 16998 main.go:141] libmachine: Making call to close connection to plugin binary
W0401 19:46:29.195539 16998 out.go:270] ! Enabling 'volcano' returned an error: running callbacks: [volcano addon does not support crio]
I0401 19:46:29.196126 16998 addons.go:435] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0401 19:46:29.196140 16998 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0401 19:46:29.196152 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:29.199515 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.199931 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:29.199963 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.200165 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHPort
I0401 19:46:29.200331 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:29.200565 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHUsername
I0401 19:46:29.200656 16998 sshutil.go:53] new ssh client: &{IP:192.168.39.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468/id_rsa Username:docker}
I0401 19:46:29.203694 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37007
I0401 19:46:29.204070 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:29.204524 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:29.204546 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:29.204846 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:29.205033 16998 main.go:141] libmachine: (addons-357468) Calling .GetState
I0401 19:46:29.206381 16998 main.go:141] libmachine: (addons-357468) Calling .DriverName
I0401 19:46:29.208009 16998 out.go:177] - Using image docker.io/busybox:stable
I0401 19:46:29.209495 16998 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0401 19:46:29.210881 16998 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0401 19:46:29.210905 16998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0401 19:46:29.210925 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:29.214027 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.214491 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:29.214515 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:29.214663 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHPort
I0401 19:46:29.214855 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:29.215065 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHUsername
I0401 19:46:29.215233 16998 sshutil.go:53] new ssh client: &{IP:192.168.39.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468/id_rsa Username:docker}
W0401 19:46:29.218188 16998 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 192.168.39.1:57158->192.168.39.65:22: read: connection reset by peer
I0401 19:46:29.218239 16998 retry.go:31] will retry after 206.047586ms: ssh: handshake failed: read tcp 192.168.39.1:57158->192.168.39.65:22: read: connection reset by peer
W0401 19:46:29.395179 16998 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 192.168.39.1:57170->192.168.39.65:22: read: connection reset by peer
I0401 19:46:29.395212 16998 retry.go:31] will retry after 438.228878ms: ssh: handshake failed: read tcp 192.168.39.1:57170->192.168.39.65:22: read: connection reset by peer
I0401 19:46:29.532009 16998 addons.go:435] installing /etc/kubernetes/addons/registry-svc.yaml
I0401 19:46:29.532030 16998 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0401 19:46:29.590081 16998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/amd-gpu-device-plugin.yaml
I0401 19:46:29.595488 16998 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0401 19:46:29.595679 16998 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.32.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.39.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.32.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0401 19:46:29.610222 16998 addons.go:435] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0401 19:46:29.610248 16998 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0401 19:46:29.629283 16998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0401 19:46:29.698168 16998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0401 19:46:29.705194 16998 addons.go:435] installing /etc/kubernetes/addons/yakd-sa.yaml
I0401 19:46:29.705214 16998 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0401 19:46:29.717613 16998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0401 19:46:29.730029 16998 addons.go:435] installing /etc/kubernetes/addons/registry-proxy.yaml
I0401 19:46:29.730049 16998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0401 19:46:29.738839 16998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0401 19:46:29.749479 16998 addons.go:435] installing /etc/kubernetes/addons/ig-deployment.yaml
I0401 19:46:29.749500 16998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-deployment.yaml (14539 bytes)
I0401 19:46:29.752442 16998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0401 19:46:29.775162 16998 addons.go:435] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0401 19:46:29.775188 16998 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0401 19:46:29.815208 16998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0401 19:46:29.863064 16998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0401 19:46:29.886053 16998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0401 19:46:29.915514 16998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml
I0401 19:46:29.934893 16998 addons.go:435] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0401 19:46:29.934915 16998 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0401 19:46:30.000295 16998 addons.go:435] installing /etc/kubernetes/addons/yakd-crb.yaml
I0401 19:46:30.000327 16998 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0401 19:46:30.008482 16998 addons.go:435] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0401 19:46:30.008508 16998 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0401 19:46:30.229940 16998 addons.go:435] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0401 19:46:30.229967 16998 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0401 19:46:30.258678 16998 addons.go:435] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0401 19:46:30.258702 16998 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0401 19:46:30.319472 16998 addons.go:435] installing /etc/kubernetes/addons/yakd-svc.yaml
I0401 19:46:30.319509 16998 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0401 19:46:30.474697 16998 addons.go:435] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0401 19:46:30.474722 16998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0401 19:46:30.517134 16998 addons.go:435] installing /etc/kubernetes/addons/yakd-dp.yaml
I0401 19:46:30.517155 16998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0401 19:46:30.519914 16998 addons.go:435] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0401 19:46:30.519941 16998 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0401 19:46:30.531885 16998 addons.go:435] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0401 19:46:30.531915 16998 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0401 19:46:30.808804 16998 addons.go:435] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0401 19:46:30.808828 16998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0401 19:46:30.852090 16998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0401 19:46:30.859965 16998 addons.go:435] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0401 19:46:30.859992 16998 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0401 19:46:31.004998 16998 addons.go:435] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0401 19:46:31.005023 16998 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0401 19:46:31.246577 16998 addons.go:435] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0401 19:46:31.246606 16998 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0401 19:46:31.268486 16998 addons.go:435] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0401 19:46:31.268528 16998 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0401 19:46:31.364069 16998 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (1.768549449s)
I0401 19:46:31.364139 16998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/amd-gpu-device-plugin.yaml: (1.774016997s)
I0401 19:46:31.364187 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:31.364207 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:31.364477 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:31.364492 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:31.364502 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:31.364510 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:31.364715 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:31.364728 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:31.364931 16998 node_ready.go:35] waiting up to 6m0s for node "addons-357468" to be "Ready" ...
I0401 19:46:31.371015 16998 node_ready.go:49] node "addons-357468" has status "Ready":"True"
I0401 19:46:31.371033 16998 node_ready.go:38] duration metric: took 6.085937ms for node "addons-357468" to be "Ready" ...
I0401 19:46:31.371044 16998 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0401 19:46:31.382867 16998 pod_ready.go:79] waiting up to 6m0s for pod "amd-gpu-device-plugin-bcc9r" in "kube-system" namespace to be "Ready" ...
I0401 19:46:31.562488 16998 addons.go:435] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0401 19:46:31.562511 16998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0401 19:46:31.582348 16998 addons.go:435] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0401 19:46:31.582372 16998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0401 19:46:31.659008 16998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0401 19:46:31.857027 16998 addons.go:435] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0401 19:46:31.857048 16998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0401 19:46:31.924130 16998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0401 19:46:32.048977 16998 addons.go:435] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0401 19:46:32.049005 16998 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0401 19:46:32.067113 16998 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.32.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.39.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.32.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.471399738s)
I0401 19:46:32.067155 16998 start.go:971] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap
I0401 19:46:32.067168 16998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (2.437842094s)
I0401 19:46:32.067224 16998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (2.369026155s)
I0401 19:46:32.067227 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:32.067267 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:32.067268 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:32.067278 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:32.067635 16998 main.go:141] libmachine: (addons-357468) DBG | Closing plugin on server side
I0401 19:46:32.067637 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:32.067656 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:32.067666 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:32.067674 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:32.067682 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:32.067681 16998 main.go:141] libmachine: (addons-357468) DBG | Closing plugin on server side
I0401 19:46:32.067690 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:32.067701 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:32.067689 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:32.067990 16998 main.go:141] libmachine: (addons-357468) DBG | Closing plugin on server side
I0401 19:46:32.067995 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:32.068007 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:32.068014 16998 main.go:141] libmachine: (addons-357468) DBG | Closing plugin on server side
I0401 19:46:32.068039 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:32.068046 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:32.094340 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:32.094358 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:32.094638 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:32.094655 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:32.094662 16998 main.go:141] libmachine: (addons-357468) DBG | Closing plugin on server side
I0401 19:46:32.250680 16998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0401 19:46:32.578973 16998 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-357468" context rescaled to 1 replicas
I0401 19:46:33.621998 16998 pod_ready.go:103] pod "amd-gpu-device-plugin-bcc9r" in "kube-system" namespace has status "Ready":"False"
I0401 19:46:36.005057 16998 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0401 19:46:36.005091 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:36.008404 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:36.008873 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:36.008898 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:36.009112 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHPort
I0401 19:46:36.009285 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:36.009401 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHUsername
I0401 19:46:36.009539 16998 sshutil.go:53] new ssh client: &{IP:192.168.39.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468/id_rsa Username:docker}
I0401 19:46:36.032208 16998 pod_ready.go:103] pod "amd-gpu-device-plugin-bcc9r" in "kube-system" namespace has status "Ready":"False"
I0401 19:46:36.377907 16998 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0401 19:46:36.411119 16998 addons.go:238] Setting addon gcp-auth=true in "addons-357468"
I0401 19:46:36.411186 16998 host.go:66] Checking if "addons-357468" exists ...
I0401 19:46:36.411519 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:36.411559 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:36.427654 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39813
I0401 19:46:36.428217 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:36.428735 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:36.428771 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:36.429132 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:36.429632 16998 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0401 19:46:36.429669 16998 main.go:141] libmachine: Launching plugin server for driver kvm2
I0401 19:46:36.445709 16998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45313
I0401 19:46:36.446129 16998 main.go:141] libmachine: () Calling .GetVersion
I0401 19:46:36.446610 16998 main.go:141] libmachine: Using API Version 1
I0401 19:46:36.446628 16998 main.go:141] libmachine: () Calling .SetConfigRaw
I0401 19:46:36.447001 16998 main.go:141] libmachine: () Calling .GetMachineName
I0401 19:46:36.447163 16998 main.go:141] libmachine: (addons-357468) Calling .GetState
I0401 19:46:36.448718 16998 main.go:141] libmachine: (addons-357468) Calling .DriverName
I0401 19:46:36.448928 16998 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0401 19:46:36.448955 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHHostname
I0401 19:46:36.451372 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:36.451721 16998 main.go:141] libmachine: (addons-357468) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2b:c8:c2", ip: ""} in network mk-addons-357468: {Iface:virbr1 ExpiryTime:2025-04-01 20:45:57 +0000 UTC Type:0 Mac:52:54:00:2b:c8:c2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:addons-357468 Clientid:01:52:54:00:2b:c8:c2}
I0401 19:46:36.451756 16998 main.go:141] libmachine: (addons-357468) DBG | domain addons-357468 has defined IP address 192.168.39.65 and MAC address 52:54:00:2b:c8:c2 in network mk-addons-357468
I0401 19:46:36.451835 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHPort
I0401 19:46:36.451984 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHKeyPath
I0401 19:46:36.452131 16998 main.go:141] libmachine: (addons-357468) Calling .GetSSHUsername
I0401 19:46:36.452294 16998 sshutil.go:53] new ssh client: &{IP:192.168.39.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20506-9129/.minikube/machines/addons-357468/id_rsa Username:docker}
I0401 19:46:37.689347 16998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (7.971694785s)
I0401 19:46:37.689406 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:37.689409 16998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (7.950539579s)
I0401 19:46:37.689418 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:37.689465 16998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (7.937002886s)
I0401 19:46:37.689445 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:37.689511 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:37.689520 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:37.689536 16998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (7.874289862s)
I0401 19:46:37.689522 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:37.689555 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:37.689565 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:37.689581 16998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (7.826492284s)
I0401 19:46:37.689605 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:37.689615 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:37.689615 16998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (7.803536764s)
I0401 19:46:37.689632 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:37.689643 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:37.689703 16998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: (7.774160879s)
I0401 19:46:37.689725 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:37.689733 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:37.689810 16998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (6.837689757s)
I0401 19:46:37.689827 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:37.689837 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:37.689855 16998 main.go:141] libmachine: (addons-357468) DBG | Closing plugin on server side
I0401 19:46:37.689874 16998 main.go:141] libmachine: (addons-357468) DBG | Closing plugin on server side
I0401 19:46:37.689902 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:37.689908 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:37.689916 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:37.689922 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:37.689936 16998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (6.030903953s)
I0401 19:46:37.689952 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:37.689955 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:37.689961 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:37.689967 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:37.689975 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:37.689980 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:37.690179 16998 main.go:141] libmachine: (addons-357468) DBG | Closing plugin on server side
I0401 19:46:37.690242 16998 main.go:141] libmachine: (addons-357468) DBG | Closing plugin on server side
I0401 19:46:37.690258 16998 main.go:141] libmachine: (addons-357468) DBG | Closing plugin on server side
I0401 19:46:37.690264 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:37.690276 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:37.690279 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:37.690285 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:37.690280 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:37.690292 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:37.690302 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:37.690312 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:37.690319 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:37.690321 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:37.690328 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:37.690338 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:37.690344 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:37.690286 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:37.690511 16998 main.go:141] libmachine: (addons-357468) DBG | Closing plugin on server side
I0401 19:46:37.690538 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:37.690544 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:37.690551 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:37.690557 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:37.690578 16998 main.go:141] libmachine: (addons-357468) DBG | Closing plugin on server side
I0401 19:46:37.690600 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:37.690603 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:37.690607 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:37.690610 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:37.690614 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:37.690617 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:37.690621 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:37.690624 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:37.690663 16998 main.go:141] libmachine: (addons-357468) DBG | Closing plugin on server side
I0401 19:46:37.690682 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:37.690688 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:37.690694 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:37.690701 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:37.690890 16998 main.go:141] libmachine: (addons-357468) DBG | Closing plugin on server side
I0401 19:46:37.690916 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:37.690923 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:37.690302 16998 main.go:141] libmachine: (addons-357468) DBG | Closing plugin on server side
I0401 19:46:37.691650 16998 main.go:141] libmachine: (addons-357468) DBG | Closing plugin on server side
I0401 19:46:37.691676 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:37.691682 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:37.691881 16998 main.go:141] libmachine: (addons-357468) DBG | Closing plugin on server side
I0401 19:46:37.691906 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:37.691913 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:37.692069 16998 main.go:141] libmachine: (addons-357468) DBG | Closing plugin on server side
I0401 19:46:37.692103 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:37.692121 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:37.692130 16998 addons.go:479] Verifying addon ingress=true in "addons-357468"
I0401 19:46:37.692627 16998 main.go:141] libmachine: (addons-357468) DBG | Closing plugin on server side
I0401 19:46:37.692647 16998 main.go:141] libmachine: (addons-357468) DBG | Closing plugin on server side
I0401 19:46:37.692670 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:37.692676 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:37.692684 16998 addons.go:479] Verifying addon metrics-server=true in "addons-357468"
I0401 19:46:37.693046 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:37.693057 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:37.693068 16998 addons.go:479] Verifying addon registry=true in "addons-357468"
I0401 19:46:37.694149 16998 main.go:141] libmachine: (addons-357468) DBG | Closing plugin on server side
I0401 19:46:37.694205 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:37.694251 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:37.694303 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:37.694329 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:37.694662 16998 out.go:177] * Verifying ingress addon...
I0401 19:46:37.695779 16998 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-357468 service yakd-dashboard -n yakd-dashboard
I0401 19:46:37.695828 16998 out.go:177] * Verifying registry addon...
I0401 19:46:37.696692 16998 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0401 19:46:37.698008 16998 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0401 19:46:37.723166 16998 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0401 19:46:37.723187 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:37.723166 16998 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0401 19:46:37.723200 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:37.778239 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:37.778269 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:37.778639 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:37.778690 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:37.778661 16998 main.go:141] libmachine: (addons-357468) DBG | Closing plugin on server side
I0401 19:46:37.978458 16998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (6.054286105s)
W0401 19:46:37.978511 16998 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0401 19:46:37.978532 16998 retry.go:31] will retry after 280.54106ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0401 19:46:38.219635 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:38.220320 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:38.259463 16998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0401 19:46:38.414636 16998 pod_ready.go:103] pod "amd-gpu-device-plugin-bcc9r" in "kube-system" namespace has status "Ready":"False"
I0401 19:46:38.734817 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:38.737409 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:38.931607 16998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (6.68087891s)
I0401 19:46:38.931647 16998 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (2.482699535s)
I0401 19:46:38.931662 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:38.931674 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:38.932095 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:38.932111 16998 main.go:141] libmachine: (addons-357468) DBG | Closing plugin on server side
I0401 19:46:38.932116 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:38.932133 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:38.932142 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:38.932429 16998 main.go:141] libmachine: (addons-357468) DBG | Closing plugin on server side
I0401 19:46:38.932445 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:38.932459 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:38.932470 16998 addons.go:479] Verifying addon csi-hostpath-driver=true in "addons-357468"
I0401 19:46:38.933606 16998 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.4
I0401 19:46:38.934413 16998 out.go:177] * Verifying csi-hostpath-driver addon...
I0401 19:46:38.935703 16998 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.3
I0401 19:46:38.936419 16998 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0401 19:46:38.936701 16998 addons.go:435] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0401 19:46:38.936715 16998 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0401 19:46:38.962978 16998 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0401 19:46:38.962998 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:39.016411 16998 addons.go:435] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0401 19:46:39.016437 16998 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0401 19:46:39.078509 16998 addons.go:435] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0401 19:46:39.078540 16998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I0401 19:46:39.149004 16998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0401 19:46:39.205578 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:39.206018 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:39.441447 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:39.701669 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:39.702678 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:39.940040 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:40.201582 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:40.201676 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:40.439811 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:40.558378 16998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.298873759s)
I0401 19:46:40.558443 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:40.558461 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:40.558742 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:40.558768 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:40.558779 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:40.558787 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:40.559047 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:40.559061 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:40.705114 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:40.705154 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:40.867556 16998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.718509871s)
I0401 19:46:40.867608 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:40.867620 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:40.867881 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:40.867895 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:40.867905 16998 main.go:141] libmachine: Making call to close driver server
I0401 19:46:40.867911 16998 main.go:141] libmachine: (addons-357468) Calling .Close
I0401 19:46:40.868204 16998 main.go:141] libmachine: (addons-357468) DBG | Closing plugin on server side
I0401 19:46:40.868245 16998 main.go:141] libmachine: Successfully made call to close driver server
I0401 19:46:40.868255 16998 main.go:141] libmachine: Making call to close connection to plugin binary
I0401 19:46:40.869216 16998 addons.go:479] Verifying addon gcp-auth=true in "addons-357468"
I0401 19:46:40.871699 16998 out.go:177] * Verifying gcp-auth addon...
I0401 19:46:40.873390 16998 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0401 19:46:40.901547 16998 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0401 19:46:40.901566 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:40.918181 16998 pod_ready.go:103] pod "amd-gpu-device-plugin-bcc9r" in "kube-system" namespace has status "Ready":"False"
I0401 19:46:41.007005 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:41.200057 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:41.201882 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:41.376676 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:41.439842 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:41.701644 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:41.702103 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:41.877008 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:41.941284 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:42.200092 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:42.201719 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:42.377513 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:42.441328 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:42.701343 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:42.701358 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:42.876305 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:42.948890 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:43.201938 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:43.202336 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:43.376034 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:43.388156 16998 pod_ready.go:103] pod "amd-gpu-device-plugin-bcc9r" in "kube-system" namespace has status "Ready":"False"
I0401 19:46:43.440387 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:43.701064 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:43.701176 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:43.877297 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:43.940663 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:44.201137 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:44.202467 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:44.376768 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:44.527487 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:44.752043 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:44.752472 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:44.876377 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:44.939736 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:45.200985 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:45.203015 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:45.377228 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:45.440882 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:45.701201 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:45.701436 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:45.876876 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:45.888621 16998 pod_ready.go:103] pod "amd-gpu-device-plugin-bcc9r" in "kube-system" namespace has status "Ready":"False"
I0401 19:46:45.939650 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:46.199805 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:46.201801 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:46.376688 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:46.439624 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:46.701012 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:46.702709 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:46.877313 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:46.939130 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:47.201265 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:47.202645 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:47.376911 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:47.440134 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:47.716282 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:47.716766 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:47.877398 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:47.888971 16998 pod_ready.go:103] pod "amd-gpu-device-plugin-bcc9r" in "kube-system" namespace has status "Ready":"False"
I0401 19:46:47.940435 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:48.200671 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:48.201929 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:48.377087 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:48.439857 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:48.701841 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:48.702075 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:48.877451 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:48.939984 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:49.200468 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:49.201555 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:49.376714 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:49.440509 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:49.702076 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:49.702311 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:49.877284 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:49.889115 16998 pod_ready.go:103] pod "amd-gpu-device-plugin-bcc9r" in "kube-system" namespace has status "Ready":"False"
I0401 19:46:49.940741 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:50.200167 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:50.207055 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:50.376861 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:50.439982 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:50.700197 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:50.700936 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:50.877690 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:50.939561 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:51.201870 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:51.202028 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:51.377105 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:51.440739 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:51.699685 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:51.701723 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:51.876578 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:51.940074 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:52.202133 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:52.202143 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:52.377247 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:52.387907 16998 pod_ready.go:103] pod "amd-gpu-device-plugin-bcc9r" in "kube-system" namespace has status "Ready":"False"
I0401 19:46:52.440493 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:52.701784 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:52.701965 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:52.877773 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:52.940844 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:53.201102 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:53.201315 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:53.378605 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:53.440122 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:53.701660 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:53.702487 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:53.876911 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:53.940051 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:54.200395 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:54.201026 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:54.377130 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:54.388249 16998 pod_ready.go:103] pod "amd-gpu-device-plugin-bcc9r" in "kube-system" namespace has status "Ready":"False"
I0401 19:46:54.440429 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:54.946585 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:54.946785 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:54.946876 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:54.947124 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:55.200552 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:55.201175 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:55.377065 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:55.440011 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:55.700191 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:55.701513 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:55.876500 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:55.939104 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:56.200449 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:56.201032 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:56.377094 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:56.439312 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:56.701860 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:56.701955 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:56.877053 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:56.888187 16998 pod_ready.go:103] pod "amd-gpu-device-plugin-bcc9r" in "kube-system" namespace has status "Ready":"False"
I0401 19:46:56.940875 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:57.435706 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:57.435753 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:57.435925 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:57.441261 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:57.700513 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:57.701340 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:57.876020 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:57.940453 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:58.202069 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:58.202893 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:58.377804 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:58.440454 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:58.701808 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:58.701957 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:58.876686 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:58.940327 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:59.199967 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:59.204195 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:59.909198 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:46:59.909310 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:59.911700 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:46:59.912048 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:46:59.913579 16998 pod_ready.go:103] pod "amd-gpu-device-plugin-bcc9r" in "kube-system" namespace has status "Ready":"False"
I0401 19:46:59.916217 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:46:59.941076 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:00.201949 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:00.202262 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:00.377966 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:00.439957 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:00.701076 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:00.701709 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:00.876592 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:00.941130 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:01.201027 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:01.202355 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:01.376088 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:01.439676 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:01.700885 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:01.701883 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:01.881980 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:01.982488 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:02.201311 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:02.201830 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:02.377044 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:02.387246 16998 pod_ready.go:103] pod "amd-gpu-device-plugin-bcc9r" in "kube-system" namespace has status "Ready":"False"
I0401 19:47:02.440731 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:02.699603 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:02.701300 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:02.877495 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:02.940600 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:03.199749 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:03.201723 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:03.376953 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:03.440395 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:03.700987 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:03.701174 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:03.877445 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:03.941448 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:04.201014 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:04.201336 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:04.377504 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:04.389397 16998 pod_ready.go:103] pod "amd-gpu-device-plugin-bcc9r" in "kube-system" namespace has status "Ready":"False"
I0401 19:47:04.440436 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:04.700721 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:04.702161 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:04.877159 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:04.940278 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:05.200362 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:05.202411 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:05.376713 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:05.440085 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:05.701447 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:05.701555 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:05.876363 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:05.949523 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:06.200340 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:06.200996 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:06.377199 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:06.441665 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:06.699929 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:06.701549 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:06.876610 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:06.888186 16998 pod_ready.go:103] pod "amd-gpu-device-plugin-bcc9r" in "kube-system" namespace has status "Ready":"False"
I0401 19:47:06.958871 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:07.200160 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:07.202131 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:07.377571 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:07.439340 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:07.700556 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:07.701717 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:07.876656 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:07.940176 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:08.202296 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:08.202424 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:08.376182 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:08.439450 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:08.700485 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:08.701307 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:08.877798 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:08.888929 16998 pod_ready.go:103] pod "amd-gpu-device-plugin-bcc9r" in "kube-system" namespace has status "Ready":"False"
I0401 19:47:08.940375 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:09.202858 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:09.202870 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:09.377036 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:09.440547 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:09.700677 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:09.702562 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:09.876457 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:09.939989 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:10.201174 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:10.201307 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:10.376130 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:10.440695 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:10.699891 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:10.701645 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:10.876975 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:10.940370 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:11.200667 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:11.201775 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:11.376838 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:11.388518 16998 pod_ready.go:103] pod "amd-gpu-device-plugin-bcc9r" in "kube-system" namespace has status "Ready":"False"
I0401 19:47:11.439755 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:11.699699 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:11.701288 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:11.877134 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:11.941020 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:12.200809 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:12.201326 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:12.376065 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:12.387356 16998 pod_ready.go:93] pod "amd-gpu-device-plugin-bcc9r" in "kube-system" namespace has status "Ready":"True"
I0401 19:47:12.387375 16998 pod_ready.go:82] duration metric: took 41.004482811s for pod "amd-gpu-device-plugin-bcc9r" in "kube-system" namespace to be "Ready" ...
I0401 19:47:12.387383 16998 pod_ready.go:79] waiting up to 6m0s for pod "coredns-668d6bf9bc-7nvdn" in "kube-system" namespace to be "Ready" ...
I0401 19:47:12.390311 16998 pod_ready.go:98] error getting pod "coredns-668d6bf9bc-7nvdn" in "kube-system" namespace (skipping!): pods "coredns-668d6bf9bc-7nvdn" not found
I0401 19:47:12.390328 16998 pod_ready.go:82] duration metric: took 2.939066ms for pod "coredns-668d6bf9bc-7nvdn" in "kube-system" namespace to be "Ready" ...
E0401 19:47:12.390336 16998 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-668d6bf9bc-7nvdn" in "kube-system" namespace (skipping!): pods "coredns-668d6bf9bc-7nvdn" not found
I0401 19:47:12.390342 16998 pod_ready.go:79] waiting up to 6m0s for pod "coredns-668d6bf9bc-cfh7q" in "kube-system" namespace to be "Ready" ...
I0401 19:47:12.394249 16998 pod_ready.go:93] pod "coredns-668d6bf9bc-cfh7q" in "kube-system" namespace has status "Ready":"True"
I0401 19:47:12.394268 16998 pod_ready.go:82] duration metric: took 3.919864ms for pod "coredns-668d6bf9bc-cfh7q" in "kube-system" namespace to be "Ready" ...
I0401 19:47:12.394277 16998 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-357468" in "kube-system" namespace to be "Ready" ...
I0401 19:47:12.398333 16998 pod_ready.go:93] pod "etcd-addons-357468" in "kube-system" namespace has status "Ready":"True"
I0401 19:47:12.398354 16998 pod_ready.go:82] duration metric: took 4.06919ms for pod "etcd-addons-357468" in "kube-system" namespace to be "Ready" ...
I0401 19:47:12.398365 16998 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-357468" in "kube-system" namespace to be "Ready" ...
I0401 19:47:12.402517 16998 pod_ready.go:93] pod "kube-apiserver-addons-357468" in "kube-system" namespace has status "Ready":"True"
I0401 19:47:12.402532 16998 pod_ready.go:82] duration metric: took 4.160815ms for pod "kube-apiserver-addons-357468" in "kube-system" namespace to be "Ready" ...
I0401 19:47:12.402540 16998 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-357468" in "kube-system" namespace to be "Ready" ...
I0401 19:47:12.441262 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:12.585439 16998 pod_ready.go:93] pod "kube-controller-manager-addons-357468" in "kube-system" namespace has status "Ready":"True"
I0401 19:47:12.585462 16998 pod_ready.go:82] duration metric: took 182.915613ms for pod "kube-controller-manager-addons-357468" in "kube-system" namespace to be "Ready" ...
I0401 19:47:12.585473 16998 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-rm6gh" in "kube-system" namespace to be "Ready" ...
I0401 19:47:12.700766 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:12.701360 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:12.876935 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:12.940478 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:12.985955 16998 pod_ready.go:93] pod "kube-proxy-rm6gh" in "kube-system" namespace has status "Ready":"True"
I0401 19:47:12.985977 16998 pod_ready.go:82] duration metric: took 400.497834ms for pod "kube-proxy-rm6gh" in "kube-system" namespace to be "Ready" ...
I0401 19:47:12.985986 16998 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-357468" in "kube-system" namespace to be "Ready" ...
I0401 19:47:13.205106 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:13.303384 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:13.377100 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:13.386600 16998 pod_ready.go:93] pod "kube-scheduler-addons-357468" in "kube-system" namespace has status "Ready":"True"
I0401 19:47:13.386627 16998 pod_ready.go:82] duration metric: took 400.634271ms for pod "kube-scheduler-addons-357468" in "kube-system" namespace to be "Ready" ...
I0401 19:47:13.386638 16998 pod_ready.go:39] duration metric: took 42.015579181s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0401 19:47:13.386659 16998 api_server.go:52] waiting for apiserver process to appear ...
I0401 19:47:13.386736 16998 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0401 19:47:13.430144 16998 api_server.go:72] duration metric: took 44.403448606s to wait for apiserver process to appear ...
I0401 19:47:13.430170 16998 api_server.go:88] waiting for apiserver healthz status ...
I0401 19:47:13.430191 16998 api_server.go:253] Checking apiserver healthz at https://192.168.39.65:8443/healthz ...
I0401 19:47:13.435523 16998 api_server.go:279] https://192.168.39.65:8443/healthz returned 200:
ok
I0401 19:47:13.436770 16998 api_server.go:141] control plane version: v1.32.2
I0401 19:47:13.436794 16998 api_server.go:131] duration metric: took 6.617025ms to wait for apiserver health ...
I0401 19:47:13.436803 16998 system_pods.go:43] waiting for kube-system pods to appear ...
I0401 19:47:13.439685 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:13.589930 16998 system_pods.go:59] 18 kube-system pods found
I0401 19:47:13.589971 16998 system_pods.go:61] "amd-gpu-device-plugin-bcc9r" [c23b66cf-45c7-4934-893d-bb20072b09e3] Running
I0401 19:47:13.589980 16998 system_pods.go:61] "coredns-668d6bf9bc-cfh7q" [f1e19243-d755-429f-adf4-cbba1763647f] Running
I0401 19:47:13.589990 16998 system_pods.go:61] "csi-hostpath-attacher-0" [1d309d5f-aa0a-4c35-a70e-273f297e4e07] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0401 19:47:13.590000 16998 system_pods.go:61] "csi-hostpath-resizer-0" [3ff0c75b-f68d-4d93-82fe-027230ee0090] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0401 19:47:13.590015 16998 system_pods.go:61] "csi-hostpathplugin-qn7g7" [af407583-e9cd-4c5c-93b2-29c17c4da3d6] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0401 19:47:13.590026 16998 system_pods.go:61] "etcd-addons-357468" [4614fce5-5e01-469f-ac16-b52195876186] Running
I0401 19:47:13.590035 16998 system_pods.go:61] "kube-apiserver-addons-357468" [c07e64ba-3a62-40c7-acad-862316fabe10] Running
I0401 19:47:13.590042 16998 system_pods.go:61] "kube-controller-manager-addons-357468" [1a6c60a3-4b77-4d48-86f5-e1b4d3060eb2] Running
I0401 19:47:13.590051 16998 system_pods.go:61] "kube-ingress-dns-minikube" [6cf917b0-6ad6-4a63-ad55-3d3e9fbc5a29] Running
I0401 19:47:13.590059 16998 system_pods.go:61] "kube-proxy-rm6gh" [9a55728a-36d5-4139-aee2-c3c8d64a56b6] Running
I0401 19:47:13.590065 16998 system_pods.go:61] "kube-scheduler-addons-357468" [21726162-bb55-4472-9936-40adb373b308] Running
I0401 19:47:13.590076 16998 system_pods.go:61] "metrics-server-7fbb699795-5gb2p" [8290b608-2b6f-48d1-b0e9-b3224861fc9f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0401 19:47:13.590084 16998 system_pods.go:61] "nvidia-device-plugin-daemonset-vtmjq" [62241ccb-0ac0-423e-b2ec-9c837985d9ab] Running
I0401 19:47:13.590095 16998 system_pods.go:61] "registry-6c88467877-9sz7s" [6aaae033-47aa-4ef3-84b0-7a7e433ed652] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0401 19:47:13.590106 16998 system_pods.go:61] "registry-proxy-tr78m" [2b69a23c-961a-4f69-bdf5-7b655e5ab42c] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0401 19:47:13.590118 16998 system_pods.go:61] "snapshot-controller-68b874b76f-58kh8" [3cb6698d-08a0-410c-9d69-0760d8256362] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0401 19:47:13.590131 16998 system_pods.go:61] "snapshot-controller-68b874b76f-vbdbd" [69f8a0e9-05fc-480c-971e-8b11cf4fec68] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0401 19:47:13.590140 16998 system_pods.go:61] "storage-provisioner" [cdf1e6c5-ba2e-4657-bee2-12904cbe2cb7] Running
I0401 19:47:13.590150 16998 system_pods.go:74] duration metric: took 153.341144ms to wait for pod list to return data ...
I0401 19:47:13.590163 16998 default_sa.go:34] waiting for default service account to be created ...
I0401 19:47:13.701297 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:13.701589 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:13.786567 16998 default_sa.go:45] found service account: "default"
I0401 19:47:13.786590 16998 default_sa.go:55] duration metric: took 196.418258ms for default service account to be created ...
I0401 19:47:13.786598 16998 system_pods.go:116] waiting for k8s-apps to be running ...
I0401 19:47:13.876557 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:13.943604 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:13.991452 16998 system_pods.go:86] 18 kube-system pods found
I0401 19:47:13.991491 16998 system_pods.go:89] "amd-gpu-device-plugin-bcc9r" [c23b66cf-45c7-4934-893d-bb20072b09e3] Running
I0401 19:47:13.991501 16998 system_pods.go:89] "coredns-668d6bf9bc-cfh7q" [f1e19243-d755-429f-adf4-cbba1763647f] Running
I0401 19:47:13.991512 16998 system_pods.go:89] "csi-hostpath-attacher-0" [1d309d5f-aa0a-4c35-a70e-273f297e4e07] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0401 19:47:13.991529 16998 system_pods.go:89] "csi-hostpath-resizer-0" [3ff0c75b-f68d-4d93-82fe-027230ee0090] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0401 19:47:13.991540 16998 system_pods.go:89] "csi-hostpathplugin-qn7g7" [af407583-e9cd-4c5c-93b2-29c17c4da3d6] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0401 19:47:13.991552 16998 system_pods.go:89] "etcd-addons-357468" [4614fce5-5e01-469f-ac16-b52195876186] Running
I0401 19:47:13.991559 16998 system_pods.go:89] "kube-apiserver-addons-357468" [c07e64ba-3a62-40c7-acad-862316fabe10] Running
I0401 19:47:13.991564 16998 system_pods.go:89] "kube-controller-manager-addons-357468" [1a6c60a3-4b77-4d48-86f5-e1b4d3060eb2] Running
I0401 19:47:13.991571 16998 system_pods.go:89] "kube-ingress-dns-minikube" [6cf917b0-6ad6-4a63-ad55-3d3e9fbc5a29] Running
I0401 19:47:13.991576 16998 system_pods.go:89] "kube-proxy-rm6gh" [9a55728a-36d5-4139-aee2-c3c8d64a56b6] Running
I0401 19:47:13.991584 16998 system_pods.go:89] "kube-scheduler-addons-357468" [21726162-bb55-4472-9936-40adb373b308] Running
I0401 19:47:13.991592 16998 system_pods.go:89] "metrics-server-7fbb699795-5gb2p" [8290b608-2b6f-48d1-b0e9-b3224861fc9f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0401 19:47:13.991597 16998 system_pods.go:89] "nvidia-device-plugin-daemonset-vtmjq" [62241ccb-0ac0-423e-b2ec-9c837985d9ab] Running
I0401 19:47:13.991606 16998 system_pods.go:89] "registry-6c88467877-9sz7s" [6aaae033-47aa-4ef3-84b0-7a7e433ed652] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0401 19:47:13.991613 16998 system_pods.go:89] "registry-proxy-tr78m" [2b69a23c-961a-4f69-bdf5-7b655e5ab42c] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0401 19:47:13.991623 16998 system_pods.go:89] "snapshot-controller-68b874b76f-58kh8" [3cb6698d-08a0-410c-9d69-0760d8256362] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0401 19:47:13.991642 16998 system_pods.go:89] "snapshot-controller-68b874b76f-vbdbd" [69f8a0e9-05fc-480c-971e-8b11cf4fec68] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0401 19:47:13.991647 16998 system_pods.go:89] "storage-provisioner" [cdf1e6c5-ba2e-4657-bee2-12904cbe2cb7] Running
I0401 19:47:13.991657 16998 system_pods.go:126] duration metric: took 205.053161ms to wait for k8s-apps to be running ...
I0401 19:47:13.991667 16998 system_svc.go:44] waiting for kubelet service to be running ....
I0401 19:47:13.991721 16998 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0401 19:47:14.025660 16998 system_svc.go:56] duration metric: took 33.983884ms WaitForService to wait for kubelet
I0401 19:47:14.025698 16998 kubeadm.go:582] duration metric: took 44.99900873s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0401 19:47:14.025722 16998 node_conditions.go:102] verifying NodePressure condition ...
I0401 19:47:14.397479 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:14.398400 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:14.398500 16998 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki
I0401 19:47:14.398521 16998 node_conditions.go:123] node cpu capacity is 2
I0401 19:47:14.398533 16998 node_conditions.go:105] duration metric: took 372.804916ms to run NodePressure ...
I0401 19:47:14.398544 16998 start.go:241] waiting for startup goroutines ...
I0401 19:47:14.398810 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:14.440461 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:14.702362 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:14.702424 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:14.876356 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:14.942065 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:15.202512 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:15.207535 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:15.376969 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:15.440384 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:15.701521 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:15.702595 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:15.876903 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:15.940060 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:16.201046 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:16.201958 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:16.379940 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:16.481096 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:16.700869 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:16.701646 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:16.876575 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:16.940424 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:17.200935 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:17.202287 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:17.377337 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:17.440919 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:17.700849 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:17.702197 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:17.878772 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:17.979781 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:18.199697 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:18.201305 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:18.376681 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:18.477461 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:18.700861 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:18.701806 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:18.876627 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:18.940607 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:19.201018 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:19.201155 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:19.412487 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:19.439363 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:19.702112 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:19.702246 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:19.879049 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:19.940389 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:20.200486 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:20.200998 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:20.376563 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:20.439806 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:20.700543 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:20.701779 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:20.876747 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:20.939811 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:21.199731 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:21.201535 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:21.376357 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:21.440427 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:21.700604 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:21.701847 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:21.876678 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:21.939994 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:22.200507 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:22.201909 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:22.376862 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:22.441122 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:22.700136 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:22.701053 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:22.876751 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:22.939652 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:23.200694 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:23.201635 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:23.376911 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:23.440108 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:23.702011 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:23.702069 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:23.877420 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:23.940668 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:24.199753 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:24.201950 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:24.376878 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:24.442874 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:24.701397 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:24.704639 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:24.876615 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:24.940133 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:25.201810 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:25.201927 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:25.376781 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:25.439767 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:25.699992 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:25.701724 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:25.877633 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:25.940105 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:26.202256 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:26.202282 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:26.377104 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:26.440545 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:26.701742 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:26.701747 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:26.876412 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:26.939748 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:27.201305 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:27.202290 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:27.377575 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:27.440905 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:27.699851 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:27.700806 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:27.876449 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:27.940386 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:28.201388 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:28.201675 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:28.376772 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:28.444962 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:28.701073 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:28.701202 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:28.877344 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:28.940410 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:29.200479 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:29.202401 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:29.376482 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:29.439657 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:29.699590 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:29.701150 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:29.877631 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:29.940087 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:30.200467 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:30.202354 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:30.376477 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:30.440015 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:30.701764 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:30.701899 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:30.877122 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:30.940187 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:31.201726 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0401 19:47:31.201850 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:31.376305 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:31.441116 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:31.700389 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:31.701286 16998 kapi.go:107] duration metric: took 54.003275244s to wait for kubernetes.io/minikube-addons=registry ...
I0401 19:47:31.877374 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:31.941081 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:32.200739 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:32.377046 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:32.440361 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:32.701733 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:32.876573 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:32.940500 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:33.202654 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:33.376713 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:33.440627 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:33.699935 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:33.877486 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:33.980610 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:34.201251 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:34.377747 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:34.441173 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:34.702114 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:34.877310 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:34.941213 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:35.200735 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:35.376952 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:35.440729 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:35.701022 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:35.876976 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:35.940126 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:36.200638 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:36.377062 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:36.440366 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:36.700898 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:36.877069 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:36.940810 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:37.202224 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:37.835706 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:37.836618 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:37.844734 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:37.886435 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:37.941027 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:38.200338 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:38.377518 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:38.440563 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:38.701077 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:38.877513 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:38.939742 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:39.199781 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:39.376411 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:39.441551 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:39.700739 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:39.877630 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:39.940379 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:40.200771 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:40.376687 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:40.439864 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:40.712700 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:41.090558 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:41.091198 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:41.200098 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:41.377642 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:41.440616 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:41.702871 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:41.876614 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:41.939832 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:42.200238 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:42.377260 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:42.441097 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:42.700478 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:42.876908 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:42.940797 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:43.204429 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:43.378053 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:43.440192 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:43.704689 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:43.878399 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:43.940562 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:44.200615 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:44.376774 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:44.440172 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:44.706702 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:44.877307 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:44.941760 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:45.202727 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:45.382994 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:45.440131 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:45.705152 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:45.877098 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:45.940262 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:46.200443 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:46.381274 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:46.440509 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:46.919874 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:46.920588 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:46.941724 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:47.200740 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:47.376465 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:47.440197 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:47.714759 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:47.876484 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:47.939969 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:48.200391 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:48.376233 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:48.441402 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:48.700838 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:48.881618 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:48.983131 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:49.202699 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:49.376517 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:49.439932 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:49.700367 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:49.877255 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:49.941355 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:50.201394 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:50.377155 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:50.441121 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:50.700091 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:50.876938 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:50.943034 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:51.200599 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:51.375999 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:51.440071 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:51.703446 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:51.876134 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:51.940551 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:52.200521 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:52.377290 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:52.442965 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:52.701581 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:52.877147 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:52.941496 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:53.202107 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:53.377058 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:53.441495 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:53.700654 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:53.876483 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:53.939904 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:54.200722 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:54.376510 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:54.439940 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:54.700736 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:54.877893 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:54.940600 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:55.228561 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:55.378693 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:55.478154 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:55.700422 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:55.876079 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:55.940265 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:56.201187 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:56.377454 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:56.440498 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:56.701069 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:56.877150 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:56.940819 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:57.201103 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:57.377638 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:57.440111 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0401 19:47:57.700880 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:57.877462 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:57.939629 16998 kapi.go:107] duration metric: took 1m19.00321048s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0401 19:47:58.200012 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:58.376707 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:58.704229 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:58.877293 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:59.200778 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:59.377011 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:47:59.701343 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:47:59.876233 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:00.201015 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:00.377723 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:00.700601 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:00.876724 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:01.200145 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:01.377362 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:01.700420 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:01.875978 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:02.200007 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:02.376882 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:02.700901 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:02.876705 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:03.200531 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:03.376702 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:03.700005 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:03.876696 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:04.200496 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:04.376049 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:04.701109 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:04.877500 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:05.200392 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:05.377962 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:05.700519 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:05.876805 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:06.200276 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:06.377962 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:06.700688 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:06.876846 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:07.200782 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:07.377081 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:07.701100 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:07.878364 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:08.200570 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:08.377015 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:08.700917 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:08.876691 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:09.200267 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:09.379383 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:09.701374 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:09.877229 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:10.201018 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:10.376980 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:10.700696 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:10.876953 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:11.200532 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:11.377299 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:11.701052 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:11.877104 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:12.200439 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:12.376317 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:12.701957 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:12.876639 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:13.200629 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:13.377151 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:13.701242 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:13.877383 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:14.201234 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:14.377295 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:14.701623 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:14.877184 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:15.201138 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:15.378012 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:15.700502 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:15.876689 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:16.200561 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:16.376772 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:16.700756 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:16.877208 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:17.200540 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:17.377265 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:17.700990 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:17.877604 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:18.200053 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:18.377315 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:18.701116 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:18.877200 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:19.200121 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:19.377733 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:19.700916 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:19.877175 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:20.200615 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:20.376372 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:20.701476 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:20.876401 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:21.201393 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:21.376556 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:21.699786 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:21.876512 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:22.201466 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:22.376288 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:22.700708 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:22.877367 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:23.201437 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:23.376953 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:23.700878 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:23.876761 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:24.200568 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:24.376363 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:24.701358 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:24.877734 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:25.200066 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:25.412090 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:25.700982 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:25.876908 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:26.200740 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:26.376626 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:26.699914 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:26.877237 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:27.200647 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:27.376528 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:27.700413 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:27.876754 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:28.200007 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:28.377854 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:28.700028 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:28.877057 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:29.200896 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:29.376542 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:29.700898 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:29.877085 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:30.200989 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:30.377653 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:30.700264 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:30.877345 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:31.201154 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:31.377529 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:31.700934 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:31.877121 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:32.200201 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:32.377559 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:32.700367 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:32.877298 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:33.201422 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:33.376708 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:33.700897 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:33.878075 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:34.200734 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:34.377233 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:34.701325 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:34.877679 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:35.199944 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:35.377506 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:35.700862 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:35.877211 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:36.200784 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:36.376878 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:36.700613 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:36.876556 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:37.200895 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:37.377258 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:37.701114 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:37.877489 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:38.201006 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:38.377595 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:38.700040 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:38.877099 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:39.201433 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:39.376621 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:39.700938 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:39.876999 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:40.200522 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:40.376731 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:40.700526 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:40.877303 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:41.202251 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:41.377115 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:41.701424 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:41.876326 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:42.200588 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:42.376309 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:42.700416 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:42.877150 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:43.201066 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:43.377396 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:43.700843 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:43.876970 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:44.200653 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:44.377011 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:44.700580 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:44.877386 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:45.201864 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:45.377310 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:45.701173 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:45.876961 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:46.200701 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:46.376584 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:46.699946 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:46.876990 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:47.200536 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:47.376588 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:47.700859 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:47.877137 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:48.200711 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:48.377081 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:48.700874 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:48.877272 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:49.201075 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:49.377024 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:49.703464 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:49.877393 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:50.201002 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:50.376865 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:50.701054 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:50.877383 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:51.201549 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:51.376290 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:51.701721 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:51.876818 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:52.199893 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:52.377224 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:52.701415 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:52.876771 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:53.202353 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:53.378635 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:53.700745 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:53.877356 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:54.200951 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:54.377535 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:54.700893 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:54.877675 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:55.201183 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:55.377441 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:55.701344 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:55.877313 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:56.201430 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:56.376525 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:56.712835 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:56.877724 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:57.203039 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:57.377327 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:57.701135 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:57.877502 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:58.200975 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:58.377363 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:58.701567 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:58.876552 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:59.200716 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:48:59.377515 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:59.998491 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:48:59.998654 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:49:00.200183 16998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0401 19:49:00.377727 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:49:00.700823 16998 kapi.go:107] duration metric: took 2m23.004130611s to wait for app.kubernetes.io/name=ingress-nginx ...
I0401 19:49:00.876696 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:49:01.376855 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:49:01.877957 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:49:02.377617 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:49:02.878504 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:49:03.378145 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:49:03.877331 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:49:04.377330 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:49:04.877128 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:49:05.377572 16998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0401 19:49:05.877464 16998 kapi.go:107] duration metric: took 2m25.004069236s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0401 19:49:05.879237 16998 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-357468 cluster.
I0401 19:49:05.880503 16998 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0401 19:49:05.881571 16998 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0401 19:49:05.882750 16998 out.go:177] * Enabled addons: amd-gpu-device-plugin, nvidia-device-plugin, default-storageclass, cloud-spanner, storage-provisioner, inspektor-gadget, metrics-server, ingress-dns, yakd, storage-provisioner-rancher, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth
I0401 19:49:05.883995 16998 addons.go:514] duration metric: took 2m36.8572399s for enable addons: enabled=[amd-gpu-device-plugin nvidia-device-plugin default-storageclass cloud-spanner storage-provisioner inspektor-gadget metrics-server ingress-dns yakd storage-provisioner-rancher volumesnapshots registry csi-hostpath-driver ingress gcp-auth]
I0401 19:49:05.884033 16998 start.go:246] waiting for cluster config update ...
I0401 19:49:05.884059 16998 start.go:255] writing updated cluster config ...
I0401 19:49:05.884316 16998 ssh_runner.go:195] Run: rm -f paused
I0401 19:49:05.938628 16998 start.go:600] kubectl: 1.32.3, cluster: 1.32.2 (minor skew: 0)
I0401 19:49:05.940682 16998 out.go:177] * Done! kubectl is now configured to use "addons-357468" cluster and "default" namespace by default
==> CRI-O <==
Apr 01 19:52:22 addons-357468 crio[665]: time="2025-04-01 19:52:22.297013007Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1743537142296928941,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:595374,},InodesUsed:&UInt64Value{Value:201,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=ade6d351-37af-44f4-b8cd-3803a35f33d0 name=/runtime.v1.ImageService/ImageFsInfo
Apr 01 19:52:22 addons-357468 crio[665]: time="2025-04-01 19:52:22.297628239Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=17efc509-370d-4aa8-b733-5f14ff519af5 name=/runtime.v1.RuntimeService/ListContainers
Apr 01 19:52:22 addons-357468 crio[665]: time="2025-04-01 19:52:22.297680275Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=17efc509-370d-4aa8-b733-5f14ff519af5 name=/runtime.v1.RuntimeService/ListContainers
Apr 01 19:52:22 addons-357468 crio[665]: time="2025-04-01 19:52:22.297986279Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:58566dbd14cddb59bb7987291f1f06ee1f46e1f889a90724420b8ad51e07f2fc,PodSandboxId:164a9a575bb9d3f2f3f1b6a2d58c837fd436ea2412bfc3655f1efd02d0d45538,Metadata:&ContainerMetadata{Name:nginx,Attempt:0,},Image:&ImageSpec{Image:docker.io/library/nginx@sha256:4ff102c5d78d254a6f0da062b3cf39eaf07f01eec0927fd21e219d0af8bc0591,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:1ff4bb4faebcfb1f7e01144fa9904a570ab9bab88694457855feb6c6bba3fa07,State:CONTAINER_RUNNING,CreatedAt:1743537003792735729,Labels:map[string]string{io.kubernetes.container.name: nginx,io.kubernetes.pod.name: nginx,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 87f5b89f-50aa-4374-b4de-f14b987a8435,},Annotations:map[string]string{io.kubernetes.container.hash: cdfbc70a,io.kubernetes.container.ports: [{\"containerPort\":80,\"protocol\":\"TCP\"}],
io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:de211d1fc70928258b1dd67c41f6f8ec03cc83e99146405ff93e832d0d04c922,PodSandboxId:74859d6cde350e0946fff9e7b8d56c052b7cb88b20d71dc65fe76e6d6c554eb5,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c,State:CONTAINER_RUNNING,CreatedAt:1743536950830380539,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: d351faea-3a0e-4224-9e5f-f278ee6d59a9,},Annotations:map[string]string{io.kubernetes.container.hash: 35e73d3c,io.kubernetes.con
tainer.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3fb68a046c185ca17291172b4488ece3f3afaab2d57902ac832423f40242a7d8,PodSandboxId:47f50bf89d592f3534fb340b5d0026800251d96ad9ce2caceb354b0b9814380e,Metadata:&ContainerMetadata{Name:controller,Attempt:0,},Image:&ImageSpec{Image:registry.k8s.io/ingress-nginx/controller@sha256:62b61c42ec8dd877b85c0aa24c4744ce44d274bc16cc5d2364edfe67964ba55b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ee44bc2368033ba6147d84fb376356de1e40e4778c20dd8b4817bd1636121ddf,State:CONTAINER_RUNNING,CreatedAt:1743536940183826122,Labels:map[string]string{io.kubernetes.container.name: controller,io.kubernetes.pod.name: ingress-nginx-controller-56d7c84fd4-c9p9b,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: 97e1784a-9374-4066-a5ef-47970fbf9aca,},Annotations:map[string]string{io.kubernetes.
container.hash: 4e8eee94,io.kubernetes.container.ports: [{\"name\":\"http\",\"hostPort\":80,\"containerPort\":80,\"protocol\":\"TCP\"},{\"name\":\"https\",\"hostPort\":443,\"containerPort\":443,\"protocol\":\"TCP\"},{\"name\":\"webhook\",\"containerPort\":8443,\"protocol\":\"TCP\"}],io.kubernetes.container.preStopHandler: {\"exec\":{\"command\":[\"/wait-shutdown\"]}},io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 0,},},&Container{Id:8fda6efe11911ab80ef6a49da3e5de3d349cb39030be4fe5d4f794d13b73839f,PodSandboxId:442db462e579a8314ecf62614fb47ee6432aec4da52b3501befc97873b9a4215,Metadata:&ContainerMetadata{Name:patch,Attempt:0,},Image:&ImageSpec{Image:registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a9f03b34a3cbfbb26d103a14046ab2c5130a80c3d69d526ff8063d2b37b9fd3f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a62eeff05
ba5194cac31b3f6180655290afa3ed3f2573bcd2aaff319416951eb,State:CONTAINER_EXITED,CreatedAt:1743536861346005948,Labels:map[string]string{io.kubernetes.container.name: patch,io.kubernetes.pod.name: ingress-nginx-admission-patch-klv5s,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: 71787d54-f12b-44db-929c-cfb2c6edaea6,},Annotations:map[string]string{io.kubernetes.container.hash: 3f610496,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f841af2a2cff40e6d54299579db7e96b53c6a5e6a4ff6ea2c331249083f91331,PodSandboxId:fbea6c478d4ff4699b2e48dfd59ceaf69d1ddf1bb3b3d4b3faf07e3fc190952f,Metadata:&ContainerMetadata{Name:create,Attempt:0,},Image:&ImageSpec{Image:registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a9f03b34a3cbfbb26d103a14046ab2c5130a80c3d69d526ff8063d2b37b9fd3f,Annotations:map[string]string{},UserSpecifiedImage:,
RuntimeHandler:,},ImageRef:a62eeff05ba5194cac31b3f6180655290afa3ed3f2573bcd2aaff319416951eb,State:CONTAINER_EXITED,CreatedAt:1743536861229162939,Labels:map[string]string{io.kubernetes.container.name: create,io.kubernetes.pod.name: ingress-nginx-admission-create-swd62,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: b6aec7c0-8bca-4e5a-8921-5dfdaa1bd536,},Annotations:map[string]string{io.kubernetes.container.hash: fe18a2bf,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f2b1606fd77a632a3f0286e63ab2225f6f78f5e3e378f2eeca5b76c4213c581e,PodSandboxId:f779673148015f3283b6b9ca3972dd90ebacd1707164bc85751d00f76c7ee0b3,Metadata:&ContainerMetadata{Name:amd-gpu-device-plugin,Attempt:0,},Image:&ImageSpec{Image:docker.io/rocm/k8s-device-plugin@sha256:f3835498cf2274e0a07c32b38c166c05a876f8eb776d756cc06805e599a3ba5f,Annotations:map[s
tring]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:d5e667c0f2bb6efe709d5abfeb749472af5cb459a5bb05d3ead8d547968c63b8,State:CONTAINER_RUNNING,CreatedAt:1743536831984105063,Labels:map[string]string{io.kubernetes.container.name: amd-gpu-device-plugin,io.kubernetes.pod.name: amd-gpu-device-plugin-bcc9r,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c23b66cf-45c7-4934-893d-bb20072b09e3,},Annotations:map[string]string{io.kubernetes.container.hash: 1903e071,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:292684c22b09f3af493b27c7c808835e14493c1b2fd5e2a92602202cb7d136fe,PodSandboxId:93490d4249b64bf9153f4a70d3007fb913a1490f41a34c4be1fd4d384db1fe09,Metadata:&ContainerMetadata{Name:minikube-ingress-dns,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/minikube-ingress-dns@sha256:07c8f5b205a3f8971bfc6d460978ae00de3
5f17e5d5392b1de8de02356f85dab,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:30dd67412fdea30479de8d5d9bf760870308d24d911c59ea1f1757f04c33cc29,State:CONTAINER_RUNNING,CreatedAt:1743536806754054215,Labels:map[string]string{io.kubernetes.container.name: minikube-ingress-dns,io.kubernetes.pod.name: kube-ingress-dns-minikube,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6cf917b0-6ad6-4a63-ad55-3d3e9fbc5a29,},Annotations:map[string]string{io.kubernetes.container.hash: 8778d474,io.kubernetes.container.ports: [{\"hostPort\":53,\"containerPort\":53,\"protocol\":\"UDP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:05d7db7ddc876169018948c401ad97c5240fd3320140c90beb784b8a051a4367,PodSandboxId:48f36e0ff1922f0004b63cac4216a6e1244c11d4affe706b56d565e5dd5e940b,Metadata:&ContainerMetadata{Name:st
orage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1743536797259309239,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cdf1e6c5-ba2e-4657-bee2-12904cbe2cb7,},Annotations:map[string]string{io.kubernetes.container.hash: 6c6bf961,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:aafeecdf61a5b9e86919f7b7d4d1a083fdaa99af012d05c9db11ba28edc53c2c,PodSandboxId:c6a04c376b4707532583bd01b737c4165eb56c80e4349a780d3eb7935eb9e2cb,Metadata:&ContainerMetadata{Name:coredns,Attemp
t:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1743536793325238350,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-668d6bf9bc-cfh7q,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: f1e19243-d755-429f-adf4-cbba1763647f,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Containe
r{Id:64b4c0edf62b7d5efaf6e9bef6185cc9bce9dc33699854015a37b00d4a7b3307,PodSandboxId:422005c4230d23e3fe9a58b9beeb7dccee5ee43fb06b855c567b6ba5cede4d7f,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:f1332858868e1c6a905123b21e2e322ab45a5b99a3532e68ff49a87c2266ebc5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:f1332858868e1c6a905123b21e2e322ab45a5b99a3532e68ff49a87c2266ebc5,State:CONTAINER_RUNNING,CreatedAt:1743536789964592242,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-rm6gh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9a55728a-36d5-4139-aee2-c3c8d64a56b6,},Annotations:map[string]string{io.kubernetes.container.hash: b4fecc5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:fdeb71283df145c10cc5bbccdd754
f954f7b98430fb0daf8b51e41cc7120b7a7,PodSandboxId:6ab934cb2d64d956489647ebfdad887ee316478780fb7852d0805ea1c9cd82cc,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:d8e673e7c9983f1f53569a9d2ba786c8abb42e3f744f77dc97a595f3caf9435d,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:d8e673e7c9983f1f53569a9d2ba786c8abb42e3f744f77dc97a595f3caf9435d,State:CONTAINER_RUNNING,CreatedAt:1743536778847266876,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-addons-357468,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 0bb3555dbbebd54d405df20dd7b644c6,},Annotations:map[string]string{io.kubernetes.container.hash: 4c5aaea3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:686ea6472bd436e7105ce81b38191c1f65e6a48f2330bf
ee556e65ed0f8a9a54,PodSandboxId:d4c8f7a80344aadc3fafe2a3056c1390b548b2cc780ac20893445578c7f8ac6f,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:b6a454c5a800d201daacead6ff195ec6049fe6dc086621b0670bca912efaf389,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:b6a454c5a800d201daacead6ff195ec6049fe6dc086621b0670bca912efaf389,State:CONTAINER_RUNNING,CreatedAt:1743536778884036550,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-addons-357468,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4a4be3169b641c9360ef9146c83e9c32,},Annotations:map[string]string{io.kubernetes.container.hash: 51692d3d,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d69f9cbd5df7d8aa3d5c80d6dcf011d2e407
e4ca3f088cb7b383e3c9e40d12f3,PodSandboxId:a87a45bd9622cb7ab42be05687511131540c260a5a65cc0fa4669bbe0d143193,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:a9e7e6b294baf1695fccb862d956c5d3ad8510e1e4ca1535f35dc09f247abbfc,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a9e7e6b294baf1695fccb862d956c5d3ad8510e1e4ca1535f35dc09f247abbfc,State:CONTAINER_RUNNING,CreatedAt:1743536778809485383,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-addons-357468,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4c1aafdb6b33142c5783ecab99522fb7,},Annotations:map[string]string{io.kubernetes.container.hash: e68be80f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:37045489d732e16ab2b48596059378f45092b7f684552335bb9ebb30bf262266,PodSandboxId:5a358
49837e2bac54c19e70f086ac0042f84102a1876a743c934d82c5b00687e,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:85b7a174738baecbc53029b7913cd430a2060e0cbdb5f56c7957d32ff7f241ef,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:85b7a174738baecbc53029b7913cd430a2060e0cbdb5f56c7957d32ff7f241ef,State:CONTAINER_RUNNING,CreatedAt:1743536778828813346,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-addons-357468,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6a7d534b830da362d60e580db68e8481,},Annotations:map[string]string{io.kubernetes.container.hash: 7745040f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=17efc509-370d-4aa8-b733-5f14ff519af5 name=/runtime.v1.RuntimeServ
ice/ListContainers
Apr 01 19:52:22 addons-357468 crio[665]: time="2025-04-01 19:52:22.335999011Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=eaf73761-166f-4e84-b715-fcdbeacf0be3 name=/runtime.v1.RuntimeService/Version
Apr 01 19:52:22 addons-357468 crio[665]: time="2025-04-01 19:52:22.336067725Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=eaf73761-166f-4e84-b715-fcdbeacf0be3 name=/runtime.v1.RuntimeService/Version
Apr 01 19:52:22 addons-357468 crio[665]: time="2025-04-01 19:52:22.337162574Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=1d4e4c5d-6a27-437b-9af2-66ef0d782583 name=/runtime.v1.ImageService/ImageFsInfo
Apr 01 19:52:22 addons-357468 crio[665]: time="2025-04-01 19:52:22.338459046Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1743537142338382733,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:595374,},InodesUsed:&UInt64Value{Value:201,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=1d4e4c5d-6a27-437b-9af2-66ef0d782583 name=/runtime.v1.ImageService/ImageFsInfo
Apr 01 19:52:22 addons-357468 crio[665]: time="2025-04-01 19:52:22.339135765Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=6bebf1c1-1b01-42f7-afef-ba02a38897fd name=/runtime.v1.RuntimeService/ListContainers
Apr 01 19:52:22 addons-357468 crio[665]: time="2025-04-01 19:52:22.339189822Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=6bebf1c1-1b01-42f7-afef-ba02a38897fd name=/runtime.v1.RuntimeService/ListContainers
Apr 01 19:52:22 addons-357468 crio[665]: time="2025-04-01 19:52:22.339590045Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:58566dbd14cddb59bb7987291f1f06ee1f46e1f889a90724420b8ad51e07f2fc,PodSandboxId:164a9a575bb9d3f2f3f1b6a2d58c837fd436ea2412bfc3655f1efd02d0d45538,Metadata:&ContainerMetadata{Name:nginx,Attempt:0,},Image:&ImageSpec{Image:docker.io/library/nginx@sha256:4ff102c5d78d254a6f0da062b3cf39eaf07f01eec0927fd21e219d0af8bc0591,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:1ff4bb4faebcfb1f7e01144fa9904a570ab9bab88694457855feb6c6bba3fa07,State:CONTAINER_RUNNING,CreatedAt:1743537003792735729,Labels:map[string]string{io.kubernetes.container.name: nginx,io.kubernetes.pod.name: nginx,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 87f5b89f-50aa-4374-b4de-f14b987a8435,},Annotations:map[string]string{io.kubernetes.container.hash: cdfbc70a,io.kubernetes.container.ports: [{\"containerPort\":80,\"protocol\":\"TCP\"}],
io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:de211d1fc70928258b1dd67c41f6f8ec03cc83e99146405ff93e832d0d04c922,PodSandboxId:74859d6cde350e0946fff9e7b8d56c052b7cb88b20d71dc65fe76e6d6c554eb5,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c,State:CONTAINER_RUNNING,CreatedAt:1743536950830380539,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: d351faea-3a0e-4224-9e5f-f278ee6d59a9,},Annotations:map[string]string{io.kubernetes.container.hash: 35e73d3c,io.kubernetes.con
tainer.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3fb68a046c185ca17291172b4488ece3f3afaab2d57902ac832423f40242a7d8,PodSandboxId:47f50bf89d592f3534fb340b5d0026800251d96ad9ce2caceb354b0b9814380e,Metadata:&ContainerMetadata{Name:controller,Attempt:0,},Image:&ImageSpec{Image:registry.k8s.io/ingress-nginx/controller@sha256:62b61c42ec8dd877b85c0aa24c4744ce44d274bc16cc5d2364edfe67964ba55b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ee44bc2368033ba6147d84fb376356de1e40e4778c20dd8b4817bd1636121ddf,State:CONTAINER_RUNNING,CreatedAt:1743536940183826122,Labels:map[string]string{io.kubernetes.container.name: controller,io.kubernetes.pod.name: ingress-nginx-controller-56d7c84fd4-c9p9b,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: 97e1784a-9374-4066-a5ef-47970fbf9aca,},Annotations:map[string]string{io.kubernetes.
container.hash: 4e8eee94,io.kubernetes.container.ports: [{\"name\":\"http\",\"hostPort\":80,\"containerPort\":80,\"protocol\":\"TCP\"},{\"name\":\"https\",\"hostPort\":443,\"containerPort\":443,\"protocol\":\"TCP\"},{\"name\":\"webhook\",\"containerPort\":8443,\"protocol\":\"TCP\"}],io.kubernetes.container.preStopHandler: {\"exec\":{\"command\":[\"/wait-shutdown\"]}},io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 0,},},&Container{Id:8fda6efe11911ab80ef6a49da3e5de3d349cb39030be4fe5d4f794d13b73839f,PodSandboxId:442db462e579a8314ecf62614fb47ee6432aec4da52b3501befc97873b9a4215,Metadata:&ContainerMetadata{Name:patch,Attempt:0,},Image:&ImageSpec{Image:registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a9f03b34a3cbfbb26d103a14046ab2c5130a80c3d69d526ff8063d2b37b9fd3f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a62eeff05
ba5194cac31b3f6180655290afa3ed3f2573bcd2aaff319416951eb,State:CONTAINER_EXITED,CreatedAt:1743536861346005948,Labels:map[string]string{io.kubernetes.container.name: patch,io.kubernetes.pod.name: ingress-nginx-admission-patch-klv5s,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: 71787d54-f12b-44db-929c-cfb2c6edaea6,},Annotations:map[string]string{io.kubernetes.container.hash: 3f610496,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f841af2a2cff40e6d54299579db7e96b53c6a5e6a4ff6ea2c331249083f91331,PodSandboxId:fbea6c478d4ff4699b2e48dfd59ceaf69d1ddf1bb3b3d4b3faf07e3fc190952f,Metadata:&ContainerMetadata{Name:create,Attempt:0,},Image:&ImageSpec{Image:registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a9f03b34a3cbfbb26d103a14046ab2c5130a80c3d69d526ff8063d2b37b9fd3f,Annotations:map[string]string{},UserSpecifiedImage:,
RuntimeHandler:,},ImageRef:a62eeff05ba5194cac31b3f6180655290afa3ed3f2573bcd2aaff319416951eb,State:CONTAINER_EXITED,CreatedAt:1743536861229162939,Labels:map[string]string{io.kubernetes.container.name: create,io.kubernetes.pod.name: ingress-nginx-admission-create-swd62,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: b6aec7c0-8bca-4e5a-8921-5dfdaa1bd536,},Annotations:map[string]string{io.kubernetes.container.hash: fe18a2bf,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f2b1606fd77a632a3f0286e63ab2225f6f78f5e3e378f2eeca5b76c4213c581e,PodSandboxId:f779673148015f3283b6b9ca3972dd90ebacd1707164bc85751d00f76c7ee0b3,Metadata:&ContainerMetadata{Name:amd-gpu-device-plugin,Attempt:0,},Image:&ImageSpec{Image:docker.io/rocm/k8s-device-plugin@sha256:f3835498cf2274e0a07c32b38c166c05a876f8eb776d756cc06805e599a3ba5f,Annotations:map[s
tring]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:d5e667c0f2bb6efe709d5abfeb749472af5cb459a5bb05d3ead8d547968c63b8,State:CONTAINER_RUNNING,CreatedAt:1743536831984105063,Labels:map[string]string{io.kubernetes.container.name: amd-gpu-device-plugin,io.kubernetes.pod.name: amd-gpu-device-plugin-bcc9r,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c23b66cf-45c7-4934-893d-bb20072b09e3,},Annotations:map[string]string{io.kubernetes.container.hash: 1903e071,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:292684c22b09f3af493b27c7c808835e14493c1b2fd5e2a92602202cb7d136fe,PodSandboxId:93490d4249b64bf9153f4a70d3007fb913a1490f41a34c4be1fd4d384db1fe09,Metadata:&ContainerMetadata{Name:minikube-ingress-dns,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/minikube-ingress-dns@sha256:07c8f5b205a3f8971bfc6d460978ae00de3
5f17e5d5392b1de8de02356f85dab,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:30dd67412fdea30479de8d5d9bf760870308d24d911c59ea1f1757f04c33cc29,State:CONTAINER_RUNNING,CreatedAt:1743536806754054215,Labels:map[string]string{io.kubernetes.container.name: minikube-ingress-dns,io.kubernetes.pod.name: kube-ingress-dns-minikube,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6cf917b0-6ad6-4a63-ad55-3d3e9fbc5a29,},Annotations:map[string]string{io.kubernetes.container.hash: 8778d474,io.kubernetes.container.ports: [{\"hostPort\":53,\"containerPort\":53,\"protocol\":\"UDP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:05d7db7ddc876169018948c401ad97c5240fd3320140c90beb784b8a051a4367,PodSandboxId:48f36e0ff1922f0004b63cac4216a6e1244c11d4affe706b56d565e5dd5e940b,Metadata:&ContainerMetadata{Name:st
orage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1743536797259309239,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cdf1e6c5-ba2e-4657-bee2-12904cbe2cb7,},Annotations:map[string]string{io.kubernetes.container.hash: 6c6bf961,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:aafeecdf61a5b9e86919f7b7d4d1a083fdaa99af012d05c9db11ba28edc53c2c,PodSandboxId:c6a04c376b4707532583bd01b737c4165eb56c80e4349a780d3eb7935eb9e2cb,Metadata:&ContainerMetadata{Name:coredns,Attemp
t:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1743536793325238350,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-668d6bf9bc-cfh7q,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: f1e19243-d755-429f-adf4-cbba1763647f,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Containe
r{Id:64b4c0edf62b7d5efaf6e9bef6185cc9bce9dc33699854015a37b00d4a7b3307,PodSandboxId:422005c4230d23e3fe9a58b9beeb7dccee5ee43fb06b855c567b6ba5cede4d7f,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:f1332858868e1c6a905123b21e2e322ab45a5b99a3532e68ff49a87c2266ebc5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:f1332858868e1c6a905123b21e2e322ab45a5b99a3532e68ff49a87c2266ebc5,State:CONTAINER_RUNNING,CreatedAt:1743536789964592242,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-rm6gh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9a55728a-36d5-4139-aee2-c3c8d64a56b6,},Annotations:map[string]string{io.kubernetes.container.hash: b4fecc5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:fdeb71283df145c10cc5bbccdd754
f954f7b98430fb0daf8b51e41cc7120b7a7,PodSandboxId:6ab934cb2d64d956489647ebfdad887ee316478780fb7852d0805ea1c9cd82cc,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:d8e673e7c9983f1f53569a9d2ba786c8abb42e3f744f77dc97a595f3caf9435d,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:d8e673e7c9983f1f53569a9d2ba786c8abb42e3f744f77dc97a595f3caf9435d,State:CONTAINER_RUNNING,CreatedAt:1743536778847266876,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-addons-357468,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 0bb3555dbbebd54d405df20dd7b644c6,},Annotations:map[string]string{io.kubernetes.container.hash: 4c5aaea3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:686ea6472bd436e7105ce81b38191c1f65e6a48f2330bf
ee556e65ed0f8a9a54,PodSandboxId:d4c8f7a80344aadc3fafe2a3056c1390b548b2cc780ac20893445578c7f8ac6f,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:b6a454c5a800d201daacead6ff195ec6049fe6dc086621b0670bca912efaf389,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:b6a454c5a800d201daacead6ff195ec6049fe6dc086621b0670bca912efaf389,State:CONTAINER_RUNNING,CreatedAt:1743536778884036550,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-addons-357468,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4a4be3169b641c9360ef9146c83e9c32,},Annotations:map[string]string{io.kubernetes.container.hash: 51692d3d,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d69f9cbd5df7d8aa3d5c80d6dcf011d2e407
e4ca3f088cb7b383e3c9e40d12f3,PodSandboxId:a87a45bd9622cb7ab42be05687511131540c260a5a65cc0fa4669bbe0d143193,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:a9e7e6b294baf1695fccb862d956c5d3ad8510e1e4ca1535f35dc09f247abbfc,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a9e7e6b294baf1695fccb862d956c5d3ad8510e1e4ca1535f35dc09f247abbfc,State:CONTAINER_RUNNING,CreatedAt:1743536778809485383,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-addons-357468,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4c1aafdb6b33142c5783ecab99522fb7,},Annotations:map[string]string{io.kubernetes.container.hash: e68be80f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:37045489d732e16ab2b48596059378f45092b7f684552335bb9ebb30bf262266,PodSandboxId:5a358
49837e2bac54c19e70f086ac0042f84102a1876a743c934d82c5b00687e,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:85b7a174738baecbc53029b7913cd430a2060e0cbdb5f56c7957d32ff7f241ef,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:85b7a174738baecbc53029b7913cd430a2060e0cbdb5f56c7957d32ff7f241ef,State:CONTAINER_RUNNING,CreatedAt:1743536778828813346,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-addons-357468,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6a7d534b830da362d60e580db68e8481,},Annotations:map[string]string{io.kubernetes.container.hash: 7745040f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=6bebf1c1-1b01-42f7-afef-ba02a38897fd name=/runtime.v1.RuntimeServ
ice/ListContainers
Apr 01 19:52:22 addons-357468 crio[665]: time="2025-04-01 19:52:22.376829078Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=cd3b2438-6b80-4970-8a39-e11156316e8d name=/runtime.v1.RuntimeService/Version
Apr 01 19:52:22 addons-357468 crio[665]: time="2025-04-01 19:52:22.376904525Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=cd3b2438-6b80-4970-8a39-e11156316e8d name=/runtime.v1.RuntimeService/Version
Apr 01 19:52:22 addons-357468 crio[665]: time="2025-04-01 19:52:22.378215336Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=64a98fda-3ab9-4981-87eb-c80eae621be5 name=/runtime.v1.ImageService/ImageFsInfo
Apr 01 19:52:22 addons-357468 crio[665]: time="2025-04-01 19:52:22.379522954Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1743537142379497932,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:595374,},InodesUsed:&UInt64Value{Value:201,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=64a98fda-3ab9-4981-87eb-c80eae621be5 name=/runtime.v1.ImageService/ImageFsInfo
Apr 01 19:52:22 addons-357468 crio[665]: time="2025-04-01 19:52:22.380153858Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=8bbc4917-c403-4662-93d2-de0a405b5098 name=/runtime.v1.RuntimeService/ListContainers
Apr 01 19:52:22 addons-357468 crio[665]: time="2025-04-01 19:52:22.380213666Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=8bbc4917-c403-4662-93d2-de0a405b5098 name=/runtime.v1.RuntimeService/ListContainers
Apr 01 19:52:22 addons-357468 crio[665]: time="2025-04-01 19:52:22.380553393Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:58566dbd14cddb59bb7987291f1f06ee1f46e1f889a90724420b8ad51e07f2fc,PodSandboxId:164a9a575bb9d3f2f3f1b6a2d58c837fd436ea2412bfc3655f1efd02d0d45538,Metadata:&ContainerMetadata{Name:nginx,Attempt:0,},Image:&ImageSpec{Image:docker.io/library/nginx@sha256:4ff102c5d78d254a6f0da062b3cf39eaf07f01eec0927fd21e219d0af8bc0591,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:1ff4bb4faebcfb1f7e01144fa9904a570ab9bab88694457855feb6c6bba3fa07,State:CONTAINER_RUNNING,CreatedAt:1743537003792735729,Labels:map[string]string{io.kubernetes.container.name: nginx,io.kubernetes.pod.name: nginx,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 87f5b89f-50aa-4374-b4de-f14b987a8435,},Annotations:map[string]string{io.kubernetes.container.hash: cdfbc70a,io.kubernetes.container.ports: [{\"containerPort\":80,\"protocol\":\"TCP\"}],
io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:de211d1fc70928258b1dd67c41f6f8ec03cc83e99146405ff93e832d0d04c922,PodSandboxId:74859d6cde350e0946fff9e7b8d56c052b7cb88b20d71dc65fe76e6d6c554eb5,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c,State:CONTAINER_RUNNING,CreatedAt:1743536950830380539,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: d351faea-3a0e-4224-9e5f-f278ee6d59a9,},Annotations:map[string]string{io.kubernetes.container.hash: 35e73d3c,io.kubernetes.con
tainer.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3fb68a046c185ca17291172b4488ece3f3afaab2d57902ac832423f40242a7d8,PodSandboxId:47f50bf89d592f3534fb340b5d0026800251d96ad9ce2caceb354b0b9814380e,Metadata:&ContainerMetadata{Name:controller,Attempt:0,},Image:&ImageSpec{Image:registry.k8s.io/ingress-nginx/controller@sha256:62b61c42ec8dd877b85c0aa24c4744ce44d274bc16cc5d2364edfe67964ba55b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ee44bc2368033ba6147d84fb376356de1e40e4778c20dd8b4817bd1636121ddf,State:CONTAINER_RUNNING,CreatedAt:1743536940183826122,Labels:map[string]string{io.kubernetes.container.name: controller,io.kubernetes.pod.name: ingress-nginx-controller-56d7c84fd4-c9p9b,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: 97e1784a-9374-4066-a5ef-47970fbf9aca,},Annotations:map[string]string{io.kubernetes.
container.hash: 4e8eee94,io.kubernetes.container.ports: [{\"name\":\"http\",\"hostPort\":80,\"containerPort\":80,\"protocol\":\"TCP\"},{\"name\":\"https\",\"hostPort\":443,\"containerPort\":443,\"protocol\":\"TCP\"},{\"name\":\"webhook\",\"containerPort\":8443,\"protocol\":\"TCP\"}],io.kubernetes.container.preStopHandler: {\"exec\":{\"command\":[\"/wait-shutdown\"]}},io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 0,},},&Container{Id:8fda6efe11911ab80ef6a49da3e5de3d349cb39030be4fe5d4f794d13b73839f,PodSandboxId:442db462e579a8314ecf62614fb47ee6432aec4da52b3501befc97873b9a4215,Metadata:&ContainerMetadata{Name:patch,Attempt:0,},Image:&ImageSpec{Image:registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a9f03b34a3cbfbb26d103a14046ab2c5130a80c3d69d526ff8063d2b37b9fd3f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a62eeff05
ba5194cac31b3f6180655290afa3ed3f2573bcd2aaff319416951eb,State:CONTAINER_EXITED,CreatedAt:1743536861346005948,Labels:map[string]string{io.kubernetes.container.name: patch,io.kubernetes.pod.name: ingress-nginx-admission-patch-klv5s,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: 71787d54-f12b-44db-929c-cfb2c6edaea6,},Annotations:map[string]string{io.kubernetes.container.hash: 3f610496,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f841af2a2cff40e6d54299579db7e96b53c6a5e6a4ff6ea2c331249083f91331,PodSandboxId:fbea6c478d4ff4699b2e48dfd59ceaf69d1ddf1bb3b3d4b3faf07e3fc190952f,Metadata:&ContainerMetadata{Name:create,Attempt:0,},Image:&ImageSpec{Image:registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a9f03b34a3cbfbb26d103a14046ab2c5130a80c3d69d526ff8063d2b37b9fd3f,Annotations:map[string]string{},UserSpecifiedImage:,
RuntimeHandler:,},ImageRef:a62eeff05ba5194cac31b3f6180655290afa3ed3f2573bcd2aaff319416951eb,State:CONTAINER_EXITED,CreatedAt:1743536861229162939,Labels:map[string]string{io.kubernetes.container.name: create,io.kubernetes.pod.name: ingress-nginx-admission-create-swd62,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: b6aec7c0-8bca-4e5a-8921-5dfdaa1bd536,},Annotations:map[string]string{io.kubernetes.container.hash: fe18a2bf,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f2b1606fd77a632a3f0286e63ab2225f6f78f5e3e378f2eeca5b76c4213c581e,PodSandboxId:f779673148015f3283b6b9ca3972dd90ebacd1707164bc85751d00f76c7ee0b3,Metadata:&ContainerMetadata{Name:amd-gpu-device-plugin,Attempt:0,},Image:&ImageSpec{Image:docker.io/rocm/k8s-device-plugin@sha256:f3835498cf2274e0a07c32b38c166c05a876f8eb776d756cc06805e599a3ba5f,Annotations:map[s
tring]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:d5e667c0f2bb6efe709d5abfeb749472af5cb459a5bb05d3ead8d547968c63b8,State:CONTAINER_RUNNING,CreatedAt:1743536831984105063,Labels:map[string]string{io.kubernetes.container.name: amd-gpu-device-plugin,io.kubernetes.pod.name: amd-gpu-device-plugin-bcc9r,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c23b66cf-45c7-4934-893d-bb20072b09e3,},Annotations:map[string]string{io.kubernetes.container.hash: 1903e071,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:292684c22b09f3af493b27c7c808835e14493c1b2fd5e2a92602202cb7d136fe,PodSandboxId:93490d4249b64bf9153f4a70d3007fb913a1490f41a34c4be1fd4d384db1fe09,Metadata:&ContainerMetadata{Name:minikube-ingress-dns,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/minikube-ingress-dns@sha256:07c8f5b205a3f8971bfc6d460978ae00de3
5f17e5d5392b1de8de02356f85dab,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:30dd67412fdea30479de8d5d9bf760870308d24d911c59ea1f1757f04c33cc29,State:CONTAINER_RUNNING,CreatedAt:1743536806754054215,Labels:map[string]string{io.kubernetes.container.name: minikube-ingress-dns,io.kubernetes.pod.name: kube-ingress-dns-minikube,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6cf917b0-6ad6-4a63-ad55-3d3e9fbc5a29,},Annotations:map[string]string{io.kubernetes.container.hash: 8778d474,io.kubernetes.container.ports: [{\"hostPort\":53,\"containerPort\":53,\"protocol\":\"UDP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:05d7db7ddc876169018948c401ad97c5240fd3320140c90beb784b8a051a4367,PodSandboxId:48f36e0ff1922f0004b63cac4216a6e1244c11d4affe706b56d565e5dd5e940b,Metadata:&ContainerMetadata{Name:st
orage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1743536797259309239,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cdf1e6c5-ba2e-4657-bee2-12904cbe2cb7,},Annotations:map[string]string{io.kubernetes.container.hash: 6c6bf961,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:aafeecdf61a5b9e86919f7b7d4d1a083fdaa99af012d05c9db11ba28edc53c2c,PodSandboxId:c6a04c376b4707532583bd01b737c4165eb56c80e4349a780d3eb7935eb9e2cb,Metadata:&ContainerMetadata{Name:coredns,Attemp
t:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1743536793325238350,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-668d6bf9bc-cfh7q,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: f1e19243-d755-429f-adf4-cbba1763647f,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Containe
r{Id:64b4c0edf62b7d5efaf6e9bef6185cc9bce9dc33699854015a37b00d4a7b3307,PodSandboxId:422005c4230d23e3fe9a58b9beeb7dccee5ee43fb06b855c567b6ba5cede4d7f,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:f1332858868e1c6a905123b21e2e322ab45a5b99a3532e68ff49a87c2266ebc5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:f1332858868e1c6a905123b21e2e322ab45a5b99a3532e68ff49a87c2266ebc5,State:CONTAINER_RUNNING,CreatedAt:1743536789964592242,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-rm6gh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9a55728a-36d5-4139-aee2-c3c8d64a56b6,},Annotations:map[string]string{io.kubernetes.container.hash: b4fecc5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:fdeb71283df145c10cc5bbccdd754
f954f7b98430fb0daf8b51e41cc7120b7a7,PodSandboxId:6ab934cb2d64d956489647ebfdad887ee316478780fb7852d0805ea1c9cd82cc,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:d8e673e7c9983f1f53569a9d2ba786c8abb42e3f744f77dc97a595f3caf9435d,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:d8e673e7c9983f1f53569a9d2ba786c8abb42e3f744f77dc97a595f3caf9435d,State:CONTAINER_RUNNING,CreatedAt:1743536778847266876,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-addons-357468,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 0bb3555dbbebd54d405df20dd7b644c6,},Annotations:map[string]string{io.kubernetes.container.hash: 4c5aaea3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:686ea6472bd436e7105ce81b38191c1f65e6a48f2330bf
ee556e65ed0f8a9a54,PodSandboxId:d4c8f7a80344aadc3fafe2a3056c1390b548b2cc780ac20893445578c7f8ac6f,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:b6a454c5a800d201daacead6ff195ec6049fe6dc086621b0670bca912efaf389,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:b6a454c5a800d201daacead6ff195ec6049fe6dc086621b0670bca912efaf389,State:CONTAINER_RUNNING,CreatedAt:1743536778884036550,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-addons-357468,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4a4be3169b641c9360ef9146c83e9c32,},Annotations:map[string]string{io.kubernetes.container.hash: 51692d3d,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d69f9cbd5df7d8aa3d5c80d6dcf011d2e407
e4ca3f088cb7b383e3c9e40d12f3,PodSandboxId:a87a45bd9622cb7ab42be05687511131540c260a5a65cc0fa4669bbe0d143193,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:a9e7e6b294baf1695fccb862d956c5d3ad8510e1e4ca1535f35dc09f247abbfc,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a9e7e6b294baf1695fccb862d956c5d3ad8510e1e4ca1535f35dc09f247abbfc,State:CONTAINER_RUNNING,CreatedAt:1743536778809485383,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-addons-357468,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4c1aafdb6b33142c5783ecab99522fb7,},Annotations:map[string]string{io.kubernetes.container.hash: e68be80f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:37045489d732e16ab2b48596059378f45092b7f684552335bb9ebb30bf262266,PodSandboxId:5a358
49837e2bac54c19e70f086ac0042f84102a1876a743c934d82c5b00687e,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:85b7a174738baecbc53029b7913cd430a2060e0cbdb5f56c7957d32ff7f241ef,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:85b7a174738baecbc53029b7913cd430a2060e0cbdb5f56c7957d32ff7f241ef,State:CONTAINER_RUNNING,CreatedAt:1743536778828813346,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-addons-357468,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6a7d534b830da362d60e580db68e8481,},Annotations:map[string]string{io.kubernetes.container.hash: 7745040f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=8bbc4917-c403-4662-93d2-de0a405b5098 name=/runtime.v1.RuntimeServ
ice/ListContainers
Apr 01 19:52:22 addons-357468 crio[665]: time="2025-04-01 19:52:22.415598655Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=fab9883e-940d-4100-b400-51066a9dea6b name=/runtime.v1.RuntimeService/Version
Apr 01 19:52:22 addons-357468 crio[665]: time="2025-04-01 19:52:22.415672991Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=fab9883e-940d-4100-b400-51066a9dea6b name=/runtime.v1.RuntimeService/Version
Apr 01 19:52:22 addons-357468 crio[665]: time="2025-04-01 19:52:22.416799721Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=5f26dbd0-8711-4a0c-840c-a5ba404e5f2e name=/runtime.v1.ImageService/ImageFsInfo
Apr 01 19:52:22 addons-357468 crio[665]: time="2025-04-01 19:52:22.419726977Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1743537142419694388,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:595374,},InodesUsed:&UInt64Value{Value:201,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=5f26dbd0-8711-4a0c-840c-a5ba404e5f2e name=/runtime.v1.ImageService/ImageFsInfo
Apr 01 19:52:22 addons-357468 crio[665]: time="2025-04-01 19:52:22.420357932Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=0d6071fa-8b72-4f02-830f-29eeec05ead8 name=/runtime.v1.RuntimeService/ListContainers
Apr 01 19:52:22 addons-357468 crio[665]: time="2025-04-01 19:52:22.420520535Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=0d6071fa-8b72-4f02-830f-29eeec05ead8 name=/runtime.v1.RuntimeService/ListContainers
Apr 01 19:52:22 addons-357468 crio[665]: time="2025-04-01 19:52:22.420876395Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:58566dbd14cddb59bb7987291f1f06ee1f46e1f889a90724420b8ad51e07f2fc,PodSandboxId:164a9a575bb9d3f2f3f1b6a2d58c837fd436ea2412bfc3655f1efd02d0d45538,Metadata:&ContainerMetadata{Name:nginx,Attempt:0,},Image:&ImageSpec{Image:docker.io/library/nginx@sha256:4ff102c5d78d254a6f0da062b3cf39eaf07f01eec0927fd21e219d0af8bc0591,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:1ff4bb4faebcfb1f7e01144fa9904a570ab9bab88694457855feb6c6bba3fa07,State:CONTAINER_RUNNING,CreatedAt:1743537003792735729,Labels:map[string]string{io.kubernetes.container.name: nginx,io.kubernetes.pod.name: nginx,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 87f5b89f-50aa-4374-b4de-f14b987a8435,},Annotations:map[string]string{io.kubernetes.container.hash: cdfbc70a,io.kubernetes.container.ports: [{\"containerPort\":80,\"protocol\":\"TCP\"}],
io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:de211d1fc70928258b1dd67c41f6f8ec03cc83e99146405ff93e832d0d04c922,PodSandboxId:74859d6cde350e0946fff9e7b8d56c052b7cb88b20d71dc65fe76e6d6c554eb5,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c,State:CONTAINER_RUNNING,CreatedAt:1743536950830380539,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: d351faea-3a0e-4224-9e5f-f278ee6d59a9,},Annotations:map[string]string{io.kubernetes.container.hash: 35e73d3c,io.kubernetes.con
tainer.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3fb68a046c185ca17291172b4488ece3f3afaab2d57902ac832423f40242a7d8,PodSandboxId:47f50bf89d592f3534fb340b5d0026800251d96ad9ce2caceb354b0b9814380e,Metadata:&ContainerMetadata{Name:controller,Attempt:0,},Image:&ImageSpec{Image:registry.k8s.io/ingress-nginx/controller@sha256:62b61c42ec8dd877b85c0aa24c4744ce44d274bc16cc5d2364edfe67964ba55b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ee44bc2368033ba6147d84fb376356de1e40e4778c20dd8b4817bd1636121ddf,State:CONTAINER_RUNNING,CreatedAt:1743536940183826122,Labels:map[string]string{io.kubernetes.container.name: controller,io.kubernetes.pod.name: ingress-nginx-controller-56d7c84fd4-c9p9b,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: 97e1784a-9374-4066-a5ef-47970fbf9aca,},Annotations:map[string]string{io.kubernetes.
container.hash: 4e8eee94,io.kubernetes.container.ports: [{\"name\":\"http\",\"hostPort\":80,\"containerPort\":80,\"protocol\":\"TCP\"},{\"name\":\"https\",\"hostPort\":443,\"containerPort\":443,\"protocol\":\"TCP\"},{\"name\":\"webhook\",\"containerPort\":8443,\"protocol\":\"TCP\"}],io.kubernetes.container.preStopHandler: {\"exec\":{\"command\":[\"/wait-shutdown\"]}},io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 0,},},&Container{Id:8fda6efe11911ab80ef6a49da3e5de3d349cb39030be4fe5d4f794d13b73839f,PodSandboxId:442db462e579a8314ecf62614fb47ee6432aec4da52b3501befc97873b9a4215,Metadata:&ContainerMetadata{Name:patch,Attempt:0,},Image:&ImageSpec{Image:registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a9f03b34a3cbfbb26d103a14046ab2c5130a80c3d69d526ff8063d2b37b9fd3f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a62eeff05
ba5194cac31b3f6180655290afa3ed3f2573bcd2aaff319416951eb,State:CONTAINER_EXITED,CreatedAt:1743536861346005948,Labels:map[string]string{io.kubernetes.container.name: patch,io.kubernetes.pod.name: ingress-nginx-admission-patch-klv5s,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: 71787d54-f12b-44db-929c-cfb2c6edaea6,},Annotations:map[string]string{io.kubernetes.container.hash: 3f610496,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f841af2a2cff40e6d54299579db7e96b53c6a5e6a4ff6ea2c331249083f91331,PodSandboxId:fbea6c478d4ff4699b2e48dfd59ceaf69d1ddf1bb3b3d4b3faf07e3fc190952f,Metadata:&ContainerMetadata{Name:create,Attempt:0,},Image:&ImageSpec{Image:registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a9f03b34a3cbfbb26d103a14046ab2c5130a80c3d69d526ff8063d2b37b9fd3f,Annotations:map[string]string{},UserSpecifiedImage:,
RuntimeHandler:,},ImageRef:a62eeff05ba5194cac31b3f6180655290afa3ed3f2573bcd2aaff319416951eb,State:CONTAINER_EXITED,CreatedAt:1743536861229162939,Labels:map[string]string{io.kubernetes.container.name: create,io.kubernetes.pod.name: ingress-nginx-admission-create-swd62,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: b6aec7c0-8bca-4e5a-8921-5dfdaa1bd536,},Annotations:map[string]string{io.kubernetes.container.hash: fe18a2bf,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f2b1606fd77a632a3f0286e63ab2225f6f78f5e3e378f2eeca5b76c4213c581e,PodSandboxId:f779673148015f3283b6b9ca3972dd90ebacd1707164bc85751d00f76c7ee0b3,Metadata:&ContainerMetadata{Name:amd-gpu-device-plugin,Attempt:0,},Image:&ImageSpec{Image:docker.io/rocm/k8s-device-plugin@sha256:f3835498cf2274e0a07c32b38c166c05a876f8eb776d756cc06805e599a3ba5f,Annotations:map[s
tring]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:d5e667c0f2bb6efe709d5abfeb749472af5cb459a5bb05d3ead8d547968c63b8,State:CONTAINER_RUNNING,CreatedAt:1743536831984105063,Labels:map[string]string{io.kubernetes.container.name: amd-gpu-device-plugin,io.kubernetes.pod.name: amd-gpu-device-plugin-bcc9r,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c23b66cf-45c7-4934-893d-bb20072b09e3,},Annotations:map[string]string{io.kubernetes.container.hash: 1903e071,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:292684c22b09f3af493b27c7c808835e14493c1b2fd5e2a92602202cb7d136fe,PodSandboxId:93490d4249b64bf9153f4a70d3007fb913a1490f41a34c4be1fd4d384db1fe09,Metadata:&ContainerMetadata{Name:minikube-ingress-dns,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/minikube-ingress-dns@sha256:07c8f5b205a3f8971bfc6d460978ae00de3
5f17e5d5392b1de8de02356f85dab,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:30dd67412fdea30479de8d5d9bf760870308d24d911c59ea1f1757f04c33cc29,State:CONTAINER_RUNNING,CreatedAt:1743536806754054215,Labels:map[string]string{io.kubernetes.container.name: minikube-ingress-dns,io.kubernetes.pod.name: kube-ingress-dns-minikube,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6cf917b0-6ad6-4a63-ad55-3d3e9fbc5a29,},Annotations:map[string]string{io.kubernetes.container.hash: 8778d474,io.kubernetes.container.ports: [{\"hostPort\":53,\"containerPort\":53,\"protocol\":\"UDP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:05d7db7ddc876169018948c401ad97c5240fd3320140c90beb784b8a051a4367,PodSandboxId:48f36e0ff1922f0004b63cac4216a6e1244c11d4affe706b56d565e5dd5e940b,Metadata:&ContainerMetadata{Name:st
orage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1743536797259309239,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cdf1e6c5-ba2e-4657-bee2-12904cbe2cb7,},Annotations:map[string]string{io.kubernetes.container.hash: 6c6bf961,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:aafeecdf61a5b9e86919f7b7d4d1a083fdaa99af012d05c9db11ba28edc53c2c,PodSandboxId:c6a04c376b4707532583bd01b737c4165eb56c80e4349a780d3eb7935eb9e2cb,Metadata:&ContainerMetadata{Name:coredns,Attemp
t:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1743536793325238350,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-668d6bf9bc-cfh7q,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: f1e19243-d755-429f-adf4-cbba1763647f,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Containe
r{Id:64b4c0edf62b7d5efaf6e9bef6185cc9bce9dc33699854015a37b00d4a7b3307,PodSandboxId:422005c4230d23e3fe9a58b9beeb7dccee5ee43fb06b855c567b6ba5cede4d7f,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:f1332858868e1c6a905123b21e2e322ab45a5b99a3532e68ff49a87c2266ebc5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:f1332858868e1c6a905123b21e2e322ab45a5b99a3532e68ff49a87c2266ebc5,State:CONTAINER_RUNNING,CreatedAt:1743536789964592242,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-rm6gh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9a55728a-36d5-4139-aee2-c3c8d64a56b6,},Annotations:map[string]string{io.kubernetes.container.hash: b4fecc5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:fdeb71283df145c10cc5bbccdd754
f954f7b98430fb0daf8b51e41cc7120b7a7,PodSandboxId:6ab934cb2d64d956489647ebfdad887ee316478780fb7852d0805ea1c9cd82cc,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:d8e673e7c9983f1f53569a9d2ba786c8abb42e3f744f77dc97a595f3caf9435d,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:d8e673e7c9983f1f53569a9d2ba786c8abb42e3f744f77dc97a595f3caf9435d,State:CONTAINER_RUNNING,CreatedAt:1743536778847266876,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-addons-357468,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 0bb3555dbbebd54d405df20dd7b644c6,},Annotations:map[string]string{io.kubernetes.container.hash: 4c5aaea3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:686ea6472bd436e7105ce81b38191c1f65e6a48f2330bf
ee556e65ed0f8a9a54,PodSandboxId:d4c8f7a80344aadc3fafe2a3056c1390b548b2cc780ac20893445578c7f8ac6f,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:b6a454c5a800d201daacead6ff195ec6049fe6dc086621b0670bca912efaf389,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:b6a454c5a800d201daacead6ff195ec6049fe6dc086621b0670bca912efaf389,State:CONTAINER_RUNNING,CreatedAt:1743536778884036550,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-addons-357468,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4a4be3169b641c9360ef9146c83e9c32,},Annotations:map[string]string{io.kubernetes.container.hash: 51692d3d,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d69f9cbd5df7d8aa3d5c80d6dcf011d2e407
e4ca3f088cb7b383e3c9e40d12f3,PodSandboxId:a87a45bd9622cb7ab42be05687511131540c260a5a65cc0fa4669bbe0d143193,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:a9e7e6b294baf1695fccb862d956c5d3ad8510e1e4ca1535f35dc09f247abbfc,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a9e7e6b294baf1695fccb862d956c5d3ad8510e1e4ca1535f35dc09f247abbfc,State:CONTAINER_RUNNING,CreatedAt:1743536778809485383,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-addons-357468,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4c1aafdb6b33142c5783ecab99522fb7,},Annotations:map[string]string{io.kubernetes.container.hash: e68be80f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:37045489d732e16ab2b48596059378f45092b7f684552335bb9ebb30bf262266,PodSandboxId:5a358
49837e2bac54c19e70f086ac0042f84102a1876a743c934d82c5b00687e,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:85b7a174738baecbc53029b7913cd430a2060e0cbdb5f56c7957d32ff7f241ef,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:85b7a174738baecbc53029b7913cd430a2060e0cbdb5f56c7957d32ff7f241ef,State:CONTAINER_RUNNING,CreatedAt:1743536778828813346,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-addons-357468,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6a7d534b830da362d60e580db68e8481,},Annotations:map[string]string{io.kubernetes.container.hash: 7745040f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=0d6071fa-8b72-4f02-830f-29eeec05ead8 name=/runtime.v1.RuntimeServ
ice/ListContainers
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
58566dbd14cdd docker.io/library/nginx@sha256:4ff102c5d78d254a6f0da062b3cf39eaf07f01eec0927fd21e219d0af8bc0591 2 minutes ago Running nginx 0 164a9a575bb9d nginx
de211d1fc7092 gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e 3 minutes ago Running busybox 0 74859d6cde350 busybox
3fb68a046c185 registry.k8s.io/ingress-nginx/controller@sha256:62b61c42ec8dd877b85c0aa24c4744ce44d274bc16cc5d2364edfe67964ba55b 3 minutes ago Running controller 0 47f50bf89d592 ingress-nginx-controller-56d7c84fd4-c9p9b
8fda6efe11911 registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a9f03b34a3cbfbb26d103a14046ab2c5130a80c3d69d526ff8063d2b37b9fd3f 4 minutes ago Exited patch 0 442db462e579a ingress-nginx-admission-patch-klv5s
f841af2a2cff4 registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a9f03b34a3cbfbb26d103a14046ab2c5130a80c3d69d526ff8063d2b37b9fd3f 4 minutes ago Exited create 0 fbea6c478d4ff ingress-nginx-admission-create-swd62
f2b1606fd77a6 docker.io/rocm/k8s-device-plugin@sha256:f3835498cf2274e0a07c32b38c166c05a876f8eb776d756cc06805e599a3ba5f 5 minutes ago Running amd-gpu-device-plugin 0 f779673148015 amd-gpu-device-plugin-bcc9r
292684c22b09f gcr.io/k8s-minikube/minikube-ingress-dns@sha256:07c8f5b205a3f8971bfc6d460978ae00de35f17e5d5392b1de8de02356f85dab 5 minutes ago Running minikube-ingress-dns 0 93490d4249b64 kube-ingress-dns-minikube
05d7db7ddc876 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 5 minutes ago Running storage-provisioner 0 48f36e0ff1922 storage-provisioner
aafeecdf61a5b c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6 5 minutes ago Running coredns 0 c6a04c376b470 coredns-668d6bf9bc-cfh7q
64b4c0edf62b7 f1332858868e1c6a905123b21e2e322ab45a5b99a3532e68ff49a87c2266ebc5 5 minutes ago Running kube-proxy 0 422005c4230d2 kube-proxy-rm6gh
686ea6472bd43 b6a454c5a800d201daacead6ff195ec6049fe6dc086621b0670bca912efaf389 6 minutes ago Running kube-controller-manager 0 d4c8f7a80344a kube-controller-manager-addons-357468
fdeb71283df14 d8e673e7c9983f1f53569a9d2ba786c8abb42e3f744f77dc97a595f3caf9435d 6 minutes ago Running kube-scheduler 0 6ab934cb2d64d kube-scheduler-addons-357468
37045489d732e 85b7a174738baecbc53029b7913cd430a2060e0cbdb5f56c7957d32ff7f241ef 6 minutes ago Running kube-apiserver 0 5a35849837e2b kube-apiserver-addons-357468
d69f9cbd5df7d a9e7e6b294baf1695fccb862d956c5d3ad8510e1e4ca1535f35dc09f247abbfc 6 minutes ago Running etcd 0 a87a45bd9622c etcd-addons-357468
==> coredns [aafeecdf61a5b9e86919f7b7d4d1a083fdaa99af012d05c9db11ba28edc53c2c] <==
[INFO] 10.244.0.8:53441 - 59699 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 109 false 1232" NXDOMAIN qr,aa,rd 179 0.000093019s
[INFO] 10.244.0.8:53441 - 3623 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 85 false 1232" NXDOMAIN qr,aa,rd 167 0.000121448s
[INFO] 10.244.0.8:53441 - 34790 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 85 false 1232" NXDOMAIN qr,aa,rd 167 0.000438588s
[INFO] 10.244.0.8:53441 - 47805 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 81 false 1232" NXDOMAIN qr,aa,rd 163 0.000086301s
[INFO] 10.244.0.8:53441 - 12314 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 81 false 1232" NXDOMAIN qr,aa,rd 163 0.000298034s
[INFO] 10.244.0.8:53441 - 29616 "A IN registry.kube-system.svc.cluster.local. udp 67 false 1232" NOERROR qr,aa,rd 110 0.000120386s
[INFO] 10.244.0.8:53441 - 64529 "AAAA IN registry.kube-system.svc.cluster.local. udp 67 false 1232" NOERROR qr,aa,rd 149 0.000120366s
[INFO] 10.244.0.8:47820 - 20200 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000130833s
[INFO] 10.244.0.8:47820 - 19922 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000298207s
[INFO] 10.244.0.8:32990 - 48897 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000092946s
[INFO] 10.244.0.8:32990 - 48638 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000255731s
[INFO] 10.244.0.8:37324 - 37419 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000095342s
[INFO] 10.244.0.8:37324 - 37126 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.00029383s
[INFO] 10.244.0.8:36084 - 17070 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000135208s
[INFO] 10.244.0.8:36084 - 16885 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000106739s
[INFO] 10.244.0.23:56379 - 65466 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000382365s
[INFO] 10.244.0.23:42873 - 3949 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000146293s
[INFO] 10.244.0.23:53236 - 34730 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000115165s
[INFO] 10.244.0.23:41711 - 57613 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000063843s
[INFO] 10.244.0.23:33474 - 11687 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000108385s
[INFO] 10.244.0.23:53713 - 24100 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000114193s
[INFO] 10.244.0.23:36441 - 6458 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.00398178s
[INFO] 10.244.0.23:37597 - 15643 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 496 0.004356915s
[INFO] 10.244.0.26:42549 - 2 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000503598s
[INFO] 10.244.0.26:50947 - 3 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000124063s
==> describe nodes <==
Name: addons-357468
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=addons-357468
kubernetes.io/os=linux
minikube.k8s.io/commit=73c6e1c927350a51068882397e0642f8dfb63f2a
minikube.k8s.io/name=addons-357468
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_04_01T19_46_24_0700
minikube.k8s.io/version=v1.35.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-357468
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Tue, 01 Apr 2025 19:46:21 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-357468
AcquireTime: <unset>
RenewTime: Tue, 01 Apr 2025 19:52:12 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Tue, 01 Apr 2025 19:50:29 +0000 Tue, 01 Apr 2025 19:46:19 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Tue, 01 Apr 2025 19:50:29 +0000 Tue, 01 Apr 2025 19:46:19 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Tue, 01 Apr 2025 19:50:29 +0000 Tue, 01 Apr 2025 19:46:19 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Tue, 01 Apr 2025 19:50:29 +0000 Tue, 01 Apr 2025 19:46:25 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.65
Hostname: addons-357468
Capacity:
cpu: 2
ephemeral-storage: 17734596Ki
hugepages-2Mi: 0
memory: 3912788Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17734596Ki
hugepages-2Mi: 0
memory: 3912788Ki
pods: 110
System Info:
Machine ID: 24808dfd85a74043982a99e7609f5ee6
System UUID: 24808dfd-85a7-4043-982a-99e7609f5ee6
Boot ID: 5b4c7890-de3a-4fd3-ba6b-54832e6404fb
Kernel Version: 5.10.207
OS Image: Buildroot 2023.02.9
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.29.1
Kubelet Version: v1.32.2
Kube-Proxy Version: v1.32.2
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (13 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 3m16s
default hello-world-app-7d9564db4-9qn8z 0 (0%) 0 (0%) 0 (0%) 0 (0%) 2s
default nginx 0 (0%) 0 (0%) 0 (0%) 0 (0%) 2m30s
ingress-nginx ingress-nginx-controller-56d7c84fd4-c9p9b 100m (5%) 0 (0%) 90Mi (2%) 0 (0%) 5m45s
kube-system amd-gpu-device-plugin-bcc9r 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m51s
kube-system coredns-668d6bf9bc-cfh7q 100m (5%) 0 (0%) 70Mi (1%) 170Mi (4%) 5m53s
kube-system etcd-addons-357468 100m (5%) 0 (0%) 100Mi (2%) 0 (0%) 5m58s
kube-system kube-apiserver-addons-357468 250m (12%) 0 (0%) 0 (0%) 0 (0%) 5m58s
kube-system kube-controller-manager-addons-357468 200m (10%) 0 (0%) 0 (0%) 0 (0%) 5m58s
kube-system kube-ingress-dns-minikube 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m49s
kube-system kube-proxy-rm6gh 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m54s
kube-system kube-scheduler-addons-357468 100m (5%) 0 (0%) 0 (0%) 0 (0%) 5m58s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m48s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (42%) 0 (0%)
memory 260Mi (6%) 170Mi (4%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 5m51s kube-proxy
Normal Starting 5m59s kubelet Starting kubelet.
Normal NodeAllocatableEnforced 5m58s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 5m58s kubelet Node addons-357468 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m58s kubelet Node addons-357468 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m58s kubelet Node addons-357468 status is now: NodeHasSufficientPID
Normal NodeReady 5m57s kubelet Node addons-357468 status is now: NodeReady
Normal RegisteredNode 5m55s node-controller Node addons-357468 event: Registered Node addons-357468 in Controller
==> dmesg <==
[ +0.110044] kauditd_printk_skb: 21 callbacks suppressed
[ +5.201531] kauditd_printk_skb: 113 callbacks suppressed
[ +5.029746] kauditd_printk_skb: 152 callbacks suppressed
[ +5.374886] kauditd_printk_skb: 59 callbacks suppressed
[Apr 1 19:47] kauditd_printk_skb: 5 callbacks suppressed
[ +12.717086] kauditd_printk_skb: 2 callbacks suppressed
[ +11.618793] kauditd_printk_skb: 6 callbacks suppressed
[ +7.800237] kauditd_printk_skb: 2 callbacks suppressed
[ +5.002779] kauditd_printk_skb: 5 callbacks suppressed
[ +5.146640] kauditd_printk_skb: 46 callbacks suppressed
[ +5.860013] kauditd_printk_skb: 19 callbacks suppressed
[ +5.378697] kauditd_printk_skb: 23 callbacks suppressed
[Apr 1 19:48] kauditd_printk_skb: 3 callbacks suppressed
[Apr 1 19:49] kauditd_printk_skb: 11 callbacks suppressed
[ +6.185483] kauditd_printk_skb: 9 callbacks suppressed
[ +17.535505] kauditd_printk_skb: 2 callbacks suppressed
[ +5.959260] kauditd_printk_skb: 10 callbacks suppressed
[ +5.655428] kauditd_printk_skb: 29 callbacks suppressed
[ +5.098390] kauditd_printk_skb: 23 callbacks suppressed
[ +5.121943] kauditd_printk_skb: 42 callbacks suppressed
[ +6.012478] kauditd_printk_skb: 36 callbacks suppressed
[Apr 1 19:50] kauditd_printk_skb: 19 callbacks suppressed
[ +14.830167] kauditd_printk_skb: 32 callbacks suppressed
[ +7.899305] kauditd_printk_skb: 7 callbacks suppressed
[ +8.381320] kauditd_printk_skb: 49 callbacks suppressed
==> etcd [d69f9cbd5df7d8aa3d5c80d6dcf011d2e407e4ca3f088cb7b383e3c9e40d12f3] <==
{"level":"info","ts":"2025-04-01T19:49:27.419573Z","caller":"traceutil/trace.go:171","msg":"trace[1876937039] transaction","detail":"{read_only:false; number_of_response:1; response_revision:1327; }","duration":"105.495314ms","start":"2025-04-01T19:49:27.314063Z","end":"2025-04-01T19:49:27.419559Z","steps":["trace[1876937039] 'process raft request' (duration: 92.737745ms)"],"step_count":1}
{"level":"info","ts":"2025-04-01T19:49:36.439574Z","caller":"traceutil/trace.go:171","msg":"trace[399408126] transaction","detail":"{read_only:false; response_revision:1402; number_of_response:1; }","duration":"378.875773ms","start":"2025-04-01T19:49:36.060683Z","end":"2025-04-01T19:49:36.439559Z","steps":["trace[399408126] 'process raft request' (duration: 378.715507ms)"],"step_count":1}
{"level":"warn","ts":"2025-04-01T19:49:36.439702Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-04-01T19:49:36.060645Z","time spent":"378.997689ms","remote":"127.0.0.1:51372","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":4553,"response count":0,"response size":40,"request content":"compare:<target:MOD key:\"/registry/pods/kube-system/metrics-server-7fbb699795-5gb2p\" mod_revision:1400 > success:<request_put:<key:\"/registry/pods/kube-system/metrics-server-7fbb699795-5gb2p\" value_size:4487 >> failure:<request_range:<key:\"/registry/pods/kube-system/metrics-server-7fbb699795-5gb2p\" > >"}
{"level":"info","ts":"2025-04-01T19:49:36.439827Z","caller":"traceutil/trace.go:171","msg":"trace[127517996] linearizableReadLoop","detail":"{readStateIndex:1461; appliedIndex:1461; }","duration":"324.108832ms","start":"2025-04-01T19:49:36.115703Z","end":"2025-04-01T19:49:36.439812Z","steps":["trace[127517996] 'read index received' (duration: 324.101092ms)","trace[127517996] 'applied index is now lower than readState.Index' (duration: 6.628µs)"],"step_count":2}
{"level":"warn","ts":"2025-04-01T19:49:36.440054Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"324.338449ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2025-04-01T19:49:36.440178Z","caller":"traceutil/trace.go:171","msg":"trace[915055605] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1402; }","duration":"324.486418ms","start":"2025-04-01T19:49:36.115680Z","end":"2025-04-01T19:49:36.440166Z","steps":["trace[915055605] 'agreement among raft nodes before linearized reading' (duration: 324.281961ms)"],"step_count":1}
{"level":"warn","ts":"2025-04-01T19:49:36.440378Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-04-01T19:49:36.115660Z","time spent":"324.707839ms","remote":"127.0.0.1:51164","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "}
{"level":"info","ts":"2025-04-01T19:49:36.446260Z","caller":"traceutil/trace.go:171","msg":"trace[563621073] transaction","detail":"{read_only:false; response_revision:1403; number_of_response:1; }","duration":"130.557096ms","start":"2025-04-01T19:49:36.315689Z","end":"2025-04-01T19:49:36.446246Z","steps":["trace[563621073] 'process raft request' (duration: 129.128989ms)"],"step_count":1}
{"level":"warn","ts":"2025-04-01T19:49:36.446975Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"279.981067ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" limit:1 ","response":"range_response_count:1 size:1113"}
{"level":"info","ts":"2025-04-01T19:49:36.447991Z","caller":"traceutil/trace.go:171","msg":"trace[2045988609] range","detail":"{range_begin:/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath; range_end:; response_count:1; response_revision:1403; }","duration":"280.766088ms","start":"2025-04-01T19:49:36.166954Z","end":"2025-04-01T19:49:36.447721Z","steps":["trace[2045988609] 'agreement among raft nodes before linearized reading' (duration: 278.935556ms)"],"step_count":1}
{"level":"warn","ts":"2025-04-01T19:49:53.838795Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"165.709345ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/default/cloud-spanner-emulator-cc9755fc7-xftcs\" limit:1 ","response":"range_response_count:1 size:3511"}
{"level":"info","ts":"2025-04-01T19:49:53.838843Z","caller":"traceutil/trace.go:171","msg":"trace[1894366632] range","detail":"{range_begin:/registry/pods/default/cloud-spanner-emulator-cc9755fc7-xftcs; range_end:; response_count:1; response_revision:1587; }","duration":"165.789518ms","start":"2025-04-01T19:49:53.673041Z","end":"2025-04-01T19:49:53.838831Z","steps":["trace[1894366632] 'range keys from in-memory index tree' (duration: 165.501266ms)"],"step_count":1}
{"level":"warn","ts":"2025-04-01T19:49:53.838946Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"219.539123ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods\" limit:1 ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2025-04-01T19:49:53.838982Z","caller":"traceutil/trace.go:171","msg":"trace[1008702752] range","detail":"{range_begin:/registry/pods; range_end:; response_count:0; response_revision:1587; }","duration":"219.598208ms","start":"2025-04-01T19:49:53.619373Z","end":"2025-04-01T19:49:53.838971Z","steps":["trace[1008702752] 'range keys from in-memory index tree' (duration: 219.394222ms)"],"step_count":1}
{"level":"warn","ts":"2025-04-01T19:50:02.435308Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"374.971254ms","expected-duration":"100ms","prefix":"read-only range ","request":"limit:1 serializable:true keys_only:true ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2025-04-01T19:50:02.435381Z","caller":"traceutil/trace.go:171","msg":"trace[1312093401] range","detail":"{range_begin:; range_end:; response_count:0; response_revision:1649; }","duration":"375.064061ms","start":"2025-04-01T19:50:02.060305Z","end":"2025-04-01T19:50:02.435369Z","steps":["trace[1312093401] 'range keys from in-memory index tree' (duration: 374.950947ms)"],"step_count":1}
{"level":"info","ts":"2025-04-01T19:50:02.440380Z","caller":"traceutil/trace.go:171","msg":"trace[803909234] linearizableReadLoop","detail":"{readStateIndex:1719; appliedIndex:1718; }","duration":"327.248464ms","start":"2025-04-01T19:50:02.113118Z","end":"2025-04-01T19:50:02.440366Z","steps":["trace[803909234] 'read index received' (duration: 327.119309ms)","trace[803909234] 'applied index is now lower than readState.Index' (duration: 128.815µs)"],"step_count":2}
{"level":"info","ts":"2025-04-01T19:50:02.440731Z","caller":"traceutil/trace.go:171","msg":"trace[37837617] transaction","detail":"{read_only:false; response_revision:1650; number_of_response:1; }","duration":"387.389783ms","start":"2025-04-01T19:50:02.053325Z","end":"2025-04-01T19:50:02.440715Z","steps":["trace[37837617] 'process raft request' (duration: 386.954044ms)"],"step_count":1}
{"level":"warn","ts":"2025-04-01T19:50:02.440803Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-04-01T19:50:02.053307Z","time spent":"387.44547ms","remote":"127.0.0.1:36750","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1342,"response count":0,"response size":40,"request content":"compare:<target:MOD key:\"/registry/snapshot.storage.k8s.io/volumesnapshotcontents/snapcontent-5d4544ab-cc29-4070-80d4-8cd914d68587\" mod_revision:0 > success:<request_put:<key:\"/registry/snapshot.storage.k8s.io/volumesnapshotcontents/snapcontent-5d4544ab-cc29-4070-80d4-8cd914d68587\" value_size:1229 >> failure:<>"}
{"level":"warn","ts":"2025-04-01T19:50:02.440955Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"327.832739ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/local-path-storage/local-path-provisioner-service-account\" limit:1 ","response":"range_response_count:1 size:635"}
{"level":"info","ts":"2025-04-01T19:50:02.440975Z","caller":"traceutil/trace.go:171","msg":"trace[1338793133] range","detail":"{range_begin:/registry/serviceaccounts/local-path-storage/local-path-provisioner-service-account; range_end:; response_count:1; response_revision:1650; }","duration":"327.874344ms","start":"2025-04-01T19:50:02.113094Z","end":"2025-04-01T19:50:02.440969Z","steps":["trace[1338793133] 'agreement among raft nodes before linearized reading' (duration: 327.805306ms)"],"step_count":1}
{"level":"warn","ts":"2025-04-01T19:50:02.440992Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-04-01T19:50:02.113080Z","time spent":"327.907984ms","remote":"127.0.0.1:51390","response type":"/etcdserverpb.KV/Range","request count":0,"request size":87,"response count":1,"response size":659,"request content":"key:\"/registry/serviceaccounts/local-path-storage/local-path-provisioner-service-account\" limit:1 "}
{"level":"warn","ts":"2025-04-01T19:50:02.441127Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"316.621671ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2025-04-01T19:50:02.441184Z","caller":"traceutil/trace.go:171","msg":"trace[695906322] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1650; }","duration":"316.701423ms","start":"2025-04-01T19:50:02.124475Z","end":"2025-04-01T19:50:02.441176Z","steps":["trace[695906322] 'agreement among raft nodes before linearized reading' (duration: 316.626551ms)"],"step_count":1}
{"level":"warn","ts":"2025-04-01T19:50:02.441206Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-04-01T19:50:02.124407Z","time spent":"316.793714ms","remote":"127.0.0.1:51164","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "}
==> kernel <==
19:52:22 up 6 min, 0 users, load average: 0.24, 0.91, 0.55
Linux addons-357468 5.10.207 #1 SMP Tue Jan 14 08:15:54 UTC 2025 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2023.02.9"
==> kube-apiserver [37045489d732e16ab2b48596059378f45092b7f684552335bb9ebb30bf262266] <==
E0401 19:47:16.315637 1 remote_available_controller.go:448] "Unhandled Error" err="v1beta1.metrics.k8s.io failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io \"v1beta1.metrics.k8s.io\": the object has been modified; please apply your changes to the latest version and try again" logger="UnhandledError"
E0401 19:49:18.764682 1 conn.go:339] Error on socket receive: read tcp 192.168.39.65:8443->192.168.39.1:49466: use of closed network connection
E0401 19:49:18.946045 1 conn.go:339] Error on socket receive: read tcp 192.168.39.65:8443->192.168.39.1:49486: use of closed network connection
I0401 19:49:28.390026 1 alloc.go:330] "allocated clusterIPs" service="headlamp/headlamp" clusterIPs={"IPv4":"10.101.158.179"}
I0401 19:49:52.404957 1 controller.go:615] quota admission added evaluator for: ingresses.networking.k8s.io
I0401 19:49:52.612654 1 alloc.go:330] "allocated clusterIPs" service="default/nginx" clusterIPs={"IPv4":"10.98.56.3"}
I0401 19:49:55.997350 1 handler.go:286] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager
W0401 19:49:57.040534 1 cacher.go:171] Terminating all watchers from cacher traces.gadget.kinvolk.io
I0401 19:50:01.875820 1 controller.go:615] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io
I0401 19:50:17.283180 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Nothing (removed from the queue).
E0401 19:50:18.039123 1 authentication.go:74] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"local-path-provisioner-service-account\" not found]"
I0401 19:50:25.862842 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0401 19:50:25.862975 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0401 19:50:25.894530 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0401 19:50:25.894688 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0401 19:50:25.919503 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0401 19:50:25.919725 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0401 19:50:25.946210 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0401 19:50:25.946515 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0401 19:50:26.001273 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0401 19:50:26.003070 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
W0401 19:50:26.947045 1 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io
W0401 19:50:27.002574 1 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io
W0401 19:50:27.078805 1 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io
I0401 19:52:21.204124 1 alloc.go:330] "allocated clusterIPs" service="default/hello-world-app" clusterIPs={"IPv4":"10.96.93.204"}
==> kube-controller-manager [686ea6472bd436e7105ce81b38191c1f65e6a48f2330bfee556e65ed0f8a9a54] <==
E0401 19:51:09.559276 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0401 19:51:33.627185 1 reflector.go:362] The watchlist request ended with an error, falling back to the standard LIST/WATCH semantics because making progress is better than deadlocking, err = the server could not find the requested resource
E0401 19:51:33.628541 1 metadata.go:231] "The watchlist request ended with an error, falling back to the standard LIST semantics" err="the server could not find the requested resource" resource="snapshot.storage.k8s.io/v1, Resource=volumesnapshotcontents"
W0401 19:51:33.629328 1 reflector.go:569] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0401 19:51:33.629479 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0401 19:51:42.325722 1 reflector.go:362] The watchlist request ended with an error, falling back to the standard LIST/WATCH semantics because making progress is better than deadlocking, err = the server could not find the requested resource
E0401 19:51:42.327003 1 metadata.go:231] "The watchlist request ended with an error, falling back to the standard LIST semantics" err="the server could not find the requested resource" resource="snapshot.storage.k8s.io/v1, Resource=volumesnapshots"
W0401 19:51:42.327897 1 reflector.go:569] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0401 19:51:42.327950 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0401 19:51:49.763257 1 reflector.go:362] The watchlist request ended with an error, falling back to the standard LIST/WATCH semantics because making progress is better than deadlocking, err = the server could not find the requested resource
E0401 19:51:49.764383 1 metadata.go:231] "The watchlist request ended with an error, falling back to the standard LIST semantics" err="the server could not find the requested resource" resource="gadget.kinvolk.io/v1alpha1, Resource=traces"
W0401 19:51:49.765373 1 reflector.go:569] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0401 19:51:49.765490 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0401 19:51:56.878558 1 reflector.go:362] The watchlist request ended with an error, falling back to the standard LIST/WATCH semantics because making progress is better than deadlocking, err = the server could not find the requested resource
E0401 19:51:56.879894 1 metadata.go:231] "The watchlist request ended with an error, falling back to the standard LIST semantics" err="the server could not find the requested resource" resource="snapshot.storage.k8s.io/v1, Resource=volumesnapshotclasses"
W0401 19:51:56.880870 1 reflector.go:569] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0401 19:51:56.880935 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0401 19:52:20.030945 1 reflector.go:362] The watchlist request ended with an error, falling back to the standard LIST/WATCH semantics because making progress is better than deadlocking, err = the server could not find the requested resource
E0401 19:52:20.031990 1 metadata.go:231] "The watchlist request ended with an error, falling back to the standard LIST semantics" err="the server could not find the requested resource" resource="snapshot.storage.k8s.io/v1, Resource=volumesnapshots"
W0401 19:52:20.032781 1 reflector.go:569] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0401 19:52:20.032828 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
I0401 19:52:21.021146 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-world-app-7d9564db4" duration="30.012703ms"
I0401 19:52:21.034382 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-world-app-7d9564db4" duration="13.188391ms"
I0401 19:52:21.034524 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-world-app-7d9564db4" duration="35.968µs"
I0401 19:52:21.050562 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-world-app-7d9564db4" duration="37.111µs"
==> kube-proxy [64b4c0edf62b7d5efaf6e9bef6185cc9bce9dc33699854015a37b00d4a7b3307] <==
add table ip kube-proxy
^^^^^^^^^^^^^^^^^^^^^^^^
>
E0401 19:46:30.976853 1 proxier.go:733] "Error cleaning up nftables rules" err=<
could not run nftables command: /dev/stdin:1:1-25: Error: Could not process rule: Operation not supported
add table ip6 kube-proxy
^^^^^^^^^^^^^^^^^^^^^^^^^
>
I0401 19:46:31.014063 1 server.go:698] "Successfully retrieved node IP(s)" IPs=["192.168.39.65"]
E0401 19:46:31.014186 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I0401 19:46:31.224189 1 server_linux.go:147] "No iptables support for family" ipFamily="IPv6"
I0401 19:46:31.228594 1 server.go:245] "kube-proxy running in single-stack mode" ipFamily="IPv4"
I0401 19:46:31.228670 1 server_linux.go:170] "Using iptables Proxier"
I0401 19:46:31.264891 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I0401 19:46:31.265163 1 server.go:497] "Version info" version="v1.32.2"
I0401 19:46:31.265175 1 server.go:499] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0401 19:46:31.272975 1 config.go:199] "Starting service config controller"
I0401 19:46:31.281539 1 shared_informer.go:313] Waiting for caches to sync for service config
I0401 19:46:31.281631 1 config.go:105] "Starting endpoint slice config controller"
I0401 19:46:31.281637 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0401 19:46:31.282161 1 config.go:329] "Starting node config controller"
I0401 19:46:31.282168 1 shared_informer.go:313] Waiting for caches to sync for node config
I0401 19:46:31.383567 1 shared_informer.go:320] Caches are synced for node config
I0401 19:46:31.383649 1 shared_informer.go:320] Caches are synced for service config
I0401 19:46:31.383659 1 shared_informer.go:320] Caches are synced for endpoint slice config
==> kube-scheduler [fdeb71283df145c10cc5bbccdd754f954f7b98430fb0daf8b51e41cc7120b7a7] <==
W0401 19:46:21.452367 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0401 19:46:21.452391 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0401 19:46:21.452467 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0401 19:46:21.452495 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0401 19:46:21.452610 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0401 19:46:21.452648 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError"
W0401 19:46:21.452789 1 reflector.go:569] runtime/asm_amd64.s:1700: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0401 19:46:21.452824 1 reflector.go:166] "Unhandled Error" err="runtime/asm_amd64.s:1700: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"
W0401 19:46:22.410092 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
E0401 19:46:22.410146 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0401 19:46:22.450760 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.VolumeAttachment: volumeattachments.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "volumeattachments" in API group "storage.k8s.io" at the cluster scope
E0401 19:46:22.450941 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.VolumeAttachment: failed to list *v1.VolumeAttachment: volumeattachments.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"volumeattachments\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0401 19:46:22.451987 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0401 19:46:22.452055 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0401 19:46:22.458164 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0401 19:46:22.458228 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0401 19:46:22.545872 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0401 19:46:22.545920 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0401 19:46:22.592742 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0401 19:46:22.592835 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0401 19:46:22.606032 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0401 19:46:22.606118 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0401 19:46:22.611547 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0401 19:46:22.611687 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError"
I0401 19:46:23.046042 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Apr 01 19:51:34 addons-357468 kubelet[1230]: E0401 19:51:34.590615 1230 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1743537094590244131,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:595374,},InodesUsed:&UInt64Value{Value:201,},},},ContainerFilesystems:[]*FilesystemUsage{},}"
Apr 01 19:51:34 addons-357468 kubelet[1230]: E0401 19:51:34.590654 1230 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1743537094590244131,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:595374,},InodesUsed:&UInt64Value{Value:201,},},},ContainerFilesystems:[]*FilesystemUsage{},}"
Apr 01 19:51:42 addons-357468 kubelet[1230]: I0401 19:51:42.087389 1230 kubelet_pods.go:1021] "Unable to retrieve pull secret, the image pull may not succeed." pod="default/busybox" secret="" err="secret \"gcp-auth\" not found"
Apr 01 19:51:44 addons-357468 kubelet[1230]: E0401 19:51:44.593137 1230 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1743537104592651831,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:595374,},InodesUsed:&UInt64Value{Value:201,},},},ContainerFilesystems:[]*FilesystemUsage{},}"
Apr 01 19:51:44 addons-357468 kubelet[1230]: E0401 19:51:44.593626 1230 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1743537104592651831,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:595374,},InodesUsed:&UInt64Value{Value:201,},},},ContainerFilesystems:[]*FilesystemUsage{},}"
Apr 01 19:51:54 addons-357468 kubelet[1230]: E0401 19:51:54.595998 1230 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1743537114595693482,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:595374,},InodesUsed:&UInt64Value{Value:201,},},},ContainerFilesystems:[]*FilesystemUsage{},}"
Apr 01 19:51:54 addons-357468 kubelet[1230]: E0401 19:51:54.596072 1230 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1743537114595693482,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:595374,},InodesUsed:&UInt64Value{Value:201,},},},ContainerFilesystems:[]*FilesystemUsage{},}"
Apr 01 19:52:04 addons-357468 kubelet[1230]: E0401 19:52:04.598999 1230 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1743537124598558621,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:595374,},InodesUsed:&UInt64Value{Value:201,},},},ContainerFilesystems:[]*FilesystemUsage{},}"
Apr 01 19:52:04 addons-357468 kubelet[1230]: E0401 19:52:04.599498 1230 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1743537124598558621,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:595374,},InodesUsed:&UInt64Value{Value:201,},},},ContainerFilesystems:[]*FilesystemUsage{},}"
Apr 01 19:52:14 addons-357468 kubelet[1230]: E0401 19:52:14.602083 1230 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1743537134601751206,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:595374,},InodesUsed:&UInt64Value{Value:201,},},},ContainerFilesystems:[]*FilesystemUsage{},}"
Apr 01 19:52:14 addons-357468 kubelet[1230]: E0401 19:52:14.602126 1230 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1743537134601751206,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:595374,},InodesUsed:&UInt64Value{Value:201,},},},ContainerFilesystems:[]*FilesystemUsage{},}"
Apr 01 19:52:21 addons-357468 kubelet[1230]: I0401 19:52:21.031050 1230 memory_manager.go:355] "RemoveStaleState removing state" podUID="1d309d5f-aa0a-4c35-a70e-273f297e4e07" containerName="csi-attacher"
Apr 01 19:52:21 addons-357468 kubelet[1230]: I0401 19:52:21.031097 1230 memory_manager.go:355] "RemoveStaleState removing state" podUID="69f8a0e9-05fc-480c-971e-8b11cf4fec68" containerName="volume-snapshot-controller"
Apr 01 19:52:21 addons-357468 kubelet[1230]: I0401 19:52:21.031104 1230 memory_manager.go:355] "RemoveStaleState removing state" podUID="af407583-e9cd-4c5c-93b2-29c17c4da3d6" containerName="hostpath"
Apr 01 19:52:21 addons-357468 kubelet[1230]: I0401 19:52:21.031109 1230 memory_manager.go:355] "RemoveStaleState removing state" podUID="bb2978a1-f3d5-475c-a8bb-79f50b5bf665" containerName="local-path-provisioner"
Apr 01 19:52:21 addons-357468 kubelet[1230]: I0401 19:52:21.031115 1230 memory_manager.go:355] "RemoveStaleState removing state" podUID="3cb6698d-08a0-410c-9d69-0760d8256362" containerName="volume-snapshot-controller"
Apr 01 19:52:21 addons-357468 kubelet[1230]: I0401 19:52:21.031119 1230 memory_manager.go:355] "RemoveStaleState removing state" podUID="3ff0c75b-f68d-4d93-82fe-027230ee0090" containerName="csi-resizer"
Apr 01 19:52:21 addons-357468 kubelet[1230]: I0401 19:52:21.031123 1230 memory_manager.go:355] "RemoveStaleState removing state" podUID="af407583-e9cd-4c5c-93b2-29c17c4da3d6" containerName="node-driver-registrar"
Apr 01 19:52:21 addons-357468 kubelet[1230]: I0401 19:52:21.031128 1230 memory_manager.go:355] "RemoveStaleState removing state" podUID="af407583-e9cd-4c5c-93b2-29c17c4da3d6" containerName="csi-snapshotter"
Apr 01 19:52:21 addons-357468 kubelet[1230]: I0401 19:52:21.031132 1230 memory_manager.go:355] "RemoveStaleState removing state" podUID="af407583-e9cd-4c5c-93b2-29c17c4da3d6" containerName="liveness-probe"
Apr 01 19:52:21 addons-357468 kubelet[1230]: I0401 19:52:21.031137 1230 memory_manager.go:355] "RemoveStaleState removing state" podUID="af407583-e9cd-4c5c-93b2-29c17c4da3d6" containerName="csi-provisioner"
Apr 01 19:52:21 addons-357468 kubelet[1230]: I0401 19:52:21.031141 1230 memory_manager.go:355] "RemoveStaleState removing state" podUID="0d4da170-5d2d-411b-8f98-496e54109da9" containerName="task-pv-container"
Apr 01 19:52:21 addons-357468 kubelet[1230]: I0401 19:52:21.031146 1230 memory_manager.go:355] "RemoveStaleState removing state" podUID="af407583-e9cd-4c5c-93b2-29c17c4da3d6" containerName="csi-external-health-monitor-controller"
Apr 01 19:52:21 addons-357468 kubelet[1230]: I0401 19:52:21.176518 1230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8fr7\" (UniqueName: \"kubernetes.io/projected/465d0ba8-b2df-46cb-be17-2a98098f865d-kube-api-access-x8fr7\") pod \"hello-world-app-7d9564db4-9qn8z\" (UID: \"465d0ba8-b2df-46cb-be17-2a98098f865d\") " pod="default/hello-world-app-7d9564db4-9qn8z"
Apr 01 19:52:22 addons-357468 kubelet[1230]: I0401 19:52:22.087297 1230 kubelet_pods.go:1021] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/amd-gpu-device-plugin-bcc9r" secret="" err="secret \"gcp-auth\" not found"
==> storage-provisioner [05d7db7ddc876169018948c401ad97c5240fd3320140c90beb784b8a051a4367] <==
I0401 19:46:38.288568 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0401 19:46:38.431728 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0401 19:46:38.431828 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0401 19:46:38.465022 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0401 19:46:38.465240 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-357468_c632b4ad-d96e-418f-a44a-7b9c06f7be56!
I0401 19:46:38.465665 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"518478f1-a57a-4d87-b4e2-962ff30457df", APIVersion:"v1", ResourceVersion:"742", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-357468_c632b4ad-d96e-418f-a44a-7b9c06f7be56 became leader
I0401 19:46:38.569766 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-357468_c632b4ad-d96e-418f-a44a-7b9c06f7be56!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p addons-357468 -n addons-357468
helpers_test.go:261: (dbg) Run: kubectl --context addons-357468 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: hello-world-app-7d9564db4-9qn8z ingress-nginx-admission-create-swd62 ingress-nginx-admission-patch-klv5s
helpers_test.go:274: ======> post-mortem[TestAddons/parallel/Ingress]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-357468 describe pod hello-world-app-7d9564db4-9qn8z ingress-nginx-admission-create-swd62 ingress-nginx-admission-patch-klv5s
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-357468 describe pod hello-world-app-7d9564db4-9qn8z ingress-nginx-admission-create-swd62 ingress-nginx-admission-patch-klv5s: exit status 1 (74.935622ms)
-- stdout --
Name: hello-world-app-7d9564db4-9qn8z
Namespace: default
Priority: 0
Service Account: default
Node: addons-357468/192.168.39.65
Start Time: Tue, 01 Apr 2025 19:52:21 +0000
Labels: app=hello-world-app
pod-template-hash=7d9564db4
Annotations: <none>
Status: Pending
IP:
IPs: <none>
Controlled By: ReplicaSet/hello-world-app-7d9564db4
Containers:
hello-world-app:
Container ID:
Image: docker.io/kicbase/echo-server:1.0
Image ID:
Port: 8080/TCP
Host Port: 0/TCP
State: Waiting
Reason: ContainerCreating
Ready: False
Restart Count: 0
Environment: <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-x8fr7 (ro)
Conditions:
Type Status
PodReadyToStartContainers False
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
kube-api-access-x8fr7:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 2s default-scheduler Successfully assigned default/hello-world-app-7d9564db4-9qn8z to addons-357468
Normal Pulling 2s kubelet Pulling image "docker.io/kicbase/echo-server:1.0"
-- /stdout --
** stderr **
Error from server (NotFound): pods "ingress-nginx-admission-create-swd62" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-klv5s" not found
** /stderr **
helpers_test.go:279: kubectl --context addons-357468 describe pod hello-world-app-7d9564db4-9qn8z ingress-nginx-admission-create-swd62 ingress-nginx-admission-patch-klv5s: exit status 1
addons_test.go:992: (dbg) Run: out/minikube-linux-amd64 -p addons-357468 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:992: (dbg) Done: out/minikube-linux-amd64 -p addons-357468 addons disable ingress-dns --alsologtostderr -v=1: (1.35583817s)
addons_test.go:992: (dbg) Run: out/minikube-linux-amd64 -p addons-357468 addons disable ingress --alsologtostderr -v=1
addons_test.go:992: (dbg) Done: out/minikube-linux-amd64 -p addons-357468 addons disable ingress --alsologtostderr -v=1: (7.743457238s)
--- FAIL: TestAddons/parallel/Ingress (160.59s)