=== RUN TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress
=== CONT TestAddons/parallel/Ingress
addons_test.go:206: (dbg) Run: kubectl --context addons-361656 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:206: (dbg) Done: kubectl --context addons-361656 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s: (5.673278998s)
addons_test.go:231: (dbg) Run: kubectl --context addons-361656 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:244: (dbg) Run: kubectl --context addons-361656 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:249: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [5b06d6d2-998c-4fa5-b223-3add010e8e2f] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [5b06d6d2-998c-4fa5-b223-3add010e8e2f] Running
addons_test.go:249: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 11.019936398s
addons_test.go:261: (dbg) Run: out/minikube-linux-amd64 -p addons-361656 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:261: (dbg) Non-zero exit: out/minikube-linux-amd64 -p addons-361656 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'": exit status 1 (2m9.766954036s)
** stderr **
ssh: Process exited with status 28
** /stderr **
addons_test.go:277: failed to get expected response from http://127.0.0.1/ within minikube: exit status 1
addons_test.go:285: (dbg) Run: kubectl --context addons-361656 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:290: (dbg) Run: out/minikube-linux-amd64 -p addons-361656 ip
addons_test.go:296: (dbg) Run: nslookup hello-john.test 192.168.39.86
addons_test.go:305: (dbg) Run: out/minikube-linux-amd64 -p addons-361656 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:305: (dbg) Done: out/minikube-linux-amd64 -p addons-361656 addons disable ingress-dns --alsologtostderr -v=1: (1.344716508s)
addons_test.go:310: (dbg) Run: out/minikube-linux-amd64 -p addons-361656 addons disable ingress --alsologtostderr -v=1
addons_test.go:310: (dbg) Done: out/minikube-linux-amd64 -p addons-361656 addons disable ingress --alsologtostderr -v=1: (8.039370866s)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p addons-361656 -n addons-361656
helpers_test.go:244: <<< TestAddons/parallel/Ingress FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/parallel/Ingress]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p addons-361656 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p addons-361656 logs -n 25: (1.456334071s)
helpers_test.go:252: TestAddons/parallel/Ingress logs:
-- stdout --
*
* ==> Audit <==
* |---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| start | -o=json --download-only | download-only-526453 | jenkins | v1.32.0 | 12 Dec 23 22:02 UTC | |
| | -p download-only-526453 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| delete | --all | minikube | jenkins | v1.32.0 | 12 Dec 23 22:03 UTC | 12 Dec 23 22:03 UTC |
| delete | -p download-only-526453 | download-only-526453 | jenkins | v1.32.0 | 12 Dec 23 22:03 UTC | 12 Dec 23 22:03 UTC |
| delete | -p download-only-526453 | download-only-526453 | jenkins | v1.32.0 | 12 Dec 23 22:03 UTC | 12 Dec 23 22:03 UTC |
| start | --download-only -p | binary-mirror-207180 | jenkins | v1.32.0 | 12 Dec 23 22:03 UTC | |
| | binary-mirror-207180 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:37499 | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| delete | -p binary-mirror-207180 | binary-mirror-207180 | jenkins | v1.32.0 | 12 Dec 23 22:03 UTC | 12 Dec 23 22:03 UTC |
| addons | disable dashboard -p | addons-361656 | jenkins | v1.32.0 | 12 Dec 23 22:03 UTC | |
| | addons-361656 | | | | | |
| addons | enable dashboard -p | addons-361656 | jenkins | v1.32.0 | 12 Dec 23 22:03 UTC | |
| | addons-361656 | | | | | |
| start | -p addons-361656 --wait=true | addons-361656 | jenkins | v1.32.0 | 12 Dec 23 22:03 UTC | 12 Dec 23 22:05 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
| | --addons=helm-tiller | | | | | |
| addons | disable inspektor-gadget -p | addons-361656 | jenkins | v1.32.0 | 12 Dec 23 22:05 UTC | 12 Dec 23 22:05 UTC |
| | addons-361656 | | | | | |
| addons | addons-361656 addons disable | addons-361656 | jenkins | v1.32.0 | 12 Dec 23 22:05 UTC | 12 Dec 23 22:05 UTC |
| | helm-tiller --alsologtostderr | | | | | |
| | -v=1 | | | | | |
| ip | addons-361656 ip | addons-361656 | jenkins | v1.32.0 | 12 Dec 23 22:05 UTC | 12 Dec 23 22:05 UTC |
| addons | addons-361656 addons disable | addons-361656 | jenkins | v1.32.0 | 12 Dec 23 22:05 UTC | 12 Dec 23 22:05 UTC |
| | registry --alsologtostderr | | | | | |
| | -v=1 | | | | | |
| addons | disable cloud-spanner -p | addons-361656 | jenkins | v1.32.0 | 12 Dec 23 22:05 UTC | 12 Dec 23 22:05 UTC |
| | addons-361656 | | | | | |
| addons | disable nvidia-device-plugin | addons-361656 | jenkins | v1.32.0 | 12 Dec 23 22:05 UTC | 12 Dec 23 22:05 UTC |
| | -p addons-361656 | | | | | |
| addons | enable headlamp | addons-361656 | jenkins | v1.32.0 | 12 Dec 23 22:05 UTC | 12 Dec 23 22:05 UTC |
| | -p addons-361656 | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| ssh | addons-361656 ssh curl -s | addons-361656 | jenkins | v1.32.0 | 12 Dec 23 22:05 UTC | |
| | http://127.0.0.1/ -H 'Host: | | | | | |
| | nginx.example.com' | | | | | |
| addons | addons-361656 addons | addons-361656 | jenkins | v1.32.0 | 12 Dec 23 22:05 UTC | 12 Dec 23 22:05 UTC |
| | disable metrics-server | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| ssh | addons-361656 ssh cat | addons-361656 | jenkins | v1.32.0 | 12 Dec 23 22:05 UTC | 12 Dec 23 22:05 UTC |
| | /opt/local-path-provisioner/pvc-274c2300-c02f-4998-a3f1-15f0e2208ef9_default_test-pvc/file1 | | | | | |
| addons | addons-361656 addons disable | addons-361656 | jenkins | v1.32.0 | 12 Dec 23 22:05 UTC | 12 Dec 23 22:05 UTC |
| | storage-provisioner-rancher | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | addons-361656 addons | addons-361656 | jenkins | v1.32.0 | 12 Dec 23 22:06 UTC | 12 Dec 23 22:06 UTC |
| | disable csi-hostpath-driver | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | addons-361656 addons | addons-361656 | jenkins | v1.32.0 | 12 Dec 23 22:06 UTC | 12 Dec 23 22:06 UTC |
| | disable volumesnapshots | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| ip | addons-361656 ip | addons-361656 | jenkins | v1.32.0 | 12 Dec 23 22:07 UTC | 12 Dec 23 22:07 UTC |
| addons | addons-361656 addons disable | addons-361656 | jenkins | v1.32.0 | 12 Dec 23 22:07 UTC | 12 Dec 23 22:07 UTC |
| | ingress-dns --alsologtostderr | | | | | |
| | -v=1 | | | | | |
| addons | addons-361656 addons disable | addons-361656 | jenkins | v1.32.0 | 12 Dec 23 22:07 UTC | 12 Dec 23 22:08 UTC |
| | ingress --alsologtostderr -v=1 | | | | | |
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
*
* ==> Last Start <==
* Log file created at: 2023/12/12 22:03:01
Running on machine: ubuntu-20-agent-13
Binary: Built with gc go1.21.5 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1212 22:03:01.346202 84229 out.go:296] Setting OutFile to fd 1 ...
I1212 22:03:01.346347 84229 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1212 22:03:01.346360 84229 out.go:309] Setting ErrFile to fd 2...
I1212 22:03:01.346365 84229 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1212 22:03:01.346577 84229 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17761-76611/.minikube/bin
I1212 22:03:01.347229 84229 out.go:303] Setting JSON to false
I1212 22:03:01.348096 84229 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":9935,"bootTime":1702408646,"procs":174,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1047-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1212 22:03:01.348158 84229 start.go:138] virtualization: kvm guest
I1212 22:03:01.350766 84229 out.go:177] * [addons-361656] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I1212 22:03:01.352605 84229 out.go:177] - MINIKUBE_LOCATION=17761
I1212 22:03:01.352601 84229 notify.go:220] Checking for updates...
I1212 22:03:01.354395 84229 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1212 22:03:01.355939 84229 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17761-76611/kubeconfig
I1212 22:03:01.357466 84229 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17761-76611/.minikube
I1212 22:03:01.359050 84229 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I1212 22:03:01.360652 84229 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I1212 22:03:01.362484 84229 driver.go:392] Setting default libvirt URI to qemu:///system
I1212 22:03:01.394988 84229 out.go:177] * Using the kvm2 driver based on user configuration
I1212 22:03:01.396673 84229 start.go:298] selected driver: kvm2
I1212 22:03:01.396693 84229 start.go:902] validating driver "kvm2" against <nil>
I1212 22:03:01.396705 84229 start.go:913] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1212 22:03:01.397426 84229 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1212 22:03:01.397508 84229 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17761-76611/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I1212 22:03:01.412841 84229 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I1212 22:03:01.412888 84229 start_flags.go:309] no existing cluster config was found, will generate one from the flags
I1212 22:03:01.413095 84229 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1212 22:03:01.413152 84229 cni.go:84] Creating CNI manager for ""
I1212 22:03:01.413164 84229 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I1212 22:03:01.413176 84229 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I1212 22:03:01.413182 84229 start_flags.go:323] config:
{Name:addons-361656 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1702394725-17761@sha256:d54bd539f5344c99d05c8897079f380df5ad03e2c1323e08060f77c1f95b4517 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:addons-361656 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISo
cket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
I1212 22:03:01.413341 84229 iso.go:125] acquiring lock: {Name:mkf96250a0474180453751c446ab11a6b46f047e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1212 22:03:01.415369 84229 out.go:177] * Starting control plane node addons-361656 in cluster addons-361656
I1212 22:03:01.416797 84229 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I1212 22:03:01.416835 84229 preload.go:148] Found local preload: /home/jenkins/minikube-integration/17761-76611/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4
I1212 22:03:01.416848 84229 cache.go:56] Caching tarball of preloaded images
I1212 22:03:01.416950 84229 preload.go:174] Found /home/jenkins/minikube-integration/17761-76611/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I1212 22:03:01.416964 84229 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on crio
I1212 22:03:01.417307 84229 profile.go:148] Saving config to /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/config.json ...
I1212 22:03:01.417331 84229 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/config.json: {Name:mk5b9e0620b4003e0d57419886eb6048c9d44714 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1212 22:03:01.417530 84229 start.go:365] acquiring machines lock for addons-361656: {Name:mk555df2d735c9b28cd3d47b9383af9866178911 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I1212 22:03:01.417595 84229 start.go:369] acquired machines lock for "addons-361656" in 44.862µs
I1212 22:03:01.417619 84229 start.go:93] Provisioning new machine with config: &{Name:addons-361656 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17761/minikube-v1.32.1-1702394653-17761-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1702394725-17761@sha256:d54bd539f5344c99d05c8897079f380df5ad03e2c1323e08060f77c1f95b4517 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:addons-361656 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountO
ptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I1212 22:03:01.417677 84229 start.go:125] createHost starting for "" (driver="kvm2")
I1212 22:03:01.420515 84229 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
I1212 22:03:01.420651 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:01.420693 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:01.435590 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37827
I1212 22:03:01.436285 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:01.436999 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:01.437024 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:01.437413 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:01.437644 84229 main.go:141] libmachine: (addons-361656) Calling .GetMachineName
I1212 22:03:01.437815 84229 main.go:141] libmachine: (addons-361656) Calling .DriverName
I1212 22:03:01.438012 84229 start.go:159] libmachine.API.Create for "addons-361656" (driver="kvm2")
I1212 22:03:01.438047 84229 client.go:168] LocalClient.Create starting
I1212 22:03:01.438083 84229 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/17761-76611/.minikube/certs/ca.pem
I1212 22:03:01.614880 84229 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/17761-76611/.minikube/certs/cert.pem
I1212 22:03:01.701914 84229 main.go:141] libmachine: Running pre-create checks...
I1212 22:03:01.701942 84229 main.go:141] libmachine: (addons-361656) Calling .PreCreateCheck
I1212 22:03:01.702541 84229 main.go:141] libmachine: (addons-361656) Calling .GetConfigRaw
I1212 22:03:01.703051 84229 main.go:141] libmachine: Creating machine...
I1212 22:03:01.703068 84229 main.go:141] libmachine: (addons-361656) Calling .Create
I1212 22:03:01.703254 84229 main.go:141] libmachine: (addons-361656) Creating KVM machine...
I1212 22:03:01.704603 84229 main.go:141] libmachine: (addons-361656) DBG | found existing default KVM network
I1212 22:03:01.705304 84229 main.go:141] libmachine: (addons-361656) DBG | I1212 22:03:01.705103 84251 network.go:209] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015a40}
I1212 22:03:01.710910 84229 main.go:141] libmachine: (addons-361656) DBG | trying to create private KVM network mk-addons-361656 192.168.39.0/24...
I1212 22:03:01.782931 84229 main.go:141] libmachine: (addons-361656) DBG | private KVM network mk-addons-361656 192.168.39.0/24 created
I1212 22:03:01.782980 84229 main.go:141] libmachine: (addons-361656) DBG | I1212 22:03:01.782895 84251 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/17761-76611/.minikube
I1212 22:03:01.782995 84229 main.go:141] libmachine: (addons-361656) Setting up store path in /home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656 ...
I1212 22:03:01.783014 84229 main.go:141] libmachine: (addons-361656) Building disk image from file:///home/jenkins/minikube-integration/17761-76611/.minikube/cache/iso/amd64/minikube-v1.32.1-1702394653-17761-amd64.iso
I1212 22:03:01.783035 84229 main.go:141] libmachine: (addons-361656) Downloading /home/jenkins/minikube-integration/17761-76611/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/17761-76611/.minikube/cache/iso/amd64/minikube-v1.32.1-1702394653-17761-amd64.iso...
I1212 22:03:01.996224 84229 main.go:141] libmachine: (addons-361656) DBG | I1212 22:03:01.995992 84251 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656/id_rsa...
I1212 22:03:02.062911 84229 main.go:141] libmachine: (addons-361656) DBG | I1212 22:03:02.062759 84251 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656/addons-361656.rawdisk...
I1212 22:03:02.062948 84229 main.go:141] libmachine: (addons-361656) DBG | Writing magic tar header
I1212 22:03:02.062959 84229 main.go:141] libmachine: (addons-361656) DBG | Writing SSH key tar header
I1212 22:03:02.062968 84229 main.go:141] libmachine: (addons-361656) DBG | I1212 22:03:02.062911 84251 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656 ...
I1212 22:03:02.063046 84229 main.go:141] libmachine: (addons-361656) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656
I1212 22:03:02.063093 84229 main.go:141] libmachine: (addons-361656) Setting executable bit set on /home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656 (perms=drwx------)
I1212 22:03:02.063112 84229 main.go:141] libmachine: (addons-361656) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17761-76611/.minikube/machines
I1212 22:03:02.063130 84229 main.go:141] libmachine: (addons-361656) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17761-76611/.minikube
I1212 22:03:02.063145 84229 main.go:141] libmachine: (addons-361656) Setting executable bit set on /home/jenkins/minikube-integration/17761-76611/.minikube/machines (perms=drwxr-xr-x)
I1212 22:03:02.063176 84229 main.go:141] libmachine: (addons-361656) Setting executable bit set on /home/jenkins/minikube-integration/17761-76611/.minikube (perms=drwxr-xr-x)
I1212 22:03:02.063199 84229 main.go:141] libmachine: (addons-361656) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17761-76611
I1212 22:03:02.063208 84229 main.go:141] libmachine: (addons-361656) Setting executable bit set on /home/jenkins/minikube-integration/17761-76611 (perms=drwxrwxr-x)
I1212 22:03:02.063217 84229 main.go:141] libmachine: (addons-361656) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I1212 22:03:02.063226 84229 main.go:141] libmachine: (addons-361656) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I1212 22:03:02.063257 84229 main.go:141] libmachine: (addons-361656) Creating domain...
I1212 22:03:02.063272 84229 main.go:141] libmachine: (addons-361656) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I1212 22:03:02.063282 84229 main.go:141] libmachine: (addons-361656) DBG | Checking permissions on dir: /home/jenkins
I1212 22:03:02.063313 84229 main.go:141] libmachine: (addons-361656) DBG | Checking permissions on dir: /home
I1212 22:03:02.063343 84229 main.go:141] libmachine: (addons-361656) DBG | Skipping /home - not owner
I1212 22:03:02.064469 84229 main.go:141] libmachine: (addons-361656) define libvirt domain using xml:
I1212 22:03:02.064494 84229 main.go:141] libmachine: (addons-361656) <domain type='kvm'>
I1212 22:03:02.064509 84229 main.go:141] libmachine: (addons-361656) <name>addons-361656</name>
I1212 22:03:02.064532 84229 main.go:141] libmachine: (addons-361656) <memory unit='MiB'>4000</memory>
I1212 22:03:02.064551 84229 main.go:141] libmachine: (addons-361656) <vcpu>2</vcpu>
I1212 22:03:02.064560 84229 main.go:141] libmachine: (addons-361656) <features>
I1212 22:03:02.064566 84229 main.go:141] libmachine: (addons-361656) <acpi/>
I1212 22:03:02.064577 84229 main.go:141] libmachine: (addons-361656) <apic/>
I1212 22:03:02.064611 84229 main.go:141] libmachine: (addons-361656) <pae/>
I1212 22:03:02.064638 84229 main.go:141] libmachine: (addons-361656)
I1212 22:03:02.064654 84229 main.go:141] libmachine: (addons-361656) </features>
I1212 22:03:02.064668 84229 main.go:141] libmachine: (addons-361656) <cpu mode='host-passthrough'>
I1212 22:03:02.064680 84229 main.go:141] libmachine: (addons-361656)
I1212 22:03:02.064691 84229 main.go:141] libmachine: (addons-361656) </cpu>
I1212 22:03:02.064703 84229 main.go:141] libmachine: (addons-361656) <os>
I1212 22:03:02.064720 84229 main.go:141] libmachine: (addons-361656) <type>hvm</type>
I1212 22:03:02.064740 84229 main.go:141] libmachine: (addons-361656) <boot dev='cdrom'/>
I1212 22:03:02.064752 84229 main.go:141] libmachine: (addons-361656) <boot dev='hd'/>
I1212 22:03:02.064764 84229 main.go:141] libmachine: (addons-361656) <bootmenu enable='no'/>
I1212 22:03:02.064775 84229 main.go:141] libmachine: (addons-361656) </os>
I1212 22:03:02.064795 84229 main.go:141] libmachine: (addons-361656) <devices>
I1212 22:03:02.064812 84229 main.go:141] libmachine: (addons-361656) <disk type='file' device='cdrom'>
I1212 22:03:02.064831 84229 main.go:141] libmachine: (addons-361656) <source file='/home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656/boot2docker.iso'/>
I1212 22:03:02.064845 84229 main.go:141] libmachine: (addons-361656) <target dev='hdc' bus='scsi'/>
I1212 22:03:02.064857 84229 main.go:141] libmachine: (addons-361656) <readonly/>
I1212 22:03:02.064869 84229 main.go:141] libmachine: (addons-361656) </disk>
I1212 22:03:02.064901 84229 main.go:141] libmachine: (addons-361656) <disk type='file' device='disk'>
I1212 22:03:02.064926 84229 main.go:141] libmachine: (addons-361656) <driver name='qemu' type='raw' cache='default' io='threads' />
I1212 22:03:02.064960 84229 main.go:141] libmachine: (addons-361656) <source file='/home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656/addons-361656.rawdisk'/>
I1212 22:03:02.064978 84229 main.go:141] libmachine: (addons-361656) <target dev='hda' bus='virtio'/>
I1212 22:03:02.064992 84229 main.go:141] libmachine: (addons-361656) </disk>
I1212 22:03:02.065005 84229 main.go:141] libmachine: (addons-361656) <interface type='network'>
I1212 22:03:02.065019 84229 main.go:141] libmachine: (addons-361656) <source network='mk-addons-361656'/>
I1212 22:03:02.065034 84229 main.go:141] libmachine: (addons-361656) <model type='virtio'/>
I1212 22:03:02.065044 84229 main.go:141] libmachine: (addons-361656) </interface>
I1212 22:03:02.065055 84229 main.go:141] libmachine: (addons-361656) <interface type='network'>
I1212 22:03:02.065068 84229 main.go:141] libmachine: (addons-361656) <source network='default'/>
I1212 22:03:02.065088 84229 main.go:141] libmachine: (addons-361656) <model type='virtio'/>
I1212 22:03:02.065104 84229 main.go:141] libmachine: (addons-361656) </interface>
I1212 22:03:02.065117 84229 main.go:141] libmachine: (addons-361656) <serial type='pty'>
I1212 22:03:02.065129 84229 main.go:141] libmachine: (addons-361656) <target port='0'/>
I1212 22:03:02.065141 84229 main.go:141] libmachine: (addons-361656) </serial>
I1212 22:03:02.065150 84229 main.go:141] libmachine: (addons-361656) <console type='pty'>
I1212 22:03:02.065162 84229 main.go:141] libmachine: (addons-361656) <target type='serial' port='0'/>
I1212 22:03:02.065174 84229 main.go:141] libmachine: (addons-361656) </console>
I1212 22:03:02.065200 84229 main.go:141] libmachine: (addons-361656) <rng model='virtio'>
I1212 22:03:02.065223 84229 main.go:141] libmachine: (addons-361656) <backend model='random'>/dev/random</backend>
I1212 22:03:02.065237 84229 main.go:141] libmachine: (addons-361656) </rng>
I1212 22:03:02.065246 84229 main.go:141] libmachine: (addons-361656)
I1212 22:03:02.065258 84229 main.go:141] libmachine: (addons-361656)
I1212 22:03:02.065270 84229 main.go:141] libmachine: (addons-361656) </devices>
I1212 22:03:02.065287 84229 main.go:141] libmachine: (addons-361656) </domain>
I1212 22:03:02.065308 84229 main.go:141] libmachine: (addons-361656)
I1212 22:03:02.070080 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:4c:38:4b in network default
I1212 22:03:02.070716 84229 main.go:141] libmachine: (addons-361656) Ensuring networks are active...
I1212 22:03:02.070738 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:02.071512 84229 main.go:141] libmachine: (addons-361656) Ensuring network default is active
I1212 22:03:02.071954 84229 main.go:141] libmachine: (addons-361656) Ensuring network mk-addons-361656 is active
I1212 22:03:02.072471 84229 main.go:141] libmachine: (addons-361656) Getting domain xml...
I1212 22:03:02.073179 84229 main.go:141] libmachine: (addons-361656) Creating domain...
I1212 22:03:03.300638 84229 main.go:141] libmachine: (addons-361656) Waiting to get IP...
I1212 22:03:03.301471 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:03.301862 84229 main.go:141] libmachine: (addons-361656) DBG | unable to find current IP address of domain addons-361656 in network mk-addons-361656
I1212 22:03:03.301889 84229 main.go:141] libmachine: (addons-361656) DBG | I1212 22:03:03.301850 84251 retry.go:31] will retry after 204.582203ms: waiting for machine to come up
I1212 22:03:03.508428 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:03.509058 84229 main.go:141] libmachine: (addons-361656) DBG | unable to find current IP address of domain addons-361656 in network mk-addons-361656
I1212 22:03:03.509083 84229 main.go:141] libmachine: (addons-361656) DBG | I1212 22:03:03.508960 84251 retry.go:31] will retry after 292.889283ms: waiting for machine to come up
I1212 22:03:03.803706 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:03.804116 84229 main.go:141] libmachine: (addons-361656) DBG | unable to find current IP address of domain addons-361656 in network mk-addons-361656
I1212 22:03:03.804144 84229 main.go:141] libmachine: (addons-361656) DBG | I1212 22:03:03.804050 84251 retry.go:31] will retry after 407.602482ms: waiting for machine to come up
I1212 22:03:04.213809 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:04.214351 84229 main.go:141] libmachine: (addons-361656) DBG | unable to find current IP address of domain addons-361656 in network mk-addons-361656
I1212 22:03:04.214380 84229 main.go:141] libmachine: (addons-361656) DBG | I1212 22:03:04.214289 84251 retry.go:31] will retry after 385.172128ms: waiting for machine to come up
I1212 22:03:04.601077 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:04.601688 84229 main.go:141] libmachine: (addons-361656) DBG | unable to find current IP address of domain addons-361656 in network mk-addons-361656
I1212 22:03:04.601727 84229 main.go:141] libmachine: (addons-361656) DBG | I1212 22:03:04.601676 84251 retry.go:31] will retry after 582.6214ms: waiting for machine to come up
I1212 22:03:05.185443 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:05.185944 84229 main.go:141] libmachine: (addons-361656) DBG | unable to find current IP address of domain addons-361656 in network mk-addons-361656
I1212 22:03:05.185974 84229 main.go:141] libmachine: (addons-361656) DBG | I1212 22:03:05.185891 84251 retry.go:31] will retry after 881.168943ms: waiting for machine to come up
I1212 22:03:06.069279 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:06.069784 84229 main.go:141] libmachine: (addons-361656) DBG | unable to find current IP address of domain addons-361656 in network mk-addons-361656
I1212 22:03:06.069811 84229 main.go:141] libmachine: (addons-361656) DBG | I1212 22:03:06.069747 84251 retry.go:31] will retry after 894.03025ms: waiting for machine to come up
I1212 22:03:06.965495 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:06.965839 84229 main.go:141] libmachine: (addons-361656) DBG | unable to find current IP address of domain addons-361656 in network mk-addons-361656
I1212 22:03:06.965873 84229 main.go:141] libmachine: (addons-361656) DBG | I1212 22:03:06.965771 84251 retry.go:31] will retry after 1.33116679s: waiting for machine to come up
I1212 22:03:08.299286 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:08.299705 84229 main.go:141] libmachine: (addons-361656) DBG | unable to find current IP address of domain addons-361656 in network mk-addons-361656
I1212 22:03:08.299735 84229 main.go:141] libmachine: (addons-361656) DBG | I1212 22:03:08.299637 84251 retry.go:31] will retry after 1.176150855s: waiting for machine to come up
I1212 22:03:09.477258 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:09.477655 84229 main.go:141] libmachine: (addons-361656) DBG | unable to find current IP address of domain addons-361656 in network mk-addons-361656
I1212 22:03:09.477686 84229 main.go:141] libmachine: (addons-361656) DBG | I1212 22:03:09.477600 84251 retry.go:31] will retry after 1.682978043s: waiting for machine to come up
I1212 22:03:11.162541 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:11.163011 84229 main.go:141] libmachine: (addons-361656) DBG | unable to find current IP address of domain addons-361656 in network mk-addons-361656
I1212 22:03:11.163034 84229 main.go:141] libmachine: (addons-361656) DBG | I1212 22:03:11.162966 84251 retry.go:31] will retry after 2.399185345s: waiting for machine to come up
I1212 22:03:13.564479 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:13.564976 84229 main.go:141] libmachine: (addons-361656) DBG | unable to find current IP address of domain addons-361656 in network mk-addons-361656
I1212 22:03:13.565012 84229 main.go:141] libmachine: (addons-361656) DBG | I1212 22:03:13.564885 84251 retry.go:31] will retry after 2.559663997s: waiting for machine to come up
I1212 22:03:16.125632 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:16.126049 84229 main.go:141] libmachine: (addons-361656) DBG | unable to find current IP address of domain addons-361656 in network mk-addons-361656
I1212 22:03:16.126074 84229 main.go:141] libmachine: (addons-361656) DBG | I1212 22:03:16.126002 84251 retry.go:31] will retry after 3.62228261s: waiting for machine to come up
I1212 22:03:19.752132 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:19.752566 84229 main.go:141] libmachine: (addons-361656) DBG | unable to find current IP address of domain addons-361656 in network mk-addons-361656
I1212 22:03:19.752594 84229 main.go:141] libmachine: (addons-361656) DBG | I1212 22:03:19.752509 84251 retry.go:31] will retry after 3.855770406s: waiting for machine to come up
I1212 22:03:23.611431 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:23.611897 84229 main.go:141] libmachine: (addons-361656) Found IP for machine: 192.168.39.86
I1212 22:03:23.611911 84229 main.go:141] libmachine: (addons-361656) Reserving static IP address...
I1212 22:03:23.611964 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has current primary IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:23.612257 84229 main.go:141] libmachine: (addons-361656) DBG | unable to find host DHCP lease matching {name: "addons-361656", mac: "52:54:00:9c:1e:2f", ip: "192.168.39.86"} in network mk-addons-361656
I1212 22:03:23.684176 84229 main.go:141] libmachine: (addons-361656) DBG | Getting to WaitForSSH function...
I1212 22:03:23.684217 84229 main.go:141] libmachine: (addons-361656) Reserved static IP address: 192.168.39.86
I1212 22:03:23.684230 84229 main.go:141] libmachine: (addons-361656) Waiting for SSH to be available...
I1212 22:03:23.686674 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:23.686986 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:minikube Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:23.687016 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:23.687216 84229 main.go:141] libmachine: (addons-361656) DBG | Using SSH client type: external
I1212 22:03:23.687264 84229 main.go:141] libmachine: (addons-361656) DBG | Using SSH private key: /home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656/id_rsa (-rw-------)
I1212 22:03:23.687303 84229 main.go:141] libmachine: (addons-361656) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.86 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656/id_rsa -p 22] /usr/bin/ssh <nil>}
I1212 22:03:23.687318 84229 main.go:141] libmachine: (addons-361656) DBG | About to run SSH command:
I1212 22:03:23.687333 84229 main.go:141] libmachine: (addons-361656) DBG | exit 0
I1212 22:03:23.783277 84229 main.go:141] libmachine: (addons-361656) DBG | SSH cmd err, output: <nil>:
I1212 22:03:23.783556 84229 main.go:141] libmachine: (addons-361656) KVM machine creation complete!
I1212 22:03:23.783893 84229 main.go:141] libmachine: (addons-361656) Calling .GetConfigRaw
I1212 22:03:23.784466 84229 main.go:141] libmachine: (addons-361656) Calling .DriverName
I1212 22:03:23.784688 84229 main.go:141] libmachine: (addons-361656) Calling .DriverName
I1212 22:03:23.784872 84229 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I1212 22:03:23.784894 84229 main.go:141] libmachine: (addons-361656) Calling .GetState
I1212 22:03:23.786247 84229 main.go:141] libmachine: Detecting operating system of created instance...
I1212 22:03:23.786264 84229 main.go:141] libmachine: Waiting for SSH to be available...
I1212 22:03:23.786272 84229 main.go:141] libmachine: Getting to WaitForSSH function...
I1212 22:03:23.786282 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHHostname
I1212 22:03:23.788736 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:23.789113 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:23.789141 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:23.789321 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHPort
I1212 22:03:23.789474 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:23.789616 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:23.789713 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHUsername
I1212 22:03:23.789891 84229 main.go:141] libmachine: Using SSH client type: native
I1212 22:03:23.790374 84229 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x808ea0] 0x80bb80 <nil> [] 0s} 192.168.39.86 22 <nil> <nil>}
I1212 22:03:23.790390 84229 main.go:141] libmachine: About to run SSH command:
exit 0
I1212 22:03:23.918602 84229 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1212 22:03:23.918629 84229 main.go:141] libmachine: Detecting the provisioner...
I1212 22:03:23.918639 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHHostname
I1212 22:03:23.921268 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:23.921593 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:23.921635 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:23.921799 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHPort
I1212 22:03:23.921987 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:23.922142 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:23.922293 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHUsername
I1212 22:03:23.922457 84229 main.go:141] libmachine: Using SSH client type: native
I1212 22:03:23.922808 84229 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x808ea0] 0x80bb80 <nil> [] 0s} 192.168.39.86 22 <nil> <nil>}
I1212 22:03:23.922822 84229 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I1212 22:03:24.052273 84229 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2021.02.12-1-g161fa11-dirty
ID=buildroot
VERSION_ID=2021.02.12
PRETTY_NAME="Buildroot 2021.02.12"
I1212 22:03:24.052415 84229 main.go:141] libmachine: found compatible host: buildroot
I1212 22:03:24.052435 84229 main.go:141] libmachine: Provisioning with buildroot...
I1212 22:03:24.052448 84229 main.go:141] libmachine: (addons-361656) Calling .GetMachineName
I1212 22:03:24.052684 84229 buildroot.go:166] provisioning hostname "addons-361656"
I1212 22:03:24.052709 84229 main.go:141] libmachine: (addons-361656) Calling .GetMachineName
I1212 22:03:24.052911 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHHostname
I1212 22:03:24.055297 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:24.055726 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:24.055764 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:24.055898 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHPort
I1212 22:03:24.056097 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:24.056246 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:24.056361 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHUsername
I1212 22:03:24.056516 84229 main.go:141] libmachine: Using SSH client type: native
I1212 22:03:24.056818 84229 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x808ea0] 0x80bb80 <nil> [] 0s} 192.168.39.86 22 <nil> <nil>}
I1212 22:03:24.056832 84229 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-361656 && echo "addons-361656" | sudo tee /etc/hostname
I1212 22:03:24.195689 84229 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-361656
I1212 22:03:24.195723 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHHostname
I1212 22:03:24.198441 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:24.198747 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:24.198768 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:24.198925 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHPort
I1212 22:03:24.199140 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:24.199343 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:24.199524 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHUsername
I1212 22:03:24.199679 84229 main.go:141] libmachine: Using SSH client type: native
I1212 22:03:24.200050 84229 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x808ea0] 0x80bb80 <nil> [] 0s} 192.168.39.86 22 <nil> <nil>}
I1212 22:03:24.200076 84229 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-361656' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-361656/g' /etc/hosts;
else
echo '127.0.1.1 addons-361656' | sudo tee -a /etc/hosts;
fi
fi
I1212 22:03:24.335549 84229 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1212 22:03:24.335583 84229 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17761-76611/.minikube CaCertPath:/home/jenkins/minikube-integration/17761-76611/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17761-76611/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17761-76611/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17761-76611/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17761-76611/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17761-76611/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17761-76611/.minikube}
I1212 22:03:24.335620 84229 buildroot.go:174] setting up certificates
I1212 22:03:24.335656 84229 provision.go:83] configureAuth start
I1212 22:03:24.335670 84229 main.go:141] libmachine: (addons-361656) Calling .GetMachineName
I1212 22:03:24.335943 84229 main.go:141] libmachine: (addons-361656) Calling .GetIP
I1212 22:03:24.338223 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:24.338612 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:24.338633 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:24.338789 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHHostname
I1212 22:03:24.341510 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:24.341843 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:24.341872 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:24.342030 84229 provision.go:138] copyHostCerts
I1212 22:03:24.342103 84229 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17761-76611/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17761-76611/.minikube/ca.pem (1082 bytes)
I1212 22:03:24.342238 84229 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17761-76611/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17761-76611/.minikube/cert.pem (1123 bytes)
I1212 22:03:24.342320 84229 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17761-76611/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17761-76611/.minikube/key.pem (1675 bytes)
I1212 22:03:24.342394 84229 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17761-76611/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17761-76611/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17761-76611/.minikube/certs/ca-key.pem org=jenkins.addons-361656 san=[192.168.39.86 192.168.39.86 localhost 127.0.0.1 minikube addons-361656]
I1212 22:03:24.495453 84229 provision.go:172] copyRemoteCerts
I1212 22:03:24.495553 84229 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1212 22:03:24.495587 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHHostname
I1212 22:03:24.498181 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:24.498473 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:24.498500 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:24.498631 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHPort
I1212 22:03:24.498811 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:24.498991 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHUsername
I1212 22:03:24.499168 84229 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656/id_rsa Username:docker}
I1212 22:03:24.593596 84229 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17761-76611/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I1212 22:03:24.620297 84229 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17761-76611/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)
I1212 22:03:24.645847 84229 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17761-76611/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1212 22:03:24.668781 84229 provision.go:86] duration metric: configureAuth took 333.108315ms
I1212 22:03:24.668804 84229 buildroot.go:189] setting minikube options for container-runtime
I1212 22:03:24.668986 84229 config.go:182] Loaded profile config "addons-361656": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I1212 22:03:24.669059 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHHostname
I1212 22:03:24.671625 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:24.671985 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:24.672012 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:24.672128 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHPort
I1212 22:03:24.672338 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:24.672617 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:24.672822 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHUsername
I1212 22:03:24.672993 84229 main.go:141] libmachine: Using SSH client type: native
I1212 22:03:24.673320 84229 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x808ea0] 0x80bb80 <nil> [] 0s} 192.168.39.86 22 <nil> <nil>}
I1212 22:03:24.673337 84229 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1212 22:03:24.997950 84229 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1212 22:03:24.997986 84229 main.go:141] libmachine: Checking connection to Docker...
I1212 22:03:24.998026 84229 main.go:141] libmachine: (addons-361656) Calling .GetURL
I1212 22:03:24.999536 84229 main.go:141] libmachine: (addons-361656) DBG | Using libvirt version 6000000
I1212 22:03:25.001594 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:25.002002 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:25.002047 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:25.002185 84229 main.go:141] libmachine: Docker is up and running!
I1212 22:03:25.002203 84229 main.go:141] libmachine: Reticulating splines...
I1212 22:03:25.002210 84229 client.go:171] LocalClient.Create took 23.564155752s
I1212 22:03:25.002229 84229 start.go:167] duration metric: libmachine.API.Create for "addons-361656" took 23.564221878s
I1212 22:03:25.002248 84229 start.go:300] post-start starting for "addons-361656" (driver="kvm2")
I1212 22:03:25.002260 84229 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1212 22:03:25.002275 84229 main.go:141] libmachine: (addons-361656) Calling .DriverName
I1212 22:03:25.002532 84229 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1212 22:03:25.002560 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHHostname
I1212 22:03:25.004595 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:25.004931 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:25.004950 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:25.005092 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHPort
I1212 22:03:25.005295 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:25.005462 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHUsername
I1212 22:03:25.005574 84229 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656/id_rsa Username:docker}
I1212 22:03:25.097983 84229 ssh_runner.go:195] Run: cat /etc/os-release
I1212 22:03:25.102365 84229 info.go:137] Remote host: Buildroot 2021.02.12
I1212 22:03:25.102386 84229 filesync.go:126] Scanning /home/jenkins/minikube-integration/17761-76611/.minikube/addons for local assets ...
I1212 22:03:25.102458 84229 filesync.go:126] Scanning /home/jenkins/minikube-integration/17761-76611/.minikube/files for local assets ...
I1212 22:03:25.102482 84229 start.go:303] post-start completed in 100.226148ms
I1212 22:03:25.102514 84229 main.go:141] libmachine: (addons-361656) Calling .GetConfigRaw
I1212 22:03:25.103042 84229 main.go:141] libmachine: (addons-361656) Calling .GetIP
I1212 22:03:25.106618 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:25.106942 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:25.106974 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:25.107192 84229 profile.go:148] Saving config to /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/config.json ...
I1212 22:03:25.107438 84229 start.go:128] duration metric: createHost completed in 23.689747563s
I1212 22:03:25.107468 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHHostname
I1212 22:03:25.109552 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:25.109833 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:25.109864 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:25.109990 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHPort
I1212 22:03:25.110162 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:25.110348 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:25.110457 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHUsername
I1212 22:03:25.110603 84229 main.go:141] libmachine: Using SSH client type: native
I1212 22:03:25.110908 84229 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x808ea0] 0x80bb80 <nil> [] 0s} 192.168.39.86 22 <nil> <nil>}
I1212 22:03:25.110920 84229 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I1212 22:03:25.236005 84229 main.go:141] libmachine: SSH cmd err, output: <nil>: 1702418605.213816803
I1212 22:03:25.236035 84229 fix.go:206] guest clock: 1702418605.213816803
I1212 22:03:25.236057 84229 fix.go:219] Guest: 2023-12-12 22:03:25.213816803 +0000 UTC Remote: 2023-12-12 22:03:25.107454112 +0000 UTC m=+23.811651762 (delta=106.362691ms)
I1212 22:03:25.236082 84229 fix.go:190] guest clock delta is within tolerance: 106.362691ms
I1212 22:03:25.236089 84229 start.go:83] releasing machines lock for "addons-361656", held for 23.818481779s
I1212 22:03:25.236117 84229 main.go:141] libmachine: (addons-361656) Calling .DriverName
I1212 22:03:25.236415 84229 main.go:141] libmachine: (addons-361656) Calling .GetIP
I1212 22:03:25.238937 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:25.239297 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:25.239337 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:25.239469 84229 main.go:141] libmachine: (addons-361656) Calling .DriverName
I1212 22:03:25.240085 84229 main.go:141] libmachine: (addons-361656) Calling .DriverName
I1212 22:03:25.240250 84229 main.go:141] libmachine: (addons-361656) Calling .DriverName
I1212 22:03:25.240349 84229 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1212 22:03:25.240388 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHHostname
I1212 22:03:25.240535 84229 ssh_runner.go:195] Run: cat /version.json
I1212 22:03:25.240562 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHHostname
I1212 22:03:25.242960 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:25.243154 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:25.243321 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:25.243349 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:25.243489 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:25.243492 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHPort
I1212 22:03:25.243510 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:25.243650 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHPort
I1212 22:03:25.243669 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:25.243818 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:25.243887 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHUsername
I1212 22:03:25.243966 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHUsername
I1212 22:03:25.244075 84229 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656/id_rsa Username:docker}
I1212 22:03:25.244103 84229 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656/id_rsa Username:docker}
I1212 22:03:25.362939 84229 ssh_runner.go:195] Run: systemctl --version
I1212 22:03:25.368853 84229 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1212 22:03:25.532427 84229 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1212 22:03:25.538428 84229 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1212 22:03:25.538492 84229 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1212 22:03:25.558192 84229 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I1212 22:03:25.558221 84229 start.go:475] detecting cgroup driver to use...
I1212 22:03:25.558307 84229 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1212 22:03:25.573468 84229 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1212 22:03:25.586940 84229 docker.go:203] disabling cri-docker service (if available) ...
I1212 22:03:25.587022 84229 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1212 22:03:25.600709 84229 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1212 22:03:25.614586 84229 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1212 22:03:25.718035 84229 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1212 22:03:25.833441 84229 docker.go:219] disabling docker service ...
I1212 22:03:25.833525 84229 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1212 22:03:25.847357 84229 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1212 22:03:25.858313 84229 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1212 22:03:25.957847 84229 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1212 22:03:26.059489 84229 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1212 22:03:26.073418 84229 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1212 22:03:26.094230 84229 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I1212 22:03:26.094293 84229 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I1212 22:03:26.103816 84229 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I1212 22:03:26.103895 84229 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I1212 22:03:26.113361 84229 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1212 22:03:26.122835 84229 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1212 22:03:26.132368 84229 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1212 22:03:26.142226 84229 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1212 22:03:26.150470 84229 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I1212 22:03:26.150544 84229 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I1212 22:03:26.163459 84229 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1212 22:03:26.172322 84229 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1212 22:03:26.274948 84229 ssh_runner.go:195] Run: sudo systemctl restart crio
I1212 22:03:26.452484 84229 start.go:522] Will wait 60s for socket path /var/run/crio/crio.sock
I1212 22:03:26.452587 84229 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1212 22:03:26.458240 84229 start.go:543] Will wait 60s for crictl version
I1212 22:03:26.458323 84229 ssh_runner.go:195] Run: which crictl
I1212 22:03:26.462336 84229 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I1212 22:03:26.511474 84229 start.go:559] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I1212 22:03:26.511589 84229 ssh_runner.go:195] Run: crio --version
I1212 22:03:26.560378 84229 ssh_runner.go:195] Run: crio --version
I1212 22:03:26.611729 84229 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I1212 22:03:26.613399 84229 main.go:141] libmachine: (addons-361656) Calling .GetIP
I1212 22:03:26.616202 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:26.616590 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:26.616615 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:26.616793 84229 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I1212 22:03:26.621260 84229 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1212 22:03:26.634433 84229 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I1212 22:03:26.634510 84229 ssh_runner.go:195] Run: sudo crictl images --output json
I1212 22:03:26.668385 84229 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.28.4". assuming images are not preloaded.
I1212 22:03:26.668479 84229 ssh_runner.go:195] Run: which lz4
I1212 22:03:26.672499 84229 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I1212 22:03:26.676678 84229 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I1212 22:03:26.676711 84229 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17761-76611/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (458073571 bytes)
I1212 22:03:28.445489 84229 crio.go:444] Took 1.773042 seconds to copy over tarball
I1212 22:03:28.445565 84229 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4
I1212 22:03:31.624001 84229 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (3.178403967s)
I1212 22:03:31.624038 84229 crio.go:451] Took 3.178521 seconds to extract the tarball
I1212 22:03:31.624048 84229 ssh_runner.go:146] rm: /preloaded.tar.lz4
I1212 22:03:31.666186 84229 ssh_runner.go:195] Run: sudo crictl images --output json
I1212 22:03:31.735795 84229 crio.go:496] all images are preloaded for cri-o runtime.
I1212 22:03:31.735821 84229 cache_images.go:84] Images are preloaded, skipping loading
I1212 22:03:31.735921 84229 ssh_runner.go:195] Run: crio config
I1212 22:03:31.802036 84229 cni.go:84] Creating CNI manager for ""
I1212 22:03:31.802058 84229 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I1212 22:03:31.802076 84229 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I1212 22:03:31.802098 84229 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.86 APIServerPort:8443 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-361656 NodeName:addons-361656 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.86"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.86 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kube
rnetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1212 22:03:31.802225 84229 kubeadm.go:181] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.86
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "addons-361656"
kubeletExtraArgs:
node-ip: 192.168.39.86
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.86"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1212 22:03:31.802325 84229 kubeadm.go:976] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=addons-361656 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.86
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:addons-361656 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I1212 22:03:31.802412 84229 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I1212 22:03:31.811105 84229 binaries.go:44] Found k8s binaries, skipping transfer
I1212 22:03:31.811195 84229 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1212 22:03:31.819660 84229 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (372 bytes)
I1212 22:03:31.835881 84229 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1212 22:03:31.851975 84229 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2097 bytes)
I1212 22:03:31.867426 84229 ssh_runner.go:195] Run: grep 192.168.39.86 control-plane.minikube.internal$ /etc/hosts
I1212 22:03:31.870871 84229 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.86 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1212 22:03:31.882827 84229 certs.go:56] Setting up /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656 for IP: 192.168.39.86
I1212 22:03:31.882871 84229 certs.go:190] acquiring lock for shared ca certs: {Name:mka69d87bb8d52665cf9447f83b78e5d881b0569 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1212 22:03:31.883021 84229 certs.go:204] generating minikubeCA CA: /home/jenkins/minikube-integration/17761-76611/.minikube/ca.key
I1212 22:03:32.101574 84229 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17761-76611/.minikube/ca.crt ...
I1212 22:03:32.101605 84229 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17761-76611/.minikube/ca.crt: {Name:mk94c73b728f8b13d2926e6b95853e808186d897 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1212 22:03:32.101766 84229 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17761-76611/.minikube/ca.key ...
I1212 22:03:32.101779 84229 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17761-76611/.minikube/ca.key: {Name:mk1f314481754f198daba7f20c7be081dbd76a2b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1212 22:03:32.101859 84229 certs.go:204] generating proxyClientCA CA: /home/jenkins/minikube-integration/17761-76611/.minikube/proxy-client-ca.key
I1212 22:03:32.187857 84229 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17761-76611/.minikube/proxy-client-ca.crt ...
I1212 22:03:32.187887 84229 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17761-76611/.minikube/proxy-client-ca.crt: {Name:mk21e2498c254772214fc94b18b64d46389ebdca Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1212 22:03:32.188032 84229 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17761-76611/.minikube/proxy-client-ca.key ...
I1212 22:03:32.188042 84229 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17761-76611/.minikube/proxy-client-ca.key: {Name:mk4bc14b6a70c28c8a87624002d813a5f113f4c7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1212 22:03:32.188142 84229 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/client.key
I1212 22:03:32.188155 84229 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/client.crt with IP's: []
I1212 22:03:32.326264 84229 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/client.crt ...
I1212 22:03:32.326293 84229 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/client.crt: {Name:mk9658ebd85836c0021c395fbafce7babff8fdef Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1212 22:03:32.326440 84229 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/client.key ...
I1212 22:03:32.326451 84229 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/client.key: {Name:mke77b0a3903443efc8bf263db6d7a21231f2ac4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1212 22:03:32.326518 84229 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/apiserver.key.966dc577
I1212 22:03:32.326534 84229 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/apiserver.crt.966dc577 with IP's: [192.168.39.86 10.96.0.1 127.0.0.1 10.0.0.1]
I1212 22:03:32.477521 84229 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/apiserver.crt.966dc577 ...
I1212 22:03:32.477573 84229 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/apiserver.crt.966dc577: {Name:mk8215f9d5d933b24afbb87033e46b787cb3f004 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1212 22:03:32.477808 84229 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/apiserver.key.966dc577 ...
I1212 22:03:32.477827 84229 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/apiserver.key.966dc577: {Name:mkc1fe8830f3a065a2fc3ca428d26aea3331fee1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1212 22:03:32.477919 84229 certs.go:337] copying /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/apiserver.crt.966dc577 -> /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/apiserver.crt
I1212 22:03:32.478020 84229 certs.go:341] copying /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/apiserver.key.966dc577 -> /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/apiserver.key
I1212 22:03:32.478083 84229 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/proxy-client.key
I1212 22:03:32.478105 84229 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/proxy-client.crt with IP's: []
I1212 22:03:32.537387 84229 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/proxy-client.crt ...
I1212 22:03:32.537416 84229 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/proxy-client.crt: {Name:mk490dab787400b2c4f3531e542226ce359e3489 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1212 22:03:32.537581 84229 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/proxy-client.key ...
I1212 22:03:32.537599 84229 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/proxy-client.key: {Name:mk17138f16fe6bbd076aa18d8a9f9b2b216666e2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1212 22:03:32.537800 84229 certs.go:437] found cert: /home/jenkins/minikube-integration/17761-76611/.minikube/certs/home/jenkins/minikube-integration/17761-76611/.minikube/certs/ca-key.pem (1675 bytes)
I1212 22:03:32.537844 84229 certs.go:437] found cert: /home/jenkins/minikube-integration/17761-76611/.minikube/certs/home/jenkins/minikube-integration/17761-76611/.minikube/certs/ca.pem (1082 bytes)
I1212 22:03:32.537890 84229 certs.go:437] found cert: /home/jenkins/minikube-integration/17761-76611/.minikube/certs/home/jenkins/minikube-integration/17761-76611/.minikube/certs/cert.pem (1123 bytes)
I1212 22:03:32.537935 84229 certs.go:437] found cert: /home/jenkins/minikube-integration/17761-76611/.minikube/certs/home/jenkins/minikube-integration/17761-76611/.minikube/certs/key.pem (1675 bytes)
I1212 22:03:32.538672 84229 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I1212 22:03:32.563261 84229 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I1212 22:03:32.586971 84229 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1212 22:03:32.613182 84229 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17761-76611/.minikube/profiles/addons-361656/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I1212 22:03:32.635099 84229 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17761-76611/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1212 22:03:32.657791 84229 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17761-76611/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I1212 22:03:32.680502 84229 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17761-76611/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1212 22:03:32.704363 84229 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17761-76611/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I1212 22:03:32.727142 84229 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17761-76611/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1212 22:03:32.750007 84229 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1212 22:03:32.765914 84229 ssh_runner.go:195] Run: openssl version
I1212 22:03:32.771184 84229 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1212 22:03:32.781161 84229 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1212 22:03:32.785599 84229 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Dec 12 22:03 /usr/share/ca-certificates/minikubeCA.pem
I1212 22:03:32.785664 84229 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1212 22:03:32.791109 84229 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1212 22:03:32.803005 84229 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
I1212 22:03:32.807091 84229 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
stdout:
stderr:
ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
I1212 22:03:32.807144 84229 kubeadm.go:404] StartCluster: {Name:addons-361656 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17761/minikube-v1.32.1-1702394653-17761-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1702394725-17761@sha256:d54bd539f5344c99d05c8897079f380df5ad03e2c1323e08060f77c1f95b4517 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1
.28.4 ClusterName:addons-361656 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.39.86 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[]
MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
I1212 22:03:32.807264 84229 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1212 22:03:32.807353 84229 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1212 22:03:32.846922 84229 cri.go:89] found id: ""
I1212 22:03:32.846997 84229 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1212 22:03:32.856077 84229 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1212 22:03:32.864683 84229 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1212 22:03:32.872868 84229 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1212 22:03:32.872911 84229 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I1212 22:03:32.927709 84229 kubeadm.go:322] [init] Using Kubernetes version: v1.28.4
I1212 22:03:32.927787 84229 kubeadm.go:322] [preflight] Running pre-flight checks
I1212 22:03:33.074365 84229 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I1212 22:03:33.074500 84229 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1212 22:03:33.074651 84229 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I1212 22:03:33.289310 84229 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1212 22:03:33.380830 84229 out.go:204] - Generating certificates and keys ...
I1212 22:03:33.380996 84229 kubeadm.go:322] [certs] Using existing ca certificate authority
I1212 22:03:33.381077 84229 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I1212 22:03:33.560404 84229 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
I1212 22:03:33.796288 84229 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
I1212 22:03:33.844606 84229 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
I1212 22:03:34.034700 84229 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
I1212 22:03:34.219115 84229 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
I1212 22:03:34.219300 84229 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [addons-361656 localhost] and IPs [192.168.39.86 127.0.0.1 ::1]
I1212 22:03:34.336930 84229 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
I1212 22:03:34.337076 84229 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [addons-361656 localhost] and IPs [192.168.39.86 127.0.0.1 ::1]
I1212 22:03:34.528068 84229 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
I1212 22:03:34.642042 84229 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
I1212 22:03:34.720558 84229 kubeadm.go:322] [certs] Generating "sa" key and public key
I1212 22:03:34.720692 84229 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1212 22:03:34.905625 84229 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I1212 22:03:35.027625 84229 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1212 22:03:35.113956 84229 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1212 22:03:35.206883 84229 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1212 22:03:35.207533 84229 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1212 22:03:35.212748 84229 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1212 22:03:35.284355 84229 out.go:204] - Booting up control plane ...
I1212 22:03:35.284536 84229 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1212 22:03:35.284681 84229 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1212 22:03:35.284812 84229 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1212 22:03:35.284956 84229 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1212 22:03:35.285089 84229 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1212 22:03:35.285152 84229 kubeadm.go:322] [kubelet-start] Starting the kubelet
I1212 22:03:35.375326 84229 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I1212 22:03:42.874827 84229 kubeadm.go:322] [apiclient] All control plane components are healthy after 7.501772 seconds
I1212 22:03:42.874985 84229 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I1212 22:03:42.900498 84229 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I1212 22:03:43.444397 84229 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
I1212 22:03:43.444635 84229 kubeadm.go:322] [mark-control-plane] Marking the node addons-361656 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I1212 22:03:43.960191 84229 kubeadm.go:322] [bootstrap-token] Using token: igw3i3.6cfv78cc3idmgdca
I1212 22:03:43.961670 84229 out.go:204] - Configuring RBAC rules ...
I1212 22:03:43.961805 84229 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I1212 22:03:43.968491 84229 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I1212 22:03:43.977117 84229 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I1212 22:03:43.981266 84229 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I1212 22:03:43.988433 84229 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I1212 22:03:43.992171 84229 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I1212 22:03:44.006986 84229 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I1212 22:03:44.295213 84229 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
I1212 22:03:44.373819 84229 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
I1212 22:03:44.374839 84229 kubeadm.go:322]
I1212 22:03:44.374960 84229 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
I1212 22:03:44.374983 84229 kubeadm.go:322]
I1212 22:03:44.375067 84229 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
I1212 22:03:44.375075 84229 kubeadm.go:322]
I1212 22:03:44.375102 84229 kubeadm.go:322] mkdir -p $HOME/.kube
I1212 22:03:44.375193 84229 kubeadm.go:322] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I1212 22:03:44.375291 84229 kubeadm.go:322] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I1212 22:03:44.375302 84229 kubeadm.go:322]
I1212 22:03:44.375397 84229 kubeadm.go:322] Alternatively, if you are the root user, you can run:
I1212 22:03:44.375417 84229 kubeadm.go:322]
I1212 22:03:44.375493 84229 kubeadm.go:322] export KUBECONFIG=/etc/kubernetes/admin.conf
I1212 22:03:44.375506 84229 kubeadm.go:322]
I1212 22:03:44.375560 84229 kubeadm.go:322] You should now deploy a pod network to the cluster.
I1212 22:03:44.375651 84229 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I1212 22:03:44.375742 84229 kubeadm.go:322] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I1212 22:03:44.375751 84229 kubeadm.go:322]
I1212 22:03:44.375864 84229 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
I1212 22:03:44.375961 84229 kubeadm.go:322] and service account keys on each node and then running the following as root:
I1212 22:03:44.375975 84229 kubeadm.go:322]
I1212 22:03:44.376092 84229 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token igw3i3.6cfv78cc3idmgdca \
I1212 22:03:44.376237 84229 kubeadm.go:322] --discovery-token-ca-cert-hash sha256:cf451e9de31410137a9591dd9b0dc2bd7e93f286a9b116a1d0a376e773a32f42 \
I1212 22:03:44.376268 84229 kubeadm.go:322] --control-plane
I1212 22:03:44.376277 84229 kubeadm.go:322]
I1212 22:03:44.376391 84229 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
I1212 22:03:44.376401 84229 kubeadm.go:322]
I1212 22:03:44.376514 84229 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token igw3i3.6cfv78cc3idmgdca \
I1212 22:03:44.376641 84229 kubeadm.go:322] --discovery-token-ca-cert-hash sha256:cf451e9de31410137a9591dd9b0dc2bd7e93f286a9b116a1d0a376e773a32f42
I1212 22:03:44.377207 84229 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1212 22:03:44.377244 84229 cni.go:84] Creating CNI manager for ""
I1212 22:03:44.377259 84229 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I1212 22:03:44.379319 84229 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I1212 22:03:44.380944 84229 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I1212 22:03:44.409668 84229 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I1212 22:03:44.490724 84229 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I1212 22:03:44.490818 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:44.490852 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl label nodes minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=7b3e481dbceb877ce85ff888adf9de756f54684f minikube.k8s.io/name=addons-361656 minikube.k8s.io/updated_at=2023_12_12T22_03_44_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:44.729713 84229 ops.go:34] apiserver oom_adj: -16
I1212 22:03:44.805534 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:44.908855 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:45.513587 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:46.013023 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:46.513630 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:47.013332 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:47.513249 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:48.013914 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:48.513480 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:49.013106 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:49.513633 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:50.013319 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:50.513783 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:51.013748 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:51.513628 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:52.013281 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:52.513243 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:53.013738 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:53.513583 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:54.013953 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:54.512964 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:55.013234 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:55.513714 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:56.013344 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:56.513709 84229 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1212 22:03:56.654025 84229 kubeadm.go:1088] duration metric: took 12.163271463s to wait for elevateKubeSystemPrivileges.
I1212 22:03:56.654068 84229 kubeadm.go:406] StartCluster complete in 23.846929353s
I1212 22:03:56.654106 84229 settings.go:142] acquiring lock: {Name:mk63a7317f157298d3f2d571dd9a6545e40f6012 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1212 22:03:56.654246 84229 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17761-76611/kubeconfig
I1212 22:03:56.654664 84229 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17761-76611/kubeconfig: {Name:mkd30784daf64363feb2413d937b99eb8cd15a38 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1212 22:03:56.654875 84229 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I1212 22:03:56.655025 84229 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:true inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volumesnapshots:true]
I1212 22:03:56.655128 84229 addons.go:69] Setting gcp-auth=true in profile "addons-361656"
I1212 22:03:56.655174 84229 addons.go:69] Setting storage-provisioner=true in profile "addons-361656"
I1212 22:03:56.655176 84229 addons.go:69] Setting ingress=true in profile "addons-361656"
I1212 22:03:56.655203 84229 addons.go:231] Setting addon storage-provisioner=true in "addons-361656"
I1212 22:03:56.655192 84229 addons.go:69] Setting metrics-server=true in profile "addons-361656"
I1212 22:03:56.655235 84229 addons.go:69] Setting default-storageclass=true in profile "addons-361656"
I1212 22:03:56.655272 84229 addons.go:231] Setting addon metrics-server=true in "addons-361656"
I1212 22:03:56.655300 84229 host.go:66] Checking if "addons-361656" exists ...
I1212 22:03:56.655318 84229 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-361656"
I1212 22:03:56.655146 84229 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-361656"
I1212 22:03:56.655329 84229 host.go:66] Checking if "addons-361656" exists ...
I1212 22:03:56.655340 84229 addons.go:231] Setting addon nvidia-device-plugin=true in "addons-361656"
I1212 22:03:56.655402 84229 host.go:66] Checking if "addons-361656" exists ...
I1212 22:03:56.655701 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.655755 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.655790 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.655215 84229 addons.go:231] Setting addon ingress=true in "addons-361656"
I1212 22:03:56.655165 84229 addons.go:69] Setting registry=true in profile "addons-361656"
I1212 22:03:56.655823 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.655837 84229 addons.go:231] Setting addon registry=true in "addons-361656"
I1212 22:03:56.655854 84229 host.go:66] Checking if "addons-361656" exists ...
I1212 22:03:56.655895 84229 host.go:66] Checking if "addons-361656" exists ...
I1212 22:03:56.655792 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.656102 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.656158 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.656189 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.656246 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.656290 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.655210 84229 mustload.go:65] Loading cluster: addons-361656
I1212 22:03:56.655213 84229 config.go:182] Loaded profile config "addons-361656": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I1212 22:03:56.655222 84229 addons.go:69] Setting helm-tiller=true in profile "addons-361656"
I1212 22:03:56.656484 84229 addons.go:231] Setting addon helm-tiller=true in "addons-361656"
I1212 22:03:56.656488 84229 config.go:182] Loaded profile config "addons-361656": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I1212 22:03:56.656519 84229 host.go:66] Checking if "addons-361656" exists ...
I1212 22:03:56.655224 84229 addons.go:69] Setting cloud-spanner=true in profile "addons-361656"
I1212 22:03:56.656601 84229 addons.go:231] Setting addon cloud-spanner=true in "addons-361656"
I1212 22:03:56.656646 84229 host.go:66] Checking if "addons-361656" exists ...
I1212 22:03:56.656819 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.656829 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.656838 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.656846 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.656993 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.657035 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.655226 84229 addons.go:69] Setting ingress-dns=true in profile "addons-361656"
I1212 22:03:56.657088 84229 addons.go:231] Setting addon ingress-dns=true in "addons-361656"
I1212 22:03:56.657159 84229 host.go:66] Checking if "addons-361656" exists ...
I1212 22:03:56.655135 84229 addons.go:69] Setting volumesnapshots=true in profile "addons-361656"
I1212 22:03:56.657335 84229 addons.go:231] Setting addon volumesnapshots=true in "addons-361656"
I1212 22:03:56.657381 84229 host.go:66] Checking if "addons-361656" exists ...
I1212 22:03:56.657517 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.657535 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.657716 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.657745 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.655231 84229 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-361656"
I1212 22:03:56.659548 84229 addons.go:231] Setting addon csi-hostpath-driver=true in "addons-361656"
I1212 22:03:56.659591 84229 host.go:66] Checking if "addons-361656" exists ...
I1212 22:03:56.659939 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.659968 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.655235 84229 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-361656"
I1212 22:03:56.663419 84229 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-361656"
I1212 22:03:56.655249 84229 addons.go:69] Setting inspektor-gadget=true in profile "addons-361656"
I1212 22:03:56.664035 84229 addons.go:231] Setting addon inspektor-gadget=true in "addons-361656"
I1212 22:03:56.664080 84229 host.go:66] Checking if "addons-361656" exists ...
I1212 22:03:56.655798 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.664414 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.664433 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.664443 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.675217 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45549
I1212 22:03:56.675694 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.676284 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.676315 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.676716 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.677275 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.677317 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.679062 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36549
I1212 22:03:56.679560 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.680067 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.680104 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.680516 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.681073 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.681104 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.681826 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35253
I1212 22:03:56.682155 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.682336 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45793
I1212 22:03:56.682763 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.682784 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.682823 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.683109 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.683361 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.683378 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.683874 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.683915 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.684678 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.686502 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45795
I1212 22:03:56.686979 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.687208 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.687269 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.687545 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.687570 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.687906 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.688404 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.688447 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.691189 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35015
I1212 22:03:56.691836 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.691881 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.693535 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39397
I1212 22:03:56.693694 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.693886 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.694204 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.694223 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.694357 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.694375 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.694561 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.694757 84229 main.go:141] libmachine: (addons-361656) Calling .GetState
I1212 22:03:56.695044 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.695574 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.695613 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.697792 84229 addons.go:231] Setting addon default-storageclass=true in "addons-361656"
I1212 22:03:56.697833 84229 host.go:66] Checking if "addons-361656" exists ...
I1212 22:03:56.698228 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.698257 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.704586 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35667
I1212 22:03:56.704792 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42937
I1212 22:03:56.704949 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.705292 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.705417 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46639
I1212 22:03:56.705666 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.705715 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.706283 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.706314 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.706499 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.706747 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.706981 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.707000 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.707153 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.707363 84229 main.go:141] libmachine: (addons-361656) Calling .GetState
I1212 22:03:56.707399 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.707454 84229 main.go:141] libmachine: (addons-361656) Calling .GetState
I1212 22:03:56.707903 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.707952 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.709742 84229 main.go:141] libmachine: (addons-361656) Calling .DriverName
I1212 22:03:56.709962 84229 host.go:66] Checking if "addons-361656" exists ...
I1212 22:03:56.710319 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.710339 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.713281 84229 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.14.3
I1212 22:03:56.714659 84229 addons.go:423] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I1212 22:03:56.714678 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I1212 22:03:56.714699 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHHostname
I1212 22:03:56.717685 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:56.718038 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:56.718063 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:56.718262 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHPort
I1212 22:03:56.718476 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:56.718542 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38365
I1212 22:03:56.718807 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHUsername
I1212 22:03:56.719003 84229 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656/id_rsa Username:docker}
I1212 22:03:56.719607 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.720138 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.720157 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.720622 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.720907 84229 main.go:141] libmachine: (addons-361656) Calling .GetState
I1212 22:03:56.723800 84229 addons.go:231] Setting addon storage-provisioner-rancher=true in "addons-361656"
I1212 22:03:56.723872 84229 host.go:66] Checking if "addons-361656" exists ...
I1212 22:03:56.724324 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.724368 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.730812 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44381
I1212 22:03:56.731314 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.733167 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35455
I1212 22:03:56.733353 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36291
I1212 22:03:56.733681 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39351
I1212 22:03:56.733700 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.734006 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.734026 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.734043 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.734317 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.734342 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.734555 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.734580 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.734651 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.734716 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.734765 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42691
I1212 22:03:56.735173 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.735345 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.735366 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.735431 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.735844 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.735870 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.735947 84229 main.go:141] libmachine: (addons-361656) Calling .GetState
I1212 22:03:56.735967 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.735996 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.736158 84229 main.go:141] libmachine: (addons-361656) Calling .GetState
I1212 22:03:56.736174 84229 main.go:141] libmachine: (addons-361656) Calling .DriverName
I1212 22:03:56.736384 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.736427 84229 main.go:141] libmachine: (addons-361656) Calling .GetState
I1212 22:03:56.736877 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.736911 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.737845 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44389
I1212 22:03:56.738173 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.738608 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.738632 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.738740 84229 main.go:141] libmachine: (addons-361656) Calling .DriverName
I1212 22:03:56.738792 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38967
I1212 22:03:56.738995 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.739065 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.741274 84229 out.go:177] - Using image ghcr.io/helm/tiller:v2.17.0
I1212 22:03:56.739691 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.739803 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.740661 84229 main.go:141] libmachine: (addons-361656) Calling .DriverName
I1212 22:03:56.742534 84229 addons.go:423] installing /etc/kubernetes/addons/helm-tiller-dp.yaml
I1212 22:03:56.742546 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-dp.yaml (2422 bytes)
I1212 22:03:56.742562 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHHostname
I1212 22:03:56.742625 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.744138 84229 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.12
I1212 22:03:56.742819 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.745036 84229 main.go:141] libmachine: (addons-361656) Calling .DriverName
I1212 22:03:56.745566 84229 addons.go:423] installing /etc/kubernetes/addons/deployment.yaml
I1212 22:03:56.745589 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I1212 22:03:56.745612 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHHostname
I1212 22:03:56.745802 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42073
I1212 22:03:56.747281 84229 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1212 22:03:56.746053 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.746342 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.748434 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:56.748772 84229 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1212 22:03:56.748789 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1212 22:03:56.748805 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHHostname
I1212 22:03:56.748867 84229 main.go:141] libmachine: (addons-361656) Calling .GetState
I1212 22:03:56.749297 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.749329 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.750036 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.750042 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHPort
I1212 22:03:56.750117 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:56.750133 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:56.750154 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:56.750249 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:56.750419 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHUsername
I1212 22:03:56.750619 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.750673 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.750629 84229 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656/id_rsa Username:docker}
I1212 22:03:56.751205 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHPort
I1212 22:03:56.751287 84229 main.go:141] libmachine: (addons-361656) Calling .DriverName
I1212 22:03:56.751337 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:56.751351 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:56.751638 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:56.753253 84229 out.go:177] - Using image docker.io/registry:2.8.3
I1212 22:03:56.751968 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHUsername
I1212 22:03:56.753081 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:56.753626 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHPort
I1212 22:03:56.756336 84229 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.5
I1212 22:03:56.754871 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:56.755014 84229 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656/id_rsa Username:docker}
I1212 22:03:56.755043 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:56.756198 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45881
I1212 22:03:56.756628 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36187
I1212 22:03:56.757623 84229 addons.go:423] installing /etc/kubernetes/addons/registry-rc.yaml
I1212 22:03:56.757638 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (798 bytes)
I1212 22:03:56.757660 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHHostname
I1212 22:03:56.757718 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:56.759664 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHUsername
I1212 22:03:56.759882 84229 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656/id_rsa Username:docker}
I1212 22:03:56.760185 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.762243 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40631
I1212 22:03:56.762357 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.762400 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.762423 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.762665 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:56.762717 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.762965 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.763281 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.763301 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.763323 84229 main.go:141] libmachine: (addons-361656) Calling .GetState
I1212 22:03:56.763369 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:56.763387 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:56.764127 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.764670 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.764709 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.765835 84229 main.go:141] libmachine: (addons-361656) Calling .DriverName
I1212 22:03:56.765843 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHPort
I1212 22:03:56.767977 84229 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2
I1212 22:03:56.766304 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:56.766475 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.766662 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44307
I1212 22:03:56.767028 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36129
I1212 22:03:56.768913 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46617
I1212 22:03:56.769707 84229 addons.go:423] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I1212 22:03:56.769730 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I1212 22:03:56.769750 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHHostname
I1212 22:03:56.769710 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.770120 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHUsername
I1212 22:03:56.770190 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.770648 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.770701 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.770734 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.770746 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.770764 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.771290 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.771331 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.771410 84229 main.go:141] libmachine: (addons-361656) Calling .GetState
I1212 22:03:56.770621 84229 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656/id_rsa Username:docker}
I1212 22:03:56.771445 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.771714 84229 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-361656" context rescaled to 1 replicas
I1212 22:03:56.771750 84229 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.39.86 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I1212 22:03:56.773517 84229 out.go:177] * Verifying Kubernetes components...
I1212 22:03:56.771953 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.772056 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.772339 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.773120 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:56.773921 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHPort
I1212 22:03:56.775007 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.775050 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.775109 84229 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1212 22:03:56.775161 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:56.775223 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:56.775265 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:56.775365 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHUsername
I1212 22:03:56.775567 84229 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656/id_rsa Username:docker}
I1212 22:03:56.775849 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:03:56.775891 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:03:56.775999 84229 main.go:141] libmachine: (addons-361656) Calling .DriverName
I1212 22:03:56.777671 84229 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.9.4
I1212 22:03:56.776632 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.777904 84229 main.go:141] libmachine: (addons-361656) Calling .GetState
I1212 22:03:56.779026 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37309
I1212 22:03:56.779198 84229 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20231011-8b53cabe0
I1212 22:03:56.780730 84229 main.go:141] libmachine: (addons-361656) Calling .DriverName
I1212 22:03:56.780743 84229 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20231011-8b53cabe0
I1212 22:03:56.779581 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.780929 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41119
I1212 22:03:56.783756 84229 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.6.4
I1212 22:03:56.782512 84229 addons.go:423] installing /etc/kubernetes/addons/ingress-deploy.yaml
I1212 22:03:56.782740 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.782877 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.785324 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.785328 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16103 bytes)
I1212 22:03:56.785359 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHHostname
I1212 22:03:56.785383 84229 addons.go:423] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I1212 22:03:56.785408 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I1212 22:03:56.785427 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHHostname
I1212 22:03:56.785786 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.785936 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.785961 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.785988 84229 main.go:141] libmachine: (addons-361656) Calling .GetState
I1212 22:03:56.786347 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.786569 84229 main.go:141] libmachine: (addons-361656) Calling .GetState
I1212 22:03:56.788176 84229 main.go:141] libmachine: (addons-361656) Calling .DriverName
I1212 22:03:56.788412 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40587
I1212 22:03:56.790165 84229 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.23.1
I1212 22:03:56.789003 84229 main.go:141] libmachine: (addons-361656) Calling .DriverName
I1212 22:03:56.789019 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.789856 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:56.790501 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHPort
I1212 22:03:56.791277 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:56.791686 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:56.791705 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:56.791759 84229 addons.go:423] installing /etc/kubernetes/addons/ig-namespace.yaml
I1212 22:03:56.791767 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I1212 22:03:56.791782 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHHostname
I1212 22:03:56.791837 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHPort
I1212 22:03:56.791890 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:56.791910 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:56.792016 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:56.793638 84229 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I1212 22:03:56.792610 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:56.792635 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHUsername
I1212 22:03:56.792751 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.794931 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.794937 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:56.796231 84229 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I1212 22:03:56.797685 84229 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I1212 22:03:56.795331 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.795372 84229 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656/id_rsa Username:docker}
I1212 22:03:56.795380 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHUsername
I1212 22:03:56.795555 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:56.795707 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHPort
I1212 22:03:56.800483 84229 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I1212 22:03:56.799318 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:56.799322 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:56.799328 84229 main.go:141] libmachine: (addons-361656) Calling .GetState
I1212 22:03:56.799471 84229 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656/id_rsa Username:docker}
I1212 22:03:56.800725 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHUsername
I1212 22:03:56.800896 84229 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656/id_rsa Username:docker}
I1212 22:03:56.802332 84229 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I1212 22:03:56.802921 84229 main.go:141] libmachine: (addons-361656) Calling .DriverName
I1212 22:03:56.804072 84229 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I1212 22:03:56.805569 84229 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I1212 22:03:56.807002 84229 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I1212 22:03:56.807024 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I1212 22:03:56.805501 84229 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I1212 22:03:56.807044 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHHostname
I1212 22:03:56.805672 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36405
I1212 22:03:56.806530 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46059
I1212 22:03:56.810376 84229 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I1212 22:03:56.809167 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.809689 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:03:56.811985 84229 addons.go:423] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I1212 22:03:56.812010 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I1212 22:03:56.812033 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHHostname
I1212 22:03:56.810067 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:56.810697 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHPort
I1212 22:03:56.811092 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.811112 84229 main.go:141] libmachine: Using API Version 1
I1212 22:03:56.812171 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.812177 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:03:56.812072 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:56.812237 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:56.812304 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:56.812462 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHUsername
I1212 22:03:56.812525 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.812561 84229 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656/id_rsa Username:docker}
I1212 22:03:56.813319 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:03:56.813947 84229 main.go:141] libmachine: (addons-361656) Calling .GetState
I1212 22:03:56.814164 84229 main.go:141] libmachine: (addons-361656) Calling .GetState
I1212 22:03:56.814986 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:56.815496 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:56.815516 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:56.815632 84229 main.go:141] libmachine: (addons-361656) Calling .DriverName
I1212 22:03:56.815760 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHPort
I1212 22:03:56.817606 84229 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I1212 22:03:56.815958 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:56.816002 84229 main.go:141] libmachine: (addons-361656) Calling .DriverName
I1212 22:03:56.820435 84229 out.go:177] - Using image docker.io/busybox:stable
I1212 22:03:56.819342 84229 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml
I1212 22:03:56.819444 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHUsername
I1212 22:03:56.821848 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1212 22:03:56.821866 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHHostname
I1212 22:03:56.821909 84229 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I1212 22:03:56.821925 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I1212 22:03:56.821943 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHHostname
I1212 22:03:56.822027 84229 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656/id_rsa Username:docker}
W1212 22:03:56.823135 84229 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 192.168.39.1:47578->192.168.39.86:22: read: connection reset by peer
I1212 22:03:56.823219 84229 retry.go:31] will retry after 253.225039ms: ssh: handshake failed: read tcp 192.168.39.1:47578->192.168.39.86:22: read: connection reset by peer
I1212 22:03:56.825374 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:56.825428 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:56.825788 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:56.825824 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:03:56.825868 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:56.825890 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:03:56.826006 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHPort
I1212 22:03:56.826138 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHPort
I1212 22:03:56.826200 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:56.826281 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:03:56.826326 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHUsername
I1212 22:03:56.826414 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHUsername
I1212 22:03:56.826456 84229 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656/id_rsa Username:docker}
I1212 22:03:56.826838 84229 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656/id_rsa Username:docker}
W1212 22:03:56.827538 84229 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 192.168.39.1:47594->192.168.39.86:22: read: connection reset by peer
I1212 22:03:56.827565 84229 retry.go:31] will retry after 313.154216ms: ssh: handshake failed: read tcp 192.168.39.1:47594->192.168.39.86:22: read: connection reset by peer
W1212 22:03:56.828097 84229 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 192.168.39.1:47610->192.168.39.86:22: read: connection reset by peer
I1212 22:03:56.828114 84229 retry.go:31] will retry after 179.38307ms: ssh: handshake failed: read tcp 192.168.39.1:47610->192.168.39.86:22: read: connection reset by peer
I1212 22:03:56.972445 84229 addons.go:423] installing /etc/kubernetes/addons/helm-tiller-rbac.yaml
I1212 22:03:56.972481 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-rbac.yaml (1188 bytes)
I1212 22:03:57.001443 84229 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I1212 22:03:57.018848 84229 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I1212 22:03:57.040474 84229 addons.go:423] installing /etc/kubernetes/addons/helm-tiller-svc.yaml
I1212 22:03:57.040505 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-svc.yaml (951 bytes)
I1212 22:03:57.046645 84229 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I1212 22:03:57.062909 84229 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1212 22:03:57.100177 84229 addons.go:423] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I1212 22:03:57.100225 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I1212 22:03:57.105213 84229 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I1212 22:03:57.129798 84229 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.39.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I1212 22:03:57.130505 84229 node_ready.go:35] waiting up to 6m0s for node "addons-361656" to be "Ready" ...
I1212 22:03:57.180574 84229 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml
I1212 22:03:57.192878 84229 addons.go:423] installing /etc/kubernetes/addons/registry-svc.yaml
I1212 22:03:57.192909 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I1212 22:03:57.232975 84229 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I1212 22:03:57.233008 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I1212 22:03:57.268042 84229 addons.go:423] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I1212 22:03:57.268071 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I1212 22:03:57.352861 84229 addons.go:423] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I1212 22:03:57.352892 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I1212 22:03:57.367037 84229 node_ready.go:49] node "addons-361656" has status "Ready":"True"
I1212 22:03:57.367068 84229 node_ready.go:38] duration metric: took 236.539838ms waiting for node "addons-361656" to be "Ready" ...
I1212 22:03:57.367079 84229 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I1212 22:03:57.384553 84229 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I1212 22:03:57.421976 84229 addons.go:423] installing /etc/kubernetes/addons/registry-proxy.yaml
I1212 22:03:57.422007 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I1212 22:03:57.467742 84229 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I1212 22:03:57.467775 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I1212 22:03:57.475781 84229 addons.go:423] installing /etc/kubernetes/addons/ig-role.yaml
I1212 22:03:57.475810 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I1212 22:03:57.514863 84229 addons.go:423] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I1212 22:03:57.514903 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I1212 22:03:57.538458 84229 addons.go:423] installing /etc/kubernetes/addons/metrics-server-service.yaml
I1212 22:03:57.538490 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I1212 22:03:57.642497 84229 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1212 22:03:57.646993 84229 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I1212 22:03:57.695196 84229 addons.go:423] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I1212 22:03:57.695221 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I1212 22:03:57.749406 84229 addons.go:423] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I1212 22:03:57.749438 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I1212 22:03:57.749672 84229 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I1212 22:03:57.749687 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I1212 22:03:57.755639 84229 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I1212 22:03:57.824873 84229 addons.go:423] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I1212 22:03:57.824905 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I1212 22:03:57.879121 84229 addons.go:423] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I1212 22:03:57.879148 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I1212 22:03:57.909566 84229 addons.go:423] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I1212 22:03:57.909593 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I1212 22:03:57.938822 84229 addons.go:423] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I1212 22:03:57.938848 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I1212 22:03:57.950569 84229 addons.go:423] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I1212 22:03:57.950598 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I1212 22:03:57.987819 84229 addons.go:423] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I1212 22:03:57.987846 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I1212 22:03:58.002423 84229 addons.go:423] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I1212 22:03:58.002451 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I1212 22:03:58.011616 84229 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I1212 22:03:58.045996 84229 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-4nq5c" in "kube-system" namespace to be "Ready" ...
I1212 22:03:58.077510 84229 addons.go:423] installing /etc/kubernetes/addons/ig-crd.yaml
I1212 22:03:58.077544 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I1212 22:03:58.100038 84229 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I1212 22:03:58.100060 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I1212 22:03:58.145489 84229 addons.go:423] installing /etc/kubernetes/addons/ig-daemonset.yaml
I1212 22:03:58.145514 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
I1212 22:03:58.172213 84229 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I1212 22:03:58.172245 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I1212 22:03:58.225614 84229 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I1212 22:03:58.255668 84229 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I1212 22:03:58.255697 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I1212 22:03:58.316205 84229 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I1212 22:03:58.316232 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I1212 22:03:58.369811 84229 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I1212 22:03:58.369844 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I1212 22:03:58.415596 84229 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I1212 22:04:00.676182 84229 pod_ready.go:102] pod "coredns-5dd5756b68-4nq5c" in "kube-system" namespace has status "Ready":"False"
I1212 22:04:02.945645 84229 pod_ready.go:102] pod "coredns-5dd5756b68-4nq5c" in "kube-system" namespace has status "Ready":"False"
I1212 22:04:03.236802 84229 pod_ready.go:97] pod "coredns-5dd5756b68-4nq5c" in "kube-system" namespace has status phase "Failed" (skipping!): {Phase:Failed Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-12-12 22:03:58 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-12-12 22:03:58 +0000 UTC Reason:PodFailed Message:} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-12-12 22:03:58 +0000 UTC Reason:PodFailed Message:} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-12-12 22:03:57 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:192.168.39.86 HostIPs:[] PodIP: PodIPs:[] StartTime:2023-12-12 22:03:58 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:coredns State:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:2
,Signal:0,Reason:Error,Message:,StartedAt:2023-12-12 22:04:01 +0000 UTC,FinishedAt:2023-12-12 22:04:01 +0000 UTC,ContainerID:cri-o://2a4d9b03d388d413f5798d9014c2be17e3038686446fd80927367e5b1f9b9ec9,}} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:0 Image:registry.k8s.io/coredns/coredns:v1.10.1 ImageID:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e ContainerID:cri-o://2a4d9b03d388d413f5798d9014c2be17e3038686446fd80927367e5b1f9b9ec9 Started:0xc00345eadc AllocatedResources:map[] Resources:nil}] QOSClass:Burstable EphemeralContainerStatuses:[] Resize: ResourceClaimStatuses:[]}
I1212 22:04:03.236839 84229 pod_ready.go:81] duration metric: took 5.19080103s waiting for pod "coredns-5dd5756b68-4nq5c" in "kube-system" namespace to be "Ready" ...
E1212 22:04:03.236857 84229 pod_ready.go:66] WaitExtra: waitPodCondition: pod "coredns-5dd5756b68-4nq5c" in "kube-system" namespace has status phase "Failed" (skipping!): {Phase:Failed Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-12-12 22:03:58 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-12-12 22:03:58 +0000 UTC Reason:PodFailed Message:} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-12-12 22:03:58 +0000 UTC Reason:PodFailed Message:} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-12-12 22:03:57 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:192.168.39.86 HostIPs:[] PodIP: PodIPs:[] StartTime:2023-12-12 22:03:58 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:coredns State:{Waiting:nil Running:nil Terminated:&Contai
nerStateTerminated{ExitCode:2,Signal:0,Reason:Error,Message:,StartedAt:2023-12-12 22:04:01 +0000 UTC,FinishedAt:2023-12-12 22:04:01 +0000 UTC,ContainerID:cri-o://2a4d9b03d388d413f5798d9014c2be17e3038686446fd80927367e5b1f9b9ec9,}} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:0 Image:registry.k8s.io/coredns/coredns:v1.10.1 ImageID:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e ContainerID:cri-o://2a4d9b03d388d413f5798d9014c2be17e3038686446fd80927367e5b1f9b9ec9 Started:0xc00345eadc AllocatedResources:map[] Resources:nil}] QOSClass:Burstable EphemeralContainerStatuses:[] Resize: ResourceClaimStatuses:[]}
I1212 22:04:03.236867 84229 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-wwrgq" in "kube-system" namespace to be "Ready" ...
I1212 22:04:03.238588 84229 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (6.237109317s)
I1212 22:04:03.238639 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:03.238648 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:03.239077 84229 main.go:141] libmachine: (addons-361656) DBG | Closing plugin on server side
I1212 22:04:03.239085 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:03.239112 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:03.239131 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:03.239141 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:03.239518 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:03.239537 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:03.239556 84229 main.go:141] libmachine: (addons-361656) DBG | Closing plugin on server side
I1212 22:04:03.395201 84229 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (6.376308335s)
I1212 22:04:03.395284 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:03.395299 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:03.395626 84229 main.go:141] libmachine: (addons-361656) DBG | Closing plugin on server side
I1212 22:04:03.395679 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:03.395690 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:03.395707 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:03.395723 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:03.395985 84229 main.go:141] libmachine: (addons-361656) DBG | Closing plugin on server side
I1212 22:04:03.395997 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:03.396027 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:04.826764 84229 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I1212 22:04:04.826817 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHHostname
I1212 22:04:04.830224 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:04:04.830595 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:04:04.830628 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:04:04.830800 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHPort
I1212 22:04:04.831011 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:04:04.831187 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHUsername
I1212 22:04:04.831342 84229 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656/id_rsa Username:docker}
I1212 22:04:05.060165 84229 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I1212 22:04:05.099803 84229 addons.go:231] Setting addon gcp-auth=true in "addons-361656"
I1212 22:04:05.099866 84229 host.go:66] Checking if "addons-361656" exists ...
I1212 22:04:05.100190 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:04:05.100223 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:04:05.116136 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42901
I1212 22:04:05.116619 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:04:05.117217 84229 main.go:141] libmachine: Using API Version 1
I1212 22:04:05.117239 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:04:05.117565 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:04:05.118187 84229 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1212 22:04:05.118228 84229 main.go:141] libmachine: Launching plugin server for driver kvm2
I1212 22:04:05.133071 84229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38383
I1212 22:04:05.133550 84229 main.go:141] libmachine: () Calling .GetVersion
I1212 22:04:05.134152 84229 main.go:141] libmachine: Using API Version 1
I1212 22:04:05.134180 84229 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 22:04:05.134552 84229 main.go:141] libmachine: () Calling .GetMachineName
I1212 22:04:05.134753 84229 main.go:141] libmachine: (addons-361656) Calling .GetState
I1212 22:04:05.136603 84229 main.go:141] libmachine: (addons-361656) Calling .DriverName
I1212 22:04:05.136861 84229 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I1212 22:04:05.136884 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHHostname
I1212 22:04:05.140071 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:04:05.140570 84229 main.go:141] libmachine: (addons-361656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9c:1e:2f", ip: ""} in network mk-addons-361656: {Iface:virbr1 ExpiryTime:2023-12-12 23:03:17 +0000 UTC Type:0 Mac:52:54:00:9c:1e:2f Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:addons-361656 Clientid:01:52:54:00:9c:1e:2f}
I1212 22:04:05.140605 84229 main.go:141] libmachine: (addons-361656) DBG | domain addons-361656 has defined IP address 192.168.39.86 and MAC address 52:54:00:9c:1e:2f in network mk-addons-361656
I1212 22:04:05.140772 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHPort
I1212 22:04:05.140988 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHKeyPath
I1212 22:04:05.141220 84229 main.go:141] libmachine: (addons-361656) Calling .GetSSHUsername
I1212 22:04:05.141397 84229 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17761-76611/.minikube/machines/addons-361656/id_rsa Username:docker}
I1212 22:04:05.529168 84229 pod_ready.go:102] pod "coredns-5dd5756b68-wwrgq" in "kube-system" namespace has status "Ready":"False"
I1212 22:04:06.710182 84229 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (9.663494552s)
I1212 22:04:06.710226 84229 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (9.647287273s)
I1212 22:04:06.710265 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:06.710235 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:06.710281 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:06.710294 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:06.710302 84229 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (9.605059347s)
I1212 22:04:06.710329 84229 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.39.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (9.580500144s)
I1212 22:04:06.710418 84229 start.go:929] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap
I1212 22:04:06.710387 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:06.710445 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:06.710545 84229 main.go:141] libmachine: (addons-361656) DBG | Closing plugin on server side
I1212 22:04:06.710578 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:06.710590 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:06.710604 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:06.710615 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:06.710694 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:06.710708 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:06.710718 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:06.710732 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:06.710745 84229 main.go:141] libmachine: (addons-361656) DBG | Closing plugin on server side
I1212 22:04:06.710786 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:06.710801 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:06.710817 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:06.710826 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:06.712515 84229 main.go:141] libmachine: (addons-361656) DBG | Closing plugin on server side
I1212 22:04:06.712517 84229 main.go:141] libmachine: (addons-361656) DBG | Closing plugin on server side
I1212 22:04:06.712521 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:06.712542 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:06.712555 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:06.712558 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:06.712558 84229 main.go:141] libmachine: (addons-361656) DBG | Closing plugin on server side
I1212 22:04:06.712567 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:06.712544 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:06.712578 84229 addons.go:467] Verifying addon ingress=true in "addons-361656"
I1212 22:04:06.714463 84229 out.go:177] * Verifying ingress addon...
I1212 22:04:06.712900 84229 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml: (9.532287857s)
I1212 22:04:06.712971 84229 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (9.328378811s)
I1212 22:04:06.713022 84229 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (9.070497866s)
I1212 22:04:06.713053 84229 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (9.066027331s)
I1212 22:04:06.713241 84229 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.957567834s)
I1212 22:04:06.713409 84229 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (8.701752391s)
I1212 22:04:06.713500 84229 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (8.487848421s)
I1212 22:04:06.715983 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:06.715998 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:06.716009 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:06.716016 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:06.716022 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:06.716037 84229 main.go:141] libmachine: Making call to close driver server
W1212 22:04:06.716052 84229 addons.go:449] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I1212 22:04:06.716019 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:06.716076 84229 retry.go:31] will retry after 366.059997ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I1212 22:04:06.716058 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:06.716012 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:06.716088 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:06.715997 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:06.716144 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:06.716487 84229 main.go:141] libmachine: (addons-361656) DBG | Closing plugin on server side
I1212 22:04:06.716494 84229 main.go:141] libmachine: (addons-361656) DBG | Closing plugin on server side
I1212 22:04:06.716533 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:06.716548 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:06.716555 84229 main.go:141] libmachine: (addons-361656) DBG | Closing plugin on server side
I1212 22:04:06.716562 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:06.716574 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:06.716590 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:06.716605 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:06.716619 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:06.716636 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:06.716641 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:06.716651 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:06.716666 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:06.716678 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:06.716535 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:06.716716 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:06.716727 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:06.716735 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:06.716953 84229 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I1212 22:04:06.717082 84229 main.go:141] libmachine: (addons-361656) DBG | Closing plugin on server side
I1212 22:04:06.717117 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:06.717126 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:06.717168 84229 main.go:141] libmachine: (addons-361656) DBG | Closing plugin on server side
I1212 22:04:06.717196 84229 main.go:141] libmachine: (addons-361656) DBG | Closing plugin on server side
I1212 22:04:06.717228 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:06.717240 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:06.717349 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:06.717368 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:06.717377 84229 addons.go:467] Verifying addon registry=true in "addons-361656"
I1212 22:04:06.719314 84229 out.go:177] * Verifying registry addon...
I1212 22:04:06.717589 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:06.717613 84229 main.go:141] libmachine: (addons-361656) DBG | Closing plugin on server side
I1212 22:04:06.718336 84229 main.go:141] libmachine: (addons-361656) DBG | Closing plugin on server side
I1212 22:04:06.718383 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:06.719356 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:06.719365 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:06.721643 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:06.721659 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:06.721871 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:06.721885 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:06.721895 84229 addons.go:467] Verifying addon metrics-server=true in "addons-361656"
I1212 22:04:06.722416 84229 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I1212 22:04:06.723487 84229 main.go:141] libmachine: (addons-361656) DBG | Closing plugin on server side
I1212 22:04:06.723505 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:06.723520 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:06.723530 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:06.723539 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:06.723774 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:06.723791 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:06.734422 84229 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I1212 22:04:06.734446 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:06.740582 84229 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I1212 22:04:06.740612 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:06.750582 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:06.750608 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:06.750894 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:06.750912 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:06.750949 84229 main.go:141] libmachine: (addons-361656) DBG | Closing plugin on server side
W1212 22:04:06.751028 84229 out.go:239] ! Enabling 'storage-provisioner-rancher' returned an error: running callbacks: [Error making local-path the default storage class: Error while marking storage class local-path as default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]
I1212 22:04:06.761730 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:06.763442 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:06.764061 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:06.764079 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:06.764371 84229 main.go:141] libmachine: (addons-361656) DBG | Closing plugin on server side
I1212 22:04:06.764388 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:06.764404 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:07.083321 84229 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I1212 22:04:07.357894 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:07.366220 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:07.424764 84229 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (2.287873501s)
I1212 22:04:07.424845 84229 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (9.009194909s)
I1212 22:04:07.426900 84229 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20231011-8b53cabe0
I1212 22:04:07.424902 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:07.428485 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:07.430014 84229 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0
I1212 22:04:07.428962 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:07.429068 84229 main.go:141] libmachine: (addons-361656) DBG | Closing plugin on server side
I1212 22:04:07.431629 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:07.431648 84229 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I1212 22:04:07.431663 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:07.431678 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:07.431664 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I1212 22:04:07.431979 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:07.432000 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:07.432012 84229 addons.go:467] Verifying addon csi-hostpath-driver=true in "addons-361656"
I1212 22:04:07.433690 84229 out.go:177] * Verifying csi-hostpath-driver addon...
I1212 22:04:07.435907 84229 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I1212 22:04:07.462786 84229 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I1212 22:04:07.462820 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I1212 22:04:07.495644 84229 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I1212 22:04:07.495672 84229 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5432 bytes)
I1212 22:04:07.529996 84229 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I1212 22:04:07.778039 84229 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I1212 22:04:07.778068 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:07.908532 84229 pod_ready.go:102] pod "coredns-5dd5756b68-wwrgq" in "kube-system" namespace has status "Ready":"False"
I1212 22:04:07.908647 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:07.909007 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:07.924887 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:08.275984 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:08.277426 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:08.430910 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:08.809156 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:08.831455 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:08.946034 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:09.281281 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:09.283593 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:09.439876 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:09.673948 84229 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.590548464s)
I1212 22:04:09.674009 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:09.674021 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:09.674339 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:09.674359 84229 main.go:141] libmachine: (addons-361656) DBG | Closing plugin on server side
I1212 22:04:09.674367 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:09.674379 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:09.674389 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:09.674673 84229 main.go:141] libmachine: (addons-361656) DBG | Closing plugin on server side
I1212 22:04:09.674688 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:09.674712 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:09.771132 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:09.775703 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:09.954492 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:09.966909 84229 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (2.436864652s)
I1212 22:04:09.966974 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:09.967004 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:09.967343 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:09.967364 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:09.967380 84229 main.go:141] libmachine: Making call to close driver server
I1212 22:04:09.967389 84229 main.go:141] libmachine: (addons-361656) Calling .Close
I1212 22:04:09.967634 84229 main.go:141] libmachine: Successfully made call to close driver server
I1212 22:04:09.967675 84229 main.go:141] libmachine: (addons-361656) DBG | Closing plugin on server side
I1212 22:04:09.967683 84229 main.go:141] libmachine: Making call to close connection to plugin binary
I1212 22:04:09.969536 84229 addons.go:467] Verifying addon gcp-auth=true in "addons-361656"
I1212 22:04:09.971707 84229 out.go:177] * Verifying gcp-auth addon...
I1212 22:04:09.974349 84229 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I1212 22:04:10.041737 84229 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I1212 22:04:10.041768 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:10.041849 84229 pod_ready.go:102] pod "coredns-5dd5756b68-wwrgq" in "kube-system" namespace has status "Ready":"False"
I1212 22:04:10.082563 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:10.268045 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:10.270105 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:10.439403 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:10.586410 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:10.768747 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:10.770934 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:10.932218 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:11.088544 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:11.280906 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:11.288709 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:11.438465 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:11.588006 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:11.786810 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:11.788907 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:11.943091 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:12.087167 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:12.271221 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:12.273564 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:12.430654 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:12.463537 84229 pod_ready.go:102] pod "coredns-5dd5756b68-wwrgq" in "kube-system" namespace has status "Ready":"False"
I1212 22:04:12.587880 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:12.766681 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:12.771017 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:12.930734 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:13.087233 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:13.272731 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:13.273218 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:13.431720 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:13.586600 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:13.776116 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:13.778899 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:13.939902 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:14.087928 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:14.271771 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:14.271972 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:14.434956 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:14.471536 84229 pod_ready.go:102] pod "coredns-5dd5756b68-wwrgq" in "kube-system" namespace has status "Ready":"False"
I1212 22:04:14.587584 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:14.781161 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:14.781539 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:14.930415 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:15.089961 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:15.269406 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:15.276603 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:15.431155 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:15.587684 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:15.768913 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:15.774418 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:15.931625 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:16.090304 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:16.273018 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:16.274771 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:16.445391 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:16.586888 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:16.769217 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:16.774503 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:16.953443 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:16.977997 84229 pod_ready.go:102] pod "coredns-5dd5756b68-wwrgq" in "kube-system" namespace has status "Ready":"False"
I1212 22:04:17.086349 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:17.277181 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:17.293778 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:17.458696 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:17.587874 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:17.769232 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:17.778700 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:17.939542 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:18.091738 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:18.272564 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:18.273154 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:18.439844 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:18.588680 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:18.792334 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:18.793783 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:18.931232 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:19.091805 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:19.594290 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:19.594701 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:19.598574 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:19.599078 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:19.605807 84229 pod_ready.go:102] pod "coredns-5dd5756b68-wwrgq" in "kube-system" namespace has status "Ready":"False"
I1212 22:04:19.773037 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:19.778995 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:19.935400 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:20.087547 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:20.267477 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:20.269498 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:20.439982 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:20.598870 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:20.778356 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:20.779267 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:20.941533 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:21.095128 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:21.276924 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:21.278311 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:21.453135 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:21.595521 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:21.771616 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:21.775383 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:21.947075 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:21.975519 84229 pod_ready.go:102] pod "coredns-5dd5756b68-wwrgq" in "kube-system" namespace has status "Ready":"False"
I1212 22:04:22.087784 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:22.275674 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:22.286800 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:22.443630 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:22.599160 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:22.773905 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:22.775457 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:22.934795 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:23.087798 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:23.268052 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:23.271193 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:23.432882 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:23.586386 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:23.766616 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:23.784523 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:23.932753 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:24.086412 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:24.267095 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:24.269168 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:24.433930 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:24.467061 84229 pod_ready.go:102] pod "coredns-5dd5756b68-wwrgq" in "kube-system" namespace has status "Ready":"False"
I1212 22:04:24.589726 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:24.767816 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:24.769134 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:24.931497 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:25.087094 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:25.267316 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:25.273323 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:25.467709 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:25.587087 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:25.770670 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:25.772682 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:25.944600 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:26.087993 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:26.268516 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:26.272542 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:26.451874 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:26.467470 84229 pod_ready.go:102] pod "coredns-5dd5756b68-wwrgq" in "kube-system" namespace has status "Ready":"False"
I1212 22:04:26.589531 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:26.770738 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:26.770776 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:26.934856 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:27.091325 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:27.267613 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:27.274516 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:27.431479 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:27.586889 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:27.767462 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:27.770463 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:27.939569 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:28.087267 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:28.266628 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:28.269286 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:28.433519 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:28.586645 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:28.772409 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:28.773020 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:28.933230 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:28.963547 84229 pod_ready.go:102] pod "coredns-5dd5756b68-wwrgq" in "kube-system" namespace has status "Ready":"False"
I1212 22:04:29.087401 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:29.267881 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:29.268738 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:29.431837 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:29.587351 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:29.767435 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:29.769957 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:29.932018 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:30.086277 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:30.267031 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:30.271160 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:30.431724 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:30.587220 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:30.767268 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:30.769651 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:30.930602 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:31.086681 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:31.267401 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:31.268482 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:31.432726 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:31.462848 84229 pod_ready.go:102] pod "coredns-5dd5756b68-wwrgq" in "kube-system" namespace has status "Ready":"False"
I1212 22:04:31.588141 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:31.767148 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:31.773626 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:31.930898 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:32.086723 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:32.269260 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:32.271611 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:32.431032 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:32.657105 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:32.767001 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:32.770815 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:32.931562 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:33.087250 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:33.267326 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:33.269703 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:33.431643 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:33.474257 84229 pod_ready.go:102] pod "coredns-5dd5756b68-wwrgq" in "kube-system" namespace has status "Ready":"False"
I1212 22:04:33.840299 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:33.840603 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:33.842507 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:33.937149 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:34.088151 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:34.268068 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:34.272192 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:34.434145 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:34.591366 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:34.767104 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:34.774136 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:34.931986 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:35.099811 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:35.281407 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:35.285753 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:35.433996 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:35.476415 84229 pod_ready.go:102] pod "coredns-5dd5756b68-wwrgq" in "kube-system" namespace has status "Ready":"False"
I1212 22:04:35.587220 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:35.767166 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:35.769451 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:35.939480 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:36.133897 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:36.269495 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:36.270446 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:36.431776 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:36.588465 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:36.769030 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:36.770118 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:36.932344 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:37.087857 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:37.267597 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:37.270500 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:37.432100 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:37.587390 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:37.776854 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:37.777586 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:38.378098 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:38.382926 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:38.383810 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:38.384503 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:38.384884 84229 pod_ready.go:102] pod "coredns-5dd5756b68-wwrgq" in "kube-system" namespace has status "Ready":"False"
I1212 22:04:38.431117 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:38.586521 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:38.770800 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:38.771132 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:38.936276 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:38.962751 84229 pod_ready.go:92] pod "coredns-5dd5756b68-wwrgq" in "kube-system" namespace has status "Ready":"True"
I1212 22:04:38.962782 84229 pod_ready.go:81] duration metric: took 35.725904217s waiting for pod "coredns-5dd5756b68-wwrgq" in "kube-system" namespace to be "Ready" ...
I1212 22:04:38.962795 84229 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-361656" in "kube-system" namespace to be "Ready" ...
I1212 22:04:38.967556 84229 pod_ready.go:92] pod "etcd-addons-361656" in "kube-system" namespace has status "Ready":"True"
I1212 22:04:38.967585 84229 pod_ready.go:81] duration metric: took 4.780576ms waiting for pod "etcd-addons-361656" in "kube-system" namespace to be "Ready" ...
I1212 22:04:38.967598 84229 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-361656" in "kube-system" namespace to be "Ready" ...
I1212 22:04:38.972809 84229 pod_ready.go:92] pod "kube-apiserver-addons-361656" in "kube-system" namespace has status "Ready":"True"
I1212 22:04:38.972831 84229 pod_ready.go:81] duration metric: took 5.225442ms waiting for pod "kube-apiserver-addons-361656" in "kube-system" namespace to be "Ready" ...
I1212 22:04:38.972841 84229 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-361656" in "kube-system" namespace to be "Ready" ...
I1212 22:04:38.980001 84229 pod_ready.go:92] pod "kube-controller-manager-addons-361656" in "kube-system" namespace has status "Ready":"True"
I1212 22:04:38.980032 84229 pod_ready.go:81] duration metric: took 7.182244ms waiting for pod "kube-controller-manager-addons-361656" in "kube-system" namespace to be "Ready" ...
I1212 22:04:38.980046 84229 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-pjzv8" in "kube-system" namespace to be "Ready" ...
I1212 22:04:38.987555 84229 pod_ready.go:92] pod "kube-proxy-pjzv8" in "kube-system" namespace has status "Ready":"True"
I1212 22:04:38.987584 84229 pod_ready.go:81] duration metric: took 7.528535ms waiting for pod "kube-proxy-pjzv8" in "kube-system" namespace to be "Ready" ...
I1212 22:04:38.987598 84229 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-361656" in "kube-system" namespace to be "Ready" ...
I1212 22:04:39.086921 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:39.267655 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:39.269243 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:39.381991 84229 pod_ready.go:92] pod "kube-scheduler-addons-361656" in "kube-system" namespace has status "Ready":"True"
I1212 22:04:39.382021 84229 pod_ready.go:81] duration metric: took 394.413877ms waiting for pod "kube-scheduler-addons-361656" in "kube-system" namespace to be "Ready" ...
I1212 22:04:39.382032 84229 pod_ready.go:38] duration metric: took 42.014939523s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I1212 22:04:39.382050 84229 api_server.go:52] waiting for apiserver process to appear ...
I1212 22:04:39.382113 84229 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1212 22:04:39.419077 84229 api_server.go:72] duration metric: took 42.647290813s to wait for apiserver process to appear ...
I1212 22:04:39.419107 84229 api_server.go:88] waiting for apiserver healthz status ...
I1212 22:04:39.419128 84229 api_server.go:253] Checking apiserver healthz at https://192.168.39.86:8443/healthz ...
I1212 22:04:39.424617 84229 api_server.go:279] https://192.168.39.86:8443/healthz returned 200:
ok
I1212 22:04:39.425824 84229 api_server.go:141] control plane version: v1.28.4
I1212 22:04:39.425851 84229 api_server.go:131] duration metric: took 6.737484ms to wait for apiserver health ...
I1212 22:04:39.425861 84229 system_pods.go:43] waiting for kube-system pods to appear ...
I1212 22:04:39.430845 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:39.589842 84229 system_pods.go:59] 18 kube-system pods found
I1212 22:04:39.589874 84229 system_pods.go:61] "coredns-5dd5756b68-wwrgq" [00c258da-10ba-4e62-9ae4-0ec482dc23ea] Running
I1212 22:04:39.589879 84229 system_pods.go:61] "csi-hostpath-attacher-0" [231b62bc-5fa9-4829-a7d6-9b5ff69477b3] Running
I1212 22:04:39.589884 84229 system_pods.go:61] "csi-hostpath-resizer-0" [9f2742b7-a6d0-4ff3-91fa-da8fa8b5ae81] Running
I1212 22:04:39.589892 84229 system_pods.go:61] "csi-hostpathplugin-pkwtj" [de488436-16ae-4032-960c-b9c45afa5a3d] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I1212 22:04:39.589898 84229 system_pods.go:61] "etcd-addons-361656" [2c1e3247-a676-42b4-a7bb-ce47066ee417] Running
I1212 22:04:39.589903 84229 system_pods.go:61] "kube-apiserver-addons-361656" [59fbf8a3-c83f-4264-84dd-36a067699b28] Running
I1212 22:04:39.589907 84229 system_pods.go:61] "kube-controller-manager-addons-361656" [58b58094-bf0f-448a-a6ff-3d0f0999c62a] Running
I1212 22:04:39.589912 84229 system_pods.go:61] "kube-ingress-dns-minikube" [0df541c9-11fb-444a-9fd1-cf852f2d1bd4] Running
I1212 22:04:39.589916 84229 system_pods.go:61] "kube-proxy-pjzv8" [8e145d1c-391a-4995-9f1d-d133d382adc4] Running
I1212 22:04:39.589920 84229 system_pods.go:61] "kube-scheduler-addons-361656" [b03303ba-5d30-45af-a6d3-69646577c833] Running
I1212 22:04:39.589925 84229 system_pods.go:61] "metrics-server-7c66d45ddc-xcc44" [1965630d-64fd-4589-8013-157e45b51da6] Running / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I1212 22:04:39.589932 84229 system_pods.go:61] "nvidia-device-plugin-daemonset-hp8gn" [66283d05-a203-4f57-9ab7-6e01fd05f9de] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I1212 22:04:39.589938 84229 system_pods.go:61] "registry-proxy-vmks8" [6b6af208-0ccf-4504-8c9c-7a50353cd4bb] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I1212 22:04:39.589944 84229 system_pods.go:61] "registry-t5r8q" [b3f4351f-6afa-4e2b-9e8e-902b9da6d859] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I1212 22:04:39.589950 84229 system_pods.go:61] "snapshot-controller-58dbcc7b99-8vvgr" [158dd21a-c76c-4715-b42b-3b8584ac25b7] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1212 22:04:39.589965 84229 system_pods.go:61] "snapshot-controller-58dbcc7b99-bj6nf" [53805fe1-a499-4ccd-b440-ffd51f141d44] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1212 22:04:39.589970 84229 system_pods.go:61] "storage-provisioner" [7fed1501-c613-4f8b-adb0-b94e9c7c30d8] Running
I1212 22:04:39.589978 84229 system_pods.go:61] "tiller-deploy-7b677967b9-7rrmd" [d8666a3c-6977-4eea-ad49-1d5235697f29] Running
I1212 22:04:39.589985 84229 system_pods.go:74] duration metric: took 164.116976ms to wait for pod list to return data ...
I1212 22:04:39.589995 84229 default_sa.go:34] waiting for default service account to be created ...
I1212 22:04:39.591352 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:39.771379 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:39.771988 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:39.782573 84229 default_sa.go:45] found service account: "default"
I1212 22:04:39.782603 84229 default_sa.go:55] duration metric: took 192.601785ms for default service account to be created ...
I1212 22:04:39.782613 84229 system_pods.go:116] waiting for k8s-apps to be running ...
I1212 22:04:39.941218 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:39.992517 84229 system_pods.go:86] 18 kube-system pods found
I1212 22:04:39.992550 84229 system_pods.go:89] "coredns-5dd5756b68-wwrgq" [00c258da-10ba-4e62-9ae4-0ec482dc23ea] Running
I1212 22:04:39.992555 84229 system_pods.go:89] "csi-hostpath-attacher-0" [231b62bc-5fa9-4829-a7d6-9b5ff69477b3] Running
I1212 22:04:39.992560 84229 system_pods.go:89] "csi-hostpath-resizer-0" [9f2742b7-a6d0-4ff3-91fa-da8fa8b5ae81] Running
I1212 22:04:39.992567 84229 system_pods.go:89] "csi-hostpathplugin-pkwtj" [de488436-16ae-4032-960c-b9c45afa5a3d] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I1212 22:04:39.992571 84229 system_pods.go:89] "etcd-addons-361656" [2c1e3247-a676-42b4-a7bb-ce47066ee417] Running
I1212 22:04:39.992577 84229 system_pods.go:89] "kube-apiserver-addons-361656" [59fbf8a3-c83f-4264-84dd-36a067699b28] Running
I1212 22:04:39.992581 84229 system_pods.go:89] "kube-controller-manager-addons-361656" [58b58094-bf0f-448a-a6ff-3d0f0999c62a] Running
I1212 22:04:39.992585 84229 system_pods.go:89] "kube-ingress-dns-minikube" [0df541c9-11fb-444a-9fd1-cf852f2d1bd4] Running
I1212 22:04:39.992590 84229 system_pods.go:89] "kube-proxy-pjzv8" [8e145d1c-391a-4995-9f1d-d133d382adc4] Running
I1212 22:04:39.992594 84229 system_pods.go:89] "kube-scheduler-addons-361656" [b03303ba-5d30-45af-a6d3-69646577c833] Running
I1212 22:04:39.992599 84229 system_pods.go:89] "metrics-server-7c66d45ddc-xcc44" [1965630d-64fd-4589-8013-157e45b51da6] Running / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I1212 22:04:39.992605 84229 system_pods.go:89] "nvidia-device-plugin-daemonset-hp8gn" [66283d05-a203-4f57-9ab7-6e01fd05f9de] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I1212 22:04:39.992618 84229 system_pods.go:89] "registry-proxy-vmks8" [6b6af208-0ccf-4504-8c9c-7a50353cd4bb] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I1212 22:04:39.992626 84229 system_pods.go:89] "registry-t5r8q" [b3f4351f-6afa-4e2b-9e8e-902b9da6d859] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I1212 22:04:39.992637 84229 system_pods.go:89] "snapshot-controller-58dbcc7b99-8vvgr" [158dd21a-c76c-4715-b42b-3b8584ac25b7] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1212 22:04:39.992646 84229 system_pods.go:89] "snapshot-controller-58dbcc7b99-bj6nf" [53805fe1-a499-4ccd-b440-ffd51f141d44] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1212 22:04:39.992654 84229 system_pods.go:89] "storage-provisioner" [7fed1501-c613-4f8b-adb0-b94e9c7c30d8] Running
I1212 22:04:39.992661 84229 system_pods.go:89] "tiller-deploy-7b677967b9-7rrmd" [d8666a3c-6977-4eea-ad49-1d5235697f29] Running
I1212 22:04:39.992670 84229 system_pods.go:126] duration metric: took 210.051ms to wait for k8s-apps to be running ...
I1212 22:04:39.992686 84229 system_svc.go:44] waiting for kubelet service to be running ....
I1212 22:04:39.992732 84229 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1212 22:04:40.013293 84229 system_svc.go:56] duration metric: took 20.588825ms WaitForService to wait for kubelet.
I1212 22:04:40.013328 84229 kubeadm.go:581] duration metric: took 43.241552208s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
I1212 22:04:40.013354 84229 node_conditions.go:102] verifying NodePressure condition ...
I1212 22:04:40.087777 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:40.182181 84229 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I1212 22:04:40.182242 84229 node_conditions.go:123] node cpu capacity is 2
I1212 22:04:40.182256 84229 node_conditions.go:105] duration metric: took 168.896907ms to run NodePressure ...
I1212 22:04:40.182268 84229 start.go:228] waiting for startup goroutines ...
I1212 22:04:40.266883 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:40.269526 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:40.431828 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:40.591093 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:40.766823 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:40.769201 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:40.932145 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:41.089015 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:41.266716 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:41.271867 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:41.430923 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:41.587521 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:41.769208 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:41.770427 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:41.934990 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:42.087648 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:42.268635 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:42.269032 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:42.432284 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:42.590341 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:42.767498 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:42.770146 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:42.932240 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:43.087380 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:43.269274 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:43.269417 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:43.431450 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:43.586452 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:43.799656 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:43.808550 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:43.941861 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:44.086878 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:44.273991 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:44.274195 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:44.455674 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:44.586462 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:44.766930 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:44.769027 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:44.941731 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:45.086663 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:45.270052 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:45.271449 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:45.431840 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:45.989409 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:45.989413 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:45.989541 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:45.992743 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:46.090036 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:46.266571 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:46.269106 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:46.431875 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:46.586715 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:46.767187 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:46.770732 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:46.931153 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:47.088263 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:47.267019 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:47.269646 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:47.431501 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:47.587975 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:47.766527 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:47.770462 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:47.931492 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:48.088145 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:48.269209 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:48.269470 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:48.431284 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:48.594425 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:48.769774 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:48.770108 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:48.931625 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:49.087389 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:49.268150 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:49.268260 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:49.431001 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:49.586684 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:49.767588 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:49.769295 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:49.935503 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:50.086499 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:50.270785 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:50.271103 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:50.431294 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:50.587259 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:50.767230 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:50.768988 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:50.933997 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:51.087130 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:51.271565 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:51.276758 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:51.431181 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:51.586568 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:51.767522 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:51.768660 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:51.941716 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:52.086824 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:52.268665 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:52.270089 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:52.689049 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:52.691555 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:52.766773 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:52.770614 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:52.932446 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:53.086847 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:53.267776 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:53.269255 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:53.442565 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:53.587712 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:53.771152 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:53.773620 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:53.932639 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:54.086664 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:54.267201 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:54.269730 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:54.433978 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:54.587026 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:54.766403 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:54.769661 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:54.931221 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:55.086844 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:55.268380 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:55.270298 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:55.431505 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:55.586698 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:55.767757 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:55.768301 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:55.932884 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:56.087435 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:56.267482 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:56.271023 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:56.432427 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:56.587584 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:56.772691 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:56.772837 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:56.932887 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:57.089462 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:57.266949 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:57.269974 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:57.435036 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:57.587669 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:57.767184 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:57.769563 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:57.932056 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:58.087198 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:58.278698 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:58.279055 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:58.430906 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:58.586685 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:58.769391 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:58.775553 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:58.932727 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:59.086898 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:59.268962 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:59.270096 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:59.432199 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:04:59.589305 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:04:59.767233 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:04:59.770443 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:04:59.931997 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:00.087301 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:00.267578 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:00.270614 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:05:00.482695 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:00.586372 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:00.770975 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:00.773503 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:05:00.931904 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:01.086914 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:01.267881 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:01.268891 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:05:01.430722 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:01.586238 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:01.782716 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:01.784418 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:05:01.935058 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:02.091515 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:02.269331 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:05:02.269457 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:02.431651 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:02.586483 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:02.773988 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:05:02.776544 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:02.943962 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:03.086768 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:03.268357 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:03.268600 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:05:03.432148 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:03.586489 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:03.767712 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:03.769362 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:05:03.935609 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:04.086168 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:04.267450 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:04.270215 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:05:04.433292 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:04.598754 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:04.777321 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:04.778077 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1212 22:05:04.936834 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:05.093432 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:05.269370 84229 kapi.go:107] duration metric: took 58.546950746s to wait for kubernetes.io/minikube-addons=registry ...
I1212 22:05:05.269706 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:05.430501 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:05.586359 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:05.767046 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:05.930685 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:06.104108 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:06.268038 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:06.430560 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:06.588022 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:06.770077 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:06.953428 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:07.086240 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:07.268757 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:07.619799 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:07.653049 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:07.795157 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:07.938654 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:08.088825 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:08.267076 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:08.431980 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:08.590227 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:08.807972 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:08.934416 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:09.087327 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:09.266269 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:09.431311 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:09.624670 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:09.768676 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:09.934434 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:10.088186 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:10.267064 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:10.434486 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:10.588563 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:10.767986 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:10.933475 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:11.092755 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:11.268837 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:11.432320 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:11.589214 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:11.768198 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:11.931191 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:12.088550 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:12.267270 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:12.431538 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:12.586684 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:12.767059 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:12.931232 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:13.087571 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:13.269560 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:13.511189 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:13.589455 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:13.767602 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:13.932238 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:14.086967 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:14.267061 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:14.432130 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:14.588718 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:14.766829 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:14.930594 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:15.086972 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:15.266354 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:15.431525 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:15.587311 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:15.767032 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:15.930766 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:16.086799 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:16.267423 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:16.431270 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:16.587710 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:16.766442 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:16.932060 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:17.087258 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:17.270763 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:17.431134 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:17.587509 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:17.779368 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:17.932469 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:18.086566 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:18.267235 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:18.431996 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:18.587204 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:18.767128 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:18.931410 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:19.086256 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:19.267561 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:19.432799 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:19.600108 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:19.767564 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:19.936108 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:20.087823 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:20.274994 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:20.431530 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:20.591461 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:20.766938 84229 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1212 22:05:20.951566 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:21.087777 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:21.268624 84229 kapi.go:107] duration metric: took 1m14.55166841s to wait for app.kubernetes.io/name=ingress-nginx ...
I1212 22:05:21.433195 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:21.587410 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:21.946900 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:22.087258 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:22.632529 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:22.633117 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:22.932066 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1212 22:05:23.096904 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:23.436650 84229 kapi.go:107] duration metric: took 1m16.000737889s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I1212 22:05:23.586656 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:24.087010 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:24.587827 84229 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1212 22:05:25.090865 84229 kapi.go:107] duration metric: took 1m15.116511047s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I1212 22:05:25.092722 84229 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-361656 cluster.
I1212 22:05:25.094503 84229 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I1212 22:05:25.096010 84229 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I1212 22:05:25.097874 84229 out.go:177] * Enabled addons: nvidia-device-plugin, cloud-spanner, storage-provisioner, ingress-dns, inspektor-gadget, metrics-server, helm-tiller, default-storageclass, volumesnapshots, registry, ingress, csi-hostpath-driver, gcp-auth
I1212 22:05:25.099433 84229 addons.go:502] enable addons completed in 1m28.444407541s: enabled=[nvidia-device-plugin cloud-spanner storage-provisioner ingress-dns inspektor-gadget metrics-server helm-tiller default-storageclass volumesnapshots registry ingress csi-hostpath-driver gcp-auth]
I1212 22:05:25.099479 84229 start.go:233] waiting for cluster config update ...
I1212 22:05:25.099501 84229 start.go:242] writing updated cluster config ...
I1212 22:05:25.099813 84229 ssh_runner.go:195] Run: rm -f paused
I1212 22:05:25.157136 84229 start.go:600] kubectl: 1.28.4, cluster: 1.28.4 (minor skew: 0)
I1212 22:05:25.159213 84229 out.go:177] * Done! kubectl is now configured to use "addons-361656" cluster and "default" namespace by default
*
* ==> CRI-O <==
* -- Journal begins at Tue 2023-12-12 22:03:14 UTC, ends at Tue 2023-12-12 22:08:04 UTC. --
Dec 12 22:08:04 addons-361656 crio[715]: time="2023-12-12 22:08:04.825700037Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=be0b4e65-5ecc-4bfb-89b4-c48984684508 name=/runtime.v1.RuntimeService/Version
Dec 12 22:08:04 addons-361656 crio[715]: time="2023-12-12 22:08:04.827402663Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=a2dd2903-a667-4972-bae8-91c61f47023b name=/runtime.v1.ImageService/ImageFsInfo
Dec 12 22:08:04 addons-361656 crio[715]: time="2023-12-12 22:08:04.828956520Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1702418884828937216,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:543773,},InodesUsed:&UInt64Value{Value:227,},},},}" file="go-grpc-middleware/chain.go:25" id=a2dd2903-a667-4972-bae8-91c61f47023b name=/runtime.v1.ImageService/ImageFsInfo
Dec 12 22:08:04 addons-361656 crio[715]: time="2023-12-12 22:08:04.829961103Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=b0acaf4b-6fb4-4b61-9d4d-90d1f09f01ca name=/runtime.v1.RuntimeService/ListContainers
Dec 12 22:08:04 addons-361656 crio[715]: time="2023-12-12 22:08:04.830051379Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=b0acaf4b-6fb4-4b61-9d4d-90d1f09f01ca name=/runtime.v1.RuntimeService/ListContainers
Dec 12 22:08:04 addons-361656 crio[715]: time="2023-12-12 22:08:04.830487391Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d8a3cb2b14e2fd79d7dafa0ab819a82caec3d58e3e85f9e47d7bdc4857b87615,PodSandboxId:11126c04826ceb9a433b50f982be4a2bec9863a8a4dbd013c9f12c59566dac37,Metadata:&ContainerMetadata{Name:hello-world-app,Attempt:0,},Image:&ImageSpec{Image:gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7,Annotations:map[string]string{},},ImageRef:gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7,State:CONTAINER_RUNNING,CreatedAt:1702418876330831043,Labels:map[string]string{io.kubernetes.container.name: hello-world-app,io.kubernetes.pod.name: hello-world-app-5d77478584-99x22,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: c5d8c21c-f196-454c-b323-28842ec5c5b8,},Annotations:map[string]string{io.kubernetes.container.hash: cddf2ed2,io.kubernetes.conta
iner.ports: [{\"containerPort\":8080,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:855635ac50884de1beb470732a2c911ff377aeebc88085191adef9594909a13f,PodSandboxId:867a762363d97bdf26df37b5ac3d199c4c665e3ed5b0133a332288d2a65f2f47,Metadata:&ContainerMetadata{Name:headlamp,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/headlamp-k8s/headlamp@sha256:6153bcbd375a0157858961b1138ed62321a2639b37826b37498bce16ee736cc1,Annotations:map[string]string{},},ImageRef:ghcr.io/headlamp-k8s/headlamp@sha256:6153bcbd375a0157858961b1138ed62321a2639b37826b37498bce16ee736cc1,State:CONTAINER_RUNNING,CreatedAt:1702418752080440373,Labels:map[string]string{io.kubernetes.container.name: headlamp,io.kubernetes.pod.name: headlamp-777fd4b855-wvjmv,io.kubernetes.pod.namespace: headlamp,io.kubernetes.pod.uid: 80a749a9-3e48-4683-a511-fa220661bdc4,},An
notations:map[string]string{io.kubernetes.container.hash: a2b7dcb6,io.kubernetes.container.ports: [{\"name\":\"http\",\"containerPort\":4466,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e1552202dfef028710685a2827769c363f3d6c8ba6341e48133e1d41d1dc2bbb,PodSandboxId:8ffd8386b6c0454f2a8dab00e5eaf45381df3665006cf580653fc459671cd6f0,Metadata:&ContainerMetadata{Name:nginx,Attempt:0,},Image:&ImageSpec{Image:docker.io/library/nginx@sha256:3923f8de8d2214b9490e68fd6ae63ea604deddd166df2755b788bef04848b9bc,Annotations:map[string]string{},},ImageRef:docker.io/library/nginx@sha256:3923f8de8d2214b9490e68fd6ae63ea604deddd166df2755b788bef04848b9bc,State:CONTAINER_RUNNING,CreatedAt:1702418736319930574,Labels:map[string]string{io.kubernetes.container.name: nginx,io.kubernetes.pod.name: nginx,io.kubernetes.pod.namespace: default
,io.kubernetes.pod.uid: 5b06d6d2-998c-4fa5-b223-3add010e8e2f,},Annotations:map[string]string{io.kubernetes.container.hash: d9152c3e,io.kubernetes.container.ports: [{\"containerPort\":80,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:91c228d72c6887e427e4b02bcdadbb57a5a4f6ba35695daa5ad74c544d1deb91,PodSandboxId:2ceb5cba92a483d2405e8bcaa9c9cf5afc393cb33a66d4c96a4f774df12c7a89,Metadata:&ContainerMetadata{Name:gcp-auth,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/gcp-auth-webhook@sha256:3e92b3d1c15220ae0f2f3505fb3a88899a1e48ec85fb777a1a4945ae9db2ce06,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/gcp-auth-webhook@sha256:3e92b3d1c15220ae0f2f3505fb3a88899a1e48ec85fb777a1a4945ae9db2ce06,State:CONTAINER_RUNNING,CreatedAt:1702418724628373953,Labels:map[string]string{io.kubernetes.container.name
: gcp-auth,io.kubernetes.pod.name: gcp-auth-d4c87556c-9qbm2,io.kubernetes.pod.namespace: gcp-auth,io.kubernetes.pod.uid: f980d6db-f2b0-40e8-a4ab-a8f9a8746c2c,},Annotations:map[string]string{io.kubernetes.container.hash: dc4ef1fc,io.kubernetes.container.ports: [{\"containerPort\":8443,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:01c626226dd367436ed15e97ef6fb405cacb39d7b199d71e75e414222202006c,PodSandboxId:579d1fdad5ef5b0f5931f6a423ea6114436db008de23d7aae5def900a5055953,Metadata:&ContainerMetadata{Name:patch,Attempt:2,},Image:&ImageSpec{Image:1ebff0f9671bc015dc340b12c5bf6f3dbda7d0a8b5332bd095f21bd52e1b30fb,Annotations:map[string]string{},},ImageRef:registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:29318c6957228dc10feb67fed5b91bdd8a9e3279e5b29c5965b9bd31a01ee385,State:CONTAINER_EXITED,CreatedAt:17024187
02791044868,Labels:map[string]string{io.kubernetes.container.name: patch,io.kubernetes.pod.name: ingress-nginx-admission-patch-9r5ds,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: 533d35a4-b8a6-4273-8ca1-b4126c10ec65,},Annotations:map[string]string{io.kubernetes.container.hash: 70ad9c71,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:041d4cac61ba979536ec65a3a6199ea430cc38676e6dedd99e5f625fe87e95dd,PodSandboxId:ea58cc5be71f0621444b314e89d0e2adbc57e047ecc16409915b2c3e28fe422d,Metadata:&ContainerMetadata{Name:create,Attempt:0,},Image:&ImageSpec{Image:registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:29318c6957228dc10feb67fed5b91bdd8a9e3279e5b29c5965b9bd31a01ee385,Annotations:map[string]string{},},ImageRef:registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:29318c6957228dc10feb67fed5b91bdd8a9e3279e5b29c59
65b9bd31a01ee385,State:CONTAINER_EXITED,CreatedAt:1702418688029925294,Labels:map[string]string{io.kubernetes.container.name: create,io.kubernetes.pod.name: ingress-nginx-admission-create-pts6h,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: 5f162bf0-b36e-4d15-bf62-0dbadd581cd8,},Annotations:map[string]string{io.kubernetes.container.hash: ce9bca44,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:aef04e95ad1fe933b031cad975c37a81891ea763c78a0635e4ed9e5a08545d83,PodSandboxId:fac761f91352a61431ccf85bcb6b64d7fe27631568accb2971a821fd80a08a8b,Metadata:&ContainerMetadata{Name:local-path-provisioner,Attempt:0,},Image:&ImageSpec{Image:docker.io/rancher/local-path-provisioner@sha256:73f712e7af12b06720c35ce75217f904f00e4bd96de79f8db1cf160112e667ef,Annotations:map[string]string{},},ImageRef:docker.io/rancher/local-path-provisioner
@sha256:73f712e7af12b06720c35ce75217f904f00e4bd96de79f8db1cf160112e667ef,State:CONTAINER_RUNNING,CreatedAt:1702418679799337899,Labels:map[string]string{io.kubernetes.container.name: local-path-provisioner,io.kubernetes.pod.name: local-path-provisioner-78b46b4d5c-qccjq,io.kubernetes.pod.namespace: local-path-storage,io.kubernetes.pod.uid: 9c22d109-bee3-43f0-af69-51c2db7ebc0b,},Annotations:map[string]string{io.kubernetes.container.hash: d139ac8f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:96fb98f8d7789efc274b1cf924697cb141142e383644b53888a17ba15c569025,PodSandboxId:e0d58ff32db7cedbfc823cb05940833bc6692c8a98b08c77d69165ffc769df31,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s
-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1702418659624390243,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7fed1501-c613-4f8b-adb0-b94e9c7c30d8,},Annotations:map[string]string{io.kubernetes.container.hash: c639785a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0d919eb6810b21cbb9196d13258c29f88172688f2a3fc47a26646d954fe44437,PodSandboxId:ee2881903ffaa04fd4b2dbda90ca8ba7f4cadeb1b9402775cb059db257ea329f,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube
-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1702418652795496165,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-pjzv8,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8e145d1c-391a-4995-9f1d-d133d382adc4,},Annotations:map[string]string{io.kubernetes.container.hash: e0d07811,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a20f0abe6fb84210558e8488bcd0c3d00bc1a70c4ee1a58c3509d87d431f7e88,PodSandboxId:00b8b393b274b3191069b82176fee3eea8f5fc9fc6cfb7895b7e8de0d9b908de,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044a
eb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1702418642317442308,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-wwrgq,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 00c258da-10ba-4e62-9ae4-0ec482dc23ea,},Annotations:map[string]string{io.kubernetes.container.hash: d3b7a77a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:53bacbebf69a069a9e72b6111c84f56ce650ba89aeb0470ce89711fc7f26274e,PodSandboxId:65a204f35462c9e03b4bd71d04a14264802ff79a4fbef69308f49855e69221b0,Metadata:&ContainerMetadata{Name:etcd,Attemp
t:0,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1702418617835782518,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-addons-361656,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d32cb5b6e84fc769121d58d6fc32c246,},Annotations:map[string]string{io.kubernetes.container.hash: b47b8a21,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e321afdf117e7d05e267871cf0f1a175739a242ca3e0b4ff06876917f8d35d44,PodSandboxId:1fbfb04e9bf39d63cc151d9498b201f81efcce516aeb4a200fa6f61237bc9ea1,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d
4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1702418617617557832,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-addons-361656,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6ee24e51ef69edeea560f95940655be4,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8a13315939f9f84a673ce03e6ee0001b426e72d67e06f33b3ea07a6b196f3292,PodSandboxId:5193fa5ec2c64d8b6a6f047eb72466cb3fce272b153bca331293d49f53784304,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e
7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1702418617042580820,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-addons-361656,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 95206490b18d61bd7c5803d7aafb2e07,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6e1a80dbf9b6a168ae47ecd32107e17d0fe6dbefcb1ca495a7f868935f3244fa,PodSandboxId:abe71fe755873f9471bb01f8c2b737b4dd8541887031d0ec4a58b5023274b491,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:7fe0e6f37d
b33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1702418617020007277,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-addons-361656,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: afc3200671f47f1ba478f0e65eded0e8,},Annotations:map[string]string{io.kubernetes.container.hash: 10631f5e,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=b0acaf4b-6fb4-4b61-9d4d-90d1f09f01ca name=/runtime.v1.RuntimeService/ListContainers
Dec 12 22:08:04 addons-361656 crio[715]: time="2023-12-12 22:08:04.836665319Z" level=debug msg="Request: &ListPodSandboxRequest{Filter:nil,}" file="go-grpc-middleware/chain.go:25" id=dcd2aff1-e484-44a2-8415-f703a9affa48 name=/runtime.v1.RuntimeService/ListPodSandbox
Dec 12 22:08:04 addons-361656 crio[715]: time="2023-12-12 22:08:04.837034456Z" level=debug msg="Response: &ListPodSandboxResponse{Items:[]*PodSandbox{&PodSandbox{Id:11126c04826ceb9a433b50f982be4a2bec9863a8a4dbd013c9f12c59566dac37,Metadata:&PodSandboxMetadata{Name:hello-world-app-5d77478584-99x22,Uid:c5d8c21c-f196-454c-b323-28842ec5c5b8,Namespace:default,Attempt:0,},State:SANDBOX_READY,CreatedAt:1702418874331594968,Labels:map[string]string{app: hello-world-app,io.kubernetes.container.name: POD,io.kubernetes.pod.name: hello-world-app-5d77478584-99x22,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: c5d8c21c-f196-454c-b323-28842ec5c5b8,pod-template-hash: 5d77478584,},Annotations:map[string]string{kubernetes.io/config.seen: 2023-12-12T22:07:53.992688886Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:867a762363d97bdf26df37b5ac3d199c4c665e3ed5b0133a332288d2a65f2f47,Metadata:&PodSandboxMetadata{Name:headlamp-777fd4b855-wvjmv,Uid:80a749a9-3e48-4683-a511-fa220661bdc4,Namespace
:headlamp,Attempt:0,},State:SANDBOX_READY,CreatedAt:1702418745574194325,Labels:map[string]string{app.kubernetes.io/instance: headlamp,app.kubernetes.io/name: headlamp,io.kubernetes.container.name: POD,io.kubernetes.pod.name: headlamp-777fd4b855-wvjmv,io.kubernetes.pod.namespace: headlamp,io.kubernetes.pod.uid: 80a749a9-3e48-4683-a511-fa220661bdc4,pod-template-hash: 777fd4b855,},Annotations:map[string]string{kubernetes.io/config.seen: 2023-12-12T22:05:45.222088326Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:8ffd8386b6c0454f2a8dab00e5eaf45381df3665006cf580653fc459671cd6f0,Metadata:&PodSandboxMetadata{Name:nginx,Uid:5b06d6d2-998c-4fa5-b223-3add010e8e2f,Namespace:default,Attempt:0,},State:SANDBOX_READY,CreatedAt:1702418732955212064,Labels:map[string]string{io.kubernetes.container.name: POD,io.kubernetes.pod.name: nginx,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 5b06d6d2-998c-4fa5-b223-3add010e8e2f,run: nginx,},Annotations:map[string]string{kubernetes.io/config.seen: 2023-
12-12T22:05:32.416157208Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:2ceb5cba92a483d2405e8bcaa9c9cf5afc393cb33a66d4c96a4f774df12c7a89,Metadata:&PodSandboxMetadata{Name:gcp-auth-d4c87556c-9qbm2,Uid:f980d6db-f2b0-40e8-a4ab-a8f9a8746c2c,Namespace:gcp-auth,Attempt:0,},State:SANDBOX_READY,CreatedAt:1702418713960736254,Labels:map[string]string{app: gcp-auth,io.kubernetes.container.name: POD,io.kubernetes.pod.name: gcp-auth-d4c87556c-9qbm2,io.kubernetes.pod.namespace: gcp-auth,io.kubernetes.pod.uid: f980d6db-f2b0-40e8-a4ab-a8f9a8746c2c,kubernetes.io/minikube-addons: gcp-auth,pod-template-hash: d4c87556c,},Annotations:map[string]string{kubernetes.io/config.seen: 2023-12-12T22:04:09.976301997Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:0b8951d0f3e2eb966afdcfe2369b0a68e390221505c24b90c1c0c773253c8ef6,Metadata:&PodSandboxMetadata{Name:ingress-nginx-controller-7c6974c4d8-b8x52,Uid:6e4a747a-0126-4ff4-9292-5071b16cb10d,Namespace:ingress-nginx,Attempt:0,},State:SANDBOX_NOTRE
ADY,CreatedAt:1702418710845577173,Labels:map[string]string{app.kubernetes.io/component: controller,app.kubernetes.io/instance: ingress-nginx,app.kubernetes.io/name: ingress-nginx,gcp-auth-skip-secret: true,io.kubernetes.container.name: POD,io.kubernetes.pod.name: ingress-nginx-controller-7c6974c4d8-b8x52,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: 6e4a747a-0126-4ff4-9292-5071b16cb10d,pod-template-hash: 7c6974c4d8,},Annotations:map[string]string{kubernetes.io/config.seen: 2023-12-12T22:04:06.595983604Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:579d1fdad5ef5b0f5931f6a423ea6114436db008de23d7aae5def900a5055953,Metadata:&PodSandboxMetadata{Name:ingress-nginx-admission-patch-9r5ds,Uid:533d35a4-b8a6-4273-8ca1-b4126c10ec65,Namespace:ingress-nginx,Attempt:0,},State:SANDBOX_NOTREADY,CreatedAt:1702418647067087314,Labels:map[string]string{app.kubernetes.io/component: admission-webhook,app.kubernetes.io/instance: ingress-nginx,app.kubernetes.io/name: ingress-nginx,batch.kube
rnetes.io/controller-uid: dded50ca-08f4-452e-af51-354de478f32e,batch.kubernetes.io/job-name: ingress-nginx-admission-patch,controller-uid: dded50ca-08f4-452e-af51-354de478f32e,io.kubernetes.container.name: POD,io.kubernetes.pod.name: ingress-nginx-admission-patch-9r5ds,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: 533d35a4-b8a6-4273-8ca1-b4126c10ec65,job-name: ingress-nginx-admission-patch,},Annotations:map[string]string{kubernetes.io/config.seen: 2023-12-12T22:04:06.635311438Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:ea58cc5be71f0621444b314e89d0e2adbc57e047ecc16409915b2c3e28fe422d,Metadata:&PodSandboxMetadata{Name:ingress-nginx-admission-create-pts6h,Uid:5f162bf0-b36e-4d15-bf62-0dbadd581cd8,Namespace:ingress-nginx,Attempt:0,},State:SANDBOX_NOTREADY,CreatedAt:1702418647058211978,Labels:map[string]string{app.kubernetes.io/component: admission-webhook,app.kubernetes.io/instance: ingress-nginx,app.kubernetes.io/name: ingress-nginx,batch.kubernetes.io/controller-uid:
de21aa5b-b872-4d83-b387-e43373418fe0,batch.kubernetes.io/job-name: ingress-nginx-admission-create,controller-uid: de21aa5b-b872-4d83-b387-e43373418fe0,io.kubernetes.container.name: POD,io.kubernetes.pod.name: ingress-nginx-admission-create-pts6h,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: 5f162bf0-b36e-4d15-bf62-0dbadd581cd8,job-name: ingress-nginx-admission-create,},Annotations:map[string]string{kubernetes.io/config.seen: 2023-12-12T22:04:06.624386819Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:fac761f91352a61431ccf85bcb6b64d7fe27631568accb2971a821fd80a08a8b,Metadata:&PodSandboxMetadata{Name:local-path-provisioner-78b46b4d5c-qccjq,Uid:9c22d109-bee3-43f0-af69-51c2db7ebc0b,Namespace:local-path-storage,Attempt:0,},State:SANDBOX_READY,CreatedAt:1702418645901974481,Labels:map[string]string{app: local-path-provisioner,io.kubernetes.container.name: POD,io.kubernetes.pod.name: local-path-provisioner-78b46b4d5c-qccjq,io.kubernetes.pod.namespace: local-path-storage,io.ku
bernetes.pod.uid: 9c22d109-bee3-43f0-af69-51c2db7ebc0b,pod-template-hash: 78b46b4d5c,},Annotations:map[string]string{kubernetes.io/config.seen: 2023-12-12T22:04:05.254485578Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:e0d58ff32db7cedbfc823cb05940833bc6692c8a98b08c77d69165ffc769df31,Metadata:&PodSandboxMetadata{Name:storage-provisioner,Uid:7fed1501-c613-4f8b-adb0-b94e9c7c30d8,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1702418645862780616,Labels:map[string]string{addonmanager.kubernetes.io/mode: Reconcile,integration-test: storage-provisioner,io.kubernetes.container.name: POD,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7fed1501-c613-4f8b-adb0-b94e9c7c30d8,},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {\"apiVersion\":\"v1\",\"kind\":\"Pod\",\"metadata\":{\"annotations\":{},\"labels\":{\"addonmanager.kubernetes.io/mode\":\"Reconcile\",\"integration-test\":\"storage-prov
isioner\"},\"name\":\"storage-provisioner\",\"namespace\":\"kube-system\"},\"spec\":{\"containers\":[{\"command\":[\"/storage-provisioner\"],\"image\":\"gcr.io/k8s-minikube/storage-provisioner:v5\",\"imagePullPolicy\":\"IfNotPresent\",\"name\":\"storage-provisioner\",\"volumeMounts\":[{\"mountPath\":\"/tmp\",\"name\":\"tmp\"}]}],\"hostNetwork\":true,\"serviceAccountName\":\"storage-provisioner\",\"volumes\":[{\"hostPath\":{\"path\":\"/tmp\",\"type\":\"Directory\"},\"name\":\"tmp\"}]}}\n,kubernetes.io/config.seen: 2023-12-12T22:04:05.222986432Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:11be7f20d7075bddce74ddc365e7b7a81552f303b9bf8c6e2d7ff300f911e174,Metadata:&PodSandboxMetadata{Name:kube-ingress-dns-minikube,Uid:0df541c9-11fb-444a-9fd1-cf852f2d1bd4,Namespace:kube-system,Attempt:0,},State:SANDBOX_NOTREADY,CreatedAt:1702418644931311949,Labels:map[string]string{app: minikube-ingress-dns,app.kubernetes.io/part-of: kube-system,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-
ingress-dns-minikube,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 0df541c9-11fb-444a-9fd1-cf852f2d1bd4,},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {\"apiVersion\":\"v1\",\"kind\":\"Pod\",\"metadata\":{\"annotations\":{},\"labels\":{\"app\":\"minikube-ingress-dns\",\"app.kubernetes.io/part-of\":\"kube-system\"},\"name\":\"kube-ingress-dns-minikube\",\"namespace\":\"kube-system\"},\"spec\":{\"containers\":[{\"env\":[{\"name\":\"DNS_PORT\",\"value\":\"53\"},{\"name\":\"POD_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.podIP\"}}}],\"image\":\"gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2@sha256:4abe27f9fc03fedab1d655e2020e6b165faf3bf6de1088ce6cf215a75b78f05f\",\"imagePullPolicy\":\"IfNotPresent\",\"name\":\"minikube-ingress-dns\",\"ports\":[{\"containerPort\":53,\"protocol\":\"UDP\"}]}],\"hostNetwork\":true,\"serviceAccountName\":\"minikube-ingress-dns\"}}\n,kubernetes.io/config.seen: 2023-12-12T22:04:03.963180840Z,kubernetes.io/config.source: a
pi,},RuntimeHandler:,},&PodSandbox{Id:00b8b393b274b3191069b82176fee3eea8f5fc9fc6cfb7895b7e8de0d9b908de,Metadata:&PodSandboxMetadata{Name:coredns-5dd5756b68-wwrgq,Uid:00c258da-10ba-4e62-9ae4-0ec482dc23ea,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1702418638755031470,Labels:map[string]string{io.kubernetes.container.name: POD,io.kubernetes.pod.name: coredns-5dd5756b68-wwrgq,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 00c258da-10ba-4e62-9ae4-0ec482dc23ea,k8s-app: kube-dns,pod-template-hash: 5dd5756b68,},Annotations:map[string]string{kubernetes.io/config.seen: 2023-12-12T22:03:58.117368143Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:ee2881903ffaa04fd4b2dbda90ca8ba7f4cadeb1b9402775cb059db257ea329f,Metadata:&PodSandboxMetadata{Name:kube-proxy-pjzv8,Uid:8e145d1c-391a-4995-9f1d-d133d382adc4,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1702418638194761630,Labels:map[string]string{controller-revision-hash: 8486c7d9cd,io.kubernetes.conta
iner.name: POD,io.kubernetes.pod.name: kube-proxy-pjzv8,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8e145d1c-391a-4995-9f1d-d133d382adc4,k8s-app: kube-proxy,pod-template-generation: 1,},Annotations:map[string]string{kubernetes.io/config.seen: 2023-12-12T22:03:57.263649524Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:abe71fe755873f9471bb01f8c2b737b4dd8541887031d0ec4a58b5023274b491,Metadata:&PodSandboxMetadata{Name:kube-apiserver-addons-361656,Uid:afc3200671f47f1ba478f0e65eded0e8,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1702418616597585864,Labels:map[string]string{component: kube-apiserver,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-apiserver-addons-361656,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: afc3200671f47f1ba478f0e65eded0e8,tier: control-plane,},Annotations:map[string]string{kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint: 192.168.39.86:8443,kubernetes.io/config.hash: afc3200671f47f1
ba478f0e65eded0e8,kubernetes.io/config.seen: 2023-12-12T22:03:36.030714813Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:1fbfb04e9bf39d63cc151d9498b201f81efcce516aeb4a200fa6f61237bc9ea1,Metadata:&PodSandboxMetadata{Name:kube-scheduler-addons-361656,Uid:6ee24e51ef69edeea560f95940655be4,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1702418616577194272,Labels:map[string]string{component: kube-scheduler,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-scheduler-addons-361656,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6ee24e51ef69edeea560f95940655be4,tier: control-plane,},Annotations:map[string]string{kubernetes.io/config.hash: 6ee24e51ef69edeea560f95940655be4,kubernetes.io/config.seen: 2023-12-12T22:03:36.030717488Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:65a204f35462c9e03b4bd71d04a14264802ff79a4fbef69308f49855e69221b0,Metadata:&PodSandboxMetadata{Name:etcd-addons-361656,Uid:d32cb5b6e84fc769121d58d6fc32c246,N
amespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1702418616564598104,Labels:map[string]string{component: etcd,io.kubernetes.container.name: POD,io.kubernetes.pod.name: etcd-addons-361656,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d32cb5b6e84fc769121d58d6fc32c246,tier: control-plane,},Annotations:map[string]string{kubeadm.kubernetes.io/etcd.advertise-client-urls: https://192.168.39.86:2379,kubernetes.io/config.hash: d32cb5b6e84fc769121d58d6fc32c246,kubernetes.io/config.seen: 2023-12-12T22:03:36.030711710Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:5193fa5ec2c64d8b6a6f047eb72466cb3fce272b153bca331293d49f53784304,Metadata:&PodSandboxMetadata{Name:kube-controller-manager-addons-361656,Uid:95206490b18d61bd7c5803d7aafb2e07,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1702418616554510084,Labels:map[string]string{component: kube-controller-manager,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-controller-manager-addons-361
656,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 95206490b18d61bd7c5803d7aafb2e07,tier: control-plane,},Annotations:map[string]string{kubernetes.io/config.hash: 95206490b18d61bd7c5803d7aafb2e07,kubernetes.io/config.seen: 2023-12-12T22:03:36.030716748Z,kubernetes.io/config.source: file,},RuntimeHandler:,},},}" file="go-grpc-middleware/chain.go:25" id=dcd2aff1-e484-44a2-8415-f703a9affa48 name=/runtime.v1.RuntimeService/ListPodSandbox
Dec 12 22:08:04 addons-361656 crio[715]: time="2023-12-12 22:08:04.838365114Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=7f8f6393-7309-4d21-96c1-f5755120321f name=/runtime.v1.RuntimeService/ListContainers
Dec 12 22:08:04 addons-361656 crio[715]: time="2023-12-12 22:08:04.838788340Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=7f8f6393-7309-4d21-96c1-f5755120321f name=/runtime.v1.RuntimeService/ListContainers
Dec 12 22:08:04 addons-361656 crio[715]: time="2023-12-12 22:08:04.839153125Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d8a3cb2b14e2fd79d7dafa0ab819a82caec3d58e3e85f9e47d7bdc4857b87615,PodSandboxId:11126c04826ceb9a433b50f982be4a2bec9863a8a4dbd013c9f12c59566dac37,Metadata:&ContainerMetadata{Name:hello-world-app,Attempt:0,},Image:&ImageSpec{Image:gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7,Annotations:map[string]string{},},ImageRef:gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7,State:CONTAINER_RUNNING,CreatedAt:1702418876330831043,Labels:map[string]string{io.kubernetes.container.name: hello-world-app,io.kubernetes.pod.name: hello-world-app-5d77478584-99x22,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: c5d8c21c-f196-454c-b323-28842ec5c5b8,},Annotations:map[string]string{io.kubernetes.container.hash: cddf2ed2,io.kubernetes.conta
iner.ports: [{\"containerPort\":8080,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:855635ac50884de1beb470732a2c911ff377aeebc88085191adef9594909a13f,PodSandboxId:867a762363d97bdf26df37b5ac3d199c4c665e3ed5b0133a332288d2a65f2f47,Metadata:&ContainerMetadata{Name:headlamp,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/headlamp-k8s/headlamp@sha256:6153bcbd375a0157858961b1138ed62321a2639b37826b37498bce16ee736cc1,Annotations:map[string]string{},},ImageRef:ghcr.io/headlamp-k8s/headlamp@sha256:6153bcbd375a0157858961b1138ed62321a2639b37826b37498bce16ee736cc1,State:CONTAINER_RUNNING,CreatedAt:1702418752080440373,Labels:map[string]string{io.kubernetes.container.name: headlamp,io.kubernetes.pod.name: headlamp-777fd4b855-wvjmv,io.kubernetes.pod.namespace: headlamp,io.kubernetes.pod.uid: 80a749a9-3e48-4683-a511-fa220661bdc4,},An
notations:map[string]string{io.kubernetes.container.hash: a2b7dcb6,io.kubernetes.container.ports: [{\"name\":\"http\",\"containerPort\":4466,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e1552202dfef028710685a2827769c363f3d6c8ba6341e48133e1d41d1dc2bbb,PodSandboxId:8ffd8386b6c0454f2a8dab00e5eaf45381df3665006cf580653fc459671cd6f0,Metadata:&ContainerMetadata{Name:nginx,Attempt:0,},Image:&ImageSpec{Image:docker.io/library/nginx@sha256:3923f8de8d2214b9490e68fd6ae63ea604deddd166df2755b788bef04848b9bc,Annotations:map[string]string{},},ImageRef:docker.io/library/nginx@sha256:3923f8de8d2214b9490e68fd6ae63ea604deddd166df2755b788bef04848b9bc,State:CONTAINER_RUNNING,CreatedAt:1702418736319930574,Labels:map[string]string{io.kubernetes.container.name: nginx,io.kubernetes.pod.name: nginx,io.kubernetes.pod.namespace: default
,io.kubernetes.pod.uid: 5b06d6d2-998c-4fa5-b223-3add010e8e2f,},Annotations:map[string]string{io.kubernetes.container.hash: d9152c3e,io.kubernetes.container.ports: [{\"containerPort\":80,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:91c228d72c6887e427e4b02bcdadbb57a5a4f6ba35695daa5ad74c544d1deb91,PodSandboxId:2ceb5cba92a483d2405e8bcaa9c9cf5afc393cb33a66d4c96a4f774df12c7a89,Metadata:&ContainerMetadata{Name:gcp-auth,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/gcp-auth-webhook@sha256:3e92b3d1c15220ae0f2f3505fb3a88899a1e48ec85fb777a1a4945ae9db2ce06,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/gcp-auth-webhook@sha256:3e92b3d1c15220ae0f2f3505fb3a88899a1e48ec85fb777a1a4945ae9db2ce06,State:CONTAINER_RUNNING,CreatedAt:1702418724628373953,Labels:map[string]string{io.kubernetes.container.name
: gcp-auth,io.kubernetes.pod.name: gcp-auth-d4c87556c-9qbm2,io.kubernetes.pod.namespace: gcp-auth,io.kubernetes.pod.uid: f980d6db-f2b0-40e8-a4ab-a8f9a8746c2c,},Annotations:map[string]string{io.kubernetes.container.hash: dc4ef1fc,io.kubernetes.container.ports: [{\"containerPort\":8443,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:01c626226dd367436ed15e97ef6fb405cacb39d7b199d71e75e414222202006c,PodSandboxId:579d1fdad5ef5b0f5931f6a423ea6114436db008de23d7aae5def900a5055953,Metadata:&ContainerMetadata{Name:patch,Attempt:2,},Image:&ImageSpec{Image:1ebff0f9671bc015dc340b12c5bf6f3dbda7d0a8b5332bd095f21bd52e1b30fb,Annotations:map[string]string{},},ImageRef:registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:29318c6957228dc10feb67fed5b91bdd8a9e3279e5b29c5965b9bd31a01ee385,State:CONTAINER_EXITED,CreatedAt:17024187
02791044868,Labels:map[string]string{io.kubernetes.container.name: patch,io.kubernetes.pod.name: ingress-nginx-admission-patch-9r5ds,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: 533d35a4-b8a6-4273-8ca1-b4126c10ec65,},Annotations:map[string]string{io.kubernetes.container.hash: 70ad9c71,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:041d4cac61ba979536ec65a3a6199ea430cc38676e6dedd99e5f625fe87e95dd,PodSandboxId:ea58cc5be71f0621444b314e89d0e2adbc57e047ecc16409915b2c3e28fe422d,Metadata:&ContainerMetadata{Name:create,Attempt:0,},Image:&ImageSpec{Image:registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:29318c6957228dc10feb67fed5b91bdd8a9e3279e5b29c5965b9bd31a01ee385,Annotations:map[string]string{},},ImageRef:registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:29318c6957228dc10feb67fed5b91bdd8a9e3279e5b29c59
65b9bd31a01ee385,State:CONTAINER_EXITED,CreatedAt:1702418688029925294,Labels:map[string]string{io.kubernetes.container.name: create,io.kubernetes.pod.name: ingress-nginx-admission-create-pts6h,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: 5f162bf0-b36e-4d15-bf62-0dbadd581cd8,},Annotations:map[string]string{io.kubernetes.container.hash: ce9bca44,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:aef04e95ad1fe933b031cad975c37a81891ea763c78a0635e4ed9e5a08545d83,PodSandboxId:fac761f91352a61431ccf85bcb6b64d7fe27631568accb2971a821fd80a08a8b,Metadata:&ContainerMetadata{Name:local-path-provisioner,Attempt:0,},Image:&ImageSpec{Image:docker.io/rancher/local-path-provisioner@sha256:73f712e7af12b06720c35ce75217f904f00e4bd96de79f8db1cf160112e667ef,Annotations:map[string]string{},},ImageRef:docker.io/rancher/local-path-provisioner
@sha256:73f712e7af12b06720c35ce75217f904f00e4bd96de79f8db1cf160112e667ef,State:CONTAINER_RUNNING,CreatedAt:1702418679799337899,Labels:map[string]string{io.kubernetes.container.name: local-path-provisioner,io.kubernetes.pod.name: local-path-provisioner-78b46b4d5c-qccjq,io.kubernetes.pod.namespace: local-path-storage,io.kubernetes.pod.uid: 9c22d109-bee3-43f0-af69-51c2db7ebc0b,},Annotations:map[string]string{io.kubernetes.container.hash: d139ac8f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:96fb98f8d7789efc274b1cf924697cb141142e383644b53888a17ba15c569025,PodSandboxId:e0d58ff32db7cedbfc823cb05940833bc6692c8a98b08c77d69165ffc769df31,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s
-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1702418659624390243,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7fed1501-c613-4f8b-adb0-b94e9c7c30d8,},Annotations:map[string]string{io.kubernetes.container.hash: c639785a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0d919eb6810b21cbb9196d13258c29f88172688f2a3fc47a26646d954fe44437,PodSandboxId:ee2881903ffaa04fd4b2dbda90ca8ba7f4cadeb1b9402775cb059db257ea329f,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube
-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1702418652795496165,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-pjzv8,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8e145d1c-391a-4995-9f1d-d133d382adc4,},Annotations:map[string]string{io.kubernetes.container.hash: e0d07811,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a20f0abe6fb84210558e8488bcd0c3d00bc1a70c4ee1a58c3509d87d431f7e88,PodSandboxId:00b8b393b274b3191069b82176fee3eea8f5fc9fc6cfb7895b7e8de0d9b908de,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044a
eb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1702418642317442308,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-wwrgq,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 00c258da-10ba-4e62-9ae4-0ec482dc23ea,},Annotations:map[string]string{io.kubernetes.container.hash: d3b7a77a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:53bacbebf69a069a9e72b6111c84f56ce650ba89aeb0470ce89711fc7f26274e,PodSandboxId:65a204f35462c9e03b4bd71d04a14264802ff79a4fbef69308f49855e69221b0,Metadata:&ContainerMetadata{Name:etcd,Attemp
t:0,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1702418617835782518,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-addons-361656,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d32cb5b6e84fc769121d58d6fc32c246,},Annotations:map[string]string{io.kubernetes.container.hash: b47b8a21,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e321afdf117e7d05e267871cf0f1a175739a242ca3e0b4ff06876917f8d35d44,PodSandboxId:1fbfb04e9bf39d63cc151d9498b201f81efcce516aeb4a200fa6f61237bc9ea1,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d
4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1702418617617557832,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-addons-361656,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6ee24e51ef69edeea560f95940655be4,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8a13315939f9f84a673ce03e6ee0001b426e72d67e06f33b3ea07a6b196f3292,PodSandboxId:5193fa5ec2c64d8b6a6f047eb72466cb3fce272b153bca331293d49f53784304,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e
7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1702418617042580820,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-addons-361656,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 95206490b18d61bd7c5803d7aafb2e07,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6e1a80dbf9b6a168ae47ecd32107e17d0fe6dbefcb1ca495a7f868935f3244fa,PodSandboxId:abe71fe755873f9471bb01f8c2b737b4dd8541887031d0ec4a58b5023274b491,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:7fe0e6f37d
b33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1702418617020007277,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-addons-361656,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: afc3200671f47f1ba478f0e65eded0e8,},Annotations:map[string]string{io.kubernetes.container.hash: 10631f5e,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=7f8f6393-7309-4d21-96c1-f5755120321f name=/runtime.v1.RuntimeService/ListContainers
Dec 12 22:08:04 addons-361656 crio[715]: time="2023-12-12 22:08:04.876186731Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=673c65ad-2425-46e4-b742-137a5edbaf93 name=/runtime.v1.RuntimeService/Version
Dec 12 22:08:04 addons-361656 crio[715]: time="2023-12-12 22:08:04.876305303Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=673c65ad-2425-46e4-b742-137a5edbaf93 name=/runtime.v1.RuntimeService/Version
Dec 12 22:08:04 addons-361656 crio[715]: time="2023-12-12 22:08:04.878089559Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=3fee053a-9bab-4856-84a5-cf5ceb731abc name=/runtime.v1.ImageService/ImageFsInfo
Dec 12 22:08:04 addons-361656 crio[715]: time="2023-12-12 22:08:04.879487952Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1702418884879469175,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:543773,},InodesUsed:&UInt64Value{Value:227,},},},}" file="go-grpc-middleware/chain.go:25" id=3fee053a-9bab-4856-84a5-cf5ceb731abc name=/runtime.v1.ImageService/ImageFsInfo
Dec 12 22:08:04 addons-361656 crio[715]: time="2023-12-12 22:08:04.880105649Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=1d382a65-cb2d-4d64-8bd0-bd278cd993ef name=/runtime.v1.RuntimeService/ListContainers
Dec 12 22:08:04 addons-361656 crio[715]: time="2023-12-12 22:08:04.880164617Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=1d382a65-cb2d-4d64-8bd0-bd278cd993ef name=/runtime.v1.RuntimeService/ListContainers
Dec 12 22:08:04 addons-361656 crio[715]: time="2023-12-12 22:08:04.880569984Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d8a3cb2b14e2fd79d7dafa0ab819a82caec3d58e3e85f9e47d7bdc4857b87615,PodSandboxId:11126c04826ceb9a433b50f982be4a2bec9863a8a4dbd013c9f12c59566dac37,Metadata:&ContainerMetadata{Name:hello-world-app,Attempt:0,},Image:&ImageSpec{Image:gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7,Annotations:map[string]string{},},ImageRef:gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7,State:CONTAINER_RUNNING,CreatedAt:1702418876330831043,Labels:map[string]string{io.kubernetes.container.name: hello-world-app,io.kubernetes.pod.name: hello-world-app-5d77478584-99x22,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: c5d8c21c-f196-454c-b323-28842ec5c5b8,},Annotations:map[string]string{io.kubernetes.container.hash: cddf2ed2,io.kubernetes.conta
iner.ports: [{\"containerPort\":8080,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:855635ac50884de1beb470732a2c911ff377aeebc88085191adef9594909a13f,PodSandboxId:867a762363d97bdf26df37b5ac3d199c4c665e3ed5b0133a332288d2a65f2f47,Metadata:&ContainerMetadata{Name:headlamp,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/headlamp-k8s/headlamp@sha256:6153bcbd375a0157858961b1138ed62321a2639b37826b37498bce16ee736cc1,Annotations:map[string]string{},},ImageRef:ghcr.io/headlamp-k8s/headlamp@sha256:6153bcbd375a0157858961b1138ed62321a2639b37826b37498bce16ee736cc1,State:CONTAINER_RUNNING,CreatedAt:1702418752080440373,Labels:map[string]string{io.kubernetes.container.name: headlamp,io.kubernetes.pod.name: headlamp-777fd4b855-wvjmv,io.kubernetes.pod.namespace: headlamp,io.kubernetes.pod.uid: 80a749a9-3e48-4683-a511-fa220661bdc4,},An
notations:map[string]string{io.kubernetes.container.hash: a2b7dcb6,io.kubernetes.container.ports: [{\"name\":\"http\",\"containerPort\":4466,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e1552202dfef028710685a2827769c363f3d6c8ba6341e48133e1d41d1dc2bbb,PodSandboxId:8ffd8386b6c0454f2a8dab00e5eaf45381df3665006cf580653fc459671cd6f0,Metadata:&ContainerMetadata{Name:nginx,Attempt:0,},Image:&ImageSpec{Image:docker.io/library/nginx@sha256:3923f8de8d2214b9490e68fd6ae63ea604deddd166df2755b788bef04848b9bc,Annotations:map[string]string{},},ImageRef:docker.io/library/nginx@sha256:3923f8de8d2214b9490e68fd6ae63ea604deddd166df2755b788bef04848b9bc,State:CONTAINER_RUNNING,CreatedAt:1702418736319930574,Labels:map[string]string{io.kubernetes.container.name: nginx,io.kubernetes.pod.name: nginx,io.kubernetes.pod.namespace: default
,io.kubernetes.pod.uid: 5b06d6d2-998c-4fa5-b223-3add010e8e2f,},Annotations:map[string]string{io.kubernetes.container.hash: d9152c3e,io.kubernetes.container.ports: [{\"containerPort\":80,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:91c228d72c6887e427e4b02bcdadbb57a5a4f6ba35695daa5ad74c544d1deb91,PodSandboxId:2ceb5cba92a483d2405e8bcaa9c9cf5afc393cb33a66d4c96a4f774df12c7a89,Metadata:&ContainerMetadata{Name:gcp-auth,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/gcp-auth-webhook@sha256:3e92b3d1c15220ae0f2f3505fb3a88899a1e48ec85fb777a1a4945ae9db2ce06,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/gcp-auth-webhook@sha256:3e92b3d1c15220ae0f2f3505fb3a88899a1e48ec85fb777a1a4945ae9db2ce06,State:CONTAINER_RUNNING,CreatedAt:1702418724628373953,Labels:map[string]string{io.kubernetes.container.name
: gcp-auth,io.kubernetes.pod.name: gcp-auth-d4c87556c-9qbm2,io.kubernetes.pod.namespace: gcp-auth,io.kubernetes.pod.uid: f980d6db-f2b0-40e8-a4ab-a8f9a8746c2c,},Annotations:map[string]string{io.kubernetes.container.hash: dc4ef1fc,io.kubernetes.container.ports: [{\"containerPort\":8443,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:01c626226dd367436ed15e97ef6fb405cacb39d7b199d71e75e414222202006c,PodSandboxId:579d1fdad5ef5b0f5931f6a423ea6114436db008de23d7aae5def900a5055953,Metadata:&ContainerMetadata{Name:patch,Attempt:2,},Image:&ImageSpec{Image:1ebff0f9671bc015dc340b12c5bf6f3dbda7d0a8b5332bd095f21bd52e1b30fb,Annotations:map[string]string{},},ImageRef:registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:29318c6957228dc10feb67fed5b91bdd8a9e3279e5b29c5965b9bd31a01ee385,State:CONTAINER_EXITED,CreatedAt:17024187
02791044868,Labels:map[string]string{io.kubernetes.container.name: patch,io.kubernetes.pod.name: ingress-nginx-admission-patch-9r5ds,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: 533d35a4-b8a6-4273-8ca1-b4126c10ec65,},Annotations:map[string]string{io.kubernetes.container.hash: 70ad9c71,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:041d4cac61ba979536ec65a3a6199ea430cc38676e6dedd99e5f625fe87e95dd,PodSandboxId:ea58cc5be71f0621444b314e89d0e2adbc57e047ecc16409915b2c3e28fe422d,Metadata:&ContainerMetadata{Name:create,Attempt:0,},Image:&ImageSpec{Image:registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:29318c6957228dc10feb67fed5b91bdd8a9e3279e5b29c5965b9bd31a01ee385,Annotations:map[string]string{},},ImageRef:registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:29318c6957228dc10feb67fed5b91bdd8a9e3279e5b29c59
65b9bd31a01ee385,State:CONTAINER_EXITED,CreatedAt:1702418688029925294,Labels:map[string]string{io.kubernetes.container.name: create,io.kubernetes.pod.name: ingress-nginx-admission-create-pts6h,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: 5f162bf0-b36e-4d15-bf62-0dbadd581cd8,},Annotations:map[string]string{io.kubernetes.container.hash: ce9bca44,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:aef04e95ad1fe933b031cad975c37a81891ea763c78a0635e4ed9e5a08545d83,PodSandboxId:fac761f91352a61431ccf85bcb6b64d7fe27631568accb2971a821fd80a08a8b,Metadata:&ContainerMetadata{Name:local-path-provisioner,Attempt:0,},Image:&ImageSpec{Image:docker.io/rancher/local-path-provisioner@sha256:73f712e7af12b06720c35ce75217f904f00e4bd96de79f8db1cf160112e667ef,Annotations:map[string]string{},},ImageRef:docker.io/rancher/local-path-provisioner
@sha256:73f712e7af12b06720c35ce75217f904f00e4bd96de79f8db1cf160112e667ef,State:CONTAINER_RUNNING,CreatedAt:1702418679799337899,Labels:map[string]string{io.kubernetes.container.name: local-path-provisioner,io.kubernetes.pod.name: local-path-provisioner-78b46b4d5c-qccjq,io.kubernetes.pod.namespace: local-path-storage,io.kubernetes.pod.uid: 9c22d109-bee3-43f0-af69-51c2db7ebc0b,},Annotations:map[string]string{io.kubernetes.container.hash: d139ac8f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:96fb98f8d7789efc274b1cf924697cb141142e383644b53888a17ba15c569025,PodSandboxId:e0d58ff32db7cedbfc823cb05940833bc6692c8a98b08c77d69165ffc769df31,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s
-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1702418659624390243,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7fed1501-c613-4f8b-adb0-b94e9c7c30d8,},Annotations:map[string]string{io.kubernetes.container.hash: c639785a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0d919eb6810b21cbb9196d13258c29f88172688f2a3fc47a26646d954fe44437,PodSandboxId:ee2881903ffaa04fd4b2dbda90ca8ba7f4cadeb1b9402775cb059db257ea329f,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube
-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1702418652795496165,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-pjzv8,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8e145d1c-391a-4995-9f1d-d133d382adc4,},Annotations:map[string]string{io.kubernetes.container.hash: e0d07811,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a20f0abe6fb84210558e8488bcd0c3d00bc1a70c4ee1a58c3509d87d431f7e88,PodSandboxId:00b8b393b274b3191069b82176fee3eea8f5fc9fc6cfb7895b7e8de0d9b908de,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044a
eb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1702418642317442308,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-wwrgq,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 00c258da-10ba-4e62-9ae4-0ec482dc23ea,},Annotations:map[string]string{io.kubernetes.container.hash: d3b7a77a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:53bacbebf69a069a9e72b6111c84f56ce650ba89aeb0470ce89711fc7f26274e,PodSandboxId:65a204f35462c9e03b4bd71d04a14264802ff79a4fbef69308f49855e69221b0,Metadata:&ContainerMetadata{Name:etcd,Attemp
t:0,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1702418617835782518,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-addons-361656,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d32cb5b6e84fc769121d58d6fc32c246,},Annotations:map[string]string{io.kubernetes.container.hash: b47b8a21,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e321afdf117e7d05e267871cf0f1a175739a242ca3e0b4ff06876917f8d35d44,PodSandboxId:1fbfb04e9bf39d63cc151d9498b201f81efcce516aeb4a200fa6f61237bc9ea1,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d
4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1702418617617557832,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-addons-361656,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6ee24e51ef69edeea560f95940655be4,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8a13315939f9f84a673ce03e6ee0001b426e72d67e06f33b3ea07a6b196f3292,PodSandboxId:5193fa5ec2c64d8b6a6f047eb72466cb3fce272b153bca331293d49f53784304,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e
7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1702418617042580820,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-addons-361656,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 95206490b18d61bd7c5803d7aafb2e07,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6e1a80dbf9b6a168ae47ecd32107e17d0fe6dbefcb1ca495a7f868935f3244fa,PodSandboxId:abe71fe755873f9471bb01f8c2b737b4dd8541887031d0ec4a58b5023274b491,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:7fe0e6f37d
b33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1702418617020007277,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-addons-361656,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: afc3200671f47f1ba478f0e65eded0e8,},Annotations:map[string]string{io.kubernetes.container.hash: 10631f5e,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=1d382a65-cb2d-4d64-8bd0-bd278cd993ef name=/runtime.v1.RuntimeService/ListContainers
Dec 12 22:08:04 addons-361656 crio[715]: time="2023-12-12 22:08:04.928052151Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=939e2c62-fd72-46b7-b78f-fed22e265c20 name=/runtime.v1.RuntimeService/Version
Dec 12 22:08:04 addons-361656 crio[715]: time="2023-12-12 22:08:04.928120131Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=939e2c62-fd72-46b7-b78f-fed22e265c20 name=/runtime.v1.RuntimeService/Version
Dec 12 22:08:04 addons-361656 crio[715]: time="2023-12-12 22:08:04.929985937Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=8221a9e2-9f74-4c29-8576-34accd698e79 name=/runtime.v1.ImageService/ImageFsInfo
Dec 12 22:08:04 addons-361656 crio[715]: time="2023-12-12 22:08:04.931223859Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1702418884931202951,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:543773,},InodesUsed:&UInt64Value{Value:227,},},},}" file="go-grpc-middleware/chain.go:25" id=8221a9e2-9f74-4c29-8576-34accd698e79 name=/runtime.v1.ImageService/ImageFsInfo
Dec 12 22:08:04 addons-361656 crio[715]: time="2023-12-12 22:08:04.931977487Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=fe95486f-b71a-4535-a552-48e1dca55bea name=/runtime.v1.RuntimeService/ListContainers
Dec 12 22:08:04 addons-361656 crio[715]: time="2023-12-12 22:08:04.932033172Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=fe95486f-b71a-4535-a552-48e1dca55bea name=/runtime.v1.RuntimeService/ListContainers
Dec 12 22:08:04 addons-361656 crio[715]: time="2023-12-12 22:08:04.932425368Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d8a3cb2b14e2fd79d7dafa0ab819a82caec3d58e3e85f9e47d7bdc4857b87615,PodSandboxId:11126c04826ceb9a433b50f982be4a2bec9863a8a4dbd013c9f12c59566dac37,Metadata:&ContainerMetadata{Name:hello-world-app,Attempt:0,},Image:&ImageSpec{Image:gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7,Annotations:map[string]string{},},ImageRef:gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7,State:CONTAINER_RUNNING,CreatedAt:1702418876330831043,Labels:map[string]string{io.kubernetes.container.name: hello-world-app,io.kubernetes.pod.name: hello-world-app-5d77478584-99x22,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: c5d8c21c-f196-454c-b323-28842ec5c5b8,},Annotations:map[string]string{io.kubernetes.container.hash: cddf2ed2,io.kubernetes.conta
iner.ports: [{\"containerPort\":8080,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:855635ac50884de1beb470732a2c911ff377aeebc88085191adef9594909a13f,PodSandboxId:867a762363d97bdf26df37b5ac3d199c4c665e3ed5b0133a332288d2a65f2f47,Metadata:&ContainerMetadata{Name:headlamp,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/headlamp-k8s/headlamp@sha256:6153bcbd375a0157858961b1138ed62321a2639b37826b37498bce16ee736cc1,Annotations:map[string]string{},},ImageRef:ghcr.io/headlamp-k8s/headlamp@sha256:6153bcbd375a0157858961b1138ed62321a2639b37826b37498bce16ee736cc1,State:CONTAINER_RUNNING,CreatedAt:1702418752080440373,Labels:map[string]string{io.kubernetes.container.name: headlamp,io.kubernetes.pod.name: headlamp-777fd4b855-wvjmv,io.kubernetes.pod.namespace: headlamp,io.kubernetes.pod.uid: 80a749a9-3e48-4683-a511-fa220661bdc4,},An
notations:map[string]string{io.kubernetes.container.hash: a2b7dcb6,io.kubernetes.container.ports: [{\"name\":\"http\",\"containerPort\":4466,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e1552202dfef028710685a2827769c363f3d6c8ba6341e48133e1d41d1dc2bbb,PodSandboxId:8ffd8386b6c0454f2a8dab00e5eaf45381df3665006cf580653fc459671cd6f0,Metadata:&ContainerMetadata{Name:nginx,Attempt:0,},Image:&ImageSpec{Image:docker.io/library/nginx@sha256:3923f8de8d2214b9490e68fd6ae63ea604deddd166df2755b788bef04848b9bc,Annotations:map[string]string{},},ImageRef:docker.io/library/nginx@sha256:3923f8de8d2214b9490e68fd6ae63ea604deddd166df2755b788bef04848b9bc,State:CONTAINER_RUNNING,CreatedAt:1702418736319930574,Labels:map[string]string{io.kubernetes.container.name: nginx,io.kubernetes.pod.name: nginx,io.kubernetes.pod.namespace: default
,io.kubernetes.pod.uid: 5b06d6d2-998c-4fa5-b223-3add010e8e2f,},Annotations:map[string]string{io.kubernetes.container.hash: d9152c3e,io.kubernetes.container.ports: [{\"containerPort\":80,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:91c228d72c6887e427e4b02bcdadbb57a5a4f6ba35695daa5ad74c544d1deb91,PodSandboxId:2ceb5cba92a483d2405e8bcaa9c9cf5afc393cb33a66d4c96a4f774df12c7a89,Metadata:&ContainerMetadata{Name:gcp-auth,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/gcp-auth-webhook@sha256:3e92b3d1c15220ae0f2f3505fb3a88899a1e48ec85fb777a1a4945ae9db2ce06,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/gcp-auth-webhook@sha256:3e92b3d1c15220ae0f2f3505fb3a88899a1e48ec85fb777a1a4945ae9db2ce06,State:CONTAINER_RUNNING,CreatedAt:1702418724628373953,Labels:map[string]string{io.kubernetes.container.name
: gcp-auth,io.kubernetes.pod.name: gcp-auth-d4c87556c-9qbm2,io.kubernetes.pod.namespace: gcp-auth,io.kubernetes.pod.uid: f980d6db-f2b0-40e8-a4ab-a8f9a8746c2c,},Annotations:map[string]string{io.kubernetes.container.hash: dc4ef1fc,io.kubernetes.container.ports: [{\"containerPort\":8443,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:01c626226dd367436ed15e97ef6fb405cacb39d7b199d71e75e414222202006c,PodSandboxId:579d1fdad5ef5b0f5931f6a423ea6114436db008de23d7aae5def900a5055953,Metadata:&ContainerMetadata{Name:patch,Attempt:2,},Image:&ImageSpec{Image:1ebff0f9671bc015dc340b12c5bf6f3dbda7d0a8b5332bd095f21bd52e1b30fb,Annotations:map[string]string{},},ImageRef:registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:29318c6957228dc10feb67fed5b91bdd8a9e3279e5b29c5965b9bd31a01ee385,State:CONTAINER_EXITED,CreatedAt:17024187
02791044868,Labels:map[string]string{io.kubernetes.container.name: patch,io.kubernetes.pod.name: ingress-nginx-admission-patch-9r5ds,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: 533d35a4-b8a6-4273-8ca1-b4126c10ec65,},Annotations:map[string]string{io.kubernetes.container.hash: 70ad9c71,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:041d4cac61ba979536ec65a3a6199ea430cc38676e6dedd99e5f625fe87e95dd,PodSandboxId:ea58cc5be71f0621444b314e89d0e2adbc57e047ecc16409915b2c3e28fe422d,Metadata:&ContainerMetadata{Name:create,Attempt:0,},Image:&ImageSpec{Image:registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:29318c6957228dc10feb67fed5b91bdd8a9e3279e5b29c5965b9bd31a01ee385,Annotations:map[string]string{},},ImageRef:registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:29318c6957228dc10feb67fed5b91bdd8a9e3279e5b29c59
65b9bd31a01ee385,State:CONTAINER_EXITED,CreatedAt:1702418688029925294,Labels:map[string]string{io.kubernetes.container.name: create,io.kubernetes.pod.name: ingress-nginx-admission-create-pts6h,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: 5f162bf0-b36e-4d15-bf62-0dbadd581cd8,},Annotations:map[string]string{io.kubernetes.container.hash: ce9bca44,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:aef04e95ad1fe933b031cad975c37a81891ea763c78a0635e4ed9e5a08545d83,PodSandboxId:fac761f91352a61431ccf85bcb6b64d7fe27631568accb2971a821fd80a08a8b,Metadata:&ContainerMetadata{Name:local-path-provisioner,Attempt:0,},Image:&ImageSpec{Image:docker.io/rancher/local-path-provisioner@sha256:73f712e7af12b06720c35ce75217f904f00e4bd96de79f8db1cf160112e667ef,Annotations:map[string]string{},},ImageRef:docker.io/rancher/local-path-provisioner
@sha256:73f712e7af12b06720c35ce75217f904f00e4bd96de79f8db1cf160112e667ef,State:CONTAINER_RUNNING,CreatedAt:1702418679799337899,Labels:map[string]string{io.kubernetes.container.name: local-path-provisioner,io.kubernetes.pod.name: local-path-provisioner-78b46b4d5c-qccjq,io.kubernetes.pod.namespace: local-path-storage,io.kubernetes.pod.uid: 9c22d109-bee3-43f0-af69-51c2db7ebc0b,},Annotations:map[string]string{io.kubernetes.container.hash: d139ac8f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:96fb98f8d7789efc274b1cf924697cb141142e383644b53888a17ba15c569025,PodSandboxId:e0d58ff32db7cedbfc823cb05940833bc6692c8a98b08c77d69165ffc769df31,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s
-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1702418659624390243,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7fed1501-c613-4f8b-adb0-b94e9c7c30d8,},Annotations:map[string]string{io.kubernetes.container.hash: c639785a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0d919eb6810b21cbb9196d13258c29f88172688f2a3fc47a26646d954fe44437,PodSandboxId:ee2881903ffaa04fd4b2dbda90ca8ba7f4cadeb1b9402775cb059db257ea329f,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube
-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1702418652795496165,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-pjzv8,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8e145d1c-391a-4995-9f1d-d133d382adc4,},Annotations:map[string]string{io.kubernetes.container.hash: e0d07811,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a20f0abe6fb84210558e8488bcd0c3d00bc1a70c4ee1a58c3509d87d431f7e88,PodSandboxId:00b8b393b274b3191069b82176fee3eea8f5fc9fc6cfb7895b7e8de0d9b908de,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044a
eb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1702418642317442308,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-wwrgq,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 00c258da-10ba-4e62-9ae4-0ec482dc23ea,},Annotations:map[string]string{io.kubernetes.container.hash: d3b7a77a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:53bacbebf69a069a9e72b6111c84f56ce650ba89aeb0470ce89711fc7f26274e,PodSandboxId:65a204f35462c9e03b4bd71d04a14264802ff79a4fbef69308f49855e69221b0,Metadata:&ContainerMetadata{Name:etcd,Attemp
t:0,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1702418617835782518,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-addons-361656,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d32cb5b6e84fc769121d58d6fc32c246,},Annotations:map[string]string{io.kubernetes.container.hash: b47b8a21,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e321afdf117e7d05e267871cf0f1a175739a242ca3e0b4ff06876917f8d35d44,PodSandboxId:1fbfb04e9bf39d63cc151d9498b201f81efcce516aeb4a200fa6f61237bc9ea1,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d
4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1702418617617557832,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-addons-361656,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6ee24e51ef69edeea560f95940655be4,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8a13315939f9f84a673ce03e6ee0001b426e72d67e06f33b3ea07a6b196f3292,PodSandboxId:5193fa5ec2c64d8b6a6f047eb72466cb3fce272b153bca331293d49f53784304,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e
7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1702418617042580820,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-addons-361656,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 95206490b18d61bd7c5803d7aafb2e07,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6e1a80dbf9b6a168ae47ecd32107e17d0fe6dbefcb1ca495a7f868935f3244fa,PodSandboxId:abe71fe755873f9471bb01f8c2b737b4dd8541887031d0ec4a58b5023274b491,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:7fe0e6f37d
b33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1702418617020007277,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-addons-361656,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: afc3200671f47f1ba478f0e65eded0e8,},Annotations:map[string]string{io.kubernetes.container.hash: 10631f5e,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=fe95486f-b71a-4535-a552-48e1dca55bea name=/runtime.v1.RuntimeService/ListContainers
*
* ==> container status <==
* CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
d8a3cb2b14e2f gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7 8 seconds ago Running hello-world-app 0 11126c04826ce hello-world-app-5d77478584-99x22
855635ac50884 ghcr.io/headlamp-k8s/headlamp@sha256:6153bcbd375a0157858961b1138ed62321a2639b37826b37498bce16ee736cc1 2 minutes ago Running headlamp 0 867a762363d97 headlamp-777fd4b855-wvjmv
e1552202dfef0 docker.io/library/nginx@sha256:3923f8de8d2214b9490e68fd6ae63ea604deddd166df2755b788bef04848b9bc 2 minutes ago Running nginx 0 8ffd8386b6c04 nginx
91c228d72c688 gcr.io/k8s-minikube/gcp-auth-webhook@sha256:3e92b3d1c15220ae0f2f3505fb3a88899a1e48ec85fb777a1a4945ae9db2ce06 2 minutes ago Running gcp-auth 0 2ceb5cba92a48 gcp-auth-d4c87556c-9qbm2
01c626226dd36 1ebff0f9671bc015dc340b12c5bf6f3dbda7d0a8b5332bd095f21bd52e1b30fb 3 minutes ago Exited patch 2 579d1fdad5ef5 ingress-nginx-admission-patch-9r5ds
041d4cac61ba9 registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:29318c6957228dc10feb67fed5b91bdd8a9e3279e5b29c5965b9bd31a01ee385 3 minutes ago Exited create 0 ea58cc5be71f0 ingress-nginx-admission-create-pts6h
aef04e95ad1fe docker.io/rancher/local-path-provisioner@sha256:73f712e7af12b06720c35ce75217f904f00e4bd96de79f8db1cf160112e667ef 3 minutes ago Running local-path-provisioner 0 fac761f91352a local-path-provisioner-78b46b4d5c-qccjq
96fb98f8d7789 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 3 minutes ago Running storage-provisioner 0 e0d58ff32db7c storage-provisioner
0d919eb6810b2 83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e 3 minutes ago Running kube-proxy 0 ee2881903ffaa kube-proxy-pjzv8
a20f0abe6fb84 ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 4 minutes ago Running coredns 0 00b8b393b274b coredns-5dd5756b68-wwrgq
53bacbebf69a0 73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9 4 minutes ago Running etcd 0 65a204f35462c etcd-addons-361656
e321afdf117e7 e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1 4 minutes ago Running kube-scheduler 0 1fbfb04e9bf39 kube-scheduler-addons-361656
8a13315939f9f d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591 4 minutes ago Running kube-controller-manager 0 5193fa5ec2c64 kube-controller-manager-addons-361656
6e1a80dbf9b6a 7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257 4 minutes ago Running kube-apiserver 0 abe71fe755873 kube-apiserver-addons-361656
*
* ==> coredns [a20f0abe6fb84210558e8488bcd0c3d00bc1a70c4ee1a58c3509d87d431f7e88] <==
* [INFO] 10.244.0.8:56570 - 272 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000131815s
[INFO] 10.244.0.8:57194 - 4023 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000073234s
[INFO] 10.244.0.8:57194 - 60853 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000099627s
[INFO] 10.244.0.8:52834 - 44886 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000058108s
[INFO] 10.244.0.8:52834 - 31317 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000100993s
[INFO] 10.244.0.8:46507 - 62039 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.00006889s
[INFO] 10.244.0.8:46507 - 30548 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000106004s
[INFO] 10.244.0.8:53444 - 37594 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.00016213s
[INFO] 10.244.0.8:53444 - 61150 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000074528s
[INFO] 10.244.0.8:40026 - 38970 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000110441s
[INFO] 10.244.0.8:40026 - 55356 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000108454s
[INFO] 10.244.0.8:47959 - 25113 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000112081s
[INFO] 10.244.0.8:47959 - 26911 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000129185s
[INFO] 10.244.0.8:55228 - 37550 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.00008047s
[INFO] 10.244.0.8:55228 - 3759 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000093696s
[INFO] 10.244.0.21:36387 - 50100 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000659174s
[INFO] 10.244.0.21:57515 - 60196 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000411159s
[INFO] 10.244.0.21:55002 - 14582 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.00016397s
[INFO] 10.244.0.21:37650 - 24884 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000105272s
[INFO] 10.244.0.21:60081 - 59318 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000145153s
[INFO] 10.244.0.21:56608 - 23169 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000061474s
[INFO] 10.244.0.21:33512 - 36488 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.000799017s
[INFO] 10.244.0.21:46273 - 13739 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 382 0.000494279s
[INFO] 10.244.0.24:50119 - 2 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000333661s
[INFO] 10.244.0.24:36432 - 3 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000149901s
*
* ==> describe nodes <==
* Name: addons-361656
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=addons-361656
kubernetes.io/os=linux
minikube.k8s.io/commit=7b3e481dbceb877ce85ff888adf9de756f54684f
minikube.k8s.io/name=addons-361656
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2023_12_12T22_03_44_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-361656
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Tue, 12 Dec 2023 22:03:41 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-361656
AcquireTime: <unset>
RenewTime: Tue, 12 Dec 2023 22:07:59 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Tue, 12 Dec 2023 22:06:49 +0000 Tue, 12 Dec 2023 22:03:39 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Tue, 12 Dec 2023 22:06:49 +0000 Tue, 12 Dec 2023 22:03:39 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Tue, 12 Dec 2023 22:06:49 +0000 Tue, 12 Dec 2023 22:03:39 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Tue, 12 Dec 2023 22:06:49 +0000 Tue, 12 Dec 2023 22:03:44 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.86
Hostname: addons-361656
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 3914496Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 3914496Ki
pods: 110
System Info:
Machine ID: 4fb13094a34742a49f4a05303ab76d4b
System UUID: 4fb13094-a347-42a4-9f4a-05303ab76d4b
Boot ID: 586aec9a-7669-45f5-9ea9-92113e5b0f97
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default hello-world-app-5d77478584-99x22 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 12s
default nginx 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 2m33s
gcp-auth gcp-auth-d4c87556c-9qbm2 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 3m56s
headlamp headlamp-777fd4b855-wvjmv 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 2m20s
kube-system coredns-5dd5756b68-wwrgq 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (1%!)(MISSING) 170Mi (4%!)(MISSING) 4m8s
kube-system etcd-addons-361656 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (2%!)(MISSING) 0 (0%!)(MISSING) 4m23s
kube-system kube-apiserver-addons-361656 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m21s
kube-system kube-controller-manager-addons-361656 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m21s
kube-system kube-proxy-pjzv8 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m8s
kube-system kube-scheduler-addons-361656 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m21s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m
local-path-storage local-path-provisioner-78b46b4d5c-qccjq 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 750m (37%!)(MISSING) 0 (0%!)(MISSING)
memory 170Mi (4%!)(MISSING) 170Mi (4%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 3m48s kube-proxy
Normal Starting 4m29s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 4m29s (x8 over 4m29s) kubelet Node addons-361656 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 4m29s (x8 over 4m29s) kubelet Node addons-361656 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 4m29s (x7 over 4m29s) kubelet Node addons-361656 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 4m29s kubelet Updated Node Allocatable limit across pods
Normal Starting 4m21s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 4m21s kubelet Node addons-361656 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 4m21s kubelet Node addons-361656 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 4m21s kubelet Node addons-361656 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 4m21s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 4m21s kubelet Node addons-361656 status is now: NodeReady
Normal RegisteredNode 4m9s node-controller Node addons-361656 event: Registered Node addons-361656 in Controller
*
* ==> dmesg <==
* [ +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[ +5.059867] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000008] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)
[ +6.783760] systemd-fstab-generator[642]: Ignoring "noauto" for root device
[ +0.106659] systemd-fstab-generator[653]: Ignoring "noauto" for root device
[ +0.135210] systemd-fstab-generator[666]: Ignoring "noauto" for root device
[ +0.103027] systemd-fstab-generator[677]: Ignoring "noauto" for root device
[ +0.211475] systemd-fstab-generator[701]: Ignoring "noauto" for root device
[ +9.086423] systemd-fstab-generator[910]: Ignoring "noauto" for root device
[ +8.777420] systemd-fstab-generator[1244]: Ignoring "noauto" for root device
[Dec12 22:04] kauditd_printk_skb: 4 callbacks suppressed
[ +7.970237] kauditd_printk_skb: 64 callbacks suppressed
[ +23.118308] kauditd_printk_skb: 18 callbacks suppressed
[ +9.701765] kauditd_printk_skb: 20 callbacks suppressed
[Dec12 22:05] kauditd_printk_skb: 32 callbacks suppressed
[ +11.053734] kauditd_printk_skb: 3 callbacks suppressed
[ +9.624757] kauditd_printk_skb: 24 callbacks suppressed
[ +5.532133] kauditd_printk_skb: 8 callbacks suppressed
[ +5.085550] kauditd_printk_skb: 17 callbacks suppressed
[ +5.124870] kauditd_printk_skb: 25 callbacks suppressed
[ +6.386857] kauditd_printk_skb: 7 callbacks suppressed
[ +6.008334] kauditd_printk_skb: 3 callbacks suppressed
[Dec12 22:06] kauditd_printk_skb: 12 callbacks suppressed
[Dec12 22:07] kauditd_printk_skb: 5 callbacks suppressed
*
* ==> etcd [53bacbebf69a069a9e72b6111c84f56ce650ba89aeb0470ce89711fc7f26274e] <==
* {"level":"warn","ts":"2023-12-12T22:04:52.682304Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"101.520428ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/gcp-auth/\" range_end:\"/registry/pods/gcp-auth0\" ","response":"range_response_count:3 size:10572"}
{"level":"info","ts":"2023-12-12T22:04:52.68236Z","caller":"traceutil/trace.go:171","msg":"trace[52397965] range","detail":"{range_begin:/registry/pods/gcp-auth/; range_end:/registry/pods/gcp-auth0; response_count:3; response_revision:1013; }","duration":"101.649564ms","start":"2023-12-12T22:04:52.580703Z","end":"2023-12-12T22:04:52.682353Z","steps":["trace[52397965] 'agreement among raft nodes before linearized reading' (duration: 101.477962ms)"],"step_count":1}
{"level":"warn","ts":"2023-12-12T22:04:52.682335Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2023-12-12T22:04:52.329953Z","time spent":"352.2696ms","remote":"127.0.0.1:37198","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1098,"response count":0,"response size":38,"request content":"compare:<target:MOD key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" mod_revision:1007 > success:<request_put:<key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" value_size:1025 >> failure:<request_range:<key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" > >"}
{"level":"warn","ts":"2023-12-12T22:04:52.681416Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"255.888647ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/\" range_end:\"/registry/pods/kube-system0\" ","response":"range_response_count:18 size:82003"}
{"level":"info","ts":"2023-12-12T22:04:52.682638Z","caller":"traceutil/trace.go:171","msg":"trace[596890108] range","detail":"{range_begin:/registry/pods/kube-system/; range_end:/registry/pods/kube-system0; response_count:18; response_revision:1013; }","duration":"257.1237ms","start":"2023-12-12T22:04:52.425506Z","end":"2023-12-12T22:04:52.682629Z","steps":["trace[596890108] 'agreement among raft nodes before linearized reading' (duration: 255.694017ms)"],"step_count":1}
{"level":"info","ts":"2023-12-12T22:05:07.559417Z","caller":"traceutil/trace.go:171","msg":"trace[95224457] transaction","detail":"{read_only:false; response_revision:1094; number_of_response:1; }","duration":"225.553617ms","start":"2023-12-12T22:05:07.333657Z","end":"2023-12-12T22:05:07.55921Z","steps":["trace[95224457] 'process raft request' (duration: 225.167074ms)"],"step_count":1}
{"level":"info","ts":"2023-12-12T22:05:07.560192Z","caller":"traceutil/trace.go:171","msg":"trace[4175013] linearizableReadLoop","detail":"{readStateIndex:1126; appliedIndex:1126; }","duration":"137.083868ms","start":"2023-12-12T22:05:07.423098Z","end":"2023-12-12T22:05:07.560182Z","steps":["trace[4175013] 'read index received' (duration: 137.079938ms)","trace[4175013] 'applied index is now lower than readState.Index' (duration: 3.352µs)"],"step_count":2}
{"level":"warn","ts":"2023-12-12T22:05:07.570921Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"140.761689ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/\" range_end:\"/registry/pods/kube-system0\" ","response":"range_response_count:18 size:82331"}
{"level":"info","ts":"2023-12-12T22:05:07.577366Z","caller":"traceutil/trace.go:171","msg":"trace[743277275] range","detail":"{range_begin:/registry/pods/kube-system/; range_end:/registry/pods/kube-system0; response_count:18; response_revision:1094; }","duration":"154.272353ms","start":"2023-12-12T22:05:07.423076Z","end":"2023-12-12T22:05:07.577348Z","steps":["trace[743277275] 'agreement among raft nodes before linearized reading' (duration: 137.632963ms)"],"step_count":1}
{"level":"info","ts":"2023-12-12T22:05:22.608841Z","caller":"traceutil/trace.go:171","msg":"trace[342607671] transaction","detail":"{read_only:false; response_revision:1163; number_of_response:1; }","duration":"493.136081ms","start":"2023-12-12T22:05:22.115691Z","end":"2023-12-12T22:05:22.608827Z","steps":["trace[342607671] 'process raft request' (duration: 493.034464ms)"],"step_count":1}
{"level":"warn","ts":"2023-12-12T22:05:22.608977Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2023-12-12T22:05:22.115665Z","time spent":"493.243887ms","remote":"127.0.0.1:37222","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":484,"response count":0,"response size":38,"request content":"compare:<target:MOD key:\"/registry/leases/ingress-nginx/ingress-nginx-leader\" mod_revision:0 > success:<request_put:<key:\"/registry/leases/ingress-nginx/ingress-nginx-leader\" value_size:425 >> failure:<>"}
{"level":"info","ts":"2023-12-12T22:05:22.613774Z","caller":"traceutil/trace.go:171","msg":"trace[1516690207] linearizableReadLoop","detail":"{readStateIndex:1199; appliedIndex:1197; }","duration":"223.792388ms","start":"2023-12-12T22:05:22.389969Z","end":"2023-12-12T22:05:22.613761Z","steps":["trace[1516690207] 'read index received' (duration: 218.83761ms)","trace[1516690207] 'applied index is now lower than readState.Index' (duration: 4.954202ms)"],"step_count":2}
{"level":"info","ts":"2023-12-12T22:05:22.614484Z","caller":"traceutil/trace.go:171","msg":"trace[2063432571] transaction","detail":"{read_only:false; response_revision:1164; number_of_response:1; }","duration":"403.922965ms","start":"2023-12-12T22:05:22.210448Z","end":"2023-12-12T22:05:22.614371Z","steps":["trace[2063432571] 'process raft request' (duration: 403.244604ms)"],"step_count":1}
{"level":"warn","ts":"2023-12-12T22:05:22.614838Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2023-12-12T22:05:22.210421Z","time spent":"404.214471ms","remote":"127.0.0.1:37178","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":732,"response count":0,"response size":38,"request content":"compare:<target:MOD key:\"/registry/events/ingress-nginx/ingress-nginx-controller-7c6974c4d8-b8x52.17a034cedc24c5c6\" mod_revision:0 > success:<request_put:<key:\"/registry/events/ingress-nginx/ingress-nginx-controller-7c6974c4d8-b8x52.17a034cedc24c5c6\" value_size:625 lease:985879712630515487 >> failure:<>"}
{"level":"warn","ts":"2023-12-12T22:05:22.616224Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"226.250441ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/snapshot.storage.k8s.io/volumesnapshotclasses/\" range_end:\"/registry/snapshot.storage.k8s.io/volumesnapshotclasses0\" count_only:true ","response":"range_response_count:0 size:7"}
{"level":"warn","ts":"2023-12-12T22:05:22.616616Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"192.835354ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/\" range_end:\"/registry/pods/kube-system0\" ","response":"range_response_count:18 size:82331"}
{"level":"info","ts":"2023-12-12T22:05:22.616689Z","caller":"traceutil/trace.go:171","msg":"trace[760696770] range","detail":"{range_begin:/registry/pods/kube-system/; range_end:/registry/pods/kube-system0; response_count:18; response_revision:1164; }","duration":"192.915518ms","start":"2023-12-12T22:05:22.423764Z","end":"2023-12-12T22:05:22.616679Z","steps":["trace[760696770] 'agreement among raft nodes before linearized reading' (duration: 192.695345ms)"],"step_count":1}
{"level":"info","ts":"2023-12-12T22:05:22.616479Z","caller":"traceutil/trace.go:171","msg":"trace[1808990297] range","detail":"{range_begin:/registry/snapshot.storage.k8s.io/volumesnapshotclasses/; range_end:/registry/snapshot.storage.k8s.io/volumesnapshotclasses0; response_count:0; response_revision:1164; }","duration":"226.522088ms","start":"2023-12-12T22:05:22.389945Z","end":"2023-12-12T22:05:22.616467Z","steps":["trace[1808990297] 'agreement among raft nodes before linearized reading' (duration: 225.802645ms)"],"step_count":1}
{"level":"warn","ts":"2023-12-12T22:05:22.617392Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"170.276971ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/gadget/gadget-znnlk.17a034bf93992f0b\" ","response":"range_response_count:1 size:808"}
{"level":"info","ts":"2023-12-12T22:05:22.617503Z","caller":"traceutil/trace.go:171","msg":"trace[1071657038] range","detail":"{range_begin:/registry/events/gadget/gadget-znnlk.17a034bf93992f0b; range_end:; response_count:1; response_revision:1164; }","duration":"170.392356ms","start":"2023-12-12T22:05:22.447102Z","end":"2023-12-12T22:05:22.617495Z","steps":["trace[1071657038] 'agreement among raft nodes before linearized reading' (duration: 170.121629ms)"],"step_count":1}
{"level":"warn","ts":"2023-12-12T22:05:48.651708Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"108.389147ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/priorityclasses/\" range_end:\"/registry/priorityclasses0\" count_only:true ","response":"range_response_count:0 size:7"}
{"level":"info","ts":"2023-12-12T22:05:48.651902Z","caller":"traceutil/trace.go:171","msg":"trace[440542841] range","detail":"{range_begin:/registry/priorityclasses/; range_end:/registry/priorityclasses0; response_count:0; response_revision:1434; }","duration":"108.695015ms","start":"2023-12-12T22:05:48.543182Z","end":"2023-12-12T22:05:48.651877Z","steps":["trace[440542841] 'count revisions from in-memory index tree' (duration: 108.247983ms)"],"step_count":1}
{"level":"info","ts":"2023-12-12T22:06:21.374375Z","caller":"traceutil/trace.go:171","msg":"trace[756822565] transaction","detail":"{read_only:false; response_revision:1544; number_of_response:1; }","duration":"103.330265ms","start":"2023-12-12T22:06:21.271023Z","end":"2023-12-12T22:06:21.374354Z","steps":["trace[756822565] 'process raft request' (duration: 103.109608ms)"],"step_count":1}
{"level":"info","ts":"2023-12-12T22:06:25.80671Z","caller":"traceutil/trace.go:171","msg":"trace[973700587] transaction","detail":"{read_only:false; response_revision:1566; number_of_response:1; }","duration":"168.73689ms","start":"2023-12-12T22:06:25.637957Z","end":"2023-12-12T22:06:25.806694Z","steps":["trace[973700587] 'process raft request' (duration: 168.630443ms)"],"step_count":1}
{"level":"info","ts":"2023-12-12T22:07:02.303412Z","caller":"traceutil/trace.go:171","msg":"trace[1282758935] transaction","detail":"{read_only:false; response_revision:1778; number_of_response:1; }","duration":"261.319001ms","start":"2023-12-12T22:07:02.042075Z","end":"2023-12-12T22:07:02.303394Z","steps":["trace[1282758935] 'process raft request' (duration: 261.074995ms)"],"step_count":1}
*
* ==> gcp-auth [91c228d72c6887e427e4b02bcdadbb57a5a4f6ba35695daa5ad74c544d1deb91] <==
* 2023/12/12 22:05:24 GCP Auth Webhook started!
2023/12/12 22:05:30 Ready to marshal response ...
2023/12/12 22:05:30 Ready to write response ...
2023/12/12 22:05:32 Ready to marshal response ...
2023/12/12 22:05:32 Ready to write response ...
2023/12/12 22:05:35 Ready to marshal response ...
2023/12/12 22:05:35 Ready to write response ...
2023/12/12 22:05:41 Ready to marshal response ...
2023/12/12 22:05:41 Ready to write response ...
2023/12/12 22:05:41 Ready to marshal response ...
2023/12/12 22:05:41 Ready to write response ...
2023/12/12 22:05:45 Ready to marshal response ...
2023/12/12 22:05:45 Ready to write response ...
2023/12/12 22:05:45 Ready to marshal response ...
2023/12/12 22:05:45 Ready to write response ...
2023/12/12 22:05:45 Ready to marshal response ...
2023/12/12 22:05:45 Ready to write response ...
2023/12/12 22:05:56 Ready to marshal response ...
2023/12/12 22:05:56 Ready to write response ...
2023/12/12 22:06:21 Ready to marshal response ...
2023/12/12 22:06:21 Ready to write response ...
2023/12/12 22:06:39 Ready to marshal response ...
2023/12/12 22:06:39 Ready to write response ...
2023/12/12 22:07:53 Ready to marshal response ...
2023/12/12 22:07:53 Ready to write response ...
*
* ==> kernel <==
* 22:08:05 up 4 min, 0 users, load average: 1.07, 1.93, 0.98
Linux addons-361656 5.10.57 #1 SMP Tue Dec 12 18:39:03 UTC 2023 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2021.02.12"
*
* ==> kube-apiserver [6e1a80dbf9b6a168ae47ecd32107e17d0fe6dbefcb1ca495a7f868935f3244fa] <==
* I1212 22:05:41.017563 1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
I1212 22:05:45.107977 1 alloc.go:330] "allocated clusterIPs" service="headlamp/headlamp" clusterIPs={"IPv4":"10.104.169.92"}
I1212 22:06:34.921217 1 controller.go:624] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io
I1212 22:06:45.977971 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Nothing (removed from the queue).
I1212 22:06:57.214920 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I1212 22:06:57.215060 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I1212 22:06:57.228688 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I1212 22:06:57.228800 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I1212 22:06:57.244070 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I1212 22:06:57.244324 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I1212 22:06:57.257831 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I1212 22:06:57.257934 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I1212 22:06:57.271208 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I1212 22:06:57.271346 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I1212 22:06:57.277456 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I1212 22:06:57.277517 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I1212 22:06:57.283980 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I1212 22:06:57.284047 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I1212 22:06:57.286067 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I1212 22:06:57.286131 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
W1212 22:06:58.277412 1 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io
W1212 22:06:58.284976 1 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io
W1212 22:06:58.309927 1 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io
I1212 22:07:54.214530 1 alloc.go:330] "allocated clusterIPs" service="default/hello-world-app" clusterIPs={"IPv4":"10.109.19.38"}
E1212 22:07:56.873045 1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"ingress-nginx\" not found]"
*
* ==> kube-controller-manager [8a13315939f9f84a673ce03e6ee0001b426e72d67e06f33b3ea07a6b196f3292] <==
* W1212 22:07:17.338621 1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E1212 22:07:17.338714 1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
I1212 22:07:26.763292 1 shared_informer.go:311] Waiting for caches to sync for resource quota
I1212 22:07:26.763382 1 shared_informer.go:318] Caches are synced for resource quota
I1212 22:07:27.191559 1 shared_informer.go:311] Waiting for caches to sync for garbage collector
I1212 22:07:27.191681 1 shared_informer.go:318] Caches are synced for garbage collector
W1212 22:07:31.363501 1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E1212 22:07:31.363548 1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
W1212 22:07:33.037567 1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E1212 22:07:33.037603 1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
W1212 22:07:34.685491 1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E1212 22:07:34.685698 1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
W1212 22:07:42.225711 1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E1212 22:07:42.225937 1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
I1212 22:07:53.949697 1 event.go:307] "Event occurred" object="default/hello-world-app" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set hello-world-app-5d77478584 to 1"
I1212 22:07:53.984089 1 event.go:307] "Event occurred" object="default/hello-world-app-5d77478584" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: hello-world-app-5d77478584-99x22"
I1212 22:07:54.011620 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="61.563689ms"
I1212 22:07:54.022210 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="10.394405ms"
I1212 22:07:54.023583 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="224.58µs"
I1212 22:07:54.039833 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="68.442µs"
I1212 22:07:56.713524 1 job_controller.go:562] "enqueueing job" key="ingress-nginx/ingress-nginx-admission-create"
I1212 22:07:56.724412 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="ingress-nginx/ingress-nginx-controller-7c6974c4d8" duration="12.56µs"
I1212 22:07:56.732041 1 job_controller.go:562] "enqueueing job" key="ingress-nginx/ingress-nginx-admission-patch"
I1212 22:07:56.852429 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="19.951285ms"
I1212 22:07:56.852675 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="128.655µs"
*
* ==> kube-proxy [0d919eb6810b21cbb9196d13258c29f88172688f2a3fc47a26646d954fe44437] <==
* I1212 22:04:15.456155 1 server_others.go:69] "Using iptables proxy"
I1212 22:04:15.795927 1 node.go:141] Successfully retrieved node IP: 192.168.39.86
I1212 22:04:16.651575 1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"
I1212 22:04:16.651645 1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"
I1212 22:04:16.733525 1 server_others.go:152] "Using iptables Proxier"
I1212 22:04:16.733611 1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I1212 22:04:16.733811 1 server.go:846] "Version info" version="v1.28.4"
I1212 22:04:16.733821 1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1212 22:04:16.769079 1 config.go:188] "Starting service config controller"
I1212 22:04:16.769140 1 shared_informer.go:311] Waiting for caches to sync for service config
I1212 22:04:16.769178 1 config.go:97] "Starting endpoint slice config controller"
I1212 22:04:16.769182 1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
I1212 22:04:16.769673 1 config.go:315] "Starting node config controller"
I1212 22:04:16.769679 1 shared_informer.go:311] Waiting for caches to sync for node config
I1212 22:04:17.005861 1 shared_informer.go:318] Caches are synced for node config
I1212 22:04:17.097447 1 shared_informer.go:318] Caches are synced for service config
I1212 22:04:17.116515 1 shared_informer.go:318] Caches are synced for endpoint slice config
*
* ==> kube-scheduler [e321afdf117e7d05e267871cf0f1a175739a242ca3e0b4ff06876917f8d35d44] <==
* W1212 22:03:41.191223 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E1212 22:03:41.191314 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
W1212 22:03:41.191575 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
E1212 22:03:41.191687 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
W1212 22:03:42.032303 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E1212 22:03:42.032358 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
W1212 22:03:42.083752 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E1212 22:03:42.083811 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
W1212 22:03:42.099634 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E1212 22:03:42.099712 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
W1212 22:03:42.181802 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E1212 22:03:42.181892 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
W1212 22:03:42.182178 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
E1212 22:03:42.182200 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
W1212 22:03:42.190770 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E1212 22:03:42.190912 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
W1212 22:03:42.192375 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E1212 22:03:42.192440 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
W1212 22:03:42.274290 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E1212 22:03:42.274392 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
W1212 22:03:42.364140 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E1212 22:03:42.364347 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
W1212 22:03:42.636358 1 reflector.go:535] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E1212 22:03:42.636567 1 reflector.go:147] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
I1212 22:03:44.472455 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
*
* ==> kubelet <==
* -- Journal begins at Tue 2023-12-12 22:03:14 UTC, ends at Tue 2023-12-12 22:08:05 UTC. --
Dec 12 22:07:53 addons-361656 kubelet[1251]: I1212 22:07:53.993410 1251 memory_manager.go:346] "RemoveStaleState removing state" podUID="53805fe1-a499-4ccd-b440-ffd51f141d44" containerName="volume-snapshot-controller"
Dec 12 22:07:53 addons-361656 kubelet[1251]: I1212 22:07:53.993416 1251 memory_manager.go:346] "RemoveStaleState removing state" podUID="231b62bc-5fa9-4829-a7d6-9b5ff69477b3" containerName="csi-attacher"
Dec 12 22:07:54 addons-361656 kubelet[1251]: I1212 22:07:54.080701 1251 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/c5d8c21c-f196-454c-b323-28842ec5c5b8-gcp-creds\") pod \"hello-world-app-5d77478584-99x22\" (UID: \"c5d8c21c-f196-454c-b323-28842ec5c5b8\") " pod="default/hello-world-app-5d77478584-99x22"
Dec 12 22:07:54 addons-361656 kubelet[1251]: I1212 22:07:54.080748 1251 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzhpj\" (UniqueName: \"kubernetes.io/projected/c5d8c21c-f196-454c-b323-28842ec5c5b8-kube-api-access-tzhpj\") pod \"hello-world-app-5d77478584-99x22\" (UID: \"c5d8c21c-f196-454c-b323-28842ec5c5b8\") " pod="default/hello-world-app-5d77478584-99x22"
Dec 12 22:07:55 addons-361656 kubelet[1251]: I1212 22:07:55.392453 1251 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqmsw\" (UniqueName: \"kubernetes.io/projected/0df541c9-11fb-444a-9fd1-cf852f2d1bd4-kube-api-access-kqmsw\") pod \"0df541c9-11fb-444a-9fd1-cf852f2d1bd4\" (UID: \"0df541c9-11fb-444a-9fd1-cf852f2d1bd4\") "
Dec 12 22:07:55 addons-361656 kubelet[1251]: I1212 22:07:55.397015 1251 operation_generator.go:882] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0df541c9-11fb-444a-9fd1-cf852f2d1bd4-kube-api-access-kqmsw" (OuterVolumeSpecName: "kube-api-access-kqmsw") pod "0df541c9-11fb-444a-9fd1-cf852f2d1bd4" (UID: "0df541c9-11fb-444a-9fd1-cf852f2d1bd4"). InnerVolumeSpecName "kube-api-access-kqmsw". PluginName "kubernetes.io/projected", VolumeGidValue ""
Dec 12 22:07:55 addons-361656 kubelet[1251]: I1212 22:07:55.493098 1251 reconciler_common.go:300] "Volume detached for volume \"kube-api-access-kqmsw\" (UniqueName: \"kubernetes.io/projected/0df541c9-11fb-444a-9fd1-cf852f2d1bd4-kube-api-access-kqmsw\") on node \"addons-361656\" DevicePath \"\""
Dec 12 22:07:55 addons-361656 kubelet[1251]: I1212 22:07:55.773476 1251 scope.go:117] "RemoveContainer" containerID="86c95a1a0e6438bdb55a6f9b3f57b45ecc88d6b86b827d38f6a25a5ad7b9927b"
Dec 12 22:07:55 addons-361656 kubelet[1251]: I1212 22:07:55.842671 1251 scope.go:117] "RemoveContainer" containerID="86c95a1a0e6438bdb55a6f9b3f57b45ecc88d6b86b827d38f6a25a5ad7b9927b"
Dec 12 22:07:55 addons-361656 kubelet[1251]: E1212 22:07:55.857562 1251 remote_runtime.go:432] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86c95a1a0e6438bdb55a6f9b3f57b45ecc88d6b86b827d38f6a25a5ad7b9927b\": container with ID starting with 86c95a1a0e6438bdb55a6f9b3f57b45ecc88d6b86b827d38f6a25a5ad7b9927b not found: ID does not exist" containerID="86c95a1a0e6438bdb55a6f9b3f57b45ecc88d6b86b827d38f6a25a5ad7b9927b"
Dec 12 22:07:55 addons-361656 kubelet[1251]: I1212 22:07:55.857656 1251 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86c95a1a0e6438bdb55a6f9b3f57b45ecc88d6b86b827d38f6a25a5ad7b9927b"} err="failed to get container status \"86c95a1a0e6438bdb55a6f9b3f57b45ecc88d6b86b827d38f6a25a5ad7b9927b\": rpc error: code = NotFound desc = could not find container \"86c95a1a0e6438bdb55a6f9b3f57b45ecc88d6b86b827d38f6a25a5ad7b9927b\": container with ID starting with 86c95a1a0e6438bdb55a6f9b3f57b45ecc88d6b86b827d38f6a25a5ad7b9927b not found: ID does not exist"
Dec 12 22:07:56 addons-361656 kubelet[1251]: I1212 22:07:56.444160 1251 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0df541c9-11fb-444a-9fd1-cf852f2d1bd4" path="/var/lib/kubelet/pods/0df541c9-11fb-444a-9fd1-cf852f2d1bd4/volumes"
Dec 12 22:07:58 addons-361656 kubelet[1251]: I1212 22:07:58.443846 1251 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="533d35a4-b8a6-4273-8ca1-b4126c10ec65" path="/var/lib/kubelet/pods/533d35a4-b8a6-4273-8ca1-b4126c10ec65/volumes"
Dec 12 22:07:58 addons-361656 kubelet[1251]: I1212 22:07:58.444421 1251 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5f162bf0-b36e-4d15-bf62-0dbadd581cd8" path="/var/lib/kubelet/pods/5f162bf0-b36e-4d15-bf62-0dbadd581cd8/volumes"
Dec 12 22:08:00 addons-361656 kubelet[1251]: I1212 22:08:00.126130 1251 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e4a747a-0126-4ff4-9292-5071b16cb10d-webhook-cert\") pod \"6e4a747a-0126-4ff4-9292-5071b16cb10d\" (UID: \"6e4a747a-0126-4ff4-9292-5071b16cb10d\") "
Dec 12 22:08:00 addons-361656 kubelet[1251]: I1212 22:08:00.126217 1251 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p44pv\" (UniqueName: \"kubernetes.io/projected/6e4a747a-0126-4ff4-9292-5071b16cb10d-kube-api-access-p44pv\") pod \"6e4a747a-0126-4ff4-9292-5071b16cb10d\" (UID: \"6e4a747a-0126-4ff4-9292-5071b16cb10d\") "
Dec 12 22:08:00 addons-361656 kubelet[1251]: I1212 22:08:00.128728 1251 operation_generator.go:882] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e4a747a-0126-4ff4-9292-5071b16cb10d-kube-api-access-p44pv" (OuterVolumeSpecName: "kube-api-access-p44pv") pod "6e4a747a-0126-4ff4-9292-5071b16cb10d" (UID: "6e4a747a-0126-4ff4-9292-5071b16cb10d"). InnerVolumeSpecName "kube-api-access-p44pv". PluginName "kubernetes.io/projected", VolumeGidValue ""
Dec 12 22:08:00 addons-361656 kubelet[1251]: I1212 22:08:00.130403 1251 operation_generator.go:882] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e4a747a-0126-4ff4-9292-5071b16cb10d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6e4a747a-0126-4ff4-9292-5071b16cb10d" (UID: "6e4a747a-0126-4ff4-9292-5071b16cb10d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue ""
Dec 12 22:08:00 addons-361656 kubelet[1251]: I1212 22:08:00.226707 1251 reconciler_common.go:300] "Volume detached for volume \"kube-api-access-p44pv\" (UniqueName: \"kubernetes.io/projected/6e4a747a-0126-4ff4-9292-5071b16cb10d-kube-api-access-p44pv\") on node \"addons-361656\" DevicePath \"\""
Dec 12 22:08:00 addons-361656 kubelet[1251]: I1212 22:08:00.226770 1251 reconciler_common.go:300] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e4a747a-0126-4ff4-9292-5071b16cb10d-webhook-cert\") on node \"addons-361656\" DevicePath \"\""
Dec 12 22:08:00 addons-361656 kubelet[1251]: I1212 22:08:00.444174 1251 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6e4a747a-0126-4ff4-9292-5071b16cb10d" path="/var/lib/kubelet/pods/6e4a747a-0126-4ff4-9292-5071b16cb10d/volumes"
Dec 12 22:08:00 addons-361656 kubelet[1251]: I1212 22:08:00.821376 1251 scope.go:117] "RemoveContainer" containerID="ebe21b022b1d691306ae42da43eeadce83c72528b4827856d1d8be790aa77785"
Dec 12 22:08:00 addons-361656 kubelet[1251]: I1212 22:08:00.845216 1251 scope.go:117] "RemoveContainer" containerID="ebe21b022b1d691306ae42da43eeadce83c72528b4827856d1d8be790aa77785"
Dec 12 22:08:00 addons-361656 kubelet[1251]: E1212 22:08:00.845813 1251 remote_runtime.go:432] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebe21b022b1d691306ae42da43eeadce83c72528b4827856d1d8be790aa77785\": container with ID starting with ebe21b022b1d691306ae42da43eeadce83c72528b4827856d1d8be790aa77785 not found: ID does not exist" containerID="ebe21b022b1d691306ae42da43eeadce83c72528b4827856d1d8be790aa77785"
Dec 12 22:08:00 addons-361656 kubelet[1251]: I1212 22:08:00.845883 1251 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebe21b022b1d691306ae42da43eeadce83c72528b4827856d1d8be790aa77785"} err="failed to get container status \"ebe21b022b1d691306ae42da43eeadce83c72528b4827856d1d8be790aa77785\": rpc error: code = NotFound desc = could not find container \"ebe21b022b1d691306ae42da43eeadce83c72528b4827856d1d8be790aa77785\": container with ID starting with ebe21b022b1d691306ae42da43eeadce83c72528b4827856d1d8be790aa77785 not found: ID does not exist"
*
* ==> storage-provisioner [96fb98f8d7789efc274b1cf924697cb141142e383644b53888a17ba15c569025] <==
* I1212 22:04:20.715608 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I1212 22:04:20.897013 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I1212 22:04:20.897078 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I1212 22:04:21.184084 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I1212 22:04:21.185913 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"1b668db0-2bbe-45b0-8f6e-10f119371cae", APIVersion:"v1", ResourceVersion:"875", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-361656_f5cf244a-ae26-4b2a-bce3-c141f5fa1dfa became leader
I1212 22:04:21.185982 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-361656_f5cf244a-ae26-4b2a-bce3-c141f5fa1dfa!
I1212 22:04:21.386826 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-361656_f5cf244a-ae26-4b2a-bce3-c141f5fa1dfa!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p addons-361656 -n addons-361656
helpers_test.go:261: (dbg) Run: kubectl --context addons-361656 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestAddons/parallel/Ingress FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestAddons/parallel/Ingress (160.99s)