=== RUN TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp
=== CONT TestAddons/parallel/Headlamp
addons_test.go:824: (dbg) Run: out/minikube-linux-amd64 addons enable headlamp -p addons-874655 --alsologtostderr -v=1
addons_test.go:824: (dbg) Non-zero exit: out/minikube-linux-amd64 addons enable headlamp -p addons-874655 --alsologtostderr -v=1: exit status 11 (446.701849ms)
-- stdout --
-- /stdout --
** stderr **
I0116 01:58:56.697414 567664 out.go:296] Setting OutFile to fd 1 ...
I0116 01:58:56.697703 567664 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0116 01:58:56.697739 567664 out.go:309] Setting ErrFile to fd 2...
I0116 01:58:56.697756 567664 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0116 01:58:56.698209 567664 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17967-558382/.minikube/bin
I0116 01:58:56.698983 567664 mustload.go:65] Loading cluster: addons-874655
I0116 01:58:56.700123 567664 config.go:182] Loaded profile config "addons-874655": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.28.4
I0116 01:58:56.700216 567664 addons.go:597] checking whether the cluster is paused
I0116 01:58:56.700414 567664 config.go:182] Loaded profile config "addons-874655": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.28.4
I0116 01:58:56.700444 567664 host.go:66] Checking if "addons-874655" exists ...
I0116 01:58:56.700932 567664 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:58:56.701016 567664 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:58:56.718178 567664 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40217
I0116 01:58:56.718826 567664 main.go:141] libmachine: () Calling .GetVersion
I0116 01:58:56.719588 567664 main.go:141] libmachine: Using API Version 1
I0116 01:58:56.719628 567664 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:58:56.720059 567664 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:58:56.720297 567664 main.go:141] libmachine: (addons-874655) Calling .GetState
I0116 01:58:56.722162 567664 main.go:141] libmachine: (addons-874655) Calling .DriverName
I0116 01:58:56.722405 567664 ssh_runner.go:195] Run: systemctl --version
I0116 01:58:56.722432 567664 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:58:56.725228 567664 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:58:56.725641 567664 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:58:56.725671 567664 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:58:56.725880 567664 main.go:141] libmachine: (addons-874655) Calling .GetSSHPort
I0116 01:58:56.726084 567664 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:58:56.726245 567664 main.go:141] libmachine: (addons-874655) Calling .GetSSHUsername
I0116 01:58:56.726375 567664 sshutil.go:53] new ssh client: &{IP:192.168.39.252 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/id_rsa Username:docker}
I0116 01:58:56.823655 567664 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0116 01:58:56.823783 567664 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0116 01:58:56.995494 567664 cri.go:89] found id: "16947755a849854d470eec15f1b664507b182e454a95f6384259b72d350ed5de"
I0116 01:58:56.995533 567664 cri.go:89] found id: "663d110f79a98635d89c2124f9dbe23bdc3d85b72d2ef6d4db4c0015d3694ea9"
I0116 01:58:56.995540 567664 cri.go:89] found id: "df9bc4ef29d64fc48a86ed8a719a28c52f3da87cfc9974fa19cf5ba53c284c37"
I0116 01:58:56.995554 567664 cri.go:89] found id: "99c04aa208a9bf8fa94d95d746bcf9052e58d94752410c4a30e17d697ec0023a"
I0116 01:58:56.995565 567664 cri.go:89] found id: "a5e850fb620ec4e6d1050a98439e6cbe87d0338e7dba10b43303c818728d1b55"
I0116 01:58:56.995584 567664 cri.go:89] found id: "e0b01d710aeeffd522161c14300e74a8c1e07185e894a1c7e36a3f1176ded9d7"
I0116 01:58:56.995589 567664 cri.go:89] found id: "7e2bc7e862303c9ed6e05aa07d5db99aefb5c94560d66364e6005435394fe810"
I0116 01:58:56.995594 567664 cri.go:89] found id: "800b4b42fb15c96952192dc78163d761adebb6b3becd91f7ba978806b5ecc303"
I0116 01:58:56.995599 567664 cri.go:89] found id: "d66d56ecb50b42bbcc3b9b929d31bee9dc7349843f2c2d8cd594034422698789"
I0116 01:58:56.995612 567664 cri.go:89] found id: "ed9f7c3a5daec08e50f3fd5c12a75b999bddbd33aed28f71dcc04b74c4aa4290"
I0116 01:58:56.995617 567664 cri.go:89] found id: "4930fa202417a75505a676a94bf1227c97a92e5efb2ae3cdc1be2f0f459de767"
I0116 01:58:56.995622 567664 cri.go:89] found id: "8cdab95870928b77f3d3419ba215529a377dfae706207c702a56422a96e57fe8"
I0116 01:58:56.995627 567664 cri.go:89] found id: "01577e925846a47d1fc5c5214aca11e9a139348d4be81979671f92977e3e0503"
I0116 01:58:56.995634 567664 cri.go:89] found id: "0185312efa995d56c35f389356765d2ec3d516115482241acb480471655499b8"
I0116 01:58:56.995639 567664 cri.go:89] found id: "d495d116f12b362205c7493e1405782f1b5d45d0a8b74b6243901138efc14ac0"
I0116 01:58:56.995645 567664 cri.go:89] found id: "b6c383016f6feb534657bde7edf8af0ffe2f72fd3f6cac8f6e51154801314ec8"
I0116 01:58:56.995650 567664 cri.go:89] found id: "e77edeeac5c6cbe28cfdcf68a4c17e7add5effa37e0d36432844374b617f58cb"
I0116 01:58:56.995659 567664 cri.go:89] found id: "d3b48cbdf9598c266af4e49abf8b012e38f15d1a33f818222bc4ad874add39c0"
I0116 01:58:56.995668 567664 cri.go:89] found id: "a401d2fb30cdee44bc8f2d539cd9e4a6b44f3dd6933a62fac33ce544e6a90d21"
I0116 01:58:56.995673 567664 cri.go:89] found id: "138e7cf6410ad1a952ff22471fbad10e7fc87031924284c46e86f2b6c7c9cb7c"
I0116 01:58:56.995682 567664 cri.go:89] found id: ""
I0116 01:58:56.995758 567664 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0116 01:58:57.055098 567664 main.go:141] libmachine: Making call to close driver server
I0116 01:58:57.055130 567664 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:58:57.055474 567664 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:58:57.055509 567664 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:58:57.055542 567664 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
I0116 01:58:57.058095 567664 out.go:177]
W0116 01:58:57.059599 567664 out.go:239] X Exiting due to MK_ADDON_ENABLE_PAUSED: enabled failed: check paused: list paused: runc: sudo runc --root /run/containerd/runc/k8s.io list -f json: Process exited with status 1
stdout:
stderr:
time="2024-01-16T01:58:57Z" level=error msg="stat /run/containerd/runc/k8s.io/7010e3c493ae1d4af36adeaef2828f0f9da1b15cdf9f78f705d7c137e0446ba3: no such file or directory"
X Exiting due to MK_ADDON_ENABLE_PAUSED: enabled failed: check paused: list paused: runc: sudo runc --root /run/containerd/runc/k8s.io list -f json: Process exited with status 1
stdout:
stderr:
time="2024-01-16T01:58:57Z" level=error msg="stat /run/containerd/runc/k8s.io/7010e3c493ae1d4af36adeaef2828f0f9da1b15cdf9f78f705d7c137e0446ba3: no such file or directory"
W0116 01:58:57.059626 567664 out.go:239] *
*
W0116 01:58:57.063459 567664 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_af3b8a9ce4f102efc219f1404c9eed7a69cbf2d5_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_af3b8a9ce4f102efc219f1404c9eed7a69cbf2d5_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0116 01:58:57.065057 567664 out.go:177]
** /stderr **
addons_test.go:826: failed to enable headlamp addon: args: "out/minikube-linux-amd64 addons enable headlamp -p addons-874655 --alsologtostderr -v=1": exit status 11
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p addons-874655 -n addons-874655
helpers_test.go:244: <<< TestAddons/parallel/Headlamp FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/parallel/Headlamp]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p addons-874655 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p addons-874655 logs -n 25: (1.615242761s)
helpers_test.go:252: TestAddons/parallel/Headlamp logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| start | -o=json --download-only | download-only-599955 | jenkins | v1.32.0 | 16 Jan 24 01:55 UTC | |
| | -p download-only-599955 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.16.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.32.0 | 16 Jan 24 01:55 UTC | 16 Jan 24 01:55 UTC |
| delete | -p download-only-599955 | download-only-599955 | jenkins | v1.32.0 | 16 Jan 24 01:55 UTC | 16 Jan 24 01:55 UTC |
| start | -o=json --download-only | download-only-772119 | jenkins | v1.32.0 | 16 Jan 24 01:55 UTC | |
| | -p download-only-772119 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.32.0 | 16 Jan 24 01:55 UTC | 16 Jan 24 01:55 UTC |
| delete | -p download-only-772119 | download-only-772119 | jenkins | v1.32.0 | 16 Jan 24 01:55 UTC | 16 Jan 24 01:55 UTC |
| start | -o=json --download-only | download-only-542475 | jenkins | v1.32.0 | 16 Jan 24 01:55 UTC | |
| | -p download-only-542475 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.32.0 | 16 Jan 24 01:56 UTC | 16 Jan 24 01:56 UTC |
| delete | -p download-only-542475 | download-only-542475 | jenkins | v1.32.0 | 16 Jan 24 01:56 UTC | 16 Jan 24 01:56 UTC |
| delete | -p download-only-599955 | download-only-599955 | jenkins | v1.32.0 | 16 Jan 24 01:56 UTC | 16 Jan 24 01:56 UTC |
| delete | -p download-only-772119 | download-only-772119 | jenkins | v1.32.0 | 16 Jan 24 01:56 UTC | 16 Jan 24 01:56 UTC |
| delete | -p download-only-542475 | download-only-542475 | jenkins | v1.32.0 | 16 Jan 24 01:56 UTC | 16 Jan 24 01:56 UTC |
| start | --download-only -p | binary-mirror-142069 | jenkins | v1.32.0 | 16 Jan 24 01:56 UTC | |
| | binary-mirror-142069 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:45435 | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p binary-mirror-142069 | binary-mirror-142069 | jenkins | v1.32.0 | 16 Jan 24 01:56 UTC | 16 Jan 24 01:56 UTC |
| addons | enable dashboard -p | addons-874655 | jenkins | v1.32.0 | 16 Jan 24 01:56 UTC | |
| | addons-874655 | | | | | |
| addons | disable dashboard -p | addons-874655 | jenkins | v1.32.0 | 16 Jan 24 01:56 UTC | |
| | addons-874655 | | | | | |
| start | -p addons-874655 --wait=true | addons-874655 | jenkins | v1.32.0 | 16 Jan 24 01:56 UTC | 16 Jan 24 01:58 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --driver=kvm2 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
| | --addons=helm-tiller | | | | | |
| addons | disable inspektor-gadget -p | addons-874655 | jenkins | v1.32.0 | 16 Jan 24 01:58 UTC | 16 Jan 24 01:58 UTC |
| | addons-874655 | | | | | |
| addons | addons-874655 addons | addons-874655 | jenkins | v1.32.0 | 16 Jan 24 01:58 UTC | 16 Jan 24 01:58 UTC |
| | disable metrics-server | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| ip | addons-874655 ip | addons-874655 | jenkins | v1.32.0 | 16 Jan 24 01:58 UTC | 16 Jan 24 01:58 UTC |
| addons | addons-874655 addons disable | addons-874655 | jenkins | v1.32.0 | 16 Jan 24 01:58 UTC | 16 Jan 24 01:58 UTC |
| | registry --alsologtostderr | | | | | |
| | -v=1 | | | | | |
| addons | disable nvidia-device-plugin | addons-874655 | jenkins | v1.32.0 | 16 Jan 24 01:58 UTC | 16 Jan 24 01:58 UTC |
| | -p addons-874655 | | | | | |
| addons | enable headlamp | addons-874655 | jenkins | v1.32.0 | 16 Jan 24 01:58 UTC | |
| | -p addons-874655 | | | | | |
| | --alsologtostderr -v=1 | | | | | |
|---------|--------------------------------------|----------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/01/16 01:56:13
Running on machine: ubuntu-20-agent-9
Binary: Built with gc go1.21.5 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0116 01:56:13.111496 566425 out.go:296] Setting OutFile to fd 1 ...
I0116 01:56:13.111643 566425 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0116 01:56:13.111654 566425 out.go:309] Setting ErrFile to fd 2...
I0116 01:56:13.111660 566425 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0116 01:56:13.111911 566425 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17967-558382/.minikube/bin
I0116 01:56:13.112630 566425 out.go:303] Setting JSON to false
I0116 01:56:13.113688 566425 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-9","uptime":9516,"bootTime":1705360657,"procs":238,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1048-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0116 01:56:13.113766 566425 start.go:138] virtualization: kvm guest
I0116 01:56:13.115977 566425 out.go:177] * [addons-874655] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0116 01:56:13.117501 566425 notify.go:220] Checking for updates...
I0116 01:56:13.117512 566425 out.go:177] - MINIKUBE_LOCATION=17967
I0116 01:56:13.119027 566425 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0116 01:56:13.120624 566425 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17967-558382/kubeconfig
I0116 01:56:13.121902 566425 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17967-558382/.minikube
I0116 01:56:13.123265 566425 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0116 01:56:13.125286 566425 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0116 01:56:13.126921 566425 driver.go:392] Setting default libvirt URI to qemu:///system
I0116 01:56:13.160991 566425 out.go:177] * Using the kvm2 driver based on user configuration
I0116 01:56:13.162308 566425 start.go:298] selected driver: kvm2
I0116 01:56:13.162322 566425 start.go:902] validating driver "kvm2" against <nil>
I0116 01:56:13.162335 566425 start.go:913] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0116 01:56:13.163030 566425 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0116 01:56:13.163115 566425 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17967-558382/.minikube/bin:/home/jenkins/workspace/KVM_Linux_containerd_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0116 01:56:13.178431 566425 install.go:137] /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0116 01:56:13.178519 566425 start_flags.go:307] no existing cluster config was found, will generate one from the flags
I0116 01:56:13.178759 566425 start_flags.go:927] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0116 01:56:13.178814 566425 cni.go:84] Creating CNI manager for ""
I0116 01:56:13.178827 566425 cni.go:146] "kvm2" driver + "containerd" runtime found, recommending bridge
I0116 01:56:13.178837 566425 start_flags.go:316] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0116 01:56:13.178862 566425 start_flags.go:321] config:
{Name:addons-874655 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:addons-874655 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd
CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0116 01:56:13.178995 566425 iso.go:125] acquiring lock: {Name:mkfcdc81fb6f1fb9928eb379c0846826cfbbc8ad Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0116 01:56:13.181052 566425 out.go:177] * Starting control plane node addons-874655 in cluster addons-874655
I0116 01:56:13.182740 566425 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime containerd
I0116 01:56:13.182783 566425 preload.go:148] Found local preload: /home/jenkins/minikube-integration/17967-558382/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-containerd-overlay2-amd64.tar.lz4
I0116 01:56:13.182793 566425 cache.go:56] Caching tarball of preloaded images
I0116 01:56:13.182887 566425 preload.go:174] Found /home/jenkins/minikube-integration/17967-558382/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
I0116 01:56:13.182898 566425 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on containerd
I0116 01:56:13.183226 566425 profile.go:148] Saving config to /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/config.json ...
I0116 01:56:13.183266 566425 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/config.json: {Name:mkb36875b95f748e3f30ba7fc700508c0ac4155c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0116 01:56:13.183416 566425 start.go:365] acquiring machines lock for addons-874655: {Name:mkd5c5db31d082afc8998bd8dff7207d790937ae Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0116 01:56:13.183458 566425 start.go:369] acquired machines lock for "addons-874655" in 30.132µs
I0116 01:56:13.183480 566425 start.go:93] Provisioning new machine with config: &{Name:addons-874655 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:addons-874655 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:2
62144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0116 01:56:13.183559 566425 start.go:125] createHost starting for "" (driver="kvm2")
I0116 01:56:13.185231 566425 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
I0116 01:56:13.185388 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:56:13.185436 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:56:13.200744 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44233
I0116 01:56:13.201341 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:56:13.202025 566425 main.go:141] libmachine: Using API Version 1
I0116 01:56:13.202049 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:56:13.202541 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:56:13.202778 566425 main.go:141] libmachine: (addons-874655) Calling .GetMachineName
I0116 01:56:13.202961 566425 main.go:141] libmachine: (addons-874655) Calling .DriverName
I0116 01:56:13.203163 566425 start.go:159] libmachine.API.Create for "addons-874655" (driver="kvm2")
I0116 01:56:13.203206 566425 client.go:168] LocalClient.Create starting
I0116 01:56:13.203259 566425 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/17967-558382/.minikube/certs/ca.pem
I0116 01:56:13.300876 566425 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/17967-558382/.minikube/certs/cert.pem
I0116 01:56:13.414340 566425 main.go:141] libmachine: Running pre-create checks...
I0116 01:56:13.414372 566425 main.go:141] libmachine: (addons-874655) Calling .PreCreateCheck
I0116 01:56:13.415006 566425 main.go:141] libmachine: (addons-874655) Calling .GetConfigRaw
I0116 01:56:13.415503 566425 main.go:141] libmachine: Creating machine...
I0116 01:56:13.415518 566425 main.go:141] libmachine: (addons-874655) Calling .Create
I0116 01:56:13.415698 566425 main.go:141] libmachine: (addons-874655) Creating KVM machine...
I0116 01:56:13.417316 566425 main.go:141] libmachine: (addons-874655) DBG | found existing default KVM network
I0116 01:56:13.418580 566425 main.go:141] libmachine: (addons-874655) DBG | I0116 01:56:13.418361 566447 network.go:209] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015ba0}
I0116 01:56:13.424406 566425 main.go:141] libmachine: (addons-874655) DBG | trying to create private KVM network mk-addons-874655 192.168.39.0/24...
I0116 01:56:13.503343 566425 main.go:141] libmachine: (addons-874655) Setting up store path in /home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655 ...
I0116 01:56:13.503386 566425 main.go:141] libmachine: (addons-874655) DBG | private KVM network mk-addons-874655 192.168.39.0/24 created
I0116 01:56:13.503402 566425 main.go:141] libmachine: (addons-874655) Building disk image from file:///home/jenkins/minikube-integration/17967-558382/.minikube/cache/iso/amd64/minikube-v1.32.1-1703784139-17866-amd64.iso
I0116 01:56:13.503480 566425 main.go:141] libmachine: (addons-874655) DBG | I0116 01:56:13.503238 566447 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/17967-558382/.minikube
I0116 01:56:13.503531 566425 main.go:141] libmachine: (addons-874655) Downloading /home/jenkins/minikube-integration/17967-558382/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/17967-558382/.minikube/cache/iso/amd64/minikube-v1.32.1-1703784139-17866-amd64.iso...
I0116 01:56:13.754069 566425 main.go:141] libmachine: (addons-874655) DBG | I0116 01:56:13.753933 566447 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/id_rsa...
I0116 01:56:14.040768 566425 main.go:141] libmachine: (addons-874655) DBG | I0116 01:56:14.040592 566447 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/addons-874655.rawdisk...
I0116 01:56:14.040812 566425 main.go:141] libmachine: (addons-874655) DBG | Writing magic tar header
I0116 01:56:14.040826 566425 main.go:141] libmachine: (addons-874655) DBG | Writing SSH key tar header
I0116 01:56:14.040838 566425 main.go:141] libmachine: (addons-874655) DBG | I0116 01:56:14.040726 566447 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655 ...
I0116 01:56:14.040850 566425 main.go:141] libmachine: (addons-874655) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655
I0116 01:56:14.040910 566425 main.go:141] libmachine: (addons-874655) Setting executable bit set on /home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655 (perms=drwx------)
I0116 01:56:14.040946 566425 main.go:141] libmachine: (addons-874655) Setting executable bit set on /home/jenkins/minikube-integration/17967-558382/.minikube/machines (perms=drwxr-xr-x)
I0116 01:56:14.040957 566425 main.go:141] libmachine: (addons-874655) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17967-558382/.minikube/machines
I0116 01:56:14.040968 566425 main.go:141] libmachine: (addons-874655) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17967-558382/.minikube
I0116 01:56:14.040975 566425 main.go:141] libmachine: (addons-874655) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17967-558382
I0116 01:56:14.040984 566425 main.go:141] libmachine: (addons-874655) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0116 01:56:14.040994 566425 main.go:141] libmachine: (addons-874655) DBG | Checking permissions on dir: /home/jenkins
I0116 01:56:14.041002 566425 main.go:141] libmachine: (addons-874655) Setting executable bit set on /home/jenkins/minikube-integration/17967-558382/.minikube (perms=drwxr-xr-x)
I0116 01:56:14.041014 566425 main.go:141] libmachine: (addons-874655) Setting executable bit set on /home/jenkins/minikube-integration/17967-558382 (perms=drwxrwxr-x)
I0116 01:56:14.041028 566425 main.go:141] libmachine: (addons-874655) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0116 01:56:14.041034 566425 main.go:141] libmachine: (addons-874655) DBG | Checking permissions on dir: /home
I0116 01:56:14.041043 566425 main.go:141] libmachine: (addons-874655) DBG | Skipping /home - not owner
I0116 01:56:14.041051 566425 main.go:141] libmachine: (addons-874655) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0116 01:56:14.041057 566425 main.go:141] libmachine: (addons-874655) Creating domain...
I0116 01:56:14.042541 566425 main.go:141] libmachine: (addons-874655) define libvirt domain using xml:
I0116 01:56:14.042575 566425 main.go:141] libmachine: (addons-874655) <domain type='kvm'>
I0116 01:56:14.042583 566425 main.go:141] libmachine: (addons-874655) <name>addons-874655</name>
I0116 01:56:14.042592 566425 main.go:141] libmachine: (addons-874655) <memory unit='MiB'>4000</memory>
I0116 01:56:14.042598 566425 main.go:141] libmachine: (addons-874655) <vcpu>2</vcpu>
I0116 01:56:14.042603 566425 main.go:141] libmachine: (addons-874655) <features>
I0116 01:56:14.042609 566425 main.go:141] libmachine: (addons-874655) <acpi/>
I0116 01:56:14.042614 566425 main.go:141] libmachine: (addons-874655) <apic/>
I0116 01:56:14.042620 566425 main.go:141] libmachine: (addons-874655) <pae/>
I0116 01:56:14.042631 566425 main.go:141] libmachine: (addons-874655)
I0116 01:56:14.042641 566425 main.go:141] libmachine: (addons-874655) </features>
I0116 01:56:14.042651 566425 main.go:141] libmachine: (addons-874655) <cpu mode='host-passthrough'>
I0116 01:56:14.042663 566425 main.go:141] libmachine: (addons-874655)
I0116 01:56:14.042669 566425 main.go:141] libmachine: (addons-874655) </cpu>
I0116 01:56:14.042721 566425 main.go:141] libmachine: (addons-874655) <os>
I0116 01:56:14.042766 566425 main.go:141] libmachine: (addons-874655) <type>hvm</type>
I0116 01:56:14.042855 566425 main.go:141] libmachine: (addons-874655) <boot dev='cdrom'/>
I0116 01:56:14.042878 566425 main.go:141] libmachine: (addons-874655) <boot dev='hd'/>
I0116 01:56:14.042888 566425 main.go:141] libmachine: (addons-874655) <bootmenu enable='no'/>
I0116 01:56:14.042958 566425 main.go:141] libmachine: (addons-874655) </os>
I0116 01:56:14.042985 566425 main.go:141] libmachine: (addons-874655) <devices>
I0116 01:56:14.042997 566425 main.go:141] libmachine: (addons-874655) <disk type='file' device='cdrom'>
I0116 01:56:14.043012 566425 main.go:141] libmachine: (addons-874655) <source file='/home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/boot2docker.iso'/>
I0116 01:56:14.043023 566425 main.go:141] libmachine: (addons-874655) <target dev='hdc' bus='scsi'/>
I0116 01:56:14.043029 566425 main.go:141] libmachine: (addons-874655) <readonly/>
I0116 01:56:14.043035 566425 main.go:141] libmachine: (addons-874655) </disk>
I0116 01:56:14.043044 566425 main.go:141] libmachine: (addons-874655) <disk type='file' device='disk'>
I0116 01:56:14.043052 566425 main.go:141] libmachine: (addons-874655) <driver name='qemu' type='raw' cache='default' io='threads' />
I0116 01:56:14.043062 566425 main.go:141] libmachine: (addons-874655) <source file='/home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/addons-874655.rawdisk'/>
I0116 01:56:14.043070 566425 main.go:141] libmachine: (addons-874655) <target dev='hda' bus='virtio'/>
I0116 01:56:14.043076 566425 main.go:141] libmachine: (addons-874655) </disk>
I0116 01:56:14.043087 566425 main.go:141] libmachine: (addons-874655) <interface type='network'>
I0116 01:56:14.043096 566425 main.go:141] libmachine: (addons-874655) <source network='mk-addons-874655'/>
I0116 01:56:14.043102 566425 main.go:141] libmachine: (addons-874655) <model type='virtio'/>
I0116 01:56:14.043109 566425 main.go:141] libmachine: (addons-874655) </interface>
I0116 01:56:14.043116 566425 main.go:141] libmachine: (addons-874655) <interface type='network'>
I0116 01:56:14.043122 566425 main.go:141] libmachine: (addons-874655) <source network='default'/>
I0116 01:56:14.043130 566425 main.go:141] libmachine: (addons-874655) <model type='virtio'/>
I0116 01:56:14.043135 566425 main.go:141] libmachine: (addons-874655) </interface>
I0116 01:56:14.043140 566425 main.go:141] libmachine: (addons-874655) <serial type='pty'>
I0116 01:56:14.043146 566425 main.go:141] libmachine: (addons-874655) <target port='0'/>
I0116 01:56:14.043151 566425 main.go:141] libmachine: (addons-874655) </serial>
I0116 01:56:14.043157 566425 main.go:141] libmachine: (addons-874655) <console type='pty'>
I0116 01:56:14.043162 566425 main.go:141] libmachine: (addons-874655) <target type='serial' port='0'/>
I0116 01:56:14.043168 566425 main.go:141] libmachine: (addons-874655) </console>
I0116 01:56:14.043174 566425 main.go:141] libmachine: (addons-874655) <rng model='virtio'>
I0116 01:56:14.043181 566425 main.go:141] libmachine: (addons-874655) <backend model='random'>/dev/random</backend>
I0116 01:56:14.043186 566425 main.go:141] libmachine: (addons-874655) </rng>
I0116 01:56:14.043191 566425 main.go:141] libmachine: (addons-874655)
I0116 01:56:14.043200 566425 main.go:141] libmachine: (addons-874655)
I0116 01:56:14.043215 566425 main.go:141] libmachine: (addons-874655) </devices>
I0116 01:56:14.043226 566425 main.go:141] libmachine: (addons-874655) </domain>
I0116 01:56:14.043236 566425 main.go:141] libmachine: (addons-874655)
I0116 01:56:14.049639 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:ca:2d:41 in network default
I0116 01:56:14.050388 566425 main.go:141] libmachine: (addons-874655) Ensuring networks are active...
I0116 01:56:14.050425 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:14.051190 566425 main.go:141] libmachine: (addons-874655) Ensuring network default is active
I0116 01:56:14.051539 566425 main.go:141] libmachine: (addons-874655) Ensuring network mk-addons-874655 is active
I0116 01:56:14.052732 566425 main.go:141] libmachine: (addons-874655) Getting domain xml...
I0116 01:56:14.053649 566425 main.go:141] libmachine: (addons-874655) Creating domain...
I0116 01:56:15.468883 566425 main.go:141] libmachine: (addons-874655) Waiting to get IP...
I0116 01:56:15.469662 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:15.470350 566425 main.go:141] libmachine: (addons-874655) DBG | unable to find current IP address of domain addons-874655 in network mk-addons-874655
I0116 01:56:15.470433 566425 main.go:141] libmachine: (addons-874655) DBG | I0116 01:56:15.470226 566447 retry.go:31] will retry after 201.592692ms: waiting for machine to come up
I0116 01:56:15.673965 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:15.674459 566425 main.go:141] libmachine: (addons-874655) DBG | unable to find current IP address of domain addons-874655 in network mk-addons-874655
I0116 01:56:15.674504 566425 main.go:141] libmachine: (addons-874655) DBG | I0116 01:56:15.674402 566447 retry.go:31] will retry after 318.533962ms: waiting for machine to come up
I0116 01:56:15.994773 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:15.995206 566425 main.go:141] libmachine: (addons-874655) DBG | unable to find current IP address of domain addons-874655 in network mk-addons-874655
I0116 01:56:15.995240 566425 main.go:141] libmachine: (addons-874655) DBG | I0116 01:56:15.995064 566447 retry.go:31] will retry after 357.642173ms: waiting for machine to come up
I0116 01:56:16.354496 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:16.354919 566425 main.go:141] libmachine: (addons-874655) DBG | unable to find current IP address of domain addons-874655 in network mk-addons-874655
I0116 01:56:16.354944 566425 main.go:141] libmachine: (addons-874655) DBG | I0116 01:56:16.354884 566447 retry.go:31] will retry after 540.471927ms: waiting for machine to come up
I0116 01:56:16.896607 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:16.897026 566425 main.go:141] libmachine: (addons-874655) DBG | unable to find current IP address of domain addons-874655 in network mk-addons-874655
I0116 01:56:16.897085 566425 main.go:141] libmachine: (addons-874655) DBG | I0116 01:56:16.896928 566447 retry.go:31] will retry after 516.648656ms: waiting for machine to come up
I0116 01:56:17.415527 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:17.416020 566425 main.go:141] libmachine: (addons-874655) DBG | unable to find current IP address of domain addons-874655 in network mk-addons-874655
I0116 01:56:17.416053 566425 main.go:141] libmachine: (addons-874655) DBG | I0116 01:56:17.415970 566447 retry.go:31] will retry after 752.357803ms: waiting for machine to come up
I0116 01:56:18.169953 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:18.170386 566425 main.go:141] libmachine: (addons-874655) DBG | unable to find current IP address of domain addons-874655 in network mk-addons-874655
I0116 01:56:18.170415 566425 main.go:141] libmachine: (addons-874655) DBG | I0116 01:56:18.170340 566447 retry.go:31] will retry after 1.025821607s: waiting for machine to come up
I0116 01:56:19.197960 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:19.198424 566425 main.go:141] libmachine: (addons-874655) DBG | unable to find current IP address of domain addons-874655 in network mk-addons-874655
I0116 01:56:19.198456 566425 main.go:141] libmachine: (addons-874655) DBG | I0116 01:56:19.198331 566447 retry.go:31] will retry after 1.395022217s: waiting for machine to come up
I0116 01:56:20.594874 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:20.595429 566425 main.go:141] libmachine: (addons-874655) DBG | unable to find current IP address of domain addons-874655 in network mk-addons-874655
I0116 01:56:20.595458 566425 main.go:141] libmachine: (addons-874655) DBG | I0116 01:56:20.595388 566447 retry.go:31] will retry after 1.762310198s: waiting for machine to come up
I0116 01:56:22.360658 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:22.361091 566425 main.go:141] libmachine: (addons-874655) DBG | unable to find current IP address of domain addons-874655 in network mk-addons-874655
I0116 01:56:22.361124 566425 main.go:141] libmachine: (addons-874655) DBG | I0116 01:56:22.361040 566447 retry.go:31] will retry after 1.67444468s: waiting for machine to come up
I0116 01:56:24.037818 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:24.038267 566425 main.go:141] libmachine: (addons-874655) DBG | unable to find current IP address of domain addons-874655 in network mk-addons-874655
I0116 01:56:24.038302 566425 main.go:141] libmachine: (addons-874655) DBG | I0116 01:56:24.038240 566447 retry.go:31] will retry after 2.30436737s: waiting for machine to come up
I0116 01:56:26.345279 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:26.345813 566425 main.go:141] libmachine: (addons-874655) DBG | unable to find current IP address of domain addons-874655 in network mk-addons-874655
I0116 01:56:26.345843 566425 main.go:141] libmachine: (addons-874655) DBG | I0116 01:56:26.345733 566447 retry.go:31] will retry after 3.61922858s: waiting for machine to come up
I0116 01:56:29.967283 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:29.967846 566425 main.go:141] libmachine: (addons-874655) DBG | unable to find current IP address of domain addons-874655 in network mk-addons-874655
I0116 01:56:29.967872 566425 main.go:141] libmachine: (addons-874655) DBG | I0116 01:56:29.967819 566447 retry.go:31] will retry after 3.436951748s: waiting for machine to come up
I0116 01:56:33.406531 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:33.406979 566425 main.go:141] libmachine: (addons-874655) DBG | unable to find current IP address of domain addons-874655 in network mk-addons-874655
I0116 01:56:33.407005 566425 main.go:141] libmachine: (addons-874655) DBG | I0116 01:56:33.406918 566447 retry.go:31] will retry after 4.528742746s: waiting for machine to come up
I0116 01:56:37.941743 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:37.942315 566425 main.go:141] libmachine: (addons-874655) Found IP for machine: 192.168.39.252
I0116 01:56:37.942351 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has current primary IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:37.942360 566425 main.go:141] libmachine: (addons-874655) Reserving static IP address...
I0116 01:56:37.942767 566425 main.go:141] libmachine: (addons-874655) DBG | unable to find host DHCP lease matching {name: "addons-874655", mac: "52:54:00:1d:f8:62", ip: "192.168.39.252"} in network mk-addons-874655
I0116 01:56:38.022371 566425 main.go:141] libmachine: (addons-874655) DBG | Getting to WaitForSSH function...
I0116 01:56:38.022406 566425 main.go:141] libmachine: (addons-874655) Reserved static IP address: 192.168.39.252
I0116 01:56:38.022422 566425 main.go:141] libmachine: (addons-874655) Waiting for SSH to be available...
I0116 01:56:38.025414 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:38.025775 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:minikube Clientid:01:52:54:00:1d:f8:62}
I0116 01:56:38.025811 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:38.025924 566425 main.go:141] libmachine: (addons-874655) DBG | Using SSH client type: external
I0116 01:56:38.025958 566425 main.go:141] libmachine: (addons-874655) DBG | Using SSH private key: /home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/id_rsa (-rw-------)
I0116 01:56:38.025999 566425 main.go:141] libmachine: (addons-874655) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.252 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/id_rsa -p 22] /usr/bin/ssh <nil>}
I0116 01:56:38.026021 566425 main.go:141] libmachine: (addons-874655) DBG | About to run SSH command:
I0116 01:56:38.026035 566425 main.go:141] libmachine: (addons-874655) DBG | exit 0
I0116 01:56:38.119838 566425 main.go:141] libmachine: (addons-874655) DBG | SSH cmd err, output: <nil>:
I0116 01:56:38.120177 566425 main.go:141] libmachine: (addons-874655) KVM machine creation complete!
I0116 01:56:38.120454 566425 main.go:141] libmachine: (addons-874655) Calling .GetConfigRaw
I0116 01:56:38.121019 566425 main.go:141] libmachine: (addons-874655) Calling .DriverName
I0116 01:56:38.121217 566425 main.go:141] libmachine: (addons-874655) Calling .DriverName
I0116 01:56:38.121385 566425 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0116 01:56:38.121399 566425 main.go:141] libmachine: (addons-874655) Calling .GetState
I0116 01:56:38.122632 566425 main.go:141] libmachine: Detecting operating system of created instance...
I0116 01:56:38.122648 566425 main.go:141] libmachine: Waiting for SSH to be available...
I0116 01:56:38.122654 566425 main.go:141] libmachine: Getting to WaitForSSH function...
I0116 01:56:38.122661 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:56:38.124967 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:38.125306 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:56:38.125336 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:38.125456 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHPort
I0116 01:56:38.125665 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:56:38.125849 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:56:38.125998 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHUsername
I0116 01:56:38.126182 566425 main.go:141] libmachine: Using SSH client type: native
I0116 01:56:38.126589 566425 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a8e0] 0x80d5c0 <nil> [] 0s} 192.168.39.252 22 <nil> <nil>}
I0116 01:56:38.126602 566425 main.go:141] libmachine: About to run SSH command:
exit 0
I0116 01:56:38.247109 566425 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0116 01:56:38.247140 566425 main.go:141] libmachine: Detecting the provisioner...
I0116 01:56:38.247154 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:56:38.250074 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:38.250519 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:56:38.250550 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:38.250729 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHPort
I0116 01:56:38.250981 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:56:38.251237 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:56:38.251421 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHUsername
I0116 01:56:38.251675 566425 main.go:141] libmachine: Using SSH client type: native
I0116 01:56:38.252132 566425 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a8e0] 0x80d5c0 <nil> [] 0s} 192.168.39.252 22 <nil> <nil>}
I0116 01:56:38.252155 566425 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0116 01:56:38.376963 566425 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2021.02.12-1-g19d536a-dirty
ID=buildroot
VERSION_ID=2021.02.12
PRETTY_NAME="Buildroot 2021.02.12"
I0116 01:56:38.377035 566425 main.go:141] libmachine: found compatible host: buildroot
I0116 01:56:38.377043 566425 main.go:141] libmachine: Provisioning with buildroot...
I0116 01:56:38.377052 566425 main.go:141] libmachine: (addons-874655) Calling .GetMachineName
I0116 01:56:38.377350 566425 buildroot.go:166] provisioning hostname "addons-874655"
I0116 01:56:38.377391 566425 main.go:141] libmachine: (addons-874655) Calling .GetMachineName
I0116 01:56:38.377614 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:56:38.380335 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:38.380673 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:56:38.380702 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:38.380907 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHPort
I0116 01:56:38.381134 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:56:38.381345 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:56:38.381483 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHUsername
I0116 01:56:38.381679 566425 main.go:141] libmachine: Using SSH client type: native
I0116 01:56:38.381997 566425 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a8e0] 0x80d5c0 <nil> [] 0s} 192.168.39.252 22 <nil> <nil>}
I0116 01:56:38.382011 566425 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-874655 && echo "addons-874655" | sudo tee /etc/hostname
I0116 01:56:38.516426 566425 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-874655
I0116 01:56:38.516469 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:56:38.519121 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:38.519498 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:56:38.519528 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:38.519749 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHPort
I0116 01:56:38.519972 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:56:38.520118 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:56:38.520306 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHUsername
I0116 01:56:38.520497 566425 main.go:141] libmachine: Using SSH client type: native
I0116 01:56:38.520975 566425 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a8e0] 0x80d5c0 <nil> [] 0s} 192.168.39.252 22 <nil> <nil>}
I0116 01:56:38.520999 566425 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-874655' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-874655/g' /etc/hosts;
else
echo '127.0.1.1 addons-874655' | sudo tee -a /etc/hosts;
fi
fi
I0116 01:56:38.651740 566425 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0116 01:56:38.651776 566425 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17967-558382/.minikube CaCertPath:/home/jenkins/minikube-integration/17967-558382/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17967-558382/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17967-558382/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17967-558382/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17967-558382/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17967-558382/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17967-558382/.minikube}
I0116 01:56:38.651816 566425 buildroot.go:174] setting up certificates
I0116 01:56:38.651833 566425 provision.go:83] configureAuth start
I0116 01:56:38.651849 566425 main.go:141] libmachine: (addons-874655) Calling .GetMachineName
I0116 01:56:38.652186 566425 main.go:141] libmachine: (addons-874655) Calling .GetIP
I0116 01:56:38.654656 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:38.655226 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:56:38.655251 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:38.655463 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:56:38.657848 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:38.658284 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:56:38.658332 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:38.658448 566425 provision.go:138] copyHostCerts
I0116 01:56:38.658534 566425 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17967-558382/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17967-558382/.minikube/ca.pem (1082 bytes)
I0116 01:56:38.658674 566425 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17967-558382/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17967-558382/.minikube/cert.pem (1123 bytes)
I0116 01:56:38.658780 566425 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17967-558382/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17967-558382/.minikube/key.pem (1679 bytes)
I0116 01:56:38.658850 566425 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17967-558382/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17967-558382/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17967-558382/.minikube/certs/ca-key.pem org=jenkins.addons-874655 san=[192.168.39.252 192.168.39.252 localhost 127.0.0.1 minikube addons-874655]
I0116 01:56:38.888579 566425 provision.go:172] copyRemoteCerts
I0116 01:56:38.888658 566425 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0116 01:56:38.888700 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:56:38.891316 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:38.891636 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:56:38.891675 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:38.891871 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHPort
I0116 01:56:38.892124 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:56:38.892358 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHUsername
I0116 01:56:38.892565 566425 sshutil.go:53] new ssh client: &{IP:192.168.39.252 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/id_rsa Username:docker}
I0116 01:56:38.981068 566425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17967-558382/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)
I0116 01:56:39.003260 566425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17967-558382/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0116 01:56:39.024935 566425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17967-558382/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0116 01:56:39.046289 566425 provision.go:86] duration metric: configureAuth took 394.440321ms
I0116 01:56:39.046315 566425 buildroot.go:189] setting minikube options for container-runtime
I0116 01:56:39.046526 566425 config.go:182] Loaded profile config "addons-874655": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.28.4
I0116 01:56:39.046551 566425 main.go:141] libmachine: Checking connection to Docker...
I0116 01:56:39.046570 566425 main.go:141] libmachine: (addons-874655) Calling .GetURL
I0116 01:56:39.047884 566425 main.go:141] libmachine: (addons-874655) DBG | Using libvirt version 6000000
I0116 01:56:39.050114 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:39.050493 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:56:39.050526 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:39.050684 566425 main.go:141] libmachine: Docker is up and running!
I0116 01:56:39.050701 566425 main.go:141] libmachine: Reticulating splines...
I0116 01:56:39.050708 566425 client.go:171] LocalClient.Create took 25.847490612s
I0116 01:56:39.050730 566425 start.go:167] duration metric: libmachine.API.Create for "addons-874655" took 25.847570025s
I0116 01:56:39.050740 566425 start.go:300] post-start starting for "addons-874655" (driver="kvm2")
I0116 01:56:39.050750 566425 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0116 01:56:39.050768 566425 main.go:141] libmachine: (addons-874655) Calling .DriverName
I0116 01:56:39.051078 566425 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0116 01:56:39.051107 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:56:39.053486 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:39.053771 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:56:39.053806 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:39.053960 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHPort
I0116 01:56:39.054161 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:56:39.054340 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHUsername
I0116 01:56:39.054477 566425 sshutil.go:53] new ssh client: &{IP:192.168.39.252 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/id_rsa Username:docker}
I0116 01:56:39.145317 566425 ssh_runner.go:195] Run: cat /etc/os-release
I0116 01:56:39.149561 566425 info.go:137] Remote host: Buildroot 2021.02.12
I0116 01:56:39.149598 566425 filesync.go:126] Scanning /home/jenkins/minikube-integration/17967-558382/.minikube/addons for local assets ...
I0116 01:56:39.149709 566425 filesync.go:126] Scanning /home/jenkins/minikube-integration/17967-558382/.minikube/files for local assets ...
I0116 01:56:39.149741 566425 start.go:303] post-start completed in 98.99328ms
I0116 01:56:39.149792 566425 main.go:141] libmachine: (addons-874655) Calling .GetConfigRaw
I0116 01:56:39.150430 566425 main.go:141] libmachine: (addons-874655) Calling .GetIP
I0116 01:56:39.153330 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:39.153913 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:56:39.153948 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:39.154305 566425 profile.go:148] Saving config to /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/config.json ...
I0116 01:56:39.154493 566425 start.go:128] duration metric: createHost completed in 25.970921895s
I0116 01:56:39.154519 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:56:39.156733 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:39.157048 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:56:39.157077 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:39.157225 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHPort
I0116 01:56:39.157422 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:56:39.157627 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:56:39.157763 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHUsername
I0116 01:56:39.157885 566425 main.go:141] libmachine: Using SSH client type: native
I0116 01:56:39.158265 566425 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a8e0] 0x80d5c0 <nil> [] 0s} 192.168.39.252 22 <nil> <nil>}
I0116 01:56:39.158280 566425 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0116 01:56:39.280478 566425 main.go:141] libmachine: SSH cmd err, output: <nil>: 1705370199.252354803
I0116 01:56:39.280506 566425 fix.go:206] guest clock: 1705370199.252354803
I0116 01:56:39.280516 566425 fix.go:219] Guest: 2024-01-16 01:56:39.252354803 +0000 UTC Remote: 2024-01-16 01:56:39.154506136 +0000 UTC m=+26.093253077 (delta=97.848667ms)
I0116 01:56:39.280538 566425 fix.go:190] guest clock delta is within tolerance: 97.848667ms
I0116 01:56:39.280542 566425 start.go:83] releasing machines lock for "addons-874655", held for 26.097070993s
I0116 01:56:39.280583 566425 main.go:141] libmachine: (addons-874655) Calling .DriverName
I0116 01:56:39.280927 566425 main.go:141] libmachine: (addons-874655) Calling .GetIP
I0116 01:56:39.283679 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:39.284072 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:56:39.284102 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:39.284261 566425 main.go:141] libmachine: (addons-874655) Calling .DriverName
I0116 01:56:39.284813 566425 main.go:141] libmachine: (addons-874655) Calling .DriverName
I0116 01:56:39.285051 566425 main.go:141] libmachine: (addons-874655) Calling .DriverName
I0116 01:56:39.285157 566425 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0116 01:56:39.285237 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:56:39.285324 566425 ssh_runner.go:195] Run: cat /version.json
I0116 01:56:39.285348 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:56:39.287881 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:39.288198 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:56:39.288233 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:39.288255 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:39.288385 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHPort
I0116 01:56:39.288580 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:56:39.288787 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHUsername
I0116 01:56:39.288801 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:56:39.288852 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:39.288986 566425 sshutil.go:53] new ssh client: &{IP:192.168.39.252 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/id_rsa Username:docker}
I0116 01:56:39.289051 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHPort
I0116 01:56:39.289229 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:56:39.289354 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHUsername
I0116 01:56:39.289499 566425 sshutil.go:53] new ssh client: &{IP:192.168.39.252 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/id_rsa Username:docker}
I0116 01:56:39.424589 566425 ssh_runner.go:195] Run: systemctl --version
I0116 01:56:39.430181 566425 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0116 01:56:39.435380 566425 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0116 01:56:39.435476 566425 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0116 01:56:39.452265 566425 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0116 01:56:39.452292 566425 start.go:475] detecting cgroup driver to use...
I0116 01:56:39.452379 566425 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0116 01:56:39.485068 566425 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0116 01:56:39.497927 566425 docker.go:217] disabling cri-docker service (if available) ...
I0116 01:56:39.497998 566425 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0116 01:56:39.510552 566425 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0116 01:56:39.523710 566425 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0116 01:56:39.635220 566425 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0116 01:56:39.749607 566425 docker.go:233] disabling docker service ...
I0116 01:56:39.749687 566425 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0116 01:56:39.763065 566425 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0116 01:56:39.774630 566425 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0116 01:56:39.873196 566425 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0116 01:56:39.970822 566425 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0116 01:56:39.983958 566425 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0116 01:56:40.000424 566425 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0116 01:56:40.010125 566425 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0116 01:56:40.020091 566425 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0116 01:56:40.020178 566425 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0116 01:56:40.030095 566425 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0116 01:56:40.039929 566425 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0116 01:56:40.049852 566425 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0116 01:56:40.059811 566425 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0116 01:56:40.069818 566425 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0116 01:56:40.079868 566425 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0116 01:56:40.088593 566425 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0116 01:56:40.088684 566425 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0116 01:56:40.101468 566425 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0116 01:56:40.111918 566425 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0116 01:56:40.220912 566425 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0116 01:56:40.256857 566425 start.go:522] Will wait 60s for socket path /run/containerd/containerd.sock
I0116 01:56:40.256961 566425 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0116 01:56:40.263363 566425 retry.go:31] will retry after 928.016403ms: stat /run/containerd/containerd.sock: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/run/containerd/containerd.sock': No such file or directory
I0116 01:56:41.191580 566425 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0116 01:56:41.196776 566425 start.go:543] Will wait 60s for crictl version
I0116 01:56:41.196857 566425 ssh_runner.go:195] Run: which crictl
I0116 01:56:41.200296 566425 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0116 01:56:41.235650 566425 start.go:559] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: v1.7.11
RuntimeApiVersion: v1
I0116 01:56:41.235756 566425 ssh_runner.go:195] Run: containerd --version
I0116 01:56:41.268325 566425 ssh_runner.go:195] Run: containerd --version
I0116 01:56:41.296898 566425 out.go:177] * Preparing Kubernetes v1.28.4 on containerd 1.7.11 ...
I0116 01:56:41.298612 566425 main.go:141] libmachine: (addons-874655) Calling .GetIP
I0116 01:56:41.301638 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:41.302007 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:56:41.302040 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:56:41.302337 566425 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0116 01:56:41.306269 566425 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0116 01:56:41.317406 566425 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime containerd
I0116 01:56:41.317477 566425 ssh_runner.go:195] Run: sudo crictl images --output json
I0116 01:56:41.355158 566425 containerd.go:608] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.28.4". assuming images are not preloaded.
I0116 01:56:41.355248 566425 ssh_runner.go:195] Run: which lz4
I0116 01:56:41.359020 566425 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0116 01:56:41.363114 566425 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0116 01:56:41.363148 566425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17967-558382/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-containerd-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (457457495 bytes)
I0116 01:56:43.233886 566425 containerd.go:548] Took 1.874896 seconds to copy over tarball
I0116 01:56:43.233998 566425 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0116 01:56:46.238836 566425 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.004793714s)
I0116 01:56:46.238878 566425 containerd.go:555] Took 3.004954 seconds to extract the tarball
I0116 01:56:46.238889 566425 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0116 01:56:46.279305 566425 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0116 01:56:46.378521 566425 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0116 01:56:46.403084 566425 ssh_runner.go:195] Run: sudo crictl images --output json
I0116 01:56:46.437257 566425 retry.go:31] will retry after 176.798811ms: sudo crictl images --output json: Process exited with status 1
stdout:
stderr:
time="2024-01-16T01:56:46Z" level=fatal msg="validate service connection: validate CRI v1 image API for endpoint \"unix:///run/containerd/containerd.sock\": rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
I0116 01:56:46.614780 566425 ssh_runner.go:195] Run: sudo crictl images --output json
I0116 01:56:46.653939 566425 containerd.go:612] all images are preloaded for containerd runtime.
I0116 01:56:46.653970 566425 cache_images.go:84] Images are preloaded, skipping loading
I0116 01:56:46.654030 566425 ssh_runner.go:195] Run: sudo crictl info
I0116 01:56:46.690997 566425 cni.go:84] Creating CNI manager for ""
I0116 01:56:46.691027 566425 cni.go:146] "kvm2" driver + "containerd" runtime found, recommending bridge
I0116 01:56:46.691060 566425 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0116 01:56:46.691087 566425 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.252 APIServerPort:8443 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-874655 NodeName:addons-874655 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.252"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.252 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPat
h:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0116 01:56:46.691295 566425 kubeadm.go:181] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.252
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "addons-874655"
kubeletExtraArgs:
node-ip: 192.168.39.252
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.252"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0116 01:56:46.691399 566425 kubeadm.go:976] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=addons-874655 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.252
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:addons-874655 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0116 01:56:46.691464 566425 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0116 01:56:46.700105 566425 binaries.go:44] Found k8s binaries, skipping transfer
I0116 01:56:46.700238 566425 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0116 01:56:46.708664 566425 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (387 bytes)
I0116 01:56:46.724238 566425 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0116 01:56:46.739299 566425 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2108 bytes)
I0116 01:56:46.754963 566425 ssh_runner.go:195] Run: grep 192.168.39.252 control-plane.minikube.internal$ /etc/hosts
I0116 01:56:46.758501 566425 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.252 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0116 01:56:46.770289 566425 certs.go:56] Setting up /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655 for IP: 192.168.39.252
I0116 01:56:46.770326 566425 certs.go:190] acquiring lock for shared ca certs: {Name:mkd5f6d18d877a143c5bf0a00887ef68747376af Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0116 01:56:46.770488 566425 certs.go:204] generating minikubeCA CA: /home/jenkins/minikube-integration/17967-558382/.minikube/ca.key
I0116 01:56:46.877165 566425 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17967-558382/.minikube/ca.crt ...
I0116 01:56:46.877198 566425 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17967-558382/.minikube/ca.crt: {Name:mkf368e57f575898f8969205014eaebfd1b74c9c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0116 01:56:46.877406 566425 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17967-558382/.minikube/ca.key ...
I0116 01:56:46.877422 566425 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17967-558382/.minikube/ca.key: {Name:mk4af9679e009142a99d2ef93debf27a983ebb9f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0116 01:56:46.877522 566425 certs.go:204] generating proxyClientCA CA: /home/jenkins/minikube-integration/17967-558382/.minikube/proxy-client-ca.key
I0116 01:56:47.081990 566425 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17967-558382/.minikube/proxy-client-ca.crt ...
I0116 01:56:47.082033 566425 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17967-558382/.minikube/proxy-client-ca.crt: {Name:mkb6c2617688013e80fc30c044f1fe495eb79eb6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0116 01:56:47.082263 566425 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17967-558382/.minikube/proxy-client-ca.key ...
I0116 01:56:47.082279 566425 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17967-558382/.minikube/proxy-client-ca.key: {Name:mkf29702363e51cd1e1cbff1749a92aa3cd89a09 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0116 01:56:47.082410 566425 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/client.key
I0116 01:56:47.082430 566425 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/client.crt with IP's: []
I0116 01:56:47.186684 566425 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/client.crt ...
I0116 01:56:47.186721 566425 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/client.crt: {Name:mk126a0d706d461fdbd9ad57dd2b2b4c7fd784b0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0116 01:56:47.186938 566425 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/client.key ...
I0116 01:56:47.186953 566425 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/client.key: {Name:mk83561499bd776933d4223d95b1ad93b95d9168 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0116 01:56:47.187118 566425 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/apiserver.key.ba3365be
I0116 01:56:47.187147 566425 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/apiserver.crt.ba3365be with IP's: [192.168.39.252 10.96.0.1 127.0.0.1 10.0.0.1]
I0116 01:56:47.334282 566425 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/apiserver.crt.ba3365be ...
I0116 01:56:47.334318 566425 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/apiserver.crt.ba3365be: {Name:mk4fa90cabc495caeb33959a066eabc8d487a1c4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0116 01:56:47.334527 566425 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/apiserver.key.ba3365be ...
I0116 01:56:47.334548 566425 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/apiserver.key.ba3365be: {Name:mk8990f9583797e0de32fbbf9640bb76bb4f22c4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0116 01:56:47.334640 566425 certs.go:337] copying /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/apiserver.crt.ba3365be -> /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/apiserver.crt
I0116 01:56:47.334733 566425 certs.go:341] copying /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/apiserver.key.ba3365be -> /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/apiserver.key
I0116 01:56:47.334795 566425 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/proxy-client.key
I0116 01:56:47.334823 566425 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/proxy-client.crt with IP's: []
I0116 01:56:47.392395 566425 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/proxy-client.crt ...
I0116 01:56:47.392430 566425 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/proxy-client.crt: {Name:mk9a8dc3bafe2c0901a019d4307d955c4ab54e31 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0116 01:56:47.392633 566425 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/proxy-client.key ...
I0116 01:56:47.392651 566425 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/proxy-client.key: {Name:mkf8625bccdefa77422a750e6e5ecd0839b88377 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0116 01:56:47.392857 566425 certs.go:437] found cert: /home/jenkins/minikube-integration/17967-558382/.minikube/certs/home/jenkins/minikube-integration/17967-558382/.minikube/certs/ca-key.pem (1679 bytes)
I0116 01:56:47.392901 566425 certs.go:437] found cert: /home/jenkins/minikube-integration/17967-558382/.minikube/certs/home/jenkins/minikube-integration/17967-558382/.minikube/certs/ca.pem (1082 bytes)
I0116 01:56:47.392940 566425 certs.go:437] found cert: /home/jenkins/minikube-integration/17967-558382/.minikube/certs/home/jenkins/minikube-integration/17967-558382/.minikube/certs/cert.pem (1123 bytes)
I0116 01:56:47.392975 566425 certs.go:437] found cert: /home/jenkins/minikube-integration/17967-558382/.minikube/certs/home/jenkins/minikube-integration/17967-558382/.minikube/certs/key.pem (1679 bytes)
I0116 01:56:47.393804 566425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0116 01:56:47.417265 566425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0116 01:56:47.439630 566425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0116 01:56:47.464131 566425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17967-558382/.minikube/profiles/addons-874655/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0116 01:56:47.486564 566425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17967-558382/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0116 01:56:47.508450 566425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17967-558382/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0116 01:56:47.529718 566425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17967-558382/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0116 01:56:47.551244 566425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17967-558382/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0116 01:56:47.573224 566425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17967-558382/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0116 01:56:47.594203 566425 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0116 01:56:47.609800 566425 ssh_runner.go:195] Run: openssl version
I0116 01:56:47.615085 566425 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0116 01:56:47.626208 566425 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0116 01:56:47.630933 566425 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Jan 16 01:56 /usr/share/ca-certificates/minikubeCA.pem
I0116 01:56:47.631000 566425 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0116 01:56:47.636272 566425 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0116 01:56:47.646503 566425 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
I0116 01:56:47.650395 566425 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
stdout:
stderr:
ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
I0116 01:56:47.650454 566425 kubeadm.go:404] StartCluster: {Name:addons-874655 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1
.28.4 ClusterName:addons-874655 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.39.252 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mo
untOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0116 01:56:47.650546 566425 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0116 01:56:47.650610 566425 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0116 01:56:47.689812 566425 cri.go:89] found id: ""
I0116 01:56:47.689893 566425 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0116 01:56:47.699258 566425 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0116 01:56:47.709792 566425 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0116 01:56:47.720272 566425 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0116 01:56:47.720331 566425 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0116 01:56:47.782001 566425 kubeadm.go:322] [init] Using Kubernetes version: v1.28.4
I0116 01:56:47.782099 566425 kubeadm.go:322] [preflight] Running pre-flight checks
I0116 01:56:47.920021 566425 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0116 01:56:47.920190 566425 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0116 01:56:47.920364 566425 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0116 01:56:48.150541 566425 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0116 01:56:48.152556 566425 out.go:204] - Generating certificates and keys ...
I0116 01:56:48.152666 566425 kubeadm.go:322] [certs] Using existing ca certificate authority
I0116 01:56:48.152782 566425 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0116 01:56:48.251214 566425 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
I0116 01:56:48.344151 566425 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
I0116 01:56:48.432248 566425 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
I0116 01:56:48.548742 566425 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
I0116 01:56:49.021530 566425 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
I0116 01:56:49.021798 566425 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [addons-874655 localhost] and IPs [192.168.39.252 127.0.0.1 ::1]
I0116 01:56:49.193843 566425 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
I0116 01:56:49.194064 566425 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [addons-874655 localhost] and IPs [192.168.39.252 127.0.0.1 ::1]
I0116 01:56:49.251833 566425 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
I0116 01:56:49.371743 566425 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
I0116 01:56:49.847590 566425 kubeadm.go:322] [certs] Generating "sa" key and public key
I0116 01:56:49.847934 566425 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0116 01:56:50.060480 566425 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0116 01:56:50.185422 566425 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0116 01:56:50.289208 566425 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0116 01:56:50.531533 566425 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0116 01:56:50.534467 566425 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0116 01:56:50.537012 566425 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0116 01:56:50.539520 566425 out.go:204] - Booting up control plane ...
I0116 01:56:50.539666 566425 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0116 01:56:50.539843 566425 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0116 01:56:50.539963 566425 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0116 01:56:50.558682 566425 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0116 01:56:50.559205 566425 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0116 01:56:50.559256 566425 kubeadm.go:322] [kubelet-start] Starting the kubelet
I0116 01:56:50.670376 566425 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0116 01:56:58.168117 566425 kubeadm.go:322] [apiclient] All control plane components are healthy after 7.502819 seconds
I0116 01:56:58.168287 566425 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0116 01:56:58.188728 566425 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0116 01:56:58.717399 566425 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
I0116 01:56:58.717629 566425 kubeadm.go:322] [mark-control-plane] Marking the node addons-874655 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0116 01:56:59.235812 566425 kubeadm.go:322] [bootstrap-token] Using token: yqji53.y3kda63p4qc7fc5a
I0116 01:56:59.237593 566425 out.go:204] - Configuring RBAC rules ...
I0116 01:56:59.237741 566425 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0116 01:56:59.250730 566425 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0116 01:56:59.266336 566425 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0116 01:56:59.274670 566425 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0116 01:56:59.286743 566425 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0116 01:56:59.294397 566425 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0116 01:56:59.325638 566425 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0116 01:56:59.574057 566425 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
I0116 01:56:59.661548 566425 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
I0116 01:56:59.662509 566425 kubeadm.go:322]
I0116 01:56:59.662600 566425 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
I0116 01:56:59.662611 566425 kubeadm.go:322]
I0116 01:56:59.662721 566425 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
I0116 01:56:59.662742 566425 kubeadm.go:322]
I0116 01:56:59.662785 566425 kubeadm.go:322] mkdir -p $HOME/.kube
I0116 01:56:59.662878 566425 kubeadm.go:322] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0116 01:56:59.662959 566425 kubeadm.go:322] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0116 01:56:59.662977 566425 kubeadm.go:322]
I0116 01:56:59.663061 566425 kubeadm.go:322] Alternatively, if you are the root user, you can run:
I0116 01:56:59.663069 566425 kubeadm.go:322]
I0116 01:56:59.663169 566425 kubeadm.go:322] export KUBECONFIG=/etc/kubernetes/admin.conf
I0116 01:56:59.663182 566425 kubeadm.go:322]
I0116 01:56:59.663258 566425 kubeadm.go:322] You should now deploy a pod network to the cluster.
I0116 01:56:59.663390 566425 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0116 01:56:59.663504 566425 kubeadm.go:322] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0116 01:56:59.663518 566425 kubeadm.go:322]
I0116 01:56:59.663617 566425 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
I0116 01:56:59.663713 566425 kubeadm.go:322] and service account keys on each node and then running the following as root:
I0116 01:56:59.663726 566425 kubeadm.go:322]
I0116 01:56:59.663849 566425 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token yqji53.y3kda63p4qc7fc5a \
I0116 01:56:59.663996 566425 kubeadm.go:322] --discovery-token-ca-cert-hash sha256:6deb26cf1c8e93f46cffe84eac2a224fc772129145a893fb804d73d35459ad94 \
I0116 01:56:59.664029 566425 kubeadm.go:322] --control-plane
I0116 01:56:59.664038 566425 kubeadm.go:322]
I0116 01:56:59.664166 566425 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
I0116 01:56:59.664176 566425 kubeadm.go:322]
I0116 01:56:59.664282 566425 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token yqji53.y3kda63p4qc7fc5a \
I0116 01:56:59.664452 566425 kubeadm.go:322] --discovery-token-ca-cert-hash sha256:6deb26cf1c8e93f46cffe84eac2a224fc772129145a893fb804d73d35459ad94
I0116 01:56:59.664540 566425 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0116 01:56:59.664597 566425 cni.go:84] Creating CNI manager for ""
I0116 01:56:59.664621 566425 cni.go:146] "kvm2" driver + "containerd" runtime found, recommending bridge
I0116 01:56:59.666509 566425 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0116 01:56:59.668243 566425 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0116 01:56:59.686243 566425 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0116 01:56:59.720425 566425 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0116 01:56:59.720546 566425 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0116 01:56:59.720558 566425 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl label nodes minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=880ec6d67bbc7fe8882aaa6543d5a07427c973fd minikube.k8s.io/name=addons-874655 minikube.k8s.io/updated_at=2024_01_16T01_56_59_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
I0116 01:57:00.108772 566425 ops.go:34] apiserver oom_adj: -16
I0116 01:57:00.108937 566425 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0116 01:57:00.609645 566425 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0116 01:57:01.109445 566425 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0116 01:57:01.609479 566425 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0116 01:57:02.109901 566425 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0116 01:57:02.609062 566425 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0116 01:57:03.109585 566425 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0116 01:57:03.609080 566425 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0116 01:57:04.110018 566425 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0116 01:57:04.609961 566425 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0116 01:57:05.109635 566425 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0116 01:57:05.609042 566425 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0116 01:57:06.109046 566425 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0116 01:57:06.610067 566425 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0116 01:57:07.108983 566425 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0116 01:57:07.609382 566425 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0116 01:57:08.109788 566425 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0116 01:57:08.609649 566425 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0116 01:57:09.108972 566425 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0116 01:57:09.609081 566425 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0116 01:57:10.109964 566425 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0116 01:57:10.609796 566425 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0116 01:57:11.109236 566425 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0116 01:57:11.609980 566425 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0116 01:57:11.782613 566425 kubeadm.go:1088] duration metric: took 12.06214857s to wait for elevateKubeSystemPrivileges.
I0116 01:57:11.782656 566425 kubeadm.go:406] StartCluster complete in 24.132207679s
I0116 01:57:11.782685 566425 settings.go:142] acquiring lock: {Name:mka056fd32f5453b3627898f8ccef9df55e46f8c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0116 01:57:11.782854 566425 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17967-558382/kubeconfig
I0116 01:57:11.783299 566425 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17967-558382/kubeconfig: {Name:mk589f590988c4dd25f7ecb91c9a410006fe00fe Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0116 01:57:11.783501 566425 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0116 01:57:11.783671 566425 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:true inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volumesnapshots:true yakd:true]
I0116 01:57:11.783773 566425 config.go:182] Loaded profile config "addons-874655": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.28.4
I0116 01:57:11.783813 566425 addons.go:69] Setting yakd=true in profile "addons-874655"
I0116 01:57:11.783828 566425 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-874655"
I0116 01:57:11.783843 566425 addons.go:69] Setting default-storageclass=true in profile "addons-874655"
I0116 01:57:11.783863 566425 addons.go:69] Setting registry=true in profile "addons-874655"
I0116 01:57:11.783872 566425 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-874655"
I0116 01:57:11.783882 566425 addons.go:69] Setting volumesnapshots=true in profile "addons-874655"
I0116 01:57:11.783878 566425 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-874655"
I0116 01:57:11.783892 566425 addons.go:234] Setting addon volumesnapshots=true in "addons-874655"
I0116 01:57:11.783905 566425 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-874655"
I0116 01:57:11.783903 566425 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-874655"
I0116 01:57:11.783920 566425 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-874655"
I0116 01:57:11.783927 566425 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-874655"
I0116 01:57:11.783966 566425 host.go:66] Checking if "addons-874655" exists ...
I0116 01:57:11.783967 566425 host.go:66] Checking if "addons-874655" exists ...
I0116 01:57:11.783977 566425 addons.go:69] Setting ingress=true in profile "addons-874655"
I0116 01:57:11.783988 566425 addons.go:234] Setting addon ingress=true in "addons-874655"
I0116 01:57:11.784026 566425 host.go:66] Checking if "addons-874655" exists ...
I0116 01:57:11.784282 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.784315 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.784365 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.784366 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.783850 566425 addons.go:69] Setting helm-tiller=true in profile "addons-874655"
I0116 01:57:11.784381 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.784387 566425 addons.go:234] Setting addon helm-tiller=true in "addons-874655"
I0116 01:57:11.784399 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.784404 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.784409 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.784419 566425 host.go:66] Checking if "addons-874655" exists ...
I0116 01:57:11.784468 566425 addons.go:69] Setting ingress-dns=true in profile "addons-874655"
I0116 01:57:11.784480 566425 addons.go:234] Setting addon ingress-dns=true in "addons-874655"
I0116 01:57:11.784525 566425 addons.go:69] Setting inspektor-gadget=true in profile "addons-874655"
I0116 01:57:11.784533 566425 addons.go:234] Setting addon inspektor-gadget=true in "addons-874655"
I0116 01:57:11.784536 566425 host.go:66] Checking if "addons-874655" exists ...
I0116 01:57:11.784543 566425 addons.go:69] Setting metrics-server=true in profile "addons-874655"
I0116 01:57:11.784552 566425 addons.go:234] Setting addon metrics-server=true in "addons-874655"
I0116 01:57:11.783841 566425 addons.go:234] Setting addon yakd=true in "addons-874655"
I0116 01:57:11.784674 566425 addons.go:69] Setting cloud-spanner=true in profile "addons-874655"
I0116 01:57:11.784370 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.784710 566425 addons.go:69] Setting storage-provisioner=true in profile "addons-874655"
I0116 01:57:11.784721 566425 addons.go:234] Setting addon storage-provisioner=true in "addons-874655"
I0116 01:57:11.783967 566425 host.go:66] Checking if "addons-874655" exists ...
I0116 01:57:11.783875 566425 addons.go:234] Setting addon registry=true in "addons-874655"
I0116 01:57:11.784740 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.783808 566425 addons.go:69] Setting gcp-auth=true in profile "addons-874655"
I0116 01:57:11.784698 566425 addons.go:234] Setting addon cloud-spanner=true in "addons-874655"
I0116 01:57:11.784855 566425 mustload.go:65] Loading cluster: addons-874655
I0116 01:57:11.784910 566425 host.go:66] Checking if "addons-874655" exists ...
I0116 01:57:11.784908 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.784948 566425 host.go:66] Checking if "addons-874655" exists ...
I0116 01:57:11.784968 566425 host.go:66] Checking if "addons-874655" exists ...
I0116 01:57:11.785020 566425 host.go:66] Checking if "addons-874655" exists ...
I0116 01:57:11.785070 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.785104 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.785175 566425 config.go:182] Loaded profile config "addons-874655": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.28.4
I0116 01:57:11.785184 566425 host.go:66] Checking if "addons-874655" exists ...
I0116 01:57:11.785247 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.785280 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.784978 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.785395 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.785460 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.785394 566425 host.go:66] Checking if "addons-874655" exists ...
I0116 01:57:11.785627 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.785680 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.785742 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.785754 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.785765 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.785776 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.785790 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.785797 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.785829 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.785870 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.785905 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.785943 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.802604 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46135
I0116 01:57:11.803464 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.804200 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42169
I0116 01:57:11.804314 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.804337 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.804357 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35401
I0116 01:57:11.804478 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34945
I0116 01:57:11.804652 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.804763 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.804822 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.804976 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.805328 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.805362 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.805390 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.805440 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.805511 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.805529 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.805654 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.805671 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.805912 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.805936 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.806027 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.816158 566425 main.go:141] libmachine: (addons-874655) Calling .GetState
I0116 01:57:11.816193 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36695
I0116 01:57:11.816436 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.816486 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.816551 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.816584 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.817630 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.818494 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.818523 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.820356 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.823856 566425 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-874655"
I0116 01:57:11.823917 566425 host.go:66] Checking if "addons-874655" exists ...
I0116 01:57:11.824360 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.824399 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.828964 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.829011 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.837711 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42389
I0116 01:57:11.838635 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.839360 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.839385 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.840922 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.841585 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.841632 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.850107 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42541
I0116 01:57:11.850682 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.851496 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.851522 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.852190 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.852469 566425 main.go:141] libmachine: (addons-874655) Calling .GetState
I0116 01:57:11.853403 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33725
I0116 01:57:11.854279 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.854973 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.854998 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.855059 566425 host.go:66] Checking if "addons-874655" exists ...
I0116 01:57:11.855452 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.855492 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.855704 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45191
I0116 01:57:11.856448 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.856993 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.857091 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.857494 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.857645 566425 main.go:141] libmachine: (addons-874655) Calling .GetState
I0116 01:57:11.858271 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35515
I0116 01:57:11.858421 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44949
I0116 01:57:11.858464 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.859060 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.859535 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.859703 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.859781 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.860263 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.860283 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.860727 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.860885 566425 main.go:141] libmachine: (addons-874655) Calling .DriverName
I0116 01:57:11.860924 566425 main.go:141] libmachine: (addons-874655) Calling .GetState
I0116 01:57:11.861023 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.861045 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.863320 566425 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0116 01:57:11.861588 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.862157 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46865
I0116 01:57:11.862652 566425 main.go:141] libmachine: (addons-874655) Calling .DriverName
I0116 01:57:11.866884 566425 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0116 01:57:11.865861 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.866566 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.869780 566425 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0116 01:57:11.868528 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.868547 566425 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.14.3
I0116 01:57:11.870199 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32807
I0116 01:57:11.870922 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.871240 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.873155 566425 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0116 01:57:11.872060 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.872698 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.876744 566425 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0116 01:57:11.874909 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38785
I0116 01:57:11.875032 566425 addons.go:426] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0116 01:57:11.875133 566425 main.go:141] libmachine: (addons-874655) Calling .GetState
I0116 01:57:11.875599 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.878352 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.880354 566425 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0116 01:57:11.878554 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0116 01:57:11.879230 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.879908 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.880934 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43829
I0116 01:57:11.880969 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37609
I0116 01:57:11.881460 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45437
I0116 01:57:11.884359 566425 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0116 01:57:11.882451 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:57:11.882652 566425 addons.go:234] Setting addon default-storageclass=true in "addons-874655"
I0116 01:57:11.883401 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.883420 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.883441 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44673
I0116 01:57:11.883456 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.883470 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33849
I0116 01:57:11.883683 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37533
I0116 01:57:11.883978 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.884044 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.885047 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38631
I0116 01:57:11.885909 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.887839 566425 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0116 01:57:11.886108 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.886207 566425 host.go:66] Checking if "addons-874655" exists ...
I0116 01:57:11.887547 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.887908 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.889965 566425 addons.go:426] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0116 01:57:11.889993 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0116 01:57:11.890037 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:57:11.888287 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.887727 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.887754 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.890187 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.888307 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.887677 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.890271 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.888606 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.888823 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.890353 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.890663 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.890686 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.889114 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.889456 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.890826 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38049
I0116 01:57:11.890920 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.891381 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.891571 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.891588 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.891724 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.892056 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.892568 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.892592 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.892672 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.892696 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.893020 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.893074 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.893093 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.893116 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.893155 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.893188 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.893207 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.893238 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.893257 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.893278 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.893319 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.893801 566425 main.go:141] libmachine: (addons-874655) Calling .GetState
I0116 01:57:11.893875 566425 main.go:141] libmachine: (addons-874655) Calling .GetState
I0116 01:57:11.893879 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.893947 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.894348 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.894416 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.894793 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.894829 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.894932 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.894985 566425 main.go:141] libmachine: (addons-874655) Calling .GetState
I0116 01:57:11.895379 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:57:11.895401 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.895599 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHPort
I0116 01:57:11.895765 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:57:11.896023 566425 main.go:141] libmachine: (addons-874655) Calling .DriverName
I0116 01:57:11.896077 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHUsername
I0116 01:57:11.896409 566425 sshutil.go:53] new ssh client: &{IP:192.168.39.252 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/id_rsa Username:docker}
I0116 01:57:11.898107 566425 main.go:141] libmachine: (addons-874655) Calling .DriverName
I0116 01:57:11.898180 566425 main.go:141] libmachine: (addons-874655) Calling .DriverName
I0116 01:57:11.898235 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHPort
I0116 01:57:11.900379 566425 out.go:177] - Using image ghcr.io/helm/tiller:v2.17.0
I0116 01:57:11.899232 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:57:11.899327 566425 main.go:141] libmachine: (addons-874655) Calling .DriverName
I0116 01:57:11.899408 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:57:11.902320 566425 addons.go:426] installing /etc/kubernetes/addons/helm-tiller-dp.yaml
I0116 01:57:11.902656 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHUsername
I0116 01:57:11.903873 566425 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0116 01:57:11.905470 566425 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0116 01:57:11.905494 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0116 01:57:11.905551 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:57:11.903965 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-dp.yaml (2422 bytes)
I0116 01:57:11.905635 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:57:11.903980 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.904225 566425 sshutil.go:53] new ssh client: &{IP:192.168.39.252 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/id_rsa Username:docker}
I0116 01:57:11.907670 566425 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0116 01:57:11.909463 566425 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0116 01:57:11.909489 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0116 01:57:11.909529 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:57:11.909853 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.910422 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:57:11.910458 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.910715 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHPort
I0116 01:57:11.910952 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:57:11.911321 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHUsername
I0116 01:57:11.911561 566425 sshutil.go:53] new ssh client: &{IP:192.168.39.252 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/id_rsa Username:docker}
I0116 01:57:11.912213 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.912539 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:57:11.912563 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.912972 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHPort
I0116 01:57:11.913234 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:57:11.913493 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHUsername
I0116 01:57:11.913753 566425 sshutil.go:53] new ssh client: &{IP:192.168.39.252 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/id_rsa Username:docker}
I0116 01:57:11.915625 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.916132 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:57:11.916163 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.916393 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHPort
I0116 01:57:11.916628 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:57:11.916832 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHUsername
I0116 01:57:11.917026 566425 sshutil.go:53] new ssh client: &{IP:192.168.39.252 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/id_rsa Username:docker}
I0116 01:57:11.917688 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37993
I0116 01:57:11.918096 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.918620 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40399
I0116 01:57:11.918885 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.918901 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.919533 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43099
I0116 01:57:11.919755 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.920449 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.920475 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.920564 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.920619 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.920716 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43291
I0116 01:57:11.920964 566425 main.go:141] libmachine: (addons-874655) Calling .GetState
I0116 01:57:11.921771 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.921792 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.921834 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.922225 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37045
I0116 01:57:11.922570 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.922603 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.922620 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.922676 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.922935 566425 main.go:141] libmachine: (addons-874655) Calling .DriverName
I0116 01:57:11.923004 566425 main.go:141] libmachine: (addons-874655) Calling .GetState
I0116 01:57:11.923053 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.923085 566425 main.go:141] libmachine: (addons-874655) Calling .GetState
I0116 01:57:11.924940 566425 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.13
I0116 01:57:11.923523 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.923688 566425 main.go:141] libmachine: (addons-874655) Calling .GetState
I0116 01:57:11.925490 566425 main.go:141] libmachine: (addons-874655) Calling .DriverName
I0116 01:57:11.925527 566425 main.go:141] libmachine: (addons-874655) Calling .DriverName
I0116 01:57:11.926676 566425 addons.go:426] installing /etc/kubernetes/addons/deployment.yaml
I0116 01:57:11.926697 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0116 01:57:11.926717 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:57:11.928883 566425 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2
I0116 01:57:11.927856 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.929232 566425 main.go:141] libmachine: (addons-874655) Calling .DriverName
I0116 01:57:11.930048 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42447
I0116 01:57:11.930777 566425 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.9.5
I0116 01:57:11.930870 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.930730 566425 addons.go:426] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0116 01:57:11.930382 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.931310 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHPort
I0116 01:57:11.931481 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.932311 566425 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20231011-8b53cabe0
I0116 01:57:11.932332 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0116 01:57:11.932422 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:57:11.932828 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.933760 566425 out.go:177] - Using image docker.io/registry:2.8.3
I0116 01:57:11.933830 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:57:11.933858 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.934046 566425 main.go:141] libmachine: (addons-874655) Calling .GetState
I0116 01:57:11.934085 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:57:11.934408 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.935662 566425 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.5
I0116 01:57:11.937490 566425 addons.go:426] installing /etc/kubernetes/addons/registry-rc.yaml
I0116 01:57:11.939230 566425 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20231011-8b53cabe0
I0116 01:57:11.935878 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.936487 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHUsername
I0116 01:57:11.937060 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44261
I0116 01:57:11.937509 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (798 bytes)
I0116 01:57:11.939572 566425 main.go:141] libmachine: (addons-874655) Calling .DriverName
I0116 01:57:11.941181 566425 addons.go:426] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0116 01:57:11.941206 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16103 bytes)
I0116 01:57:11.941228 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:57:11.941425 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.941458 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:57:11.942343 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHPort
I0116 01:57:11.942349 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35609
I0116 01:57:11.942344 566425 sshutil.go:53] new ssh client: &{IP:192.168.39.252 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/id_rsa Username:docker}
I0116 01:57:11.942439 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:57:11.942462 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.942495 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.942750 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:57:11.942797 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.942898 566425 main.go:141] libmachine: (addons-874655) Calling .GetState
I0116 01:57:11.944525 566425 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.6.4
I0116 01:57:11.943406 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.943896 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.944095 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHUsername
I0116 01:57:11.945932 566425 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0116 01:57:11.945949 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0116 01:57:11.945971 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:57:11.946207 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.946302 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.946521 566425 sshutil.go:53] new ssh client: &{IP:192.168.39.252 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/id_rsa Username:docker}
I0116 01:57:11.946653 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.946717 566425 main.go:141] libmachine: (addons-874655) Calling .DriverName
I0116 01:57:11.947011 566425 main.go:141] libmachine: (addons-874655) Calling .GetState
I0116 01:57:11.948597 566425 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.23.1
I0116 01:57:11.950141 566425 addons.go:426] installing /etc/kubernetes/addons/ig-namespace.yaml
I0116 01:57:11.950158 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I0116 01:57:11.950177 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:57:11.947757 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.950225 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.950224 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.947785 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.947823 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39813
I0116 01:57:11.950282 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:57:11.950314 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.947832 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:57:11.950399 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.947999 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHPort
I0116 01:57:11.948252 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHPort
I0116 01:57:11.948980 566425 main.go:141] libmachine: (addons-874655) Calling .DriverName
I0116 01:57:11.951006 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.951054 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:57:11.951118 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:57:11.951117 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:57:11.951159 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.951179 566425 main.go:141] libmachine: (addons-874655) Calling .GetState
I0116 01:57:11.953030 566425 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.4
I0116 01:57:11.951490 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHUsername
I0116 01:57:11.951507 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHPort
I0116 01:57:11.951515 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHUsername
I0116 01:57:11.951836 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.953156 566425 main.go:141] libmachine: (addons-874655) Calling .DriverName
I0116 01:57:11.953780 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.954559 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:57:11.954581 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.954657 566425 addons.go:426] installing /etc/kubernetes/addons/yakd-ns.yaml
I0116 01:57:11.954672 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0116 01:57:11.954707 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:57:11.954342 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHPort
I0116 01:57:11.954949 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:57:11.954947 566425 sshutil.go:53] new ssh client: &{IP:192.168.39.252 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/id_rsa Username:docker}
I0116 01:57:11.956622 566425 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0116 01:57:11.955345 566425 sshutil.go:53] new ssh client: &{IP:192.168.39.252 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/id_rsa Username:docker}
I0116 01:57:11.955375 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:57:11.955384 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHUsername
I0116 01:57:11.956033 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.958105 566425 out.go:177] - Using image docker.io/busybox:stable
I0116 01:57:11.958120 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.959621 566425 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0116 01:57:11.958136 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.958352 566425 sshutil.go:53] new ssh client: &{IP:192.168.39.252 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/id_rsa Username:docker}
I0116 01:57:11.958382 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHUsername
I0116 01:57:11.958923 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHPort
I0116 01:57:11.959674 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0116 01:57:11.959689 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:57:11.959707 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:57:11.959713 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.960354 566425 sshutil.go:53] new ssh client: &{IP:192.168.39.252 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/id_rsa Username:docker}
I0116 01:57:11.960387 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:57:11.960363 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.960608 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHUsername
I0116 01:57:11.960783 566425 sshutil.go:53] new ssh client: &{IP:192.168.39.252 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/id_rsa Username:docker}
I0116 01:57:11.961979 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:11.962037 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:11.963174 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.963603 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:57:11.963626 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.963851 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHPort
I0116 01:57:11.964043 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:57:11.964202 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHUsername
I0116 01:57:11.964326 566425 sshutil.go:53] new ssh client: &{IP:192.168.39.252 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/id_rsa Username:docker}
I0116 01:57:11.979490 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36863
I0116 01:57:11.980211 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:11.980802 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:11.980832 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:11.981233 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:11.981498 566425 main.go:141] libmachine: (addons-874655) Calling .GetState
I0116 01:57:11.983444 566425 main.go:141] libmachine: (addons-874655) Calling .DriverName
I0116 01:57:11.983836 566425 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0116 01:57:11.983856 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0116 01:57:11.983876 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:57:11.987616 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.988118 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:57:11.988140 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:11.988333 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHPort
I0116 01:57:11.988562 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:57:11.988690 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHUsername
I0116 01:57:11.988858 566425 sshutil.go:53] new ssh client: &{IP:192.168.39.252 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/id_rsa Username:docker}
W0116 01:57:11.996533 566425 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 192.168.39.1:51404->192.168.39.252:22: read: connection reset by peer
I0116 01:57:11.996578 566425 retry.go:31] will retry after 129.526621ms: ssh: handshake failed: read tcp 192.168.39.1:51404->192.168.39.252:22: read: connection reset by peer
I0116 01:57:12.289201 566425 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-874655" context rescaled to 1 replicas
I0116 01:57:12.289266 566425 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.39.252 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0116 01:57:12.291474 566425 out.go:177] * Verifying Kubernetes components...
I0116 01:57:12.293399 566425 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0116 01:57:12.363707 566425 addons.go:426] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0116 01:57:12.363742 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0116 01:57:12.448511 566425 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.39.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0116 01:57:12.462114 566425 node_ready.go:35] waiting up to 6m0s for node "addons-874655" to be "Ready" ...
I0116 01:57:12.466945 566425 node_ready.go:49] node "addons-874655" has status "Ready":"True"
I0116 01:57:12.466973 566425 node_ready.go:38] duration metric: took 4.812851ms waiting for node "addons-874655" to be "Ready" ...
I0116 01:57:12.466984 566425 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0116 01:57:12.477659 566425 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-76kgl" in "kube-system" namespace to be "Ready" ...
I0116 01:57:12.565344 566425 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0116 01:57:12.599961 566425 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0116 01:57:12.611009 566425 addons.go:426] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I0116 01:57:12.611065 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I0116 01:57:12.621285 566425 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0116 01:57:12.695731 566425 addons.go:426] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0116 01:57:12.695759 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0116 01:57:12.734004 566425 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0116 01:57:12.750306 566425 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0116 01:57:12.753007 566425 addons.go:426] installing /etc/kubernetes/addons/yakd-sa.yaml
I0116 01:57:12.753035 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0116 01:57:12.756779 566425 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0116 01:57:12.768990 566425 addons.go:426] installing /etc/kubernetes/addons/ig-role.yaml
I0116 01:57:12.769023 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I0116 01:57:12.812891 566425 addons.go:426] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0116 01:57:12.812927 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0116 01:57:12.830447 566425 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0116 01:57:12.830478 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0116 01:57:12.838371 566425 addons.go:426] installing /etc/kubernetes/addons/helm-tiller-rbac.yaml
I0116 01:57:12.838404 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-rbac.yaml (1188 bytes)
I0116 01:57:12.859863 566425 addons.go:426] installing /etc/kubernetes/addons/registry-svc.yaml
I0116 01:57:12.859895 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0116 01:57:13.080664 566425 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0116 01:57:13.098254 566425 addons.go:426] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0116 01:57:13.098299 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0116 01:57:13.167083 566425 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0116 01:57:13.167113 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0116 01:57:13.183339 566425 addons.go:426] installing /etc/kubernetes/addons/yakd-crb.yaml
I0116 01:57:13.183370 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0116 01:57:13.202044 566425 addons.go:426] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I0116 01:57:13.202083 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I0116 01:57:13.253404 566425 addons.go:426] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0116 01:57:13.253443 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0116 01:57:13.405368 566425 addons.go:426] installing /etc/kubernetes/addons/helm-tiller-svc.yaml
I0116 01:57:13.405406 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-svc.yaml (951 bytes)
I0116 01:57:13.410432 566425 addons.go:426] installing /etc/kubernetes/addons/registry-proxy.yaml
I0116 01:57:13.410458 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0116 01:57:13.456631 566425 addons.go:426] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0116 01:57:13.456677 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0116 01:57:13.540236 566425 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0116 01:57:13.540278 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0116 01:57:13.581962 566425 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0116 01:57:13.614597 566425 addons.go:426] installing /etc/kubernetes/addons/yakd-svc.yaml
I0116 01:57:13.614633 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0116 01:57:13.639301 566425 addons.go:426] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I0116 01:57:13.639328 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I0116 01:57:13.676470 566425 addons.go:426] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0116 01:57:13.676498 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0116 01:57:13.681559 566425 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0116 01:57:13.690486 566425 addons.go:426] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0116 01:57:13.690517 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0116 01:57:13.693249 566425 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml
I0116 01:57:13.780001 566425 addons.go:426] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I0116 01:57:13.780038 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I0116 01:57:13.815240 566425 addons.go:426] installing /etc/kubernetes/addons/yakd-dp.yaml
I0116 01:57:13.815267 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0116 01:57:13.830368 566425 addons.go:426] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0116 01:57:13.830407 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0116 01:57:13.885282 566425 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0116 01:57:13.885319 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0116 01:57:14.011668 566425 pod_ready.go:97] pod "coredns-5dd5756b68-76kgl" in "kube-system" namespace has status phase "Failed" (skipping!): {Phase:Failed Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-01-16 01:57:11 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-01-16 01:57:11 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [coredns]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-01-16 01:57:11 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [coredns]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-01-16 01:57:11 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:192.168.39.252 HostIPs:[] PodIP: PodIPs:[] StartTime:2024-01-16 01:57:11 +0000 UTC InitContainerStatuses:[] ContainerS
tatuses:[{Name:coredns State:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:137,Signal:0,Reason:ContainerStatusUnknown,Message:The container could not be located when the pod was terminated,StartedAt:0001-01-01 00:00:00 +0000 UTC,FinishedAt:0001-01-01 00:00:00 +0000 UTC,ContainerID:,}} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:0 Image:registry.k8s.io/coredns/coredns:v1.10.1 ImageID: ContainerID: Started:0xc003f94b0a AllocatedResources:map[] Resources:nil}] QOSClass:Burstable EphemeralContainerStatuses:[] Resize: ResourceClaimStatuses:[]}
I0116 01:57:14.011715 566425 pod_ready.go:81] duration metric: took 1.534020057s waiting for pod "coredns-5dd5756b68-76kgl" in "kube-system" namespace to be "Ready" ...
E0116 01:57:14.011734 566425 pod_ready.go:66] WaitExtra: waitPodCondition: pod "coredns-5dd5756b68-76kgl" in "kube-system" namespace has status phase "Failed" (skipping!): {Phase:Failed Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-01-16 01:57:11 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-01-16 01:57:11 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [coredns]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-01-16 01:57:11 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [coredns]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-01-16 01:57:11 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:192.168.39.252 HostIPs:[] PodIP: PodIPs:[] StartTime:2024-01-16 01:57:11 +0000 UTC InitCo
ntainerStatuses:[] ContainerStatuses:[{Name:coredns State:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:137,Signal:0,Reason:ContainerStatusUnknown,Message:The container could not be located when the pod was terminated,StartedAt:0001-01-01 00:00:00 +0000 UTC,FinishedAt:0001-01-01 00:00:00 +0000 UTC,ContainerID:,}} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:0 Image:registry.k8s.io/coredns/coredns:v1.10.1 ImageID: ContainerID: Started:0xc003f94b0a AllocatedResources:map[] Resources:nil}] QOSClass:Burstable EphemeralContainerStatuses:[] Resize: ResourceClaimStatuses:[]}
I0116 01:57:14.011746 566425 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-jxfvn" in "kube-system" namespace to be "Ready" ...
I0116 01:57:14.064357 566425 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0116 01:57:14.073398 566425 addons.go:426] installing /etc/kubernetes/addons/ig-crd.yaml
I0116 01:57:14.073427 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I0116 01:57:14.377355 566425 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0116 01:57:14.377393 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0116 01:57:14.417143 566425 addons.go:426] installing /etc/kubernetes/addons/ig-daemonset.yaml
I0116 01:57:14.417174 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
I0116 01:57:14.452879 566425 addons.go:426] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0116 01:57:14.452905 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0116 01:57:14.479662 566425 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I0116 01:57:14.521426 566425 pod_ready.go:92] pod "coredns-5dd5756b68-jxfvn" in "kube-system" namespace has status "Ready":"True"
I0116 01:57:14.521472 566425 pod_ready.go:81] duration metric: took 509.714636ms waiting for pod "coredns-5dd5756b68-jxfvn" in "kube-system" namespace to be "Ready" ...
I0116 01:57:14.521490 566425 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-874655" in "kube-system" namespace to be "Ready" ...
I0116 01:57:14.535146 566425 pod_ready.go:92] pod "etcd-addons-874655" in "kube-system" namespace has status "Ready":"True"
I0116 01:57:14.535172 566425 pod_ready.go:81] duration metric: took 13.67339ms waiting for pod "etcd-addons-874655" in "kube-system" namespace to be "Ready" ...
I0116 01:57:14.535185 566425 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-874655" in "kube-system" namespace to be "Ready" ...
I0116 01:57:14.543492 566425 pod_ready.go:92] pod "kube-apiserver-addons-874655" in "kube-system" namespace has status "Ready":"True"
I0116 01:57:14.543521 566425 pod_ready.go:81] duration metric: took 8.327056ms waiting for pod "kube-apiserver-addons-874655" in "kube-system" namespace to be "Ready" ...
I0116 01:57:14.543534 566425 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-874655" in "kube-system" namespace to be "Ready" ...
I0116 01:57:14.553332 566425 pod_ready.go:92] pod "kube-controller-manager-addons-874655" in "kube-system" namespace has status "Ready":"True"
I0116 01:57:14.553356 566425 pod_ready.go:81] duration metric: took 9.814556ms waiting for pod "kube-controller-manager-addons-874655" in "kube-system" namespace to be "Ready" ...
I0116 01:57:14.553367 566425 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-8xv7c" in "kube-system" namespace to be "Ready" ...
I0116 01:57:14.670883 566425 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0116 01:57:14.687829 566425 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0116 01:57:14.687863 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0116 01:57:14.865931 566425 pod_ready.go:92] pod "kube-proxy-8xv7c" in "kube-system" namespace has status "Ready":"True"
I0116 01:57:14.865959 566425 pod_ready.go:81] duration metric: took 312.583419ms waiting for pod "kube-proxy-8xv7c" in "kube-system" namespace to be "Ready" ...
I0116 01:57:14.865972 566425 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-874655" in "kube-system" namespace to be "Ready" ...
I0116 01:57:15.213411 566425 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0116 01:57:15.213441 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0116 01:57:15.265730 566425 pod_ready.go:92] pod "kube-scheduler-addons-874655" in "kube-system" namespace has status "Ready":"True"
I0116 01:57:15.265769 566425 pod_ready.go:81] duration metric: took 399.786998ms waiting for pod "kube-scheduler-addons-874655" in "kube-system" namespace to be "Ready" ...
I0116 01:57:15.265782 566425 pod_ready.go:38] duration metric: took 2.798785865s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0116 01:57:15.265808 566425 api_server.go:52] waiting for apiserver process to appear ...
I0116 01:57:15.265915 566425 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0116 01:57:15.379837 566425 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0116 01:57:15.379879 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0116 01:57:15.568383 566425 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0116 01:57:16.877170 566425 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.39.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (4.428589525s)
I0116 01:57:16.877215 566425 start.go:929] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap
I0116 01:57:18.512973 566425 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0116 01:57:18.513022 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:57:18.517186 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:18.517698 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:57:18.517736 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:18.517987 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHPort
I0116 01:57:18.518290 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:57:18.518484 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHUsername
I0116 01:57:18.518716 566425 sshutil.go:53] new ssh client: &{IP:192.168.39.252 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/id_rsa Username:docker}
I0116 01:57:19.498969 566425 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (6.898966038s)
I0116 01:57:19.499031 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:19.499043 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:19.499455 566425 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
I0116 01:57:19.499525 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:19.499540 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:19.499560 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:19.499581 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:19.499872 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:19.499974 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:19.499950 566425 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
I0116 01:57:19.501235 566425 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (6.935833992s)
I0116 01:57:19.501278 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:19.501289 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:19.501655 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:19.501681 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:19.501692 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:19.501702 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:19.501661 566425 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
I0116 01:57:19.502026 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:19.502075 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:19.502117 566425 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
I0116 01:57:19.603749 566425 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0116 01:57:19.888737 566425 addons.go:234] Setting addon gcp-auth=true in "addons-874655"
I0116 01:57:19.888809 566425 host.go:66] Checking if "addons-874655" exists ...
I0116 01:57:19.889314 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:19.889355 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:19.906066 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35845
I0116 01:57:19.906598 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:19.907213 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:19.907243 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:19.907635 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:19.908195 566425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0116 01:57:19.908230 566425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0116 01:57:19.924286 566425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35341
I0116 01:57:19.924868 566425 main.go:141] libmachine: () Calling .GetVersion
I0116 01:57:19.925470 566425 main.go:141] libmachine: Using API Version 1
I0116 01:57:19.925495 566425 main.go:141] libmachine: () Calling .SetConfigRaw
I0116 01:57:19.925843 566425 main.go:141] libmachine: () Calling .GetMachineName
I0116 01:57:19.926086 566425 main.go:141] libmachine: (addons-874655) Calling .GetState
I0116 01:57:19.927594 566425 main.go:141] libmachine: (addons-874655) Calling .DriverName
I0116 01:57:19.927866 566425 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0116 01:57:19.927898 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHHostname
I0116 01:57:19.931132 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:19.931632 566425 main.go:141] libmachine: (addons-874655) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1d:f8:62", ip: ""} in network mk-addons-874655: {Iface:virbr1 ExpiryTime:2024-01-16 02:56:29 +0000 UTC Type:0 Mac:52:54:00:1d:f8:62 Iaid: IPaddr:192.168.39.252 Prefix:24 Hostname:addons-874655 Clientid:01:52:54:00:1d:f8:62}
I0116 01:57:19.931660 566425 main.go:141] libmachine: (addons-874655) DBG | domain addons-874655 has defined IP address 192.168.39.252 and MAC address 52:54:00:1d:f8:62 in network mk-addons-874655
I0116 01:57:19.931990 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHPort
I0116 01:57:19.932228 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHKeyPath
I0116 01:57:19.932420 566425 main.go:141] libmachine: (addons-874655) Calling .GetSSHUsername
I0116 01:57:19.932705 566425 sshutil.go:53] new ssh client: &{IP:192.168.39.252 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17967-558382/.minikube/machines/addons-874655/id_rsa Username:docker}
I0116 01:57:23.857975 566425 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (11.123902638s)
I0116 01:57:23.858023 566425 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (11.107671293s)
I0116 01:57:23.858045 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:23.858064 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:23.858073 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:23.858075 566425 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (11.101268124s)
I0116 01:57:23.858089 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:23.858101 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:23.858111 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:23.858185 566425 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (10.777484957s)
I0116 01:57:23.858218 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:23.858229 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:23.858262 566425 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (10.276251162s)
I0116 01:57:23.858284 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:23.858295 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:23.858294 566425 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (10.176704535s)
I0116 01:57:23.858322 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:23.858335 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:23.858373 566425 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml: (10.165092775s)
I0116 01:57:23.858392 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:23.858402 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:23.858423 566425 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (9.794029728s)
I0116 01:57:23.858442 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:23.858453 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:23.858503 566425 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (9.378809607s)
I0116 01:57:23.858519 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:23.858528 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:23.858646 566425 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (9.187730299s)
I0116 01:57:23.858658 566425 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
W0116 01:57:23.858681 566425 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0116 01:57:23.858710 566425 retry.go:31] will retry after 352.984506ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0116 01:57:23.858712 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:23.858724 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:23.858736 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:23.858742 566425 ssh_runner.go:235] Completed: sudo pgrep -xnf kube-apiserver.*minikube.*: (8.592808572s)
I0116 01:57:23.858760 566425 api_server.go:72] duration metric: took 11.569458671s to wait for apiserver process to appear ...
I0116 01:57:23.858776 566425 api_server.go:88] waiting for apiserver healthz status ...
I0116 01:57:23.858801 566425 api_server.go:253] Checking apiserver healthz at https://192.168.39.252:8443/healthz ...
I0116 01:57:23.858825 566425 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
I0116 01:57:23.858852 566425 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
I0116 01:57:23.858861 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:23.858875 566425 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
I0116 01:57:23.858877 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:23.858893 566425 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
I0116 01:57:23.858893 566425 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
I0116 01:57:23.858898 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:23.858909 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:23.858918 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:23.858922 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:23.858928 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:23.858930 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:23.858936 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:23.858940 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:23.858945 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:23.858948 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:23.858953 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:23.858884 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:23.858973 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:23.858982 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:23.859016 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:23.859024 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:23.859033 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:23.859040 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:23.858744 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:23.859157 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:23.859168 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:23.859439 566425 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
I0116 01:57:23.859463 566425 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
I0116 01:57:23.859488 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:23.859497 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:23.859509 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:23.859519 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:23.859582 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:23.859591 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:23.859600 566425 addons.go:470] Verifying addon registry=true in "addons-874655"
I0116 01:57:23.861296 566425 out.go:177] * Verifying registry addon...
I0116 01:57:23.863059 566425 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (11.241731495s)
I0116 01:57:23.863094 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:23.863107 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:23.863727 566425 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0116 01:57:23.860994 566425 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
I0116 01:57:23.861028 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:23.863966 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:23.861380 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:23.864037 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:23.864052 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:23.864062 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:23.861047 566425 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
I0116 01:57:23.861082 566425 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
I0116 01:57:23.861101 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:23.864130 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:23.864141 566425 addons.go:470] Verifying addon metrics-server=true in "addons-874655"
I0116 01:57:23.861067 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:23.864282 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:23.865636 566425 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-874655 service yakd-dashboard -n yakd-dashboard
I0116 01:57:23.864555 566425 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
I0116 01:57:23.861257 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:23.861682 566425 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
I0116 01:57:23.861704 566425 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
I0116 01:57:23.861732 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:23.864587 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:23.864620 566425 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
I0116 01:57:23.864638 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:23.861198 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:23.861225 566425 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
I0116 01:57:23.867655 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:23.867667 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:23.867667 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:23.867681 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:23.867693 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:23.867696 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:23.867704 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:23.867706 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:23.867655 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:23.868470 566425 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
I0116 01:57:23.868482 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:23.868541 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:23.868504 566425 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
I0116 01:57:23.868552 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:23.868566 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:23.868643 566425 addons.go:470] Verifying addon ingress=true in "addons-874655"
I0116 01:57:23.870379 566425 out.go:177] * Verifying ingress addon...
I0116 01:57:23.872695 566425 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0116 01:57:23.879662 566425 api_server.go:279] https://192.168.39.252:8443/healthz returned 200:
ok
I0116 01:57:23.882004 566425 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0116 01:57:23.882028 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:23.882445 566425 api_server.go:141] control plane version: v1.28.4
I0116 01:57:23.882472 566425 api_server.go:131] duration metric: took 23.68399ms to wait for apiserver health ...
I0116 01:57:23.882483 566425 system_pods.go:43] waiting for kube-system pods to appear ...
I0116 01:57:23.885394 566425 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0116 01:57:23.885417 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:23.905020 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:23.905047 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:23.905424 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:23.905429 566425 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
I0116 01:57:23.905442 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:23.907149 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:23.907177 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:23.907448 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:23.907473 566425 main.go:141] libmachine: Making call to close connection to plugin binary
W0116 01:57:23.907597 566425 out.go:239] ! Enabling 'storage-provisioner-rancher' returned an error: running callbacks: [Error making local-path the default storage class: Error while marking storage class local-path as default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]
I0116 01:57:23.913946 566425 system_pods.go:59] 15 kube-system pods found
I0116 01:57:23.913976 566425 system_pods.go:61] "coredns-5dd5756b68-jxfvn" [020d87ec-4c0f-47ff-9799-d0091fd453d8] Running
I0116 01:57:23.913980 566425 system_pods.go:61] "etcd-addons-874655" [d39f45b4-8347-4ce3-87dc-35f966fb833d] Running
I0116 01:57:23.913985 566425 system_pods.go:61] "kube-apiserver-addons-874655" [bcdd1fb8-66eb-40d2-8e57-898a81aa49ac] Running
I0116 01:57:23.913989 566425 system_pods.go:61] "kube-controller-manager-addons-874655" [3fc5353b-24b0-48c6-83df-5e09023f746c] Running
I0116 01:57:23.913998 566425 system_pods.go:61] "kube-ingress-dns-minikube" [414b75a3-e9f0-4bc2-bc78-ccdb57d66d46] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
I0116 01:57:23.914004 566425 system_pods.go:61] "kube-proxy-8xv7c" [9ae83988-b441-4370-a27c-ff63c720e06f] Running
I0116 01:57:23.914017 566425 system_pods.go:61] "kube-scheduler-addons-874655" [1312294e-ad42-4f06-8a58-733dfa186b81] Running
I0116 01:57:23.914033 566425 system_pods.go:61] "metrics-server-7c66d45ddc-m4wqp" [be51a3a4-8a00-421c-88df-222a2ebded47] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0116 01:57:23.914044 566425 system_pods.go:61] "nvidia-device-plugin-daemonset-7xfml" [a88dbfda-64b4-4b19-b555-d3c1125242f9] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I0116 01:57:23.914058 566425 system_pods.go:61] "registry-78bhv" [1907fb2e-d297-4c24-82d4-d7d8736b29cf] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0116 01:57:23.914074 566425 system_pods.go:61] "registry-proxy-x6nzc" [64fc9ce0-7e9b-4533-89a0-30e3a30cc0ed] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0116 01:57:23.914083 566425 system_pods.go:61] "snapshot-controller-58dbcc7b99-5nprc" [12f6ab6e-50ff-4b3c-bfab-d6fb94e285ae] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0116 01:57:23.914095 566425 system_pods.go:61] "snapshot-controller-58dbcc7b99-p2tvv" [fd372217-c45c-4ddc-9410-bd643f29a822] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0116 01:57:23.914107 566425 system_pods.go:61] "storage-provisioner" [100fa3b9-4f94-4687-a675-a5e3c9f03dbb] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0116 01:57:23.914120 566425 system_pods.go:61] "tiller-deploy-7b677967b9-9f2w9" [068035ed-e81b-4a9b-921a-c3a8b21cdf49] Pending / Ready:ContainersNotReady (containers with unready status: [tiller]) / ContainersReady:ContainersNotReady (containers with unready status: [tiller])
I0116 01:57:23.914132 566425 system_pods.go:74] duration metric: took 31.642395ms to wait for pod list to return data ...
I0116 01:57:23.914150 566425 default_sa.go:34] waiting for default service account to be created ...
I0116 01:57:23.922518 566425 default_sa.go:45] found service account: "default"
I0116 01:57:23.922560 566425 default_sa.go:55] duration metric: took 8.398972ms for default service account to be created ...
I0116 01:57:23.922580 566425 system_pods.go:116] waiting for k8s-apps to be running ...
I0116 01:57:23.931723 566425 system_pods.go:86] 15 kube-system pods found
I0116 01:57:23.931757 566425 system_pods.go:89] "coredns-5dd5756b68-jxfvn" [020d87ec-4c0f-47ff-9799-d0091fd453d8] Running
I0116 01:57:23.931763 566425 system_pods.go:89] "etcd-addons-874655" [d39f45b4-8347-4ce3-87dc-35f966fb833d] Running
I0116 01:57:23.931768 566425 system_pods.go:89] "kube-apiserver-addons-874655" [bcdd1fb8-66eb-40d2-8e57-898a81aa49ac] Running
I0116 01:57:23.931772 566425 system_pods.go:89] "kube-controller-manager-addons-874655" [3fc5353b-24b0-48c6-83df-5e09023f746c] Running
I0116 01:57:23.931780 566425 system_pods.go:89] "kube-ingress-dns-minikube" [414b75a3-e9f0-4bc2-bc78-ccdb57d66d46] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
I0116 01:57:23.931785 566425 system_pods.go:89] "kube-proxy-8xv7c" [9ae83988-b441-4370-a27c-ff63c720e06f] Running
I0116 01:57:23.931811 566425 system_pods.go:89] "kube-scheduler-addons-874655" [1312294e-ad42-4f06-8a58-733dfa186b81] Running
I0116 01:57:23.931822 566425 system_pods.go:89] "metrics-server-7c66d45ddc-m4wqp" [be51a3a4-8a00-421c-88df-222a2ebded47] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0116 01:57:23.931832 566425 system_pods.go:89] "nvidia-device-plugin-daemonset-7xfml" [a88dbfda-64b4-4b19-b555-d3c1125242f9] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I0116 01:57:23.931842 566425 system_pods.go:89] "registry-78bhv" [1907fb2e-d297-4c24-82d4-d7d8736b29cf] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0116 01:57:23.931863 566425 system_pods.go:89] "registry-proxy-x6nzc" [64fc9ce0-7e9b-4533-89a0-30e3a30cc0ed] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0116 01:57:23.931870 566425 system_pods.go:89] "snapshot-controller-58dbcc7b99-5nprc" [12f6ab6e-50ff-4b3c-bfab-d6fb94e285ae] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0116 01:57:23.931877 566425 system_pods.go:89] "snapshot-controller-58dbcc7b99-p2tvv" [fd372217-c45c-4ddc-9410-bd643f29a822] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0116 01:57:23.931883 566425 system_pods.go:89] "storage-provisioner" [100fa3b9-4f94-4687-a675-a5e3c9f03dbb] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0116 01:57:23.931890 566425 system_pods.go:89] "tiller-deploy-7b677967b9-9f2w9" [068035ed-e81b-4a9b-921a-c3a8b21cdf49] Pending / Ready:ContainersNotReady (containers with unready status: [tiller]) / ContainersReady:ContainersNotReady (containers with unready status: [tiller])
I0116 01:57:23.931912 566425 system_pods.go:126] duration metric: took 9.324307ms to wait for k8s-apps to be running ...
I0116 01:57:23.931957 566425 system_svc.go:44] waiting for kubelet service to be running ....
I0116 01:57:23.932019 566425 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0116 01:57:24.212279 566425 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0116 01:57:24.368849 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:24.377412 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:24.940335 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:24.940444 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:25.368933 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:25.379592 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:25.868754 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:25.878621 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:26.306567 566425 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (6.378669289s)
I0116 01:57:26.306583 566425 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (10.738141603s)
I0116 01:57:26.306648 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:26.306676 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:26.306688 566425 ssh_runner.go:235] Completed: sudo systemctl is-active --quiet service kubelet: (2.374642152s)
I0116 01:57:26.306730 566425 system_svc.go:56] duration metric: took 2.374770154s WaitForService to wait for kubelet.
I0116 01:57:26.311697 566425 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20231011-8b53cabe0
I0116 01:57:26.306744 566425 kubeadm.go:581] duration metric: took 14.017442612s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
I0116 01:57:26.307089 566425 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
I0116 01:57:26.307145 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:26.311753 566425 node_conditions.go:102] verifying NodePressure condition ...
I0116 01:57:26.311767 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:26.313683 566425 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0
I0116 01:57:26.315531 566425 addons.go:426] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0116 01:57:26.313691 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:26.315576 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:26.315609 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0116 01:57:26.315954 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:26.315973 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:26.315990 566425 addons.go:470] Verifying addon csi-hostpath-driver=true in "addons-874655"
I0116 01:57:26.317744 566425 out.go:177] * Verifying csi-hostpath-driver addon...
I0116 01:57:26.320439 566425 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0116 01:57:26.331979 566425 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0116 01:57:26.332022 566425 node_conditions.go:123] node cpu capacity is 2
I0116 01:57:26.332036 566425 node_conditions.go:105] duration metric: took 20.259372ms to run NodePressure ...
I0116 01:57:26.332052 566425 start.go:228] waiting for startup goroutines ...
I0116 01:57:26.394891 566425 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0116 01:57:26.394931 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:26.407931 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:26.410210 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:26.484304 566425 addons.go:426] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0116 01:57:26.484341 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0116 01:57:26.606920 566425 addons.go:426] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0116 01:57:26.606952 566425 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5432 bytes)
I0116 01:57:26.635318 566425 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0116 01:57:26.826777 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:26.875543 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:26.881271 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:27.327067 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:27.370793 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:27.377574 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:27.594231 566425 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (3.381880601s)
I0116 01:57:27.594323 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:27.594349 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:27.594774 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:27.594797 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:27.594809 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:27.594818 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:27.595131 566425 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
I0116 01:57:27.595143 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:27.595218 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:27.826575 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:27.868240 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:27.877480 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:28.335458 566425 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.700081081s)
I0116 01:57:28.335519 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:28.335535 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:28.335893 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:28.335921 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:28.335933 566425 main.go:141] libmachine: Making call to close driver server
I0116 01:57:28.335942 566425 main.go:141] libmachine: (addons-874655) Calling .Close
I0116 01:57:28.336183 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:28.336282 566425 main.go:141] libmachine: (addons-874655) DBG | Closing plugin on server side
I0116 01:57:28.336310 566425 main.go:141] libmachine: Successfully made call to close driver server
I0116 01:57:28.336344 566425 main.go:141] libmachine: Making call to close connection to plugin binary
I0116 01:57:28.337762 566425 addons.go:470] Verifying addon gcp-auth=true in "addons-874655"
I0116 01:57:28.339739 566425 out.go:177] * Verifying gcp-auth addon...
I0116 01:57:28.342439 566425 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0116 01:57:28.353044 566425 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0116 01:57:28.353076 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:28.372016 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:28.378848 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:28.826902 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:28.846156 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:28.869018 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:28.878007 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:29.327657 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:29.346741 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:29.369424 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:29.377463 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:29.826548 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:29.848185 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:29.868667 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:29.877523 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:30.326317 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:30.345893 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:30.369651 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:30.377244 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:30.826990 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:30.846938 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:30.869394 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:30.880364 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:31.550020 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:31.550206 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:31.552096 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:31.553521 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:31.827199 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:31.847647 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:31.868893 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:31.878316 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:32.326332 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:32.346097 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:32.369438 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:32.376922 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:32.826653 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:32.846890 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:32.876335 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:32.880321 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:33.327098 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:33.346915 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:33.369814 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:33.377776 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:33.826435 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:33.846871 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:33.869332 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:33.877700 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:34.327300 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:34.346787 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:34.369621 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:34.377388 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:34.827972 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:34.846795 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:34.870300 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:34.878315 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:35.327546 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:35.346741 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:35.372009 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:35.378773 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:35.827349 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:35.846030 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:35.872217 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:35.876514 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:36.327763 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:36.346807 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:36.370020 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:36.377859 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:36.827043 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:36.871577 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:36.872864 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:36.876718 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:37.327183 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:37.347085 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:37.370571 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:37.377078 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:37.831459 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:37.849823 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:37.877503 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:37.885031 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:38.326817 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:38.348166 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:38.368685 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:38.379083 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:38.826819 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:38.847408 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:38.869304 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:38.876983 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:39.327001 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:39.347171 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:39.369369 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:39.377341 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:39.827045 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:39.847562 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:39.870281 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:39.878578 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:40.507201 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:40.508136 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:40.508185 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:40.509623 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:40.827278 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:40.847153 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:40.868886 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:40.877618 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:41.327075 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:41.346449 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:41.373363 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:41.379870 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:41.828552 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:41.847458 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:41.873473 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:41.877248 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:42.326312 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:42.347193 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:42.368906 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:42.377784 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:42.826927 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:42.846897 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:42.869743 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:42.878029 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:43.328749 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:43.350034 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:43.371231 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:43.377394 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:43.827359 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:43.846802 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:43.871598 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:43.880457 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:44.332056 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:44.347280 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:44.370805 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:44.379951 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:44.826935 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:44.847400 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:44.869336 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:44.877949 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:45.326295 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:45.346684 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:45.369763 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:45.377568 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:45.828194 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:45.847772 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:45.870912 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:45.877775 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:46.327865 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:46.347252 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:46.369165 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:46.378448 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:46.828078 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:46.846902 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:46.870500 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:46.877112 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:47.327171 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:47.349576 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:47.369204 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:47.379192 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:47.826694 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:47.846016 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:47.872807 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:47.877359 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:48.326897 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:48.347130 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:48.368575 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:48.377475 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:48.826742 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:48.847107 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:48.868824 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:48.878232 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:49.327262 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:49.346979 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:49.369550 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:49.377566 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:49.827879 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:49.847441 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:49.872597 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:49.876930 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:50.326143 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:50.346786 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:50.369316 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:50.376914 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:50.826498 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:50.847523 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:50.870058 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:50.878052 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:51.326683 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:51.346734 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:51.373209 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:51.379572 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:51.826741 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:51.846687 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:51.876765 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:51.878888 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:52.326835 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:52.347042 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:52.368840 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:52.377886 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:52.827019 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:52.847874 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:52.870754 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:52.877984 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:53.333753 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:53.346581 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:53.369189 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:53.377867 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:53.827107 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:53.846814 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:53.869532 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:53.878916 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:54.326879 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:54.346562 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:54.369943 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:54.378661 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:54.826865 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:54.846531 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:54.869132 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:54.878344 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:55.326772 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:55.348280 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:55.373492 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:55.378996 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:55.826038 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:55.847199 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:55.872693 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:55.878943 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:56.327411 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:56.347273 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:56.369416 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:56.377275 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:56.827129 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:56.847093 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:56.869144 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:56.878479 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:57.327285 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:57.347458 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:57.370282 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:57.378773 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:57.827392 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:57.846931 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:57.873880 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:57.878037 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:58.327684 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:58.347992 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:58.369660 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:58.377700 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:58.828009 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:58.846738 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:58.869217 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:58.877351 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:59.326961 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:59.347096 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:59.368731 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:59.377915 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:57:59.827074 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:57:59.848027 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:57:59.873700 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:57:59.878572 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:00.326990 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:00.346858 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:00.370397 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:58:00.378163 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:00.837627 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:00.847340 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:00.869379 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:58:00.877183 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:01.554061 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:01.554678 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:01.554918 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:01.556563 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:58:01.828761 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:01.846924 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:01.870165 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:58:01.877991 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:02.327235 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:02.347576 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:02.369644 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:58:02.377520 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:02.960586 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:02.961240 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:02.964222 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:58:02.964854 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:03.326956 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:03.347140 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:03.369163 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:58:03.377821 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:03.826881 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:03.847161 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:03.870179 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:58:03.878652 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:04.328744 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:04.346469 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:04.370028 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:58:04.380414 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:04.826602 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:04.846590 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:04.869198 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:58:04.877943 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:05.326816 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:05.346866 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:05.369668 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:58:05.377728 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:05.826544 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:05.847155 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:05.869788 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:58:05.877572 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:06.327355 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:06.346058 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:06.370969 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:58:06.377462 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:06.828428 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:06.846929 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:06.869314 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:58:06.877378 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:07.326429 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:07.347087 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:07.368767 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:58:07.378033 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:07.828186 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:07.846721 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:07.869892 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0116 01:58:07.877496 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:08.325841 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:08.347151 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:08.372284 566425 kapi.go:107] duration metric: took 44.508551981s to wait for kubernetes.io/minikube-addons=registry ...
I0116 01:58:08.379266 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:08.827372 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:08.846217 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:08.877544 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:09.327259 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:09.346165 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:09.377715 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:09.826139 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:09.847311 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:09.877780 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:10.327348 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:10.346268 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:10.378423 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:10.826940 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:10.846900 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:10.878305 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:11.326737 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:11.346807 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:11.377980 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:11.827998 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:11.847730 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:11.879401 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:12.326655 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:12.346399 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:12.377811 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:12.827946 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:12.846502 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:12.877917 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:13.326117 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:13.347023 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:13.379190 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:13.826421 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:13.846441 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:13.878290 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:14.334619 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:14.348261 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:14.382897 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:14.828048 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:14.848092 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:14.878925 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:15.331661 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:15.347240 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:15.377763 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:16.224361 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:16.224933 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:16.225433 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:16.332355 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:16.347411 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:16.379743 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:16.827361 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:16.847111 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:16.878138 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:17.325973 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:17.346667 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:17.380093 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:17.826764 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:17.846821 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:17.878973 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:18.326864 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:18.347840 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:18.378251 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:18.826493 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:18.846847 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:18.878094 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:19.327730 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:19.347263 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:19.377750 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:19.832359 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:19.846300 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:19.878434 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:20.335871 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:20.355667 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:20.378888 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:20.826564 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:20.846853 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:20.878636 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:21.327048 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:21.357453 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:21.377728 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:21.830254 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:21.847851 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:21.878891 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:22.327169 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:22.346547 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:22.377973 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:22.827298 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:22.847018 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:22.878411 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:23.327202 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:23.347316 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:23.379185 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:23.830999 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:23.846995 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:23.879103 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:24.327554 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:24.347401 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:24.377508 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:24.827258 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:24.847968 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:24.878913 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:25.327389 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:25.349791 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:25.378850 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:25.826002 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:25.847096 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:25.878176 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:26.328704 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:26.347122 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:26.377318 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:26.827153 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:26.847530 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:26.878210 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:27.327778 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:27.346596 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:27.378251 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:27.826654 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:27.846763 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:27.880330 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:28.326422 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:28.347094 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:28.381626 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:28.827580 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:28.846857 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:28.878535 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:29.327695 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:29.346444 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:29.378718 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:29.827687 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:29.847132 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:29.878172 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:30.340770 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0116 01:58:30.346992 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:30.381311 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:30.882783 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:30.883280 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:30.883622 566425 kapi.go:107] duration metric: took 1m4.563183235s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0116 01:58:31.347231 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:31.377530 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:31.848164 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:31.878405 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:32.346678 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:32.378007 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:32.846456 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:32.885488 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:33.347073 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:33.377994 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:33.847220 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:33.877860 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:34.346976 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:34.378443 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:34.847152 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:34.877920 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:35.347217 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:35.377455 566425 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0116 01:58:35.846850 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:35.877950 566425 kapi.go:107] duration metric: took 1m12.005254294s to wait for app.kubernetes.io/name=ingress-nginx ...
I0116 01:58:36.346448 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:36.846825 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:37.347345 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:37.847705 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:38.346284 566425 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0116 01:58:38.846594 566425 kapi.go:107] duration metric: took 1m10.504149427s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0116 01:58:38.848651 566425 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-874655 cluster.
I0116 01:58:38.850649 566425 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0116 01:58:38.852308 566425 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0116 01:58:38.854268 566425 out.go:177] * Enabled addons: cloud-spanner, storage-provisioner, nvidia-device-plugin, ingress-dns, metrics-server, yakd, inspektor-gadget, helm-tiller, default-storageclass, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth
I0116 01:58:38.855713 566425 addons.go:505] enable addons completed in 1m27.072045133s: enabled=[cloud-spanner storage-provisioner nvidia-device-plugin ingress-dns metrics-server yakd inspektor-gadget helm-tiller default-storageclass volumesnapshots registry csi-hostpath-driver ingress gcp-auth]
I0116 01:58:38.855764 566425 start.go:233] waiting for cluster config update ...
I0116 01:58:38.855789 566425 start.go:242] writing updated cluster config ...
I0116 01:58:38.856103 566425 ssh_runner.go:195] Run: rm -f paused
I0116 01:58:38.909543 566425 start.go:600] kubectl: 1.29.0, cluster: 1.28.4 (minor skew: 1)
I0116 01:58:38.911484 566425 out.go:177] * Done! kubectl is now configured to use "addons-874655" cluster and "default" namespace by default
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
e8bf9ea1434a2 6d2a98b274382 19 seconds ago Running gcp-auth 0 ac46bcf874b60 gcp-auth-d4c87556c-k54ds
624b8ecff4e59 311f90a3747fd 22 seconds ago Running controller 0 ea2dbc82b635c ingress-nginx-controller-69cff4fd79-646q9
16947755a8498 738351fd438f0 28 seconds ago Running csi-snapshotter 0 243d50af10e16 csi-hostpathplugin-57ghf
663d110f79a98 931dbfd16f87c 30 seconds ago Running csi-provisioner 0 243d50af10e16 csi-hostpathplugin-57ghf
df9bc4ef29d64 e899260153aed 32 seconds ago Running liveness-probe 0 243d50af10e16 csi-hostpathplugin-57ghf
99c04aa208a9b e255e073c508c 33 seconds ago Running hostpath 0 243d50af10e16 csi-hostpathplugin-57ghf
a5e850fb620ec 88ef14a257f42 34 seconds ago Running node-driver-registrar 0 243d50af10e16 csi-hostpathplugin-57ghf
f578c3ea0ac88 1ebff0f9671bc 36 seconds ago Exited patch 0 c0a5a02d7dae0 gcp-auth-certs-patch-n6q2g
9fbff063765ae 1ebff0f9671bc 37 seconds ago Exited create 0 9b24bbca533ac gcp-auth-certs-create-dj9qn
e0b01d710aeef a1ed5895ba635 37 seconds ago Running csi-external-health-monitor-controller 0 243d50af10e16 csi-hostpathplugin-57ghf
7e2bc7e862303 59cbb42146a37 38 seconds ago Running csi-attacher 0 bd25256591ec1 csi-hostpath-attacher-0
800b4b42fb15c 19a639eda60f0 40 seconds ago Running csi-resizer 0 0f9dbeac41f81 csi-hostpath-resizer-0
2ed5abe86c2bf 1ebff0f9671bc 42 seconds ago Exited patch 0 65f7281bd2541 ingress-nginx-admission-patch-2sqsd
a29e387026118 1ebff0f9671bc 42 seconds ago Exited create 0 06fed57ddb7e7 ingress-nginx-admission-create-kkrqg
6f22dd933a378 31de47c733c91 44 seconds ago Running yakd 0 82047b5e74565 yakd-dashboard-9947fc6bf-mjs9x
d66d56ecb50b4 aa61ee9c70bc4 49 seconds ago Running volume-snapshot-controller 0 4f9dfd345dd81 snapshot-controller-58dbcc7b99-p2tvv
ed9f7c3a5daec aa61ee9c70bc4 49 seconds ago Running volume-snapshot-controller 0 c886c1c2353ac snapshot-controller-58dbcc7b99-5nprc
704f43104f0e0 e16d1e3a10667 About a minute ago Running local-path-provisioner 0 900d0fbac6047 local-path-provisioner-78b46b4d5c-czqbm
4930fa202417a 1499ed4fbd0aa About a minute ago Running minikube-ingress-dns 0 ff00342132c19 kube-ingress-dns-minikube
01577e925846a 3f39089e90831 About a minute ago Running tiller 0 22769d3b61423 tiller-deploy-7b677967b9-9f2w9
a0c85c50864b8 754854eab8c1c About a minute ago Running cloud-spanner-emulator 0 68694b24b53a8 cloud-spanner-emulator-64c8c85f65-pgclx
0185312efa995 6e38f40d628db About a minute ago Running storage-provisioner 0 ac2b6b4b0892d storage-provisioner
d495d116f12b3 ead0a4a53df89 About a minute ago Running coredns 0 4437f950c4b17 coredns-5dd5756b68-jxfvn
b6c383016f6fe 83f6cc407eed8 About a minute ago Running kube-proxy 0 678ec991a98f4 kube-proxy-8xv7c
e77edeeac5c6c 73deb9a3f7025 2 minutes ago Running etcd 0 0e74b51480678 etcd-addons-874655
d3b48cbdf9598 e3db313c6dbc0 2 minutes ago Running kube-scheduler 0 292d9e377827e kube-scheduler-addons-874655
a401d2fb30cde 7fe0e6f37db33 2 minutes ago Running kube-apiserver 0 0b25eaf3dceb4 kube-apiserver-addons-874655
138e7cf6410ad d058aa5ab969c 2 minutes ago Running kube-controller-manager 0 76b49b9b1666a kube-controller-manager-addons-874655
==> containerd <==
-- Journal begins at Tue 2024-01-16 01:56:25 UTC, ends at Tue 2024-01-16 01:58:58 UTC. --
Jan 16 01:58:56 addons-874655 containerd[688]: time="2024-01-16T01:58:56.686935896Z" level=info msg="StopPodSandbox for \"5b3a0427d6f1639529240f727fdb07e2b8a97c05d0a975c12b94f8d40a6194ec\""
Jan 16 01:58:56 addons-874655 containerd[688]: time="2024-01-16T01:58:56.687033335Z" level=info msg="Container to stop \"7718db09554acaabeb48b7f55e0e651bc9d79eaabadb19b3f48b53ce1f8b3037\" must be in running or unknown state, current state \"CONTAINER_EXITED\""
Jan 16 01:58:56 addons-874655 containerd[688]: time="2024-01-16T01:58:56.744687952Z" level=info msg="shim disconnected" id=5b3a0427d6f1639529240f727fdb07e2b8a97c05d0a975c12b94f8d40a6194ec namespace=k8s.io
Jan 16 01:58:56 addons-874655 containerd[688]: time="2024-01-16T01:58:56.744756682Z" level=warning msg="cleaning up after shim disconnected" id=5b3a0427d6f1639529240f727fdb07e2b8a97c05d0a975c12b94f8d40a6194ec namespace=k8s.io
Jan 16 01:58:56 addons-874655 containerd[688]: time="2024-01-16T01:58:56.744768459Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Jan 16 01:58:56 addons-874655 containerd[688]: time="2024-01-16T01:58:56.807833839Z" level=info msg="TearDown network for sandbox \"5b3a0427d6f1639529240f727fdb07e2b8a97c05d0a975c12b94f8d40a6194ec\" successfully"
Jan 16 01:58:56 addons-874655 containerd[688]: time="2024-01-16T01:58:56.807895370Z" level=info msg="StopPodSandbox for \"5b3a0427d6f1639529240f727fdb07e2b8a97c05d0a975c12b94f8d40a6194ec\" returns successfully"
Jan 16 01:58:56 addons-874655 containerd[688]: time="2024-01-16T01:58:56.852969416Z" level=info msg="RemoveContainer for \"4ab97d9187a30bb9be162a996ef2ba6f10ac58dd67aa83fa9cd6d97c8c62c7c0\""
Jan 16 01:58:56 addons-874655 containerd[688]: time="2024-01-16T01:58:56.877977300Z" level=info msg="RemoveContainer for \"4ab97d9187a30bb9be162a996ef2ba6f10ac58dd67aa83fa9cd6d97c8c62c7c0\" returns successfully"
Jan 16 01:58:56 addons-874655 containerd[688]: time="2024-01-16T01:58:56.884225582Z" level=error msg="ContainerStatus for \"4ab97d9187a30bb9be162a996ef2ba6f10ac58dd67aa83fa9cd6d97c8c62c7c0\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find container \"4ab97d9187a30bb9be162a996ef2ba6f10ac58dd67aa83fa9cd6d97c8c62c7c0\": not found"
Jan 16 01:58:56 addons-874655 containerd[688]: time="2024-01-16T01:58:56.888030844Z" level=info msg="StopPodSandbox for \"7010e3c493ae1d4af36adeaef2828f0f9da1b15cdf9f78f705d7c137e0446ba3\""
Jan 16 01:58:56 addons-874655 containerd[688]: time="2024-01-16T01:58:56.888159155Z" level=info msg="Container to stop \"c3bea67148c4bf08c382a847bed299c160374f0ac76a903ad2af44589a0683db\" must be in running or unknown state, current state \"CONTAINER_EXITED\""
Jan 16 01:58:56 addons-874655 containerd[688]: time="2024-01-16T01:58:56.890770645Z" level=info msg="RemoveContainer for \"7718db09554acaabeb48b7f55e0e651bc9d79eaabadb19b3f48b53ce1f8b3037\""
Jan 16 01:58:56 addons-874655 containerd[688]: time="2024-01-16T01:58:56.955199010Z" level=info msg="RemoveContainer for \"7718db09554acaabeb48b7f55e0e651bc9d79eaabadb19b3f48b53ce1f8b3037\" returns successfully"
Jan 16 01:58:56 addons-874655 containerd[688]: time="2024-01-16T01:58:56.967591677Z" level=error msg="ContainerStatus for \"7718db09554acaabeb48b7f55e0e651bc9d79eaabadb19b3f48b53ce1f8b3037\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find container \"7718db09554acaabeb48b7f55e0e651bc9d79eaabadb19b3f48b53ce1f8b3037\": not found"
Jan 16 01:58:56 addons-874655 containerd[688]: time="2024-01-16T01:58:56.976690196Z" level=info msg="RemoveContainer for \"8cdab95870928b77f3d3419ba215529a377dfae706207c702a56422a96e57fe8\""
Jan 16 01:58:56 addons-874655 containerd[688]: time="2024-01-16T01:58:56.986040124Z" level=info msg="RemoveContainer for \"8cdab95870928b77f3d3419ba215529a377dfae706207c702a56422a96e57fe8\" returns successfully"
Jan 16 01:58:56 addons-874655 containerd[688]: time="2024-01-16T01:58:56.988069988Z" level=error msg="ContainerStatus for \"8cdab95870928b77f3d3419ba215529a377dfae706207c702a56422a96e57fe8\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find container \"8cdab95870928b77f3d3419ba215529a377dfae706207c702a56422a96e57fe8\": not found"
Jan 16 01:58:57 addons-874655 containerd[688]: time="2024-01-16T01:58:57.025249351Z" level=info msg="shim disconnected" id=7010e3c493ae1d4af36adeaef2828f0f9da1b15cdf9f78f705d7c137e0446ba3 namespace=k8s.io
Jan 16 01:58:57 addons-874655 containerd[688]: time="2024-01-16T01:58:57.025987302Z" level=warning msg="cleaning up after shim disconnected" id=7010e3c493ae1d4af36adeaef2828f0f9da1b15cdf9f78f705d7c137e0446ba3 namespace=k8s.io
Jan 16 01:58:57 addons-874655 containerd[688]: time="2024-01-16T01:58:57.026107208Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Jan 16 01:58:57 addons-874655 containerd[688]: time="2024-01-16T01:58:57.100235018Z" level=info msg="TearDown network for sandbox \"7010e3c493ae1d4af36adeaef2828f0f9da1b15cdf9f78f705d7c137e0446ba3\" successfully"
Jan 16 01:58:57 addons-874655 containerd[688]: time="2024-01-16T01:58:57.100453807Z" level=info msg="StopPodSandbox for \"7010e3c493ae1d4af36adeaef2828f0f9da1b15cdf9f78f705d7c137e0446ba3\" returns successfully"
Jan 16 01:58:57 addons-874655 containerd[688]: time="2024-01-16T01:58:57.894072640Z" level=info msg="RemoveContainer for \"c3bea67148c4bf08c382a847bed299c160374f0ac76a903ad2af44589a0683db\""
Jan 16 01:58:57 addons-874655 containerd[688]: time="2024-01-16T01:58:57.901788793Z" level=info msg="RemoveContainer for \"c3bea67148c4bf08c382a847bed299c160374f0ac76a903ad2af44589a0683db\" returns successfully"
==> coredns [d495d116f12b362205c7493e1405782f1b5d45d0a8b74b6243901138efc14ac0] <==
.:53
[INFO] plugin/reload: Running configuration SHA512 = 591cf328cccc12bc490481273e738df59329c62c0b729d94e8b61db9961c2fa5f046dd37f1cf888b953814040d180f52594972691cd6ff41be96639138a43908
CoreDNS-1.10.1
linux/amd64, go1.20, 055b2c3
[INFO] Reloading
[INFO] plugin/reload: Running configuration SHA512 = 6c8bd46af3d98e03c4ae8e438c65dd0c69a5f817565481bcf1725dd66ff794963b7938c81e3a23d4c2ad9e52f818076e819219c79e8007dd90564767ed68ba4c
[INFO] Reloading complete
[INFO] 127.0.0.1:38387 - 26635 "HINFO IN 1158326830966261383.6674419566022158997. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.023903107s
[INFO] 10.244.0.21:43758 - 20002 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000336545s
[INFO] 10.244.0.21:34087 - 35895 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000278279s
[INFO] 10.244.0.21:37853 - 60580 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000217331s
[INFO] 10.244.0.21:44808 - 18248 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000105748s
[INFO] 10.244.0.21:33100 - 36944 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000169649s
[INFO] 10.244.0.21:57995 - 11070 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000273225s
[INFO] 10.244.0.21:46465 - 53244 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.001159501s
[INFO] 10.244.0.21:48068 - 46442 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 534 0.002421783s
[INFO] 10.244.0.22:33599 - 2 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000290013s
[INFO] 10.244.0.22:35753 - 3 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000133867s
==> describe nodes <==
Name: addons-874655
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=addons-874655
kubernetes.io/os=linux
minikube.k8s.io/commit=880ec6d67bbc7fe8882aaa6543d5a07427c973fd
minikube.k8s.io/name=addons-874655
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_01_16T01_56_59_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-874655
Annotations: csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-874655"}
kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Tue, 16 Jan 2024 01:56:56 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-874655
AcquireTime: <unset>
RenewTime: Tue, 16 Jan 2024 01:58:51 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Tue, 16 Jan 2024 01:58:31 +0000 Tue, 16 Jan 2024 01:56:54 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Tue, 16 Jan 2024 01:58:31 +0000 Tue, 16 Jan 2024 01:56:54 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Tue, 16 Jan 2024 01:58:31 +0000 Tue, 16 Jan 2024 01:56:54 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Tue, 16 Jan 2024 01:58:31 +0000 Tue, 16 Jan 2024 01:57:00 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.252
Hostname: addons-874655
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 3914496Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 3914496Ki
pods: 110
System Info:
Machine ID: 42c610653047425ab8ceea5e5ec2da35
System UUID: 42c61065-3047-425a-b8ce-ea5e5ec2da35
Boot ID: a923e7f2-ea32-4012-a8d5-6d85625d0287
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: containerd://1.7.11
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (20 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default cloud-spanner-emulator-64c8c85f65-pgclx 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 101s
default test-local-path 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6s
gcp-auth gcp-auth-d4c87556c-k54ds 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 90s
ingress-nginx ingress-nginx-controller-69cff4fd79-646q9 100m (5%!)(MISSING) 0 (0%!)(MISSING) 90Mi (2%!)(MISSING) 0 (0%!)(MISSING) 95s
kube-system coredns-5dd5756b68-jxfvn 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (1%!)(MISSING) 170Mi (4%!)(MISSING) 107s
kube-system csi-hostpath-attacher-0 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 93s
kube-system csi-hostpath-resizer-0 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 92s
kube-system csi-hostpathplugin-57ghf 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 92s
kube-system etcd-addons-874655 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (2%!)(MISSING) 0 (0%!)(MISSING) 2m
kube-system kube-apiserver-addons-874655 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 118s
kube-system kube-controller-manager-addons-874655 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 118s
kube-system kube-ingress-dns-minikube 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 99s
kube-system kube-proxy-8xv7c 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 107s
kube-system kube-scheduler-addons-874655 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 118s
kube-system snapshot-controller-58dbcc7b99-5nprc 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 99s
kube-system snapshot-controller-58dbcc7b99-p2tvv 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 99s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 99s
kube-system tiller-deploy-7b677967b9-9f2w9 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 100s
local-path-storage local-path-provisioner-78b46b4d5c-czqbm 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 100s
yakd-dashboard yakd-dashboard-9947fc6bf-mjs9x 0 (0%!)(MISSING) 0 (0%!)(MISSING) 128Mi (3%!)(MISSING) 256Mi (6%!)(MISSING) 97s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (42%!)(MISSING) 0 (0%!)(MISSING)
memory 388Mi (10%!)(MISSING) 426Mi (11%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 105s kube-proxy
Normal Starting 2m7s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 2m7s (x8 over 2m7s) kubelet Node addons-874655 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 2m7s (x8 over 2m7s) kubelet Node addons-874655 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 2m7s (x7 over 2m7s) kubelet Node addons-874655 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 2m7s kubelet Updated Node Allocatable limit across pods
Normal Starting 119s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 119s kubelet Node addons-874655 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 119s kubelet Node addons-874655 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 119s kubelet Node addons-874655 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 118s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 118s kubelet Node addons-874655 status is now: NodeReady
Normal RegisteredNode 107s node-controller Node addons-874655 event: Registered Node addons-874655 in Controller
==> dmesg <==
[ +0.095605] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ +4.457675] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[ +2.969427] systemd-fstab-generator[114]: Ignoring "noauto" for root device
[ +0.139323] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[ +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[ +5.055561] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000006] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)
[ +9.039138] systemd-fstab-generator[557]: Ignoring "noauto" for root device
[ +0.104628] systemd-fstab-generator[568]: Ignoring "noauto" for root device
[ +0.135503] systemd-fstab-generator[581]: Ignoring "noauto" for root device
[ +0.098874] systemd-fstab-generator[592]: Ignoring "noauto" for root device
[ +0.245513] systemd-fstab-generator[619]: Ignoring "noauto" for root device
[ +6.157361] systemd-fstab-generator[678]: Ignoring "noauto" for root device
[ +4.281763] systemd-fstab-generator[843]: Ignoring "noauto" for root device
[ +8.779125] systemd-fstab-generator[1208]: Ignoring "noauto" for root device
[Jan16 01:57] kauditd_printk_skb: 26 callbacks suppressed
[ +5.535040] kauditd_printk_skb: 55 callbacks suppressed
[ +5.110379] kauditd_printk_skb: 30 callbacks suppressed
[ +10.747331] kauditd_printk_skb: 4 callbacks suppressed
[Jan16 01:58] kauditd_printk_skb: 18 callbacks suppressed
[ +12.838906] kauditd_printk_skb: 28 callbacks suppressed
[ +5.521844] kauditd_printk_skb: 5 callbacks suppressed
[ +12.372005] kauditd_printk_skb: 20 callbacks suppressed
[ +6.896951] kauditd_printk_skb: 9 callbacks suppressed
==> etcd [e77edeeac5c6cbe28cfdcf68a4c17e7add5effa37e0d36432844374b617f58cb] <==
{"level":"info","ts":"2024-01-16T01:58:14.123642Z","caller":"traceutil/trace.go:171","msg":"trace[71218723] transaction","detail":"{read_only:false; response_revision:1007; number_of_response:1; }","duration":"113.083388ms","start":"2024-01-16T01:58:14.009855Z","end":"2024-01-16T01:58:14.122939Z","steps":["trace[71218723] 'process raft request' (duration: 112.828315ms)"],"step_count":1}
{"level":"warn","ts":"2024-01-16T01:58:16.215156Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"311.374379ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/secrets/ingress-nginx/ingress-nginx-admission\" ","response":"range_response_count:1 size:1823"}
{"level":"info","ts":"2024-01-16T01:58:16.215231Z","caller":"traceutil/trace.go:171","msg":"trace[164172009] range","detail":"{range_begin:/registry/secrets/ingress-nginx/ingress-nginx-admission; range_end:; response_count:1; response_revision:1020; }","duration":"311.467435ms","start":"2024-01-16T01:58:15.90375Z","end":"2024-01-16T01:58:16.215217Z","steps":["trace[164172009] 'range keys from in-memory index tree' (duration: 311.296553ms)"],"step_count":1}
{"level":"warn","ts":"2024-01-16T01:58:16.215237Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"395.955725ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/\" range_end:\"/registry/pods/kube-system0\" ","response":"range_response_count:18 size:81848"}
{"level":"warn","ts":"2024-01-16T01:58:16.215261Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2024-01-16T01:58:15.903737Z","time spent":"311.516907ms","remote":"127.0.0.1:39682","response type":"/etcdserverpb.KV/Range","request count":0,"request size":57,"response count":1,"response size":1845,"request content":"key:\"/registry/secrets/ingress-nginx/ingress-nginx-admission\" "}
{"level":"info","ts":"2024-01-16T01:58:16.215373Z","caller":"traceutil/trace.go:171","msg":"trace[2083700781] range","detail":"{range_begin:/registry/pods/kube-system/; range_end:/registry/pods/kube-system0; response_count:18; response_revision:1020; }","duration":"396.076261ms","start":"2024-01-16T01:58:15.819236Z","end":"2024-01-16T01:58:16.215312Z","steps":["trace[2083700781] 'range keys from in-memory index tree' (duration: 395.740778ms)"],"step_count":1}
{"level":"warn","ts":"2024-01-16T01:58:16.215403Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2024-01-16T01:58:15.819221Z","time spent":"396.174737ms","remote":"127.0.0.1:39704","response type":"/etcdserverpb.KV/Range","request count":0,"request size":58,"response count":18,"response size":81870,"request content":"key:\"/registry/pods/kube-system/\" range_end:\"/registry/pods/kube-system0\" "}
{"level":"warn","ts":"2024-01-16T01:58:16.215588Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"373.668118ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/gcp-auth/\" range_end:\"/registry/pods/gcp-auth0\" ","response":"range_response_count:3 size:10575"}
{"level":"info","ts":"2024-01-16T01:58:16.215609Z","caller":"traceutil/trace.go:171","msg":"trace[661959869] range","detail":"{range_begin:/registry/pods/gcp-auth/; range_end:/registry/pods/gcp-auth0; response_count:3; response_revision:1020; }","duration":"373.692285ms","start":"2024-01-16T01:58:15.841911Z","end":"2024-01-16T01:58:16.215603Z","steps":["trace[661959869] 'range keys from in-memory index tree' (duration: 373.57896ms)"],"step_count":1}
{"level":"warn","ts":"2024-01-16T01:58:16.215625Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2024-01-16T01:58:15.841891Z","time spent":"373.729079ms","remote":"127.0.0.1:39704","response type":"/etcdserverpb.KV/Range","request count":0,"request size":52,"response count":3,"response size":10597,"request content":"key:\"/registry/pods/gcp-auth/\" range_end:\"/registry/pods/gcp-auth0\" "}
{"level":"warn","ts":"2024-01-16T01:58:16.215814Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"343.772769ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/ingress-nginx/\" range_end:\"/registry/pods/ingress-nginx0\" ","response":"range_response_count:3 size:13488"}
{"level":"info","ts":"2024-01-16T01:58:16.215832Z","caller":"traceutil/trace.go:171","msg":"trace[845253016] range","detail":"{range_begin:/registry/pods/ingress-nginx/; range_end:/registry/pods/ingress-nginx0; response_count:3; response_revision:1020; }","duration":"343.792088ms","start":"2024-01-16T01:58:15.872035Z","end":"2024-01-16T01:58:16.215827Z","steps":["trace[845253016] 'range keys from in-memory index tree' (duration: 343.647238ms)"],"step_count":1}
{"level":"warn","ts":"2024-01-16T01:58:16.215849Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2024-01-16T01:58:15.87202Z","time spent":"343.824631ms","remote":"127.0.0.1:39704","response type":"/etcdserverpb.KV/Range","request count":0,"request size":62,"response count":3,"response size":13510,"request content":"key:\"/registry/pods/ingress-nginx/\" range_end:\"/registry/pods/ingress-nginx0\" "}
{"level":"info","ts":"2024-01-16T01:58:21.742469Z","caller":"traceutil/trace.go:171","msg":"trace[1523905726] transaction","detail":"{read_only:false; response_revision:1069; number_of_response:1; }","duration":"240.204104ms","start":"2024-01-16T01:58:21.502242Z","end":"2024-01-16T01:58:21.742447Z","steps":["trace[1523905726] 'process raft request' (duration: 237.321202ms)"],"step_count":1}
{"level":"info","ts":"2024-01-16T01:58:30.639822Z","caller":"traceutil/trace.go:171","msg":"trace[750266840] linearizableReadLoop","detail":"{readStateIndex:1168; appliedIndex:1167; }","duration":"215.542751ms","start":"2024-01-16T01:58:30.424265Z","end":"2024-01-16T01:58:30.639808Z","steps":["trace[750266840] 'read index received' (duration: 215.396327ms)","trace[750266840] 'applied index is now lower than readState.Index' (duration: 146.048µs)"],"step_count":2}
{"level":"info","ts":"2024-01-16T01:58:30.639952Z","caller":"traceutil/trace.go:171","msg":"trace[1811847833] transaction","detail":"{read_only:false; response_revision:1131; number_of_response:1; }","duration":"260.183714ms","start":"2024-01-16T01:58:30.379761Z","end":"2024-01-16T01:58:30.639944Z","steps":["trace[1811847833] 'process raft request' (duration: 259.939832ms)"],"step_count":1}
{"level":"warn","ts":"2024-01-16T01:58:30.640081Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"215.842144ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" ","response":"range_response_count:1 size:1113"}
{"level":"info","ts":"2024-01-16T01:58:30.640107Z","caller":"traceutil/trace.go:171","msg":"trace[1420506871] range","detail":"{range_begin:/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath; range_end:; response_count:1; response_revision:1131; }","duration":"215.881431ms","start":"2024-01-16T01:58:30.424218Z","end":"2024-01-16T01:58:30.6401Z","steps":["trace[1420506871] 'agreement among raft nodes before linearized reading' (duration: 215.811312ms)"],"step_count":1}
{"level":"info","ts":"2024-01-16T01:58:30.858381Z","caller":"traceutil/trace.go:171","msg":"trace[1528159913] transaction","detail":"{read_only:false; response_revision:1132; number_of_response:1; }","duration":"211.854915ms","start":"2024-01-16T01:58:30.64651Z","end":"2024-01-16T01:58:30.858365Z","steps":["trace[1528159913] 'process raft request' (duration: 207.387752ms)"],"step_count":1}
{"level":"info","ts":"2024-01-16T01:58:30.864878Z","caller":"traceutil/trace.go:171","msg":"trace[2139513759] transaction","detail":"{read_only:false; response_revision:1133; number_of_response:1; }","duration":"211.068793ms","start":"2024-01-16T01:58:30.653794Z","end":"2024-01-16T01:58:30.864863Z","steps":["trace[2139513759] 'process raft request' (duration: 210.42822ms)"],"step_count":1}
{"level":"info","ts":"2024-01-16T01:58:40.004815Z","caller":"traceutil/trace.go:171","msg":"trace[40018877] linearizableReadLoop","detail":"{readStateIndex:1228; appliedIndex:1227; }","duration":"144.683551ms","start":"2024-01-16T01:58:39.860118Z","end":"2024-01-16T01:58:40.004801Z","steps":["trace[40018877] 'read index received' (duration: 144.530691ms)","trace[40018877] 'applied index is now lower than readState.Index' (duration: 152.388µs)"],"step_count":2}
{"level":"info","ts":"2024-01-16T01:58:40.005163Z","caller":"traceutil/trace.go:171","msg":"trace[2072463945] transaction","detail":"{read_only:false; response_revision:1189; number_of_response:1; }","duration":"345.598526ms","start":"2024-01-16T01:58:39.659547Z","end":"2024-01-16T01:58:40.005145Z","steps":["trace[2072463945] 'process raft request' (duration: 345.141975ms)"],"step_count":1}
{"level":"warn","ts":"2024-01-16T01:58:40.005641Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2024-01-16T01:58:39.659529Z","time spent":"345.816812ms","remote":"127.0.0.1:39704","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":9161,"response count":0,"response size":38,"request content":"compare:<target:MOD key:\"/registry/pods/gadget/gadget-n8nxf\" mod_revision:1095 > success:<request_put:<key:\"/registry/pods/gadget/gadget-n8nxf\" value_size:9119 >> failure:<request_range:<key:\"/registry/pods/gadget/gadget-n8nxf\" > >"}
{"level":"warn","ts":"2024-01-16T01:58:40.006151Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"146.042524ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/addons-874655\" ","response":"range_response_count:1 size:7200"}
{"level":"info","ts":"2024-01-16T01:58:40.006458Z","caller":"traceutil/trace.go:171","msg":"trace[226775157] range","detail":"{range_begin:/registry/minions/addons-874655; range_end:; response_count:1; response_revision:1189; }","duration":"146.353772ms","start":"2024-01-16T01:58:39.860092Z","end":"2024-01-16T01:58:40.006446Z","steps":["trace[226775157] 'agreement among raft nodes before linearized reading' (duration: 146.025103ms)"],"step_count":1}
==> gcp-auth [e8bf9ea1434a26dbc40b7355ac426fd430754cf0d247fdfe5ad11dac1d8158cd] <==
2024/01/16 01:58:38 GCP Auth Webhook started!
2024/01/16 01:58:50 Ready to marshal response ...
2024/01/16 01:58:50 Ready to write response ...
2024/01/16 01:58:52 Ready to marshal response ...
2024/01/16 01:58:52 Ready to write response ...
2024/01/16 01:58:52 Ready to marshal response ...
2024/01/16 01:58:52 Ready to write response ...
==> kernel <==
01:58:58 up 2 min, 0 users, load average: 2.59, 1.45, 0.57
Linux addons-874655 5.10.57 #1 SMP Thu Dec 28 22:04:21 UTC 2023 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2021.02.12"
==> kube-apiserver [a401d2fb30cdee44bc8f2d539cd9e4a6b44f3dd6933a62fac33ce544e6a90d21] <==
I0116 01:57:23.565329 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.101.252.84"}
I0116 01:57:23.661187 1 controller.go:624] quota admission added evaluator for: jobs.batch
W0116 01:57:24.997769 1 aggregator.go:166] failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0116 01:57:25.922061 1 alloc.go:330] "allocated clusterIPs" service="kube-system/csi-hostpath-attacher" clusterIPs={"IPv4":"10.109.68.207"}
I0116 01:57:25.956173 1 controller.go:624] quota admission added evaluator for: statefulsets.apps
I0116 01:57:26.178219 1 alloc.go:330] "allocated clusterIPs" service="kube-system/csi-hostpath-resizer" clusterIPs={"IPv4":"10.99.31.113"}
W0116 01:57:27.419135 1 aggregator.go:166] failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0116 01:57:28.120657 1 alloc.go:330] "allocated clusterIPs" service="gcp-auth/gcp-auth" clusterIPs={"IPv4":"10.101.73.91"}
I0116 01:57:55.919929 1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
E0116 01:57:57.023772 1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.105.157.40:443/apis/metrics.k8s.io/v1beta1: Get "https://10.105.157.40:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.105.157.40:443: connect: connection refused
E0116 01:57:57.025744 1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.105.157.40:443/apis/metrics.k8s.io/v1beta1: Get "https://10.105.157.40:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.105.157.40:443: connect: connection refused
W0116 01:57:57.027455 1 handler_proxy.go:93] no RequestInfo found in the context
E0116 01:57:57.027689 1 controller.go:146] Error updating APIService "v1beta1.metrics.k8s.io" with err: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
E0116 01:57:57.029746 1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.105.157.40:443/apis/metrics.k8s.io/v1beta1: Get "https://10.105.157.40:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.105.157.40:443: connect: connection refused
I0116 01:57:57.030646 1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
E0116 01:57:57.056820 1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.105.157.40:443/apis/metrics.k8s.io/v1beta1: Get "https://10.105.157.40:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.105.157.40:443: connect: connection refused
E0116 01:57:57.099553 1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.105.157.40:443/apis/metrics.k8s.io/v1beta1: Get "https://10.105.157.40:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.105.157.40:443: connect: connection refused
I0116 01:57:57.249886 1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
I0116 01:58:45.550820 1 handler.go:232] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager
I0116 01:58:45.557132 1 handler.go:232] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager
W0116 01:58:46.675590 1 cacher.go:171] Terminating all watchers from cacher traces.gadget.kinvolk.io
I0116 01:58:58.046006 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Nothing (removed from the queue).
==> kube-controller-manager [138e7cf6410ad1a952ff22471fbad10e7fc87031924284c46e86f2b6c7c9cb7c] <==
I0116 01:58:38.673191 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="gcp-auth/gcp-auth-d4c87556c" duration="18.371325ms"
I0116 01:58:38.673763 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="gcp-auth/gcp-auth-d4c87556c" duration="65.915µs"
I0116 01:58:39.135347 1 event.go:307] "Event occurred" object="default/hpvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="Waiting for a volume to be created either by the external provisioner 'hostpath.csi.k8s.io' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered."
I0116 01:58:41.084428 1 event.go:307] "Event occurred" object="default/hpvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="Waiting for a volume to be created either by the external provisioner 'hostpath.csi.k8s.io' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered."
I0116 01:58:45.746261 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/metrics-server-7c66d45ddc" duration="10.661µs"
E0116 01:58:46.677623 1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: the server could not find the requested resource
W0116 01:58:47.798726 1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0116 01:58:47.798834 1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
I0116 01:58:47.927179 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="ingress-nginx/ingress-nginx-controller-69cff4fd79" duration="25.920614ms"
I0116 01:58:47.927719 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="ingress-nginx/ingress-nginx-controller-69cff4fd79" duration="455.119µs"
W0116 01:58:50.473633 1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0116 01:58:50.473671 1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
I0116 01:58:52.177221 1 event.go:307] "Event occurred" object="default/test-pvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="WaitForFirstConsumer" message="waiting for first consumer to be created before binding"
I0116 01:58:52.330264 1 event.go:307] "Event occurred" object="default/test-pvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="Waiting for a volume to be created either by the external provisioner 'rancher.io/local-path' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered."
I0116 01:58:52.330996 1 event.go:307] "Event occurred" object="default/test-pvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="Waiting for a volume to be created either by the external provisioner 'rancher.io/local-path' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered."
I0116 01:58:54.021252 1 job_controller.go:562] "enqueueing job" key="gcp-auth/gcp-auth-certs-patch"
I0116 01:58:54.028419 1 job_controller.go:562] "enqueueing job" key="gcp-auth/gcp-auth-certs-create"
W0116 01:58:54.033566 1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0116 01:58:54.033780 1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
I0116 01:58:54.069890 1 job_controller.go:562] "enqueueing job" key="gcp-auth/gcp-auth-certs-patch"
I0116 01:58:54.072822 1 job_controller.go:562] "enqueueing job" key="gcp-auth/gcp-auth-certs-create"
I0116 01:58:55.686995 1 replica_set.go:676] "Finished syncing" kind="ReplicationController" key="kube-system/registry" duration="7.848µs"
I0116 01:58:55.778424 1 namespace_controller.go:182] "Namespace has been deleted" namespace="gadget"
I0116 01:58:56.084834 1 event.go:307] "Event occurred" object="default/test-pvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="Waiting for a volume to be created either by the external provisioner 'rancher.io/local-path' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered."
I0116 01:58:56.084892 1 event.go:307] "Event occurred" object="default/hpvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="Waiting for a volume to be created either by the external provisioner 'hostpath.csi.k8s.io' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered."
==> kube-proxy [b6c383016f6feb534657bde7edf8af0ffe2f72fd3f6cac8f6e51154801314ec8] <==
I0116 01:57:12.650678 1 server_others.go:69] "Using iptables proxy"
I0116 01:57:12.662010 1 node.go:141] Successfully retrieved node IP: 192.168.39.252
I0116 01:57:12.874372 1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"
I0116 01:57:12.874413 1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"
I0116 01:57:12.883993 1 server_others.go:152] "Using iptables Proxier"
I0116 01:57:12.884056 1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I0116 01:57:12.884228 1 server.go:846] "Version info" version="v1.28.4"
I0116 01:57:12.887516 1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0116 01:57:12.888504 1 config.go:188] "Starting service config controller"
I0116 01:57:12.888524 1 shared_informer.go:311] Waiting for caches to sync for service config
I0116 01:57:12.888545 1 config.go:97] "Starting endpoint slice config controller"
I0116 01:57:12.888549 1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
I0116 01:57:12.892722 1 config.go:315] "Starting node config controller"
I0116 01:57:12.892760 1 shared_informer.go:311] Waiting for caches to sync for node config
I0116 01:57:12.989389 1 shared_informer.go:318] Caches are synced for endpoint slice config
I0116 01:57:12.989492 1 shared_informer.go:318] Caches are synced for service config
I0116 01:57:13.115409 1 shared_informer.go:318] Caches are synced for node config
==> kube-scheduler [d3b48cbdf9598c266af4e49abf8b012e38f15d1a33f818222bc4ad874add39c0] <==
W0116 01:56:56.871125 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0116 01:56:56.871151 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
W0116 01:56:56.948457 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0116 01:56:56.948723 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
W0116 01:56:56.973206 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0116 01:56:56.973588 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
W0116 01:56:56.991668 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0116 01:56:56.992083 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
W0116 01:56:57.015917 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0116 01:56:57.016226 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
W0116 01:56:57.082338 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0116 01:56:57.082365 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
W0116 01:56:57.105452 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0116 01:56:57.105500 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
W0116 01:56:57.261757 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0116 01:56:57.261846 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
W0116 01:56:57.293938 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
E0116 01:56:57.293984 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
W0116 01:56:57.337040 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0116 01:56:57.337092 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
W0116 01:56:57.349056 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0116 01:56:57.349105 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
W0116 01:56:57.501070 1 reflector.go:535] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0116 01:56:57.501615 1 reflector.go:147] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
I0116 01:57:00.150409 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
-- Journal begins at Tue 2024-01-16 01:56:25 UTC, ends at Tue 2024-01-16 01:58:58 UTC. --
Jan 16 01:58:57 addons-874655 kubelet[1215]: I0116 01:58:57.139415 1215 operation_generator.go:882] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa567d99-ecd4-4bcb-8dba-42cce4221e16-script" (OuterVolumeSpecName: "script") pod "aa567d99-ecd4-4bcb-8dba-42cce4221e16" (UID: "aa567d99-ecd4-4bcb-8dba-42cce4221e16"). InnerVolumeSpecName "script". PluginName "kubernetes.io/configmap", VolumeGidValue ""
Jan 16 01:58:57 addons-874655 kubelet[1215]: I0116 01:58:57.144088 1215 operation_generator.go:882] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa567d99-ecd4-4bcb-8dba-42cce4221e16-kube-api-access-q8sxp" (OuterVolumeSpecName: "kube-api-access-q8sxp") pod "aa567d99-ecd4-4bcb-8dba-42cce4221e16" (UID: "aa567d99-ecd4-4bcb-8dba-42cce4221e16"). InnerVolumeSpecName "kube-api-access-q8sxp". PluginName "kubernetes.io/projected", VolumeGidValue ""
Jan 16 01:58:57 addons-874655 kubelet[1215]: I0116 01:58:57.239350 1215 reconciler_common.go:300] "Volume detached for volume \"script\" (UniqueName: \"kubernetes.io/configmap/aa567d99-ecd4-4bcb-8dba-42cce4221e16-script\") on node \"addons-874655\" DevicePath \"\""
Jan 16 01:58:57 addons-874655 kubelet[1215]: I0116 01:58:57.239404 1215 reconciler_common.go:300] "Volume detached for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/aa567d99-ecd4-4bcb-8dba-42cce4221e16-gcp-creds\") on node \"addons-874655\" DevicePath \"\""
Jan 16 01:58:57 addons-874655 kubelet[1215]: I0116 01:58:57.239416 1215 reconciler_common.go:300] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/host-path/aa567d99-ecd4-4bcb-8dba-42cce4221e16-data\") on node \"addons-874655\" DevicePath \"\""
Jan 16 01:58:57 addons-874655 kubelet[1215]: I0116 01:58:57.239429 1215 reconciler_common.go:300] "Volume detached for volume \"kube-api-access-q8sxp\" (UniqueName: \"kubernetes.io/projected/aa567d99-ecd4-4bcb-8dba-42cce4221e16-kube-api-access-q8sxp\") on node \"addons-874655\" DevicePath \"\""
Jan 16 01:58:57 addons-874655 kubelet[1215]: I0116 01:58:57.715435 1215 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1907fb2e-d297-4c24-82d4-d7d8736b29cf" path="/var/lib/kubelet/pods/1907fb2e-d297-4c24-82d4-d7d8736b29cf/volumes"
Jan 16 01:58:57 addons-874655 kubelet[1215]: I0116 01:58:57.716096 1215 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="64fc9ce0-7e9b-4533-89a0-30e3a30cc0ed" path="/var/lib/kubelet/pods/64fc9ce0-7e9b-4533-89a0-30e3a30cc0ed/volumes"
Jan 16 01:58:57 addons-874655 kubelet[1215]: I0116 01:58:57.716800 1215 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a88dbfda-64b4-4b19-b555-d3c1125242f9" path="/var/lib/kubelet/pods/a88dbfda-64b4-4b19-b555-d3c1125242f9/volumes"
Jan 16 01:58:57 addons-874655 kubelet[1215]: I0116 01:58:57.717430 1215 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aa567d99-ecd4-4bcb-8dba-42cce4221e16" path="/var/lib/kubelet/pods/aa567d99-ecd4-4bcb-8dba-42cce4221e16/volumes"
Jan 16 01:58:57 addons-874655 kubelet[1215]: I0116 01:58:57.891712 1215 scope.go:117] "RemoveContainer" containerID="c3bea67148c4bf08c382a847bed299c160374f0ac76a903ad2af44589a0683db"
Jan 16 01:58:58 addons-874655 kubelet[1215]: I0116 01:58:58.340412 1215 topology_manager.go:215] "Topology Admit Handler" podUID="b3265e99-bad5-4210-8d5d-dcdba5402df4" podNamespace="default" podName="test-local-path"
Jan 16 01:58:58 addons-874655 kubelet[1215]: E0116 01:58:58.340492 1215 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="a88dbfda-64b4-4b19-b555-d3c1125242f9" containerName="nvidia-device-plugin-ctr"
Jan 16 01:58:58 addons-874655 kubelet[1215]: E0116 01:58:58.340505 1215 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="64f91c39-5fc4-4a97-b018-fa61d877c001" containerName="registry-test"
Jan 16 01:58:58 addons-874655 kubelet[1215]: E0116 01:58:58.340513 1215 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="1907fb2e-d297-4c24-82d4-d7d8736b29cf" containerName="registry"
Jan 16 01:58:58 addons-874655 kubelet[1215]: E0116 01:58:58.340520 1215 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="64fc9ce0-7e9b-4533-89a0-30e3a30cc0ed" containerName="registry-proxy"
Jan 16 01:58:58 addons-874655 kubelet[1215]: E0116 01:58:58.340528 1215 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="aa567d99-ecd4-4bcb-8dba-42cce4221e16" containerName="helper-pod"
Jan 16 01:58:58 addons-874655 kubelet[1215]: I0116 01:58:58.340563 1215 memory_manager.go:346] "RemoveStaleState removing state" podUID="a88dbfda-64b4-4b19-b555-d3c1125242f9" containerName="nvidia-device-plugin-ctr"
Jan 16 01:58:58 addons-874655 kubelet[1215]: I0116 01:58:58.340570 1215 memory_manager.go:346] "RemoveStaleState removing state" podUID="64fc9ce0-7e9b-4533-89a0-30e3a30cc0ed" containerName="registry-proxy"
Jan 16 01:58:58 addons-874655 kubelet[1215]: I0116 01:58:58.340578 1215 memory_manager.go:346] "RemoveStaleState removing state" podUID="64f91c39-5fc4-4a97-b018-fa61d877c001" containerName="registry-test"
Jan 16 01:58:58 addons-874655 kubelet[1215]: I0116 01:58:58.340586 1215 memory_manager.go:346] "RemoveStaleState removing state" podUID="aa567d99-ecd4-4bcb-8dba-42cce4221e16" containerName="helper-pod"
Jan 16 01:58:58 addons-874655 kubelet[1215]: I0116 01:58:58.340592 1215 memory_manager.go:346] "RemoveStaleState removing state" podUID="1907fb2e-d297-4c24-82d4-d7d8736b29cf" containerName="registry"
Jan 16 01:58:58 addons-874655 kubelet[1215]: I0116 01:58:58.447511 1215 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/b3265e99-bad5-4210-8d5d-dcdba5402df4-gcp-creds\") pod \"test-local-path\" (UID: \"b3265e99-bad5-4210-8d5d-dcdba5402df4\") " pod="default/test-local-path"
Jan 16 01:58:58 addons-874655 kubelet[1215]: I0116 01:58:58.447731 1215 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njw75\" (UniqueName: \"kubernetes.io/projected/b3265e99-bad5-4210-8d5d-dcdba5402df4-kube-api-access-njw75\") pod \"test-local-path\" (UID: \"b3265e99-bad5-4210-8d5d-dcdba5402df4\") " pod="default/test-local-path"
Jan 16 01:58:58 addons-874655 kubelet[1215]: I0116 01:58:58.448043 1215 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-5fe80822-5bac-479e-b226-db3831abc964\" (UniqueName: \"kubernetes.io/host-path/b3265e99-bad5-4210-8d5d-dcdba5402df4-pvc-5fe80822-5bac-479e-b226-db3831abc964\") pod \"test-local-path\" (UID: \"b3265e99-bad5-4210-8d5d-dcdba5402df4\") " pod="default/test-local-path"
==> storage-provisioner [0185312efa995d56c35f389356765d2ec3d516115482241acb480471655499b8] <==
I0116 01:57:25.094077 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0116 01:57:25.150567 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0116 01:57:25.150608 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0116 01:57:25.300043 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0116 01:57:25.310362 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-874655_5444d8fd-b96b-4714-92a7-bf56e0bcbdaf!
I0116 01:57:25.586865 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"72f4f89e-1aba-4eb9-a4d8-d679c4676ab7", APIVersion:"v1", ResourceVersion:"755", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-874655_5444d8fd-b96b-4714-92a7-bf56e0bcbdaf became leader
I0116 01:57:25.715423 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-874655_5444d8fd-b96b-4714-92a7-bf56e0bcbdaf!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p addons-874655 -n addons-874655
helpers_test.go:261: (dbg) Run: kubectl --context addons-874655 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: test-local-path ingress-nginx-admission-create-kkrqg ingress-nginx-admission-patch-2sqsd
helpers_test.go:274: ======> post-mortem[TestAddons/parallel/Headlamp]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-874655 describe pod test-local-path ingress-nginx-admission-create-kkrqg ingress-nginx-admission-patch-2sqsd
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-874655 describe pod test-local-path ingress-nginx-admission-create-kkrqg ingress-nginx-admission-patch-2sqsd: exit status 1 (79.097293ms)
-- stdout --
Name: test-local-path
Namespace: default
Priority: 0
Service Account: default
Node: addons-874655/192.168.39.252
Start Time: Tue, 16 Jan 2024 01:58:58 +0000
Labels: run=test-local-path
Annotations: <none>
Status: Pending
IP:
IPs: <none>
Containers:
busybox:
Container ID:
Image: busybox:stable
Image ID:
Port: <none>
Host Port: <none>
Command:
sh
-c
echo 'local-path-provisioner' > /test/file1
State: Waiting
Reason: ContainerCreating
Ready: False
Restart Count: 0
Environment:
GOOGLE_APPLICATION_CREDENTIALS: /google-app-creds.json
PROJECT_ID: this_is_fake
GCP_PROJECT: this_is_fake
GCLOUD_PROJECT: this_is_fake
GOOGLE_CLOUD_PROJECT: this_is_fake
CLOUDSDK_CORE_PROJECT: this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/test from data (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-njw75 (ro)
Conditions:
Type Status
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
data:
Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
ClaimName: test-pvc
ReadOnly: false
kube-api-access-njw75:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
gcp-creds:
Type: HostPath (bare host directory volume)
Path: /var/lib/minikube/google_application_credentials.json
HostPathType: File
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 1s default-scheduler Successfully assigned default/test-local-path to addons-874655
Normal Pulling 0s kubelet Pulling image "busybox:stable"
-- /stdout --
** stderr **
Error from server (NotFound): pods "ingress-nginx-admission-create-kkrqg" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-2sqsd" not found
** /stderr **
helpers_test.go:279: kubectl --context addons-874655 describe pod test-local-path ingress-nginx-admission-create-kkrqg ingress-nginx-admission-patch-2sqsd: exit status 1
--- FAIL: TestAddons/parallel/Headlamp (2.98s)