=== RUN TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress
=== CONT TestAddons/parallel/Ingress
addons_test.go:207: (dbg) Run: kubectl --context addons-012219 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:232: (dbg) Run: kubectl --context addons-012219 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:245: (dbg) Run: kubectl --context addons-012219 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:250: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [a2751ab5-cd1c-44a3-a6ba-dba98b254a96] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:329: TestAddons/parallel/Ingress: WARNING: pod list for "default" "run=nginx" returned: client rate limiter Wait returned an error: context deadline exceeded
addons_test.go:250: ***** TestAddons/parallel/Ingress: pod "run=nginx" failed to start within 8m0s: context deadline exceeded ****
addons_test.go:250: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p addons-012219 -n addons-012219
addons_test.go:250: TestAddons/parallel/Ingress: showing logs for failed pods as of 2025-03-17 12:51:42.019047253 +0000 UTC m=+806.270896887
addons_test.go:250: (dbg) Run: kubectl --context addons-012219 describe po nginx -n default
addons_test.go:250: (dbg) kubectl --context addons-012219 describe po nginx -n default:
Name: nginx
Namespace: default
Priority: 0
Service Account: default
Node: addons-012219/192.168.49.2
Start Time: Mon, 17 Mar 2025 12:43:41 +0000
Labels: run=nginx
Annotations: <none>
Status: Pending
IP: 10.244.0.34
IPs:
IP: 10.244.0.34
Containers:
nginx:
Container ID:
Image: docker.io/nginx:alpine
Image ID:
Port: 80/TCP
Host Port: 0/TCP
State: Waiting
Reason: ImagePullBackOff
Ready: False
Restart Count: 0
Environment: <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-hh4v9 (ro)
Conditions:
Type Status
PodReadyToStartContainers True
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
kube-api-access-hh4v9:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 8m1s default-scheduler Successfully assigned default/nginx to addons-012219
Normal Pulling 5m (x5 over 8m) kubelet Pulling image "docker.io/nginx:alpine"
Warning Failed 4m57s (x5 over 7m57s) kubelet Failed to pull image "docker.io/nginx:alpine": failed to pull and unpack image "docker.io/library/nginx:alpine": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/nginx/manifests/sha256:4ff102c5d78d254a6f0da062b3cf39eaf07f01eec0927fd21e219d0af8bc0591: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit
Warning Failed 4m57s (x5 over 7m57s) kubelet Error: ErrImagePull
Warning Failed 2m57s (x19 over 7m56s) kubelet Error: ImagePullBackOff
Normal BackOff 2m29s (x21 over 7m56s) kubelet Back-off pulling image "docker.io/nginx:alpine"
addons_test.go:250: (dbg) Run: kubectl --context addons-012219 logs nginx -n default
addons_test.go:250: (dbg) Non-zero exit: kubectl --context addons-012219 logs nginx -n default: exit status 1 (78.132039ms)
** stderr **
Error from server (BadRequest): container "nginx" in pod "nginx" is waiting to start: trying and failing to pull image
** /stderr **
addons_test.go:250: kubectl --context addons-012219 logs nginx -n default: exit status 1
addons_test.go:251: failed waiting for ngnix pod: run=nginx within 8m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestAddons/parallel/Ingress]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect addons-012219
helpers_test.go:235: (dbg) docker inspect addons-012219:
-- stdout --
[
{
"Id": "8197043953b271260b844f01368eb6294459dd32030fca676a89e7c55b3b7baf",
"Created": "2025-03-17T12:39:11.6117619Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 455652,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-03-17T12:39:11.648441729Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:b0734d4b8a5a2dbe50c35bd8745d33dc9ec48b1b1af7ad72f6736a52b01c8ce5",
"ResolvConfPath": "/var/lib/docker/containers/8197043953b271260b844f01368eb6294459dd32030fca676a89e7c55b3b7baf/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/8197043953b271260b844f01368eb6294459dd32030fca676a89e7c55b3b7baf/hostname",
"HostsPath": "/var/lib/docker/containers/8197043953b271260b844f01368eb6294459dd32030fca676a89e7c55b3b7baf/hosts",
"LogPath": "/var/lib/docker/containers/8197043953b271260b844f01368eb6294459dd32030fca676a89e7c55b3b7baf/8197043953b271260b844f01368eb6294459dd32030fca676a89e7c55b3b7baf-json.log",
"Name": "/addons-012219",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"addons-012219:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "addons-012219",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4194304000,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8388608000,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "8197043953b271260b844f01368eb6294459dd32030fca676a89e7c55b3b7baf",
"LowerDir": "/var/lib/docker/overlay2/a74098a93f2345c9e4264de07f8a2e26b053757299012a821a0e2ec221e9ec58-init/diff:/var/lib/docker/overlay2/0d1b72eeaeef000e911d7896b151fb0d0a984c18eeb180d19223ea8ba67fdac6/diff",
"MergedDir": "/var/lib/docker/overlay2/a74098a93f2345c9e4264de07f8a2e26b053757299012a821a0e2ec221e9ec58/merged",
"UpperDir": "/var/lib/docker/overlay2/a74098a93f2345c9e4264de07f8a2e26b053757299012a821a0e2ec221e9ec58/diff",
"WorkDir": "/var/lib/docker/overlay2/a74098a93f2345c9e4264de07f8a2e26b053757299012a821a0e2ec221e9ec58/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "addons-012219",
"Source": "/var/lib/docker/volumes/addons-012219/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "addons-012219",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-012219",
"name.minikube.sigs.k8s.io": "addons-012219",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "452ad4fa346bbc598add717085bed619e052b873df7af970d51fdbc4e83feeb5",
"SandboxKey": "/var/run/docker/netns/452ad4fa346b",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33145"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33146"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33149"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33147"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33148"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"addons-012219": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "da:86:92:3e:af:06",
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "d3969b4da548f201032412c0cc3078db46294c18bc50d2dd5fac1526b374ada7",
"EndpointID": "0f281088beec74782f3e18095976832a627c3e17e266ddc1de94d77add036cd0",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-012219",
"8197043953b2"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p addons-012219 -n addons-012219
helpers_test.go:244: <<< TestAddons/parallel/Ingress FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/parallel/Ingress]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p addons-012219 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p addons-012219 logs -n 25: (1.251152135s)
helpers_test.go:252: TestAddons/parallel/Ingress logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| delete | -p download-only-498596 | download-only-498596 | jenkins | v1.35.0 | 17 Mar 25 12:38 UTC | 17 Mar 25 12:38 UTC |
| delete | -p download-only-960465 | download-only-960465 | jenkins | v1.35.0 | 17 Mar 25 12:38 UTC | 17 Mar 25 12:38 UTC |
| delete | -p download-only-498596 | download-only-498596 | jenkins | v1.35.0 | 17 Mar 25 12:38 UTC | 17 Mar 25 12:38 UTC |
| start | --download-only -p | download-docker-513231 | jenkins | v1.35.0 | 17 Mar 25 12:38 UTC | |
| | download-docker-513231 | | | | | |
| | --alsologtostderr | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p download-docker-513231 | download-docker-513231 | jenkins | v1.35.0 | 17 Mar 25 12:38 UTC | 17 Mar 25 12:38 UTC |
| start | --download-only -p | binary-mirror-312807 | jenkins | v1.35.0 | 17 Mar 25 12:38 UTC | |
| | binary-mirror-312807 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:45577 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p binary-mirror-312807 | binary-mirror-312807 | jenkins | v1.35.0 | 17 Mar 25 12:38 UTC | 17 Mar 25 12:38 UTC |
| addons | disable dashboard -p | addons-012219 | jenkins | v1.35.0 | 17 Mar 25 12:38 UTC | |
| | addons-012219 | | | | | |
| addons | enable dashboard -p | addons-012219 | jenkins | v1.35.0 | 17 Mar 25 12:38 UTC | |
| | addons-012219 | | | | | |
| start | -p addons-012219 --wait=true | addons-012219 | jenkins | v1.35.0 | 17 Mar 25 12:38 UTC | 17 Mar 25 12:42 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --addons=amd-gpu-device-plugin | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| addons | addons-012219 addons disable | addons-012219 | jenkins | v1.35.0 | 17 Mar 25 12:42 UTC | 17 Mar 25 12:42 UTC |
| | volcano --alsologtostderr -v=1 | | | | | |
| addons | addons-012219 addons disable | addons-012219 | jenkins | v1.35.0 | 17 Mar 25 12:43 UTC | 17 Mar 25 12:43 UTC |
| | gcp-auth --alsologtostderr | | | | | |
| | -v=1 | | | | | |
| addons | enable headlamp | addons-012219 | jenkins | v1.35.0 | 17 Mar 25 12:43 UTC | 17 Mar 25 12:43 UTC |
| | -p addons-012219 | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | addons-012219 addons disable | addons-012219 | jenkins | v1.35.0 | 17 Mar 25 12:43 UTC | 17 Mar 25 12:43 UTC |
| | amd-gpu-device-plugin | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | addons-012219 addons | addons-012219 | jenkins | v1.35.0 | 17 Mar 25 12:43 UTC | 17 Mar 25 12:43 UTC |
| | disable nvidia-device-plugin | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | addons-012219 addons disable | addons-012219 | jenkins | v1.35.0 | 17 Mar 25 12:43 UTC | 17 Mar 25 12:43 UTC |
| | headlamp --alsologtostderr | | | | | |
| | -v=1 | | | | | |
| addons | addons-012219 addons | addons-012219 | jenkins | v1.35.0 | 17 Mar 25 12:43 UTC | 17 Mar 25 12:43 UTC |
| | disable metrics-server | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| ip | addons-012219 ip | addons-012219 | jenkins | v1.35.0 | 17 Mar 25 12:43 UTC | 17 Mar 25 12:43 UTC |
| addons | addons-012219 addons disable | addons-012219 | jenkins | v1.35.0 | 17 Mar 25 12:43 UTC | 17 Mar 25 12:43 UTC |
| | registry --alsologtostderr | | | | | |
| | -v=1 | | | | | |
| addons | addons-012219 addons | addons-012219 | jenkins | v1.35.0 | 17 Mar 25 12:43 UTC | 17 Mar 25 12:43 UTC |
| | disable cloud-spanner | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | addons-012219 addons disable | addons-012219 | jenkins | v1.35.0 | 17 Mar 25 12:43 UTC | 17 Mar 25 12:43 UTC |
| | yakd --alsologtostderr -v=1 | | | | | |
| addons | addons-012219 addons | addons-012219 | jenkins | v1.35.0 | 17 Mar 25 12:43 UTC | 17 Mar 25 12:43 UTC |
| | disable inspektor-gadget | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | addons-012219 addons | addons-012219 | jenkins | v1.35.0 | 17 Mar 25 12:44 UTC | 17 Mar 25 12:44 UTC |
| | disable volumesnapshots | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | addons-012219 addons | addons-012219 | jenkins | v1.35.0 | 17 Mar 25 12:44 UTC | 17 Mar 25 12:44 UTC |
| | disable csi-hostpath-driver | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | addons-012219 addons disable | addons-012219 | jenkins | v1.35.0 | 17 Mar 25 12:46 UTC | 17 Mar 25 12:47 UTC |
| | storage-provisioner-rancher | | | | | |
| | --alsologtostderr -v=1 | | | | | |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2025/03/17 12:38:48
Running on machine: ubuntu-20-agent-11
Binary: Built with gc go1.24.0 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0317 12:38:48.035665 455052 out.go:345] Setting OutFile to fd 1 ...
I0317 12:38:48.036294 455052 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0317 12:38:48.036342 455052 out.go:358] Setting ErrFile to fd 2...
I0317 12:38:48.036350 455052 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0317 12:38:48.036801 455052 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20539-446828/.minikube/bin
I0317 12:38:48.037791 455052 out.go:352] Setting JSON to false
I0317 12:38:48.038760 455052 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-11","uptime":8468,"bootTime":1742206660,"procs":181,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1078-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0317 12:38:48.038904 455052 start.go:139] virtualization: kvm guest
I0317 12:38:48.040562 455052 out.go:177] * [addons-012219] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0317 12:38:48.041822 455052 out.go:177] - MINIKUBE_LOCATION=20539
I0317 12:38:48.041817 455052 notify.go:220] Checking for updates...
I0317 12:38:48.043176 455052 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0317 12:38:48.044454 455052 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20539-446828/kubeconfig
I0317 12:38:48.045722 455052 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20539-446828/.minikube
I0317 12:38:48.046826 455052 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0317 12:38:48.048090 455052 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0317 12:38:48.049578 455052 driver.go:394] Setting default libvirt URI to qemu:///system
I0317 12:38:48.074854 455052 docker.go:123] docker version: linux-28.0.1:Docker Engine - Community
I0317 12:38:48.074957 455052 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0317 12:38:48.127449 455052 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:28 OomKillDisable:true NGoroutines:44 SystemTime:2025-03-17 12:38:48.118130941 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1078-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647992832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-11 Labels:[] ExperimentalBuild:false ServerVersion:28.0.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:bcc810d6b9066471b0b6fa75f557a15a1cbf31bb Expected:bcc810d6b9066471b0b6fa75f557a15a1cbf31bb} RuncCommit:{ID:v1.2.4-0-g6c52b3f Expected:v1.2.4-0-g6c52b3f} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil>
ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.21.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.33.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I0317 12:38:48.127557 455052 docker.go:318] overlay module found
I0317 12:38:48.129183 455052 out.go:177] * Using the docker driver based on user configuration
I0317 12:38:48.130332 455052 start.go:297] selected driver: docker
I0317 12:38:48.130353 455052 start.go:901] validating driver "docker" against <nil>
I0317 12:38:48.130368 455052 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0317 12:38:48.131173 455052 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0317 12:38:48.182534 455052 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:28 OomKillDisable:true NGoroutines:44 SystemTime:2025-03-17 12:38:48.173184645 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1078-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647992832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-11 Labels:[] ExperimentalBuild:false ServerVersion:28.0.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:bcc810d6b9066471b0b6fa75f557a15a1cbf31bb Expected:bcc810d6b9066471b0b6fa75f557a15a1cbf31bb} RuncCommit:{ID:v1.2.4-0-g6c52b3f Expected:v1.2.4-0-g6c52b3f} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil>
ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.21.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.33.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I0317 12:38:48.182748 455052 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0317 12:38:48.182959 455052 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0317 12:38:48.184638 455052 out.go:177] * Using Docker driver with root privileges
I0317 12:38:48.185738 455052 cni.go:84] Creating CNI manager for ""
I0317 12:38:48.185832 455052 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0317 12:38:48.185848 455052 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0317 12:38:48.185934 455052 start.go:340] cluster config:
{Name:addons-012219 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.2 ClusterName:addons-012219 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.32.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHA
uthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0317 12:38:48.187222 455052 out.go:177] * Starting "addons-012219" primary control-plane node in "addons-012219" cluster
I0317 12:38:48.188445 455052 cache.go:121] Beginning downloading kic base image for docker with containerd
I0317 12:38:48.189727 455052 out.go:177] * Pulling base image v0.0.46-1741860993-20523 ...
I0317 12:38:48.190812 455052 preload.go:131] Checking if preload exists for k8s version v1.32.2 and runtime containerd
I0317 12:38:48.190861 455052 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20539-446828/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.32.2-containerd-overlay2-amd64.tar.lz4
I0317 12:38:48.190875 455052 cache.go:56] Caching tarball of preloaded images
I0317 12:38:48.190891 455052 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 in local docker daemon
I0317 12:38:48.191017 455052 preload.go:172] Found /home/jenkins/minikube-integration/20539-446828/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.32.2-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
I0317 12:38:48.191033 455052 cache.go:59] Finished verifying existence of preloaded tar for v1.32.2 on containerd
I0317 12:38:48.191471 455052 profile.go:143] Saving config to /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/config.json ...
I0317 12:38:48.191502 455052 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/config.json: {Name:mk5ae75b173bff0b4f3b12df1725ab9cf5ff3206 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0317 12:38:48.208531 455052 cache.go:150] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 to local cache
I0317 12:38:48.208738 455052 image.go:65] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 in local cache directory
I0317 12:38:48.208767 455052 image.go:68] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 in local cache directory, skipping pull
I0317 12:38:48.208775 455052 image.go:137] gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 exists in cache, skipping pull
I0317 12:38:48.208790 455052 cache.go:153] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 as a tarball
I0317 12:38:48.208801 455052 cache.go:163] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 from local cache
I0317 12:39:01.030051 455052 cache.go:165] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 from cached tarball
I0317 12:39:01.030110 455052 cache.go:230] Successfully downloaded all kic artifacts
I0317 12:39:01.030185 455052 start.go:360] acquireMachinesLock for addons-012219: {Name:mk4f9029816aabb75cfe9bdbdbb316adafd6cfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0317 12:39:01.030314 455052 start.go:364] duration metric: took 105.313µs to acquireMachinesLock for "addons-012219"
I0317 12:39:01.030358 455052 start.go:93] Provisioning new machine with config: &{Name:addons-012219 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.2 ClusterName:addons-012219 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.32.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fa
lse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.32.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0317 12:39:01.030431 455052 start.go:125] createHost starting for "" (driver="docker")
I0317 12:39:01.032554 455052 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
I0317 12:39:01.032866 455052 start.go:159] libmachine.API.Create for "addons-012219" (driver="docker")
I0317 12:39:01.032909 455052 client.go:168] LocalClient.Create starting
I0317 12:39:01.033127 455052 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/20539-446828/.minikube/certs/ca.pem
I0317 12:39:01.250466 455052 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/20539-446828/.minikube/certs/cert.pem
I0317 12:39:01.750594 455052 cli_runner.go:164] Run: docker network inspect addons-012219 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0317 12:39:01.770703 455052 cli_runner.go:211] docker network inspect addons-012219 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0317 12:39:01.770792 455052 network_create.go:284] running [docker network inspect addons-012219] to gather additional debugging logs...
I0317 12:39:01.770810 455052 cli_runner.go:164] Run: docker network inspect addons-012219
W0317 12:39:01.791389 455052 cli_runner.go:211] docker network inspect addons-012219 returned with exit code 1
I0317 12:39:01.791428 455052 network_create.go:287] error running [docker network inspect addons-012219]: docker network inspect addons-012219: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-012219 not found
I0317 12:39:01.791459 455052 network_create.go:289] output of [docker network inspect addons-012219]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-012219 not found
** /stderr **
I0317 12:39:01.791608 455052 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0317 12:39:01.812027 455052 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0020911c0}
I0317 12:39:01.812090 455052 network_create.go:124] attempt to create docker network addons-012219 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0317 12:39:01.812146 455052 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-012219 addons-012219
I0317 12:39:01.870671 455052 network_create.go:108] docker network addons-012219 192.168.49.0/24 created
I0317 12:39:01.870727 455052 kic.go:121] calculated static IP "192.168.49.2" for the "addons-012219" container
I0317 12:39:01.870809 455052 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0317 12:39:01.888169 455052 cli_runner.go:164] Run: docker volume create addons-012219 --label name.minikube.sigs.k8s.io=addons-012219 --label created_by.minikube.sigs.k8s.io=true
I0317 12:39:01.907968 455052 oci.go:103] Successfully created a docker volume addons-012219
I0317 12:39:01.908179 455052 cli_runner.go:164] Run: docker run --rm --name addons-012219-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-012219 --entrypoint /usr/bin/test -v addons-012219:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 -d /var/lib
I0317 12:39:06.872289 455052 cli_runner.go:217] Completed: docker run --rm --name addons-012219-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-012219 --entrypoint /usr/bin/test -v addons-012219:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 -d /var/lib: (4.964041866s)
I0317 12:39:06.872360 455052 oci.go:107] Successfully prepared a docker volume addons-012219
I0317 12:39:06.872407 455052 preload.go:131] Checking if preload exists for k8s version v1.32.2 and runtime containerd
I0317 12:39:06.872435 455052 kic.go:194] Starting extracting preloaded images to volume ...
I0317 12:39:06.872519 455052 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20539-446828/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.32.2-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v addons-012219:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 -I lz4 -xf /preloaded.tar -C /extractDir
I0317 12:39:11.538297 455052 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20539-446828/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.32.2-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v addons-012219:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 -I lz4 -xf /preloaded.tar -C /extractDir: (4.665711957s)
I0317 12:39:11.538334 455052 kic.go:203] duration metric: took 4.665893918s to extract preloaded images to volume ...
W0317 12:39:11.538500 455052 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0317 12:39:11.538611 455052 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0317 12:39:11.593645 455052 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-012219 --name addons-012219 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-012219 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-012219 --network addons-012219 --ip 192.168.49.2 --volume addons-012219:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185
I0317 12:39:11.877382 455052 cli_runner.go:164] Run: docker container inspect addons-012219 --format={{.State.Running}}
I0317 12:39:11.896804 455052 cli_runner.go:164] Run: docker container inspect addons-012219 --format={{.State.Status}}
I0317 12:39:11.916694 455052 cli_runner.go:164] Run: docker exec addons-012219 stat /var/lib/dpkg/alternatives/iptables
I0317 12:39:11.961992 455052 oci.go:144] the created container "addons-012219" has a running status.
I0317 12:39:11.962040 455052 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/20539-446828/.minikube/machines/addons-012219/id_rsa...
I0317 12:39:12.496926 455052 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/20539-446828/.minikube/machines/addons-012219/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0317 12:39:12.520345 455052 cli_runner.go:164] Run: docker container inspect addons-012219 --format={{.State.Status}}
I0317 12:39:12.539423 455052 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0317 12:39:12.539446 455052 kic_runner.go:114] Args: [docker exec --privileged addons-012219 chown docker:docker /home/docker/.ssh/authorized_keys]
I0317 12:39:12.591629 455052 cli_runner.go:164] Run: docker container inspect addons-012219 --format={{.State.Status}}
I0317 12:39:12.613026 455052 machine.go:93] provisionDockerMachine start ...
I0317 12:39:12.613173 455052 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-012219
I0317 12:39:12.632700 455052 main.go:141] libmachine: Using SSH client type: native
I0317 12:39:12.632985 455052 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 127.0.0.1 33145 <nil> <nil>}
I0317 12:39:12.633003 455052 main.go:141] libmachine: About to run SSH command:
hostname
I0317 12:39:12.768094 455052 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-012219
I0317 12:39:12.768130 455052 ubuntu.go:169] provisioning hostname "addons-012219"
I0317 12:39:12.768210 455052 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-012219
I0317 12:39:12.787598 455052 main.go:141] libmachine: Using SSH client type: native
I0317 12:39:12.787821 455052 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 127.0.0.1 33145 <nil> <nil>}
I0317 12:39:12.787838 455052 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-012219 && echo "addons-012219" | sudo tee /etc/hostname
I0317 12:39:12.936726 455052 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-012219
I0317 12:39:12.936809 455052 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-012219
I0317 12:39:12.954937 455052 main.go:141] libmachine: Using SSH client type: native
I0317 12:39:12.955163 455052 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 127.0.0.1 33145 <nil> <nil>}
I0317 12:39:12.955181 455052 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-012219' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-012219/g' /etc/hosts;
else
echo '127.0.1.1 addons-012219' | sudo tee -a /etc/hosts;
fi
fi
I0317 12:39:13.093093 455052 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0317 12:39:13.093132 455052 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/20539-446828/.minikube CaCertPath:/home/jenkins/minikube-integration/20539-446828/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20539-446828/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20539-446828/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20539-446828/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20539-446828/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20539-446828/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20539-446828/.minikube}
I0317 12:39:13.093178 455052 ubuntu.go:177] setting up certificates
I0317 12:39:13.093191 455052 provision.go:84] configureAuth start
I0317 12:39:13.093250 455052 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-012219
I0317 12:39:13.111440 455052 provision.go:143] copyHostCerts
I0317 12:39:13.111541 455052 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20539-446828/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20539-446828/.minikube/key.pem (1675 bytes)
I0317 12:39:13.111698 455052 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20539-446828/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20539-446828/.minikube/ca.pem (1082 bytes)
I0317 12:39:13.111825 455052 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20539-446828/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20539-446828/.minikube/cert.pem (1123 bytes)
I0317 12:39:13.111941 455052 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20539-446828/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20539-446828/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20539-446828/.minikube/certs/ca-key.pem org=jenkins.addons-012219 san=[127.0.0.1 192.168.49.2 addons-012219 localhost minikube]
I0317 12:39:13.162824 455052 provision.go:177] copyRemoteCerts
I0317 12:39:13.162892 455052 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0317 12:39:13.162936 455052 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-012219
I0317 12:39:13.181586 455052 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33145 SSHKeyPath:/home/jenkins/minikube-integration/20539-446828/.minikube/machines/addons-012219/id_rsa Username:docker}
I0317 12:39:13.281817 455052 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-446828/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0317 12:39:13.308715 455052 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-446828/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0317 12:39:13.335335 455052 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-446828/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0317 12:39:13.361942 455052 provision.go:87] duration metric: took 268.734518ms to configureAuth
I0317 12:39:13.361975 455052 ubuntu.go:193] setting minikube options for container-runtime
I0317 12:39:13.362170 455052 config.go:182] Loaded profile config "addons-012219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
I0317 12:39:13.362187 455052 machine.go:96] duration metric: took 749.138253ms to provisionDockerMachine
I0317 12:39:13.362195 455052 client.go:171] duration metric: took 12.329276946s to LocalClient.Create
I0317 12:39:13.362217 455052 start.go:167] duration metric: took 12.329355429s to libmachine.API.Create "addons-012219"
I0317 12:39:13.362224 455052 start.go:293] postStartSetup for "addons-012219" (driver="docker")
I0317 12:39:13.362233 455052 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0317 12:39:13.362278 455052 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0317 12:39:13.362314 455052 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-012219
I0317 12:39:13.381057 455052 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33145 SSHKeyPath:/home/jenkins/minikube-integration/20539-446828/.minikube/machines/addons-012219/id_rsa Username:docker}
I0317 12:39:13.482200 455052 ssh_runner.go:195] Run: cat /etc/os-release
I0317 12:39:13.485959 455052 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0317 12:39:13.485992 455052 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0317 12:39:13.486003 455052 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0317 12:39:13.486012 455052 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I0317 12:39:13.486025 455052 filesync.go:126] Scanning /home/jenkins/minikube-integration/20539-446828/.minikube/addons for local assets ...
I0317 12:39:13.486108 455052 filesync.go:126] Scanning /home/jenkins/minikube-integration/20539-446828/.minikube/files for local assets ...
I0317 12:39:13.486140 455052 start.go:296] duration metric: took 123.908916ms for postStartSetup
I0317 12:39:13.486452 455052 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-012219
I0317 12:39:13.505708 455052 profile.go:143] Saving config to /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/config.json ...
I0317 12:39:13.506012 455052 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0317 12:39:13.506061 455052 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-012219
I0317 12:39:13.524830 455052 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33145 SSHKeyPath:/home/jenkins/minikube-integration/20539-446828/.minikube/machines/addons-012219/id_rsa Username:docker}
I0317 12:39:13.618002 455052 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0317 12:39:13.622926 455052 start.go:128] duration metric: took 12.592476216s to createHost
I0317 12:39:13.622956 455052 start.go:83] releasing machines lock for "addons-012219", held for 12.59262781s
I0317 12:39:13.623035 455052 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-012219
I0317 12:39:13.642865 455052 ssh_runner.go:195] Run: cat /version.json
I0317 12:39:13.642925 455052 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0317 12:39:13.643002 455052 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-012219
I0317 12:39:13.642931 455052 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-012219
I0317 12:39:13.663466 455052 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33145 SSHKeyPath:/home/jenkins/minikube-integration/20539-446828/.minikube/machines/addons-012219/id_rsa Username:docker}
I0317 12:39:13.663820 455052 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33145 SSHKeyPath:/home/jenkins/minikube-integration/20539-446828/.minikube/machines/addons-012219/id_rsa Username:docker}
I0317 12:39:13.756498 455052 ssh_runner.go:195] Run: systemctl --version
I0317 12:39:13.835206 455052 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0317 12:39:13.840449 455052 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0317 12:39:13.867139 455052 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0317 12:39:13.867227 455052 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0317 12:39:13.896974 455052 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0317 12:39:13.897004 455052 start.go:495] detecting cgroup driver to use...
I0317 12:39:13.897060 455052 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0317 12:39:13.897129 455052 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0317 12:39:13.909957 455052 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0317 12:39:13.921484 455052 docker.go:217] disabling cri-docker service (if available) ...
I0317 12:39:13.921564 455052 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0317 12:39:13.935505 455052 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0317 12:39:13.950483 455052 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0317 12:39:14.027108 455052 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0317 12:39:14.108664 455052 docker.go:233] disabling docker service ...
I0317 12:39:14.108739 455052 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0317 12:39:14.128684 455052 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0317 12:39:14.140295 455052 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0317 12:39:14.223859 455052 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0317 12:39:14.311339 455052 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0317 12:39:14.323210 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0317 12:39:14.340391 455052 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0317 12:39:14.351125 455052 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0317 12:39:14.362117 455052 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0317 12:39:14.362181 455052 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0317 12:39:14.372457 455052 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0317 12:39:14.383021 455052 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0317 12:39:14.393284 455052 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0317 12:39:14.404023 455052 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0317 12:39:14.414135 455052 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0317 12:39:14.424920 455052 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0317 12:39:14.435840 455052 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0317 12:39:14.447169 455052 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0317 12:39:14.455892 455052 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0317 12:39:14.464970 455052 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0317 12:39:14.538457 455052 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0317 12:39:14.648203 455052 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0317 12:39:14.648284 455052 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0317 12:39:14.652351 455052 start.go:563] Will wait 60s for crictl version
I0317 12:39:14.652423 455052 ssh_runner.go:195] Run: which crictl
I0317 12:39:14.655987 455052 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0317 12:39:14.692655 455052 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.25
RuntimeApiVersion: v1
I0317 12:39:14.692751 455052 ssh_runner.go:195] Run: containerd --version
I0317 12:39:14.719458 455052 ssh_runner.go:195] Run: containerd --version
I0317 12:39:14.747914 455052 out.go:177] * Preparing Kubernetes v1.32.2 on containerd 1.7.25 ...
I0317 12:39:14.749467 455052 cli_runner.go:164] Run: docker network inspect addons-012219 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0317 12:39:14.768502 455052 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I0317 12:39:14.772651 455052 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0317 12:39:14.784531 455052 kubeadm.go:883] updating cluster {Name:addons-012219 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.2 ClusterName:addons-012219 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.32.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cus
tomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0317 12:39:14.784658 455052 preload.go:131] Checking if preload exists for k8s version v1.32.2 and runtime containerd
I0317 12:39:14.784705 455052 ssh_runner.go:195] Run: sudo crictl images --output json
I0317 12:39:14.821811 455052 containerd.go:627] all images are preloaded for containerd runtime.
I0317 12:39:14.821838 455052 containerd.go:534] Images already preloaded, skipping extraction
I0317 12:39:14.821903 455052 ssh_runner.go:195] Run: sudo crictl images --output json
I0317 12:39:14.856662 455052 containerd.go:627] all images are preloaded for containerd runtime.
I0317 12:39:14.856689 455052 cache_images.go:84] Images are preloaded, skipping loading
I0317 12:39:14.856698 455052 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.32.2 containerd true true} ...
I0317 12:39:14.856794 455052 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.32.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-012219 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.32.2 ClusterName:addons-012219 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0317 12:39:14.856848 455052 ssh_runner.go:195] Run: sudo crictl info
I0317 12:39:14.892646 455052 cni.go:84] Creating CNI manager for ""
I0317 12:39:14.892679 455052 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0317 12:39:14.892696 455052 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0317 12:39:14.892720 455052 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.32.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-012219 NodeName:addons-012219 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc
/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0317 12:39:14.892840 455052 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "addons-012219"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.49.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
- name: "proxy-refresh-interval"
value: "70000"
kubernetesVersion: v1.32.2
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0317 12:39:14.892907 455052 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.32.2
I0317 12:39:14.902144 455052 binaries.go:44] Found k8s binaries, skipping transfer
I0317 12:39:14.902217 455052 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0317 12:39:14.911539 455052 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (317 bytes)
I0317 12:39:14.931119 455052 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0317 12:39:14.949717 455052 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2303 bytes)
I0317 12:39:14.968581 455052 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0317 12:39:14.972599 455052 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0317 12:39:14.985705 455052 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0317 12:39:15.067453 455052 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0317 12:39:15.082243 455052 certs.go:68] Setting up /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219 for IP: 192.168.49.2
I0317 12:39:15.082266 455052 certs.go:194] generating shared ca certs ...
I0317 12:39:15.082283 455052 certs.go:226] acquiring lock for ca certs: {Name:mk0dd75eca163be7a048e137f4b2d32cf3ae35d6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0317 12:39:15.082507 455052 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/20539-446828/.minikube/ca.key
I0317 12:39:15.215977 455052 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20539-446828/.minikube/ca.crt ...
I0317 12:39:15.216013 455052 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20539-446828/.minikube/ca.crt: {Name:mk6c5810acd75cb9b3a95204aeb4923648134fec Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0317 12:39:15.216200 455052 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20539-446828/.minikube/ca.key ...
I0317 12:39:15.216211 455052 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20539-446828/.minikube/ca.key: {Name:mk42dd3bc2bef3996c8d9aca4b91a21a3483ce7d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0317 12:39:15.216284 455052 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20539-446828/.minikube/proxy-client-ca.key
I0317 12:39:15.438662 455052 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20539-446828/.minikube/proxy-client-ca.crt ...
I0317 12:39:15.438706 455052 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20539-446828/.minikube/proxy-client-ca.crt: {Name:mk85c7404144a9503537fe74ab1fafce6d5efe93 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0317 12:39:15.438914 455052 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20539-446828/.minikube/proxy-client-ca.key ...
I0317 12:39:15.438928 455052 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20539-446828/.minikube/proxy-client-ca.key: {Name:mkb6f268b434dbbb859dd2b57fc506ee093f4f5b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0317 12:39:15.439006 455052 certs.go:256] generating profile certs ...
I0317 12:39:15.439068 455052 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/client.key
I0317 12:39:15.439083 455052 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/client.crt with IP's: []
I0317 12:39:16.321284 455052 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/client.crt ...
I0317 12:39:16.321323 455052 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/client.crt: {Name:mk1eac80c5f0c5edd4268bd4c7f32a2877239abf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0317 12:39:16.321507 455052 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/client.key ...
I0317 12:39:16.321528 455052 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/client.key: {Name:mke0c492e654f28c7c87390951b63149bdb94f22 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0317 12:39:16.321599 455052 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/apiserver.key.e4ed0683
I0317 12:39:16.321617 455052 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/apiserver.crt.e4ed0683 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I0317 12:39:16.548474 455052 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/apiserver.crt.e4ed0683 ...
I0317 12:39:16.548517 455052 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/apiserver.crt.e4ed0683: {Name:mkd89694ae1d0c6fe037f6c581e4c6ae7215f3a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0317 12:39:16.548694 455052 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/apiserver.key.e4ed0683 ...
I0317 12:39:16.548708 455052 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/apiserver.key.e4ed0683: {Name:mk5c4663ccf0ea3254d6e2b196b6a7b99f9d07d4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0317 12:39:16.548785 455052 certs.go:381] copying /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/apiserver.crt.e4ed0683 -> /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/apiserver.crt
I0317 12:39:16.548860 455052 certs.go:385] copying /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/apiserver.key.e4ed0683 -> /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/apiserver.key
I0317 12:39:16.548905 455052 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/proxy-client.key
I0317 12:39:16.548921 455052 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/proxy-client.crt with IP's: []
I0317 12:39:17.036293 455052 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/proxy-client.crt ...
I0317 12:39:17.036358 455052 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/proxy-client.crt: {Name:mk30436cd124ef55c65e6fe2ce66a0585594f30b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0317 12:39:17.036538 455052 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/proxy-client.key ...
I0317 12:39:17.036552 455052 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/proxy-client.key: {Name:mk6febb43cba57732591cbb93ae48f0cb1241b3a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0317 12:39:17.036737 455052 certs.go:484] found cert: /home/jenkins/minikube-integration/20539-446828/.minikube/certs/ca-key.pem (1675 bytes)
I0317 12:39:17.036779 455052 certs.go:484] found cert: /home/jenkins/minikube-integration/20539-446828/.minikube/certs/ca.pem (1082 bytes)
I0317 12:39:17.036800 455052 certs.go:484] found cert: /home/jenkins/minikube-integration/20539-446828/.minikube/certs/cert.pem (1123 bytes)
I0317 12:39:17.036819 455052 certs.go:484] found cert: /home/jenkins/minikube-integration/20539-446828/.minikube/certs/key.pem (1675 bytes)
I0317 12:39:17.037536 455052 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-446828/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0317 12:39:17.063150 455052 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-446828/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0317 12:39:17.089188 455052 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-446828/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0317 12:39:17.114585 455052 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-446828/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0317 12:39:17.140004 455052 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0317 12:39:17.165950 455052 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0317 12:39:17.191067 455052 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0317 12:39:17.215893 455052 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-446828/.minikube/profiles/addons-012219/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0317 12:39:17.241779 455052 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-446828/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0317 12:39:17.267836 455052 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0317 12:39:17.286839 455052 ssh_runner.go:195] Run: openssl version
I0317 12:39:17.293157 455052 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0317 12:39:17.303415 455052 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0317 12:39:17.307327 455052 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Mar 17 12:39 /usr/share/ca-certificates/minikubeCA.pem
I0317 12:39:17.307401 455052 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0317 12:39:17.314186 455052 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0317 12:39:17.324679 455052 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0317 12:39:17.328279 455052 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0317 12:39:17.328363 455052 kubeadm.go:392] StartCluster: {Name:addons-012219 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.2 ClusterName:addons-012219 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.32.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom
QemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0317 12:39:17.328462 455052 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0317 12:39:17.328541 455052 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0317 12:39:17.367264 455052 cri.go:89] found id: ""
I0317 12:39:17.367360 455052 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0317 12:39:17.376658 455052 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0317 12:39:17.386258 455052 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0317 12:39:17.386328 455052 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0317 12:39:17.396059 455052 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0317 12:39:17.396096 455052 kubeadm.go:157] found existing configuration files:
I0317 12:39:17.396152 455052 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0317 12:39:17.406310 455052 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0317 12:39:17.406366 455052 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0317 12:39:17.415771 455052 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0317 12:39:17.426078 455052 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0317 12:39:17.426213 455052 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0317 12:39:17.436888 455052 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0317 12:39:17.449038 455052 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0317 12:39:17.449119 455052 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0317 12:39:17.458740 455052 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0317 12:39:17.468085 455052 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0317 12:39:17.468161 455052 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0317 12:39:17.477138 455052 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.32.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0317 12:39:17.536415 455052 kubeadm.go:310] [WARNING SystemVerification]: cgroups v1 support is in maintenance mode, please migrate to cgroups v2
I0317 12:39:17.536762 455052 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1078-gcp\n", err: exit status 1
I0317 12:39:17.594526 455052 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0317 12:39:26.716704 455052 kubeadm.go:310] [init] Using Kubernetes version: v1.32.2
I0317 12:39:26.716762 455052 kubeadm.go:310] [preflight] Running pre-flight checks
I0317 12:39:26.716880 455052 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0317 12:39:26.716982 455052 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1078-gcp[0m
I0317 12:39:26.717040 455052 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0317 12:39:26.717098 455052 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0317 12:39:26.717230 455052 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0317 12:39:26.717289 455052 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0317 12:39:26.717340 455052 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0317 12:39:26.717425 455052 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0317 12:39:26.717511 455052 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0317 12:39:26.717568 455052 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0317 12:39:26.717612 455052 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0317 12:39:26.717656 455052 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0317 12:39:26.717725 455052 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0317 12:39:26.717806 455052 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0317 12:39:26.717918 455052 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0317 12:39:26.717970 455052 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0317 12:39:26.719819 455052 out.go:235] - Generating certificates and keys ...
I0317 12:39:26.719928 455052 kubeadm.go:310] [certs] Using existing ca certificate authority
I0317 12:39:26.719987 455052 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0317 12:39:26.720057 455052 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0317 12:39:26.720122 455052 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0317 12:39:26.720180 455052 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0317 12:39:26.720234 455052 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0317 12:39:26.720332 455052 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0317 12:39:26.720471 455052 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-012219 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0317 12:39:26.720520 455052 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0317 12:39:26.720631 455052 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-012219 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0317 12:39:26.720688 455052 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0317 12:39:26.720755 455052 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0317 12:39:26.720796 455052 kubeadm.go:310] [certs] Generating "sa" key and public key
I0317 12:39:26.720846 455052 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0317 12:39:26.720892 455052 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0317 12:39:26.720952 455052 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0317 12:39:26.721012 455052 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0317 12:39:26.721067 455052 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0317 12:39:26.721121 455052 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0317 12:39:26.721229 455052 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0317 12:39:26.721313 455052 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0317 12:39:26.722821 455052 out.go:235] - Booting up control plane ...
I0317 12:39:26.722963 455052 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0317 12:39:26.723094 455052 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0317 12:39:26.723204 455052 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0317 12:39:26.723394 455052 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0317 12:39:26.723522 455052 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0317 12:39:26.723578 455052 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0317 12:39:26.723736 455052 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0317 12:39:26.723882 455052 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0317 12:39:26.723962 455052 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 502.075708ms
I0317 12:39:26.724033 455052 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0317 12:39:26.724123 455052 kubeadm.go:310] [api-check] The API server is healthy after 5.001229447s
I0317 12:39:26.724272 455052 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0317 12:39:26.724491 455052 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0317 12:39:26.724595 455052 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0317 12:39:26.724789 455052 kubeadm.go:310] [mark-control-plane] Marking the node addons-012219 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0317 12:39:26.724861 455052 kubeadm.go:310] [bootstrap-token] Using token: bcu5f8.5eu7wklvfllmqleo
I0317 12:39:26.726327 455052 out.go:235] - Configuring RBAC rules ...
I0317 12:39:26.726478 455052 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0317 12:39:26.726566 455052 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0317 12:39:26.726720 455052 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0317 12:39:26.726833 455052 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0317 12:39:26.726967 455052 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0317 12:39:26.727121 455052 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0317 12:39:26.727234 455052 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0317 12:39:26.727301 455052 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0317 12:39:26.727347 455052 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0317 12:39:26.727358 455052 kubeadm.go:310]
I0317 12:39:26.727416 455052 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0317 12:39:26.727427 455052 kubeadm.go:310]
I0317 12:39:26.727494 455052 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0317 12:39:26.727501 455052 kubeadm.go:310]
I0317 12:39:26.727533 455052 kubeadm.go:310] mkdir -p $HOME/.kube
I0317 12:39:26.727612 455052 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0317 12:39:26.727658 455052 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0317 12:39:26.727667 455052 kubeadm.go:310]
I0317 12:39:26.727717 455052 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0317 12:39:26.727722 455052 kubeadm.go:310]
I0317 12:39:26.727762 455052 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0317 12:39:26.727769 455052 kubeadm.go:310]
I0317 12:39:26.727833 455052 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0317 12:39:26.728012 455052 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0317 12:39:26.728122 455052 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0317 12:39:26.728143 455052 kubeadm.go:310]
I0317 12:39:26.728244 455052 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0317 12:39:26.728372 455052 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0317 12:39:26.728388 455052 kubeadm.go:310]
I0317 12:39:26.728496 455052 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token bcu5f8.5eu7wklvfllmqleo \
I0317 12:39:26.728637 455052 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:e05049646db0098d7df87a082a7b96dd6c54c151b6030ddf1f26dcd0982d4713 \
I0317 12:39:26.728676 455052 kubeadm.go:310] --control-plane
I0317 12:39:26.728685 455052 kubeadm.go:310]
I0317 12:39:26.728798 455052 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0317 12:39:26.728805 455052 kubeadm.go:310]
I0317 12:39:26.728933 455052 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token bcu5f8.5eu7wklvfllmqleo \
I0317 12:39:26.729128 455052 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:e05049646db0098d7df87a082a7b96dd6c54c151b6030ddf1f26dcd0982d4713
I0317 12:39:26.729143 455052 cni.go:84] Creating CNI manager for ""
I0317 12:39:26.729150 455052 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0317 12:39:26.730819 455052 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0317 12:39:26.732461 455052 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0317 12:39:26.737191 455052 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.32.2/kubectl ...
I0317 12:39:26.737228 455052 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I0317 12:39:26.757414 455052 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0317 12:39:26.978716 455052 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0317 12:39:26.978832 455052 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0317 12:39:26.978900 455052 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-012219 minikube.k8s.io/updated_at=2025_03_17T12_39_26_0700 minikube.k8s.io/version=v1.35.0 minikube.k8s.io/commit=5a6f3d20e78a9ae03fc65e3f2e727d0ae0107b3c minikube.k8s.io/name=addons-012219 minikube.k8s.io/primary=true
I0317 12:39:26.986869 455052 ops.go:34] apiserver oom_adj: -16
I0317 12:39:27.069756 455052 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0317 12:39:27.569849 455052 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0317 12:39:28.070194 455052 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0317 12:39:28.570825 455052 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0317 12:39:29.069844 455052 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0317 12:39:29.569896 455052 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0317 12:39:30.070141 455052 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0317 12:39:30.570759 455052 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0317 12:39:30.643541 455052 kubeadm.go:1113] duration metric: took 3.66480023s to wait for elevateKubeSystemPrivileges
I0317 12:39:30.643580 455052 kubeadm.go:394] duration metric: took 13.315224606s to StartCluster
I0317 12:39:30.643601 455052 settings.go:142] acquiring lock: {Name:mk72030e2b6f80365da0b928b8b3c5c72d9da724 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0317 12:39:30.643729 455052 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/20539-446828/kubeconfig
I0317 12:39:30.644109 455052 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20539-446828/kubeconfig: {Name:mk0cd04f754d83d5d928c90de569ec9144a7d4e7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0317 12:39:30.644299 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.32.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0317 12:39:30.644348 455052 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.32.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0317 12:39:30.644427 455052 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:true auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I0317 12:39:30.644597 455052 config.go:182] Loaded profile config "addons-012219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
I0317 12:39:30.644619 455052 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-012219"
I0317 12:39:30.644633 455052 addons.go:69] Setting yakd=true in profile "addons-012219"
I0317 12:39:30.644638 455052 addons.go:69] Setting metrics-server=true in profile "addons-012219"
I0317 12:39:30.644650 455052 addons.go:69] Setting amd-gpu-device-plugin=true in profile "addons-012219"
I0317 12:39:30.644666 455052 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-012219"
I0317 12:39:30.644675 455052 addons.go:238] Setting addon metrics-server=true in "addons-012219"
I0317 12:39:30.644693 455052 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-012219"
I0317 12:39:30.644703 455052 addons.go:69] Setting volcano=true in profile "addons-012219"
I0317 12:39:30.644708 455052 addons.go:238] Setting addon csi-hostpath-driver=true in "addons-012219"
I0317 12:39:30.644715 455052 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-012219"
I0317 12:39:30.644718 455052 host.go:66] Checking if "addons-012219" exists ...
I0317 12:39:30.644723 455052 addons.go:69] Setting volumesnapshots=true in profile "addons-012219"
I0317 12:39:30.644744 455052 host.go:66] Checking if "addons-012219" exists ...
I0317 12:39:30.644751 455052 addons.go:238] Setting addon volumesnapshots=true in "addons-012219"
I0317 12:39:30.644780 455052 host.go:66] Checking if "addons-012219" exists ...
I0317 12:39:30.644796 455052 addons.go:69] Setting registry=true in profile "addons-012219"
I0317 12:39:30.644813 455052 addons.go:238] Setting addon registry=true in "addons-012219"
I0317 12:39:30.644837 455052 host.go:66] Checking if "addons-012219" exists ...
I0317 12:39:30.645011 455052 addons.go:69] Setting storage-provisioner=true in profile "addons-012219"
I0317 12:39:30.645041 455052 addons.go:238] Setting addon storage-provisioner=true in "addons-012219"
I0317 12:39:30.645067 455052 host.go:66] Checking if "addons-012219" exists ...
I0317 12:39:30.645121 455052 cli_runner.go:164] Run: docker container inspect addons-012219 --format={{.State.Status}}
I0317 12:39:30.645291 455052 cli_runner.go:164] Run: docker container inspect addons-012219 --format={{.State.Status}}
I0317 12:39:30.645343 455052 addons.go:69] Setting inspektor-gadget=true in profile "addons-012219"
I0317 12:39:30.644780 455052 addons.go:69] Setting cloud-spanner=true in profile "addons-012219"
I0317 12:39:30.645385 455052 addons.go:238] Setting addon inspektor-gadget=true in "addons-012219"
I0317 12:39:30.645421 455052 host.go:66] Checking if "addons-012219" exists ...
I0317 12:39:30.644694 455052 addons.go:238] Setting addon nvidia-device-plugin=true in "addons-012219"
I0317 12:39:30.645467 455052 host.go:66] Checking if "addons-012219" exists ...
I0317 12:39:30.645531 455052 cli_runner.go:164] Run: docker container inspect addons-012219 --format={{.State.Status}}
I0317 12:39:30.644676 455052 addons.go:238] Setting addon amd-gpu-device-plugin=true in "addons-012219"
I0317 12:39:30.645706 455052 host.go:66] Checking if "addons-012219" exists ...
I0317 12:39:30.644713 455052 addons.go:238] Setting addon volcano=true in "addons-012219"
I0317 12:39:30.645967 455052 cli_runner.go:164] Run: docker container inspect addons-012219 --format={{.State.Status}}
I0317 12:39:30.645977 455052 host.go:66] Checking if "addons-012219" exists ...
I0317 12:39:30.645350 455052 addons.go:69] Setting ingress-dns=true in profile "addons-012219"
I0317 12:39:30.646063 455052 addons.go:238] Setting addon ingress-dns=true in "addons-012219"
I0317 12:39:30.646099 455052 host.go:66] Checking if "addons-012219" exists ...
I0317 12:39:30.646143 455052 cli_runner.go:164] Run: docker container inspect addons-012219 --format={{.State.Status}}
I0317 12:39:30.646440 455052 cli_runner.go:164] Run: docker container inspect addons-012219 --format={{.State.Status}}
I0317 12:39:30.646632 455052 cli_runner.go:164] Run: docker container inspect addons-012219 --format={{.State.Status}}
I0317 12:39:30.645388 455052 addons.go:238] Setting addon cloud-spanner=true in "addons-012219"
I0317 12:39:30.647227 455052 host.go:66] Checking if "addons-012219" exists ...
I0317 12:39:30.645298 455052 cli_runner.go:164] Run: docker container inspect addons-012219 --format={{.State.Status}}
I0317 12:39:30.648194 455052 out.go:177] * Verifying Kubernetes components...
I0317 12:39:30.648364 455052 cli_runner.go:164] Run: docker container inspect addons-012219 --format={{.State.Status}}
I0317 12:39:30.645317 455052 addons.go:69] Setting ingress=true in profile "addons-012219"
I0317 12:39:30.649855 455052 addons.go:238] Setting addon ingress=true in "addons-012219"
I0317 12:39:30.645326 455052 addons.go:69] Setting default-storageclass=true in profile "addons-012219"
I0317 12:39:30.645339 455052 addons.go:69] Setting gcp-auth=true in profile "addons-012219"
I0317 12:39:30.645355 455052 cli_runner.go:164] Run: docker container inspect addons-012219 --format={{.State.Status}}
I0317 12:39:30.644656 455052 addons.go:238] Setting addon yakd=true in "addons-012219"
I0317 12:39:30.645937 455052 cli_runner.go:164] Run: docker container inspect addons-012219 --format={{.State.Status}}
I0317 12:39:30.649767 455052 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0317 12:39:30.649969 455052 host.go:66] Checking if "addons-012219" exists ...
I0317 12:39:30.650227 455052 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-012219"
I0317 12:39:30.645325 455052 cli_runner.go:164] Run: docker container inspect addons-012219 --format={{.State.Status}}
I0317 12:39:30.650682 455052 cli_runner.go:164] Run: docker container inspect addons-012219 --format={{.State.Status}}
I0317 12:39:30.650903 455052 cli_runner.go:164] Run: docker container inspect addons-012219 --format={{.State.Status}}
I0317 12:39:30.656389 455052 host.go:66] Checking if "addons-012219" exists ...
I0317 12:39:30.656877 455052 cli_runner.go:164] Run: docker container inspect addons-012219 --format={{.State.Status}}
I0317 12:39:30.657273 455052 mustload.go:65] Loading cluster: addons-012219
I0317 12:39:30.673520 455052 out.go:177] - Using image docker.io/registry:2.8.3
I0317 12:39:30.674781 455052 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.8
I0317 12:39:30.676894 455052 config.go:182] Loaded profile config "addons-012219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
I0317 12:39:30.678394 455052 cli_runner.go:164] Run: docker container inspect addons-012219 --format={{.State.Status}}
I0317 12:39:30.680292 455052 addons.go:435] installing /etc/kubernetes/addons/registry-rc.yaml
I0317 12:39:30.680336 455052 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I0317 12:39:30.680404 455052 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-012219
I0317 12:39:30.690141 455052 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.17.0
I0317 12:39:30.694421 455052 addons.go:435] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0317 12:39:30.694452 455052 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0317 12:39:30.694532 455052 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-012219
I0317 12:39:30.699029 455052 out.go:177] - Using image docker.io/volcanosh/vc-webhook-manager:v1.11.0
I0317 12:39:30.700369 455052 out.go:177] - Using image docker.io/volcanosh/vc-controller-manager:v1.11.0
I0317 12:39:30.701547 455052 out.go:177] - Using image docker.io/volcanosh/vc-scheduler:v1.11.0
I0317 12:39:30.704584 455052 addons.go:435] installing /etc/kubernetes/addons/volcano-deployment.yaml
I0317 12:39:30.704617 455052 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (480278 bytes)
I0317 12:39:30.704799 455052 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-012219
I0317 12:39:30.732527 455052 out.go:177] - Using image docker.io/rocm/k8s-device-plugin:1.25.2.8
I0317 12:39:30.734198 455052 addons.go:435] installing /etc/kubernetes/addons/amd-gpu-device-plugin.yaml
I0317 12:39:30.734222 455052 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/amd-gpu-device-plugin.yaml (1868 bytes)
I0317 12:39:30.734288 455052 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-012219
I0317 12:39:30.734764 455052 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2
I0317 12:39:30.736165 455052 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.30
I0317 12:39:30.736197 455052 addons.go:435] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0317 12:39:30.736211 455052 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0317 12:39:30.736280 455052 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-012219
I0317 12:39:30.737506 455052 addons.go:435] installing /etc/kubernetes/addons/deployment.yaml
I0317 12:39:30.737526 455052 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0317 12:39:30.737582 455052 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-012219
I0317 12:39:30.737799 455052 addons.go:238] Setting addon storage-provisioner-rancher=true in "addons-012219"
I0317 12:39:30.737854 455052 host.go:66] Checking if "addons-012219" exists ...
I0317 12:39:30.738350 455052 cli_runner.go:164] Run: docker container inspect addons-012219 --format={{.State.Status}}
I0317 12:39:30.741937 455052 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0317 12:39:30.743129 455052 addons.go:435] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0317 12:39:30.743158 455052 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0317 12:39:30.743230 455052 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-012219
I0317 12:39:30.749229 455052 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0317 12:39:30.751779 455052 host.go:66] Checking if "addons-012219" exists ...
I0317 12:39:30.757697 455052 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.3
I0317 12:39:30.759304 455052 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0317 12:39:30.759385 455052 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.4
I0317 12:39:30.760535 455052 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.4
I0317 12:39:30.760652 455052 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0317 12:39:30.764350 455052 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0317 12:39:30.764692 455052 addons.go:435] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0317 12:39:30.764712 455052 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I0317 12:39:30.764783 455052 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-012219
I0317 12:39:30.766937 455052 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0317 12:39:30.768032 455052 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0317 12:39:30.769181 455052 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0317 12:39:30.770260 455052 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0317 12:39:30.771185 455052 addons.go:435] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0317 12:39:30.771210 455052 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0317 12:39:30.771282 455052 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-012219
I0317 12:39:30.774340 455052 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.37.0
I0317 12:39:30.776003 455052 addons.go:435] installing /etc/kubernetes/addons/ig-crd.yaml
I0317 12:39:30.776032 455052 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5248 bytes)
I0317 12:39:30.776109 455052 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-012219
I0317 12:39:30.783240 455052 addons.go:238] Setting addon default-storageclass=true in "addons-012219"
I0317 12:39:30.783295 455052 host.go:66] Checking if "addons-012219" exists ...
I0317 12:39:30.783728 455052 cli_runner.go:164] Run: docker container inspect addons-012219 --format={{.State.Status}}
I0317 12:39:30.788545 455052 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I0317 12:39:30.788572 455052 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0317 12:39:30.788629 455052 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I0317 12:39:30.790038 455052 addons.go:435] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0317 12:39:30.790060 455052 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0317 12:39:30.790121 455052 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-012219
I0317 12:39:30.789063 455052 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33145 SSHKeyPath:/home/jenkins/minikube-integration/20539-446828/.minikube/machines/addons-012219/id_rsa Username:docker}
I0317 12:39:30.790720 455052 addons.go:435] installing /etc/kubernetes/addons/yakd-ns.yaml
I0317 12:39:30.790737 455052 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0317 12:39:30.790793 455052 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-012219
I0317 12:39:30.791069 455052 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0317 12:39:30.791082 455052 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0317 12:39:30.791120 455052 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-012219
I0317 12:39:30.797195 455052 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33145 SSHKeyPath:/home/jenkins/minikube-integration/20539-446828/.minikube/machines/addons-012219/id_rsa Username:docker}
I0317 12:39:30.798718 455052 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33145 SSHKeyPath:/home/jenkins/minikube-integration/20539-446828/.minikube/machines/addons-012219/id_rsa Username:docker}
I0317 12:39:30.802862 455052 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33145 SSHKeyPath:/home/jenkins/minikube-integration/20539-446828/.minikube/machines/addons-012219/id_rsa Username:docker}
I0317 12:39:30.806046 455052 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33145 SSHKeyPath:/home/jenkins/minikube-integration/20539-446828/.minikube/machines/addons-012219/id_rsa Username:docker}
I0317 12:39:30.821704 455052 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33145 SSHKeyPath:/home/jenkins/minikube-integration/20539-446828/.minikube/machines/addons-012219/id_rsa Username:docker}
I0317 12:39:30.826613 455052 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0317 12:39:30.827797 455052 out.go:177] - Using image docker.io/busybox:stable
I0317 12:39:30.827903 455052 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33145 SSHKeyPath:/home/jenkins/minikube-integration/20539-446828/.minikube/machines/addons-012219/id_rsa Username:docker}
I0317 12:39:30.828417 455052 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33145 SSHKeyPath:/home/jenkins/minikube-integration/20539-446828/.minikube/machines/addons-012219/id_rsa Username:docker}
I0317 12:39:30.829204 455052 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0317 12:39:30.829229 455052 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0317 12:39:30.829288 455052 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-012219
I0317 12:39:30.829925 455052 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33145 SSHKeyPath:/home/jenkins/minikube-integration/20539-446828/.minikube/machines/addons-012219/id_rsa Username:docker}
I0317 12:39:30.831815 455052 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33145 SSHKeyPath:/home/jenkins/minikube-integration/20539-446828/.minikube/machines/addons-012219/id_rsa Username:docker}
I0317 12:39:30.833757 455052 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33145 SSHKeyPath:/home/jenkins/minikube-integration/20539-446828/.minikube/machines/addons-012219/id_rsa Username:docker}
I0317 12:39:30.835190 455052 addons.go:435] installing /etc/kubernetes/addons/storageclass.yaml
I0317 12:39:30.835212 455052 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0317 12:39:30.835267 455052 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-012219
I0317 12:39:30.846343 455052 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33145 SSHKeyPath:/home/jenkins/minikube-integration/20539-446828/.minikube/machines/addons-012219/id_rsa Username:docker}
W0317 12:39:30.852133 455052 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0317 12:39:30.852179 455052 retry.go:31] will retry after 165.673275ms: ssh: handshake failed: EOF
I0317 12:39:30.861530 455052 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33145 SSHKeyPath:/home/jenkins/minikube-integration/20539-446828/.minikube/machines/addons-012219/id_rsa Username:docker}
I0317 12:39:30.869345 455052 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33145 SSHKeyPath:/home/jenkins/minikube-integration/20539-446828/.minikube/machines/addons-012219/id_rsa Username:docker}
I0317 12:39:30.870549 455052 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33145 SSHKeyPath:/home/jenkins/minikube-integration/20539-446828/.minikube/machines/addons-012219/id_rsa Username:docker}
W0317 12:39:30.871334 455052 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0317 12:39:30.871362 455052 retry.go:31] will retry after 367.240618ms: ssh: handshake failed: EOF
W0317 12:39:30.872875 455052 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0317 12:39:30.872906 455052 retry.go:31] will retry after 248.60274ms: ssh: handshake failed: EOF
I0317 12:39:30.966162 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.32.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.32.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0317 12:39:30.966299 455052 ssh_runner.go:195] Run: sudo systemctl start kubelet
W0317 12:39:31.019574 455052 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0317 12:39:31.019616 455052 retry.go:31] will retry after 457.982718ms: ssh: handshake failed: EOF
I0317 12:39:31.257175 455052 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0317 12:39:31.267972 455052 addons.go:435] installing /etc/kubernetes/addons/registry-svc.yaml
I0317 12:39:31.268051 455052 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0317 12:39:31.359257 455052 addons.go:435] installing /etc/kubernetes/addons/yakd-sa.yaml
I0317 12:39:31.359372 455052 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0317 12:39:31.365280 455052 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0317 12:39:31.449821 455052 addons.go:435] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0317 12:39:31.449865 455052 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0317 12:39:31.462540 455052 addons.go:435] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0317 12:39:31.462592 455052 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0317 12:39:31.551215 455052 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/amd-gpu-device-plugin.yaml
I0317 12:39:31.560996 455052 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0317 12:39:31.651199 455052 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0317 12:39:31.656616 455052 addons.go:435] installing /etc/kubernetes/addons/registry-proxy.yaml
I0317 12:39:31.656726 455052 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0317 12:39:31.748151 455052 addons.go:435] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0317 12:39:31.748256 455052 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0317 12:39:31.749578 455052 addons.go:435] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0317 12:39:31.749609 455052 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0317 12:39:31.751444 455052 addons.go:435] installing /etc/kubernetes/addons/yakd-crb.yaml
I0317 12:39:31.751522 455052 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0317 12:39:31.755408 455052 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0317 12:39:31.762205 455052 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0317 12:39:31.766344 455052 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
I0317 12:39:31.851723 455052 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0317 12:39:31.968271 455052 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0317 12:39:32.060014 455052 addons.go:435] installing /etc/kubernetes/addons/ig-deployment.yaml
I0317 12:39:32.060104 455052 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-deployment.yaml (14539 bytes)
I0317 12:39:32.065631 455052 addons.go:435] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0317 12:39:32.065768 455052 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0317 12:39:32.161052 455052 addons.go:435] installing /etc/kubernetes/addons/yakd-svc.yaml
I0317 12:39:32.161164 455052 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0317 12:39:32.169358 455052 addons.go:435] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0317 12:39:32.169448 455052 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0317 12:39:32.365698 455052 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml
I0317 12:39:32.464479 455052 addons.go:435] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0317 12:39:32.464516 455052 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0317 12:39:32.467193 455052 addons.go:435] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0317 12:39:32.467280 455052 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0317 12:39:32.846142 455052 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0317 12:39:32.955524 455052 addons.go:435] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0317 12:39:32.955555 455052 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0317 12:39:32.970714 455052 addons.go:435] installing /etc/kubernetes/addons/yakd-dp.yaml
I0317 12:39:32.970743 455052 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0317 12:39:33.062460 455052 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.32.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.32.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.096230372s)
I0317 12:39:33.062510 455052 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I0317 12:39:33.063931 455052 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (2.097605245s)
I0317 12:39:33.064929 455052 node_ready.go:35] waiting up to 6m0s for node "addons-012219" to be "Ready" ...
I0317 12:39:33.065239 455052 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (1.807970086s)
I0317 12:39:33.068002 455052 node_ready.go:49] node "addons-012219" has status "Ready":"True"
I0317 12:39:33.068029 455052 node_ready.go:38] duration metric: took 3.064074ms for node "addons-012219" to be "Ready" ...
I0317 12:39:33.068041 455052 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0317 12:39:33.152942 455052 addons.go:435] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0317 12:39:33.152978 455052 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0317 12:39:33.160164 455052 pod_ready.go:79] waiting up to 6m0s for pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace to be "Ready" ...
I0317 12:39:33.567628 455052 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-012219" context rescaled to 1 replicas
I0317 12:39:33.754550 455052 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0317 12:39:33.761198 455052 addons.go:435] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0317 12:39:33.761298 455052 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0317 12:39:33.852436 455052 addons.go:435] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0317 12:39:33.852536 455052 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0317 12:39:34.254529 455052 addons.go:435] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0317 12:39:34.254655 455052 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0317 12:39:34.462280 455052 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0317 12:39:34.845500 455052 addons.go:435] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0317 12:39:34.845537 455052 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0317 12:39:35.248845 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:39:35.362365 455052 addons.go:435] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0317 12:39:35.362400 455052 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0317 12:39:35.846643 455052 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/amd-gpu-device-plugin.yaml: (4.295318375s)
I0317 12:39:35.846730 455052 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (4.285697264s)
I0317 12:39:35.846912 455052 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (4.481506128s)
I0317 12:39:35.858428 455052 addons.go:435] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0317 12:39:35.858464 455052 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0317 12:39:36.647042 455052 addons.go:435] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0317 12:39:36.647081 455052 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0317 12:39:37.065685 455052 addons.go:435] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0317 12:39:37.065718 455052 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0317 12:39:37.466458 455052 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0317 12:39:37.758106 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:39:37.762024 455052 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0317 12:39:37.762225 455052 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-012219
I0317 12:39:37.784451 455052 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33145 SSHKeyPath:/home/jenkins/minikube-integration/20539-446828/.minikube/machines/addons-012219/id_rsa Username:docker}
I0317 12:39:38.453145 455052 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0317 12:39:38.561607 455052 addons.go:238] Setting addon gcp-auth=true in "addons-012219"
I0317 12:39:38.561781 455052 host.go:66] Checking if "addons-012219" exists ...
I0317 12:39:38.562402 455052 cli_runner.go:164] Run: docker container inspect addons-012219 --format={{.State.Status}}
I0317 12:39:38.583369 455052 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0317 12:39:38.583432 455052 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-012219
I0317 12:39:38.603362 455052 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33145 SSHKeyPath:/home/jenkins/minikube-integration/20539-446828/.minikube/machines/addons-012219/id_rsa Username:docker}
I0317 12:39:39.963042 455052 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (8.311718597s)
I0317 12:39:39.963103 455052 addons.go:479] Verifying addon ingress=true in "addons-012219"
I0317 12:39:39.963146 455052 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (8.200916336s)
I0317 12:39:39.963106 455052 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (8.207671739s)
I0317 12:39:39.964972 455052 out.go:177] * Verifying ingress addon...
I0317 12:39:39.967123 455052 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0317 12:39:39.974048 455052 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0317 12:39:39.974085 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:40.168255 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:39:40.471454 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:40.970837 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:41.549708 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:42.061728 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:42.169314 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:39:42.550695 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:42.553278 455052 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (10.786881387s)
I0317 12:39:42.553444 455052 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (10.701613468s)
I0317 12:39:42.553532 455052 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (10.585225493s)
I0317 12:39:42.553565 455052 addons.go:479] Verifying addon registry=true in "addons-012219"
I0317 12:39:42.553630 455052 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: (10.187898413s)
I0317 12:39:42.553712 455052 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (9.707451979s)
I0317 12:39:42.553739 455052 addons.go:479] Verifying addon metrics-server=true in "addons-012219"
I0317 12:39:42.553800 455052 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (8.79912533s)
I0317 12:39:42.553972 455052 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (8.091594119s)
W0317 12:39:42.554015 455052 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0317 12:39:42.554040 455052 retry.go:31] will retry after 295.085511ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0317 12:39:42.555834 455052 out.go:177] * Verifying registry addon...
I0317 12:39:42.555863 455052 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-012219 service yakd-dashboard -n yakd-dashboard
I0317 12:39:42.557616 455052 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0317 12:39:42.581691 455052 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0317 12:39:42.581718 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:42.850218 455052 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0317 12:39:42.975974 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:43.075964 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:43.155821 455052 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (5.689213369s)
I0317 12:39:43.155936 455052 addons.go:479] Verifying addon csi-hostpath-driver=true in "addons-012219"
I0317 12:39:43.155942 455052 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (4.572537291s)
I0317 12:39:43.157617 455052 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.4
I0317 12:39:43.157777 455052 out.go:177] * Verifying csi-hostpath-driver addon...
I0317 12:39:43.159814 455052 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.3
I0317 12:39:43.160582 455052 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0317 12:39:43.160914 455052 addons.go:435] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0317 12:39:43.160937 455052 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0317 12:39:43.169759 455052 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0317 12:39:43.169793 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:43.261056 455052 addons.go:435] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0317 12:39:43.261091 455052 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0317 12:39:43.348254 455052 addons.go:435] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0317 12:39:43.348283 455052 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I0317 12:39:43.374483 455052 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0317 12:39:43.471359 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:43.572495 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:43.672384 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:43.971940 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:44.061084 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:44.165056 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:44.471394 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:44.649892 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:44.666193 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:39:44.751533 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:44.969390 455052 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.119113252s)
I0317 12:39:44.969492 455052 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.594968733s)
I0317 12:39:44.971520 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:44.971590 455052 addons.go:479] Verifying addon gcp-auth=true in "addons-012219"
I0317 12:39:44.973564 455052 out.go:177] * Verifying gcp-auth addon...
I0317 12:39:44.976076 455052 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0317 12:39:44.978975 455052 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0317 12:39:45.072406 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:45.173295 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:45.470631 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:45.561686 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:45.665692 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:45.971717 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:46.072106 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:46.164021 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:46.471361 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:46.561277 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:46.664535 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:46.667048 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:39:46.971565 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:47.072951 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:47.164423 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:47.471232 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:47.561723 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:47.664038 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:47.971270 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:48.071786 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:48.163686 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:48.471336 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:48.560822 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:48.663757 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:48.971328 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:49.072463 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:49.164533 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:49.166752 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:39:49.471099 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:49.561783 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:49.664190 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:49.970445 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:50.061306 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:50.164637 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:50.471009 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:50.561219 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:50.664148 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:50.971530 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:51.072842 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:51.164105 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:51.471202 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:51.561253 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:51.665220 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:51.668404 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:39:51.971071 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:52.072052 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:52.164149 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:52.470257 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:52.561883 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:52.663695 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:52.970649 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:53.061766 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:53.164768 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:53.470620 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:53.561248 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:53.665611 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:53.971016 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:54.062562 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:54.163544 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:54.165160 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:39:54.471067 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:54.562262 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:54.664297 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:54.972022 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:55.072859 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:55.164482 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:55.471483 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:55.571635 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:55.672167 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:55.970581 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:56.061517 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:56.163692 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:56.165852 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:39:56.470891 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:56.560840 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:56.664424 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:56.971609 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:57.071944 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:57.172129 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:57.471492 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:57.561328 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:57.664371 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:57.971765 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:58.061136 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:58.164717 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:58.167169 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:39:58.470811 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:58.561875 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:58.664227 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:58.971242 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:59.071723 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:59.173224 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:59.470583 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:39:59.561582 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:39:59.663620 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:39:59.974228 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:00.075968 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:00.181322 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:00.182002 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:40:00.557628 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:00.560801 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:00.664499 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:00.972439 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:01.073207 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:01.165021 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:01.470938 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:01.562561 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:01.664967 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:01.972110 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:02.073252 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:02.174502 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:02.471130 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:02.561466 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:02.665135 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:02.667591 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:40:02.972192 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:03.061318 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:03.165767 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:03.470986 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:03.572154 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:03.664213 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:03.971487 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:04.069612 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:04.165226 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:04.471284 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:04.561631 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:04.664524 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:04.971508 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:05.073253 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:05.164360 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:05.166454 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:40:05.470885 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:05.562638 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:05.664366 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:05.971238 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:06.061221 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:06.164909 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:06.471155 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:06.571876 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:06.664237 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:06.971428 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:07.061486 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:07.163639 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:07.470523 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:07.561415 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:07.664399 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:07.666587 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:40:07.971118 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:08.061747 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:08.163808 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:08.471246 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:08.561010 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:08.664428 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:08.971582 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:09.062098 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:09.164757 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:09.471103 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:09.561332 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:09.663639 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:09.970712 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:10.061070 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:10.164198 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:10.166333 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:40:10.470978 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:10.561251 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:10.663441 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:10.970760 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:11.061703 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:11.163861 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:11.471220 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:11.561820 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:11.664502 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:11.971329 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:12.061290 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:12.164136 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:12.471314 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:12.562162 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:12.664543 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:12.666877 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:40:12.971802 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:13.061379 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:13.164009 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:13.472479 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:13.562232 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:13.664301 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:13.970923 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:14.061876 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:14.164543 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:14.471702 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:14.561707 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:14.664669 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:14.971484 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:15.072515 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:15.163628 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:15.165978 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:40:15.471504 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:15.561274 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:15.664049 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:15.971437 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:16.061094 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:16.164746 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:16.471713 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:16.561773 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:16.664010 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:16.971221 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:17.061407 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:17.163749 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:17.166163 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:40:17.471449 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:17.561476 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:17.663628 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:17.971714 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:18.060744 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:18.163928 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:18.470532 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:18.561315 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:18.663470 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:18.971755 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:19.073190 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:19.166677 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:40:19.173869 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:19.471193 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:19.561520 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:19.664041 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:19.971753 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:20.061098 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:20.164104 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:20.470553 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:20.561338 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:20.663723 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:20.971982 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:21.060631 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:21.164519 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:21.166782 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:40:21.471230 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:21.560804 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:21.663752 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:21.970837 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:22.061546 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:22.164273 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:22.471264 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:22.561425 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:22.663649 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:22.971476 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:23.061583 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:23.163873 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:23.471076 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:23.561162 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:23.664420 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:23.666843 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:40:23.971320 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:24.072435 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:24.164277 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:24.470642 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:24.560842 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:24.663920 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:24.973709 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:25.076391 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:25.163684 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:25.470529 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:25.561505 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:25.663906 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:25.971534 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:26.072707 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:26.163741 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:26.166287 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:40:26.470597 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:26.561589 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:26.664129 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:26.970465 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:27.061507 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:27.163899 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:27.471149 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:27.561493 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:27.663736 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:27.971115 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:28.061301 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:28.163891 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:28.166793 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:40:28.471391 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:28.560643 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:28.664060 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:28.981446 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:29.081852 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:29.164091 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:29.470388 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:29.561673 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:29.663920 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:29.973060 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:30.060543 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:30.163606 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:30.471522 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:30.560621 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:30.664061 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:30.666611 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:40:30.990451 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:31.091406 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:31.164809 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:31.470756 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:31.561714 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:31.663874 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:31.971016 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:32.061564 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:32.164859 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:32.471579 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:32.561549 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:32.664019 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:32.970709 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:33.071305 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:33.164531 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:33.167039 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:40:33.470693 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:33.561678 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:33.664618 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:34.007171 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:34.061865 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:34.164041 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:34.470895 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:34.562349 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:34.663767 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:34.971330 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:35.061022 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:35.164413 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:35.471061 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:35.560933 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0317 12:40:35.664236 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:35.666602 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:40:35.987282 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:36.061034 455052 kapi.go:107] duration metric: took 53.503416924s to wait for kubernetes.io/minikube-addons=registry ...
I0317 12:40:36.164007 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:36.470388 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:36.664609 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:36.971153 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:37.164856 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:37.470875 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:37.663839 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:37.970590 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:38.164550 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:38.166315 455052 pod_ready.go:103] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"False"
I0317 12:40:38.471165 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:38.663884 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:38.970790 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:39.173617 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:39.176004 455052 pod_ready.go:93] pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace has status "Ready":"True"
I0317 12:40:39.176032 455052 pod_ready.go:82] duration metric: took 1m6.015822117s for pod "amd-gpu-device-plugin-vshjt" in "kube-system" namespace to be "Ready" ...
I0317 12:40:39.176044 455052 pod_ready.go:79] waiting up to 6m0s for pod "coredns-668d6bf9bc-d2bx4" in "kube-system" namespace to be "Ready" ...
I0317 12:40:39.192981 455052 pod_ready.go:93] pod "coredns-668d6bf9bc-d2bx4" in "kube-system" namespace has status "Ready":"True"
I0317 12:40:39.193007 455052 pod_ready.go:82] duration metric: took 16.956484ms for pod "coredns-668d6bf9bc-d2bx4" in "kube-system" namespace to be "Ready" ...
I0317 12:40:39.193018 455052 pod_ready.go:79] waiting up to 6m0s for pod "coredns-668d6bf9bc-gf4gw" in "kube-system" namespace to be "Ready" ...
I0317 12:40:39.195263 455052 pod_ready.go:98] error getting pod "coredns-668d6bf9bc-gf4gw" in "kube-system" namespace (skipping!): pods "coredns-668d6bf9bc-gf4gw" not found
I0317 12:40:39.195295 455052 pod_ready.go:82] duration metric: took 2.270605ms for pod "coredns-668d6bf9bc-gf4gw" in "kube-system" namespace to be "Ready" ...
E0317 12:40:39.195306 455052 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-668d6bf9bc-gf4gw" in "kube-system" namespace (skipping!): pods "coredns-668d6bf9bc-gf4gw" not found
I0317 12:40:39.195313 455052 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-012219" in "kube-system" namespace to be "Ready" ...
I0317 12:40:39.200296 455052 pod_ready.go:93] pod "etcd-addons-012219" in "kube-system" namespace has status "Ready":"True"
I0317 12:40:39.200357 455052 pod_ready.go:82] duration metric: took 5.035892ms for pod "etcd-addons-012219" in "kube-system" namespace to be "Ready" ...
I0317 12:40:39.200375 455052 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-012219" in "kube-system" namespace to be "Ready" ...
I0317 12:40:39.205221 455052 pod_ready.go:93] pod "kube-apiserver-addons-012219" in "kube-system" namespace has status "Ready":"True"
I0317 12:40:39.205243 455052 pod_ready.go:82] duration metric: took 4.860483ms for pod "kube-apiserver-addons-012219" in "kube-system" namespace to be "Ready" ...
I0317 12:40:39.205253 455052 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-012219" in "kube-system" namespace to be "Ready" ...
I0317 12:40:39.364929 455052 pod_ready.go:93] pod "kube-controller-manager-addons-012219" in "kube-system" namespace has status "Ready":"True"
I0317 12:40:39.364957 455052 pod_ready.go:82] duration metric: took 159.696703ms for pod "kube-controller-manager-addons-012219" in "kube-system" namespace to be "Ready" ...
I0317 12:40:39.364970 455052 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-dd72m" in "kube-system" namespace to be "Ready" ...
I0317 12:40:39.471469 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:39.664758 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:39.764524 455052 pod_ready.go:93] pod "kube-proxy-dd72m" in "kube-system" namespace has status "Ready":"True"
I0317 12:40:39.764556 455052 pod_ready.go:82] duration metric: took 399.576924ms for pod "kube-proxy-dd72m" in "kube-system" namespace to be "Ready" ...
I0317 12:40:39.764569 455052 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-012219" in "kube-system" namespace to be "Ready" ...
I0317 12:40:39.970483 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:40.164026 455052 pod_ready.go:93] pod "kube-scheduler-addons-012219" in "kube-system" namespace has status "Ready":"True"
I0317 12:40:40.164055 455052 pod_ready.go:82] duration metric: took 399.477967ms for pod "kube-scheduler-addons-012219" in "kube-system" namespace to be "Ready" ...
I0317 12:40:40.164065 455052 pod_ready.go:79] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-s96nr" in "kube-system" namespace to be "Ready" ...
I0317 12:40:40.164021 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:40.565634 455052 pod_ready.go:93] pod "nvidia-device-plugin-daemonset-s96nr" in "kube-system" namespace has status "Ready":"True"
I0317 12:40:40.565663 455052 pod_ready.go:82] duration metric: took 401.590789ms for pod "nvidia-device-plugin-daemonset-s96nr" in "kube-system" namespace to be "Ready" ...
I0317 12:40:40.565674 455052 pod_ready.go:39] duration metric: took 1m7.497617906s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0317 12:40:40.565698 455052 api_server.go:52] waiting for apiserver process to appear ...
I0317 12:40:40.565750 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:40.565773 455052 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0317 12:40:40.565833 455052 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0317 12:40:40.606351 455052 cri.go:89] found id: "bb5f00b7625601d21e905147e28f325d6d2eb52f6d757f39f8ce61ff4f55c983"
I0317 12:40:40.606386 455052 cri.go:89] found id: ""
I0317 12:40:40.606397 455052 logs.go:282] 1 containers: [bb5f00b7625601d21e905147e28f325d6d2eb52f6d757f39f8ce61ff4f55c983]
I0317 12:40:40.606449 455052 ssh_runner.go:195] Run: which crictl
I0317 12:40:40.610255 455052 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0317 12:40:40.610344 455052 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0317 12:40:40.646690 455052 cri.go:89] found id: "0c8a01ff0ac04a67f0ca7daa16df0b12a5be2d60bc00f609c695b24631e44cd4"
I0317 12:40:40.646721 455052 cri.go:89] found id: ""
I0317 12:40:40.646732 455052 logs.go:282] 1 containers: [0c8a01ff0ac04a67f0ca7daa16df0b12a5be2d60bc00f609c695b24631e44cd4]
I0317 12:40:40.646797 455052 ssh_runner.go:195] Run: which crictl
I0317 12:40:40.650751 455052 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0317 12:40:40.650819 455052 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0317 12:40:40.664837 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:40.694081 455052 cri.go:89] found id: "9af85dc8bdce7c7605798e49add631c328e501002f7088a1c154d4d7c6829056"
I0317 12:40:40.694109 455052 cri.go:89] found id: ""
I0317 12:40:40.694120 455052 logs.go:282] 1 containers: [9af85dc8bdce7c7605798e49add631c328e501002f7088a1c154d4d7c6829056]
I0317 12:40:40.694186 455052 ssh_runner.go:195] Run: which crictl
I0317 12:40:40.698401 455052 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0317 12:40:40.698484 455052 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0317 12:40:40.736966 455052 cri.go:89] found id: "5e2a09620775b2c75311fe4e7c162d2c0f322d3fd4424587a9c48ee80c51dc42"
I0317 12:40:40.736995 455052 cri.go:89] found id: ""
I0317 12:40:40.737006 455052 logs.go:282] 1 containers: [5e2a09620775b2c75311fe4e7c162d2c0f322d3fd4424587a9c48ee80c51dc42]
I0317 12:40:40.737055 455052 ssh_runner.go:195] Run: which crictl
I0317 12:40:40.741396 455052 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0317 12:40:40.741478 455052 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0317 12:40:40.780872 455052 cri.go:89] found id: "d3a2f527a68764f7f040d4b49dce23f813fbc96471794730d235e72cb3e66af3"
I0317 12:40:40.780909 455052 cri.go:89] found id: ""
I0317 12:40:40.780917 455052 logs.go:282] 1 containers: [d3a2f527a68764f7f040d4b49dce23f813fbc96471794730d235e72cb3e66af3]
I0317 12:40:40.780965 455052 ssh_runner.go:195] Run: which crictl
I0317 12:40:40.785035 455052 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0317 12:40:40.785132 455052 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0317 12:40:40.822415 455052 cri.go:89] found id: "379f28506a87666447bb9e5a46766c5b8106bf905cd90914f25a4fdc6d2bdac8"
I0317 12:40:40.822441 455052 cri.go:89] found id: ""
I0317 12:40:40.822450 455052 logs.go:282] 1 containers: [379f28506a87666447bb9e5a46766c5b8106bf905cd90914f25a4fdc6d2bdac8]
I0317 12:40:40.822502 455052 ssh_runner.go:195] Run: which crictl
I0317 12:40:40.826522 455052 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0317 12:40:40.826592 455052 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0317 12:40:40.863344 455052 cri.go:89] found id: "9b64fcbeb6014a84017e01b17c16c6441e599c7b3f10d9b6d2654868922d1649"
I0317 12:40:40.863373 455052 cri.go:89] found id: ""
I0317 12:40:40.863384 455052 logs.go:282] 1 containers: [9b64fcbeb6014a84017e01b17c16c6441e599c7b3f10d9b6d2654868922d1649]
I0317 12:40:40.863447 455052 ssh_runner.go:195] Run: which crictl
I0317 12:40:40.867562 455052 logs.go:123] Gathering logs for container status ...
I0317 12:40:40.867591 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0317 12:40:40.911123 455052 logs.go:123] Gathering logs for kubelet ...
I0317 12:40:40.911167 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0317 12:40:40.985490 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:41.012076 455052 logs.go:123] Gathering logs for kube-apiserver [bb5f00b7625601d21e905147e28f325d6d2eb52f6d757f39f8ce61ff4f55c983] ...
I0317 12:40:41.012172 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bb5f00b7625601d21e905147e28f325d6d2eb52f6d757f39f8ce61ff4f55c983"
I0317 12:40:41.076592 455052 logs.go:123] Gathering logs for coredns [9af85dc8bdce7c7605798e49add631c328e501002f7088a1c154d4d7c6829056] ...
I0317 12:40:41.076640 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9af85dc8bdce7c7605798e49add631c328e501002f7088a1c154d4d7c6829056"
I0317 12:40:41.121182 455052 logs.go:123] Gathering logs for kube-controller-manager [379f28506a87666447bb9e5a46766c5b8106bf905cd90914f25a4fdc6d2bdac8] ...
I0317 12:40:41.121224 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 379f28506a87666447bb9e5a46766c5b8106bf905cd90914f25a4fdc6d2bdac8"
I0317 12:40:41.164748 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:41.188610 455052 logs.go:123] Gathering logs for dmesg ...
I0317 12:40:41.188658 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0317 12:40:41.216301 455052 logs.go:123] Gathering logs for describe nodes ...
I0317 12:40:41.216368 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.32.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0317 12:40:41.454361 455052 logs.go:123] Gathering logs for etcd [0c8a01ff0ac04a67f0ca7daa16df0b12a5be2d60bc00f609c695b24631e44cd4] ...
I0317 12:40:41.454423 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0c8a01ff0ac04a67f0ca7daa16df0b12a5be2d60bc00f609c695b24631e44cd4"
I0317 12:40:41.471030 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:41.502158 455052 logs.go:123] Gathering logs for kube-scheduler [5e2a09620775b2c75311fe4e7c162d2c0f322d3fd4424587a9c48ee80c51dc42] ...
I0317 12:40:41.502206 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5e2a09620775b2c75311fe4e7c162d2c0f322d3fd4424587a9c48ee80c51dc42"
I0317 12:40:41.546833 455052 logs.go:123] Gathering logs for kube-proxy [d3a2f527a68764f7f040d4b49dce23f813fbc96471794730d235e72cb3e66af3] ...
I0317 12:40:41.546886 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d3a2f527a68764f7f040d4b49dce23f813fbc96471794730d235e72cb3e66af3"
I0317 12:40:41.586006 455052 logs.go:123] Gathering logs for kindnet [9b64fcbeb6014a84017e01b17c16c6441e599c7b3f10d9b6d2654868922d1649] ...
I0317 12:40:41.586050 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9b64fcbeb6014a84017e01b17c16c6441e599c7b3f10d9b6d2654868922d1649"
I0317 12:40:41.626915 455052 logs.go:123] Gathering logs for containerd ...
I0317 12:40:41.626946 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0317 12:40:41.664917 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:41.971006 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:42.163415 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:42.470573 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:42.664852 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:42.971232 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:43.165271 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:43.471719 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:43.663641 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:44.046664 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:44.164908 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:44.197012 455052 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0317 12:40:44.213431 455052 api_server.go:72] duration metric: took 1m13.569048658s to wait for apiserver process to appear ...
I0317 12:40:44.213465 455052 api_server.go:88] waiting for apiserver healthz status ...
I0317 12:40:44.213525 455052 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0317 12:40:44.213592 455052 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0317 12:40:44.250956 455052 cri.go:89] found id: "bb5f00b7625601d21e905147e28f325d6d2eb52f6d757f39f8ce61ff4f55c983"
I0317 12:40:44.250984 455052 cri.go:89] found id: ""
I0317 12:40:44.250991 455052 logs.go:282] 1 containers: [bb5f00b7625601d21e905147e28f325d6d2eb52f6d757f39f8ce61ff4f55c983]
I0317 12:40:44.251037 455052 ssh_runner.go:195] Run: which crictl
I0317 12:40:44.255218 455052 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0317 12:40:44.255300 455052 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0317 12:40:44.292739 455052 cri.go:89] found id: "0c8a01ff0ac04a67f0ca7daa16df0b12a5be2d60bc00f609c695b24631e44cd4"
I0317 12:40:44.292764 455052 cri.go:89] found id: ""
I0317 12:40:44.292773 455052 logs.go:282] 1 containers: [0c8a01ff0ac04a67f0ca7daa16df0b12a5be2d60bc00f609c695b24631e44cd4]
I0317 12:40:44.292837 455052 ssh_runner.go:195] Run: which crictl
I0317 12:40:44.297234 455052 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0317 12:40:44.297309 455052 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0317 12:40:44.334012 455052 cri.go:89] found id: "9af85dc8bdce7c7605798e49add631c328e501002f7088a1c154d4d7c6829056"
I0317 12:40:44.334037 455052 cri.go:89] found id: ""
I0317 12:40:44.334045 455052 logs.go:282] 1 containers: [9af85dc8bdce7c7605798e49add631c328e501002f7088a1c154d4d7c6829056]
I0317 12:40:44.334109 455052 ssh_runner.go:195] Run: which crictl
I0317 12:40:44.339441 455052 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0317 12:40:44.339535 455052 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0317 12:40:44.377185 455052 cri.go:89] found id: "5e2a09620775b2c75311fe4e7c162d2c0f322d3fd4424587a9c48ee80c51dc42"
I0317 12:40:44.377208 455052 cri.go:89] found id: ""
I0317 12:40:44.377216 455052 logs.go:282] 1 containers: [5e2a09620775b2c75311fe4e7c162d2c0f322d3fd4424587a9c48ee80c51dc42]
I0317 12:40:44.377270 455052 ssh_runner.go:195] Run: which crictl
I0317 12:40:44.381213 455052 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0317 12:40:44.381307 455052 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0317 12:40:44.419209 455052 cri.go:89] found id: "d3a2f527a68764f7f040d4b49dce23f813fbc96471794730d235e72cb3e66af3"
I0317 12:40:44.419236 455052 cri.go:89] found id: ""
I0317 12:40:44.419246 455052 logs.go:282] 1 containers: [d3a2f527a68764f7f040d4b49dce23f813fbc96471794730d235e72cb3e66af3]
I0317 12:40:44.419304 455052 ssh_runner.go:195] Run: which crictl
I0317 12:40:44.423259 455052 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0317 12:40:44.423334 455052 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0317 12:40:44.461215 455052 cri.go:89] found id: "379f28506a87666447bb9e5a46766c5b8106bf905cd90914f25a4fdc6d2bdac8"
I0317 12:40:44.461241 455052 cri.go:89] found id: ""
I0317 12:40:44.461250 455052 logs.go:282] 1 containers: [379f28506a87666447bb9e5a46766c5b8106bf905cd90914f25a4fdc6d2bdac8]
I0317 12:40:44.461313 455052 ssh_runner.go:195] Run: which crictl
I0317 12:40:44.465079 455052 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0317 12:40:44.465172 455052 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0317 12:40:44.470298 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:44.505756 455052 cri.go:89] found id: "9b64fcbeb6014a84017e01b17c16c6441e599c7b3f10d9b6d2654868922d1649"
I0317 12:40:44.505789 455052 cri.go:89] found id: ""
I0317 12:40:44.505800 455052 logs.go:282] 1 containers: [9b64fcbeb6014a84017e01b17c16c6441e599c7b3f10d9b6d2654868922d1649]
I0317 12:40:44.505862 455052 ssh_runner.go:195] Run: which crictl
I0317 12:40:44.510159 455052 logs.go:123] Gathering logs for kubelet ...
I0317 12:40:44.510194 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0317 12:40:44.612068 455052 logs.go:123] Gathering logs for describe nodes ...
I0317 12:40:44.612121 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.32.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0317 12:40:44.665305 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:44.711514 455052 logs.go:123] Gathering logs for kube-apiserver [bb5f00b7625601d21e905147e28f325d6d2eb52f6d757f39f8ce61ff4f55c983] ...
I0317 12:40:44.711552 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bb5f00b7625601d21e905147e28f325d6d2eb52f6d757f39f8ce61ff4f55c983"
I0317 12:40:44.774357 455052 logs.go:123] Gathering logs for coredns [9af85dc8bdce7c7605798e49add631c328e501002f7088a1c154d4d7c6829056] ...
I0317 12:40:44.774406 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9af85dc8bdce7c7605798e49add631c328e501002f7088a1c154d4d7c6829056"
I0317 12:40:44.813382 455052 logs.go:123] Gathering logs for kube-scheduler [5e2a09620775b2c75311fe4e7c162d2c0f322d3fd4424587a9c48ee80c51dc42] ...
I0317 12:40:44.813419 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5e2a09620775b2c75311fe4e7c162d2c0f322d3fd4424587a9c48ee80c51dc42"
I0317 12:40:44.863365 455052 logs.go:123] Gathering logs for kube-proxy [d3a2f527a68764f7f040d4b49dce23f813fbc96471794730d235e72cb3e66af3] ...
I0317 12:40:44.863421 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d3a2f527a68764f7f040d4b49dce23f813fbc96471794730d235e72cb3e66af3"
I0317 12:40:44.905079 455052 logs.go:123] Gathering logs for kindnet [9b64fcbeb6014a84017e01b17c16c6441e599c7b3f10d9b6d2654868922d1649] ...
I0317 12:40:44.905112 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9b64fcbeb6014a84017e01b17c16c6441e599c7b3f10d9b6d2654868922d1649"
I0317 12:40:44.970391 455052 logs.go:123] Gathering logs for container status ...
I0317 12:40:44.970440 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0317 12:40:44.971654 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:45.078232 455052 logs.go:123] Gathering logs for dmesg ...
I0317 12:40:45.078288 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0317 12:40:45.106924 455052 logs.go:123] Gathering logs for etcd [0c8a01ff0ac04a67f0ca7daa16df0b12a5be2d60bc00f609c695b24631e44cd4] ...
I0317 12:40:45.106966 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0c8a01ff0ac04a67f0ca7daa16df0b12a5be2d60bc00f609c695b24631e44cd4"
I0317 12:40:45.164276 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:45.188075 455052 logs.go:123] Gathering logs for kube-controller-manager [379f28506a87666447bb9e5a46766c5b8106bf905cd90914f25a4fdc6d2bdac8] ...
I0317 12:40:45.188122 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 379f28506a87666447bb9e5a46766c5b8106bf905cd90914f25a4fdc6d2bdac8"
I0317 12:40:45.295976 455052 logs.go:123] Gathering logs for containerd ...
I0317 12:40:45.296037 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0317 12:40:45.471680 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:45.664738 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:45.972089 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:46.166202 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:46.472051 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:46.664657 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:46.970725 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:47.164553 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:47.471404 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:47.664810 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:47.873980 455052 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I0317 12:40:47.878931 455052 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I0317 12:40:47.879917 455052 api_server.go:141] control plane version: v1.32.2
I0317 12:40:47.879944 455052 api_server.go:131] duration metric: took 3.666470439s to wait for apiserver health ...
I0317 12:40:47.879951 455052 system_pods.go:43] waiting for kube-system pods to appear ...
I0317 12:40:47.879974 455052 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0317 12:40:47.880026 455052 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0317 12:40:47.918549 455052 cri.go:89] found id: "bb5f00b7625601d21e905147e28f325d6d2eb52f6d757f39f8ce61ff4f55c983"
I0317 12:40:47.918579 455052 cri.go:89] found id: ""
I0317 12:40:47.918589 455052 logs.go:282] 1 containers: [bb5f00b7625601d21e905147e28f325d6d2eb52f6d757f39f8ce61ff4f55c983]
I0317 12:40:47.918637 455052 ssh_runner.go:195] Run: which crictl
I0317 12:40:47.922513 455052 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0317 12:40:47.922593 455052 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0317 12:40:47.966599 455052 cri.go:89] found id: "0c8a01ff0ac04a67f0ca7daa16df0b12a5be2d60bc00f609c695b24631e44cd4"
I0317 12:40:47.966717 455052 cri.go:89] found id: ""
I0317 12:40:47.966734 455052 logs.go:282] 1 containers: [0c8a01ff0ac04a67f0ca7daa16df0b12a5be2d60bc00f609c695b24631e44cd4]
I0317 12:40:47.966814 455052 ssh_runner.go:195] Run: which crictl
I0317 12:40:47.972421 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:47.974109 455052 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0317 12:40:47.974185 455052 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0317 12:40:48.083818 455052 cri.go:89] found id: "9af85dc8bdce7c7605798e49add631c328e501002f7088a1c154d4d7c6829056"
I0317 12:40:48.083846 455052 cri.go:89] found id: ""
I0317 12:40:48.083857 455052 logs.go:282] 1 containers: [9af85dc8bdce7c7605798e49add631c328e501002f7088a1c154d4d7c6829056]
I0317 12:40:48.083929 455052 ssh_runner.go:195] Run: which crictl
I0317 12:40:48.088505 455052 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0317 12:40:48.088582 455052 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0317 12:40:48.164562 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:48.182882 455052 cri.go:89] found id: "5e2a09620775b2c75311fe4e7c162d2c0f322d3fd4424587a9c48ee80c51dc42"
I0317 12:40:48.182907 455052 cri.go:89] found id: ""
I0317 12:40:48.182917 455052 logs.go:282] 1 containers: [5e2a09620775b2c75311fe4e7c162d2c0f322d3fd4424587a9c48ee80c51dc42]
I0317 12:40:48.182973 455052 ssh_runner.go:195] Run: which crictl
I0317 12:40:48.187292 455052 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0317 12:40:48.187364 455052 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0317 12:40:48.266843 455052 cri.go:89] found id: "d3a2f527a68764f7f040d4b49dce23f813fbc96471794730d235e72cb3e66af3"
I0317 12:40:48.266868 455052 cri.go:89] found id: ""
I0317 12:40:48.266876 455052 logs.go:282] 1 containers: [d3a2f527a68764f7f040d4b49dce23f813fbc96471794730d235e72cb3e66af3]
I0317 12:40:48.266924 455052 ssh_runner.go:195] Run: which crictl
I0317 12:40:48.271302 455052 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0317 12:40:48.271366 455052 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0317 12:40:48.362922 455052 cri.go:89] found id: "379f28506a87666447bb9e5a46766c5b8106bf905cd90914f25a4fdc6d2bdac8"
I0317 12:40:48.362948 455052 cri.go:89] found id: ""
I0317 12:40:48.362958 455052 logs.go:282] 1 containers: [379f28506a87666447bb9e5a46766c5b8106bf905cd90914f25a4fdc6d2bdac8]
I0317 12:40:48.363018 455052 ssh_runner.go:195] Run: which crictl
I0317 12:40:48.366903 455052 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0317 12:40:48.366987 455052 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0317 12:40:48.445208 455052 cri.go:89] found id: "9b64fcbeb6014a84017e01b17c16c6441e599c7b3f10d9b6d2654868922d1649"
I0317 12:40:48.445239 455052 cri.go:89] found id: ""
I0317 12:40:48.445250 455052 logs.go:282] 1 containers: [9b64fcbeb6014a84017e01b17c16c6441e599c7b3f10d9b6d2654868922d1649]
I0317 12:40:48.445316 455052 ssh_runner.go:195] Run: which crictl
I0317 12:40:48.449909 455052 logs.go:123] Gathering logs for kubelet ...
I0317 12:40:48.449941 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0317 12:40:48.470951 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:48.564227 455052 logs.go:123] Gathering logs for dmesg ...
I0317 12:40:48.564287 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0317 12:40:48.594274 455052 logs.go:123] Gathering logs for etcd [0c8a01ff0ac04a67f0ca7daa16df0b12a5be2d60bc00f609c695b24631e44cd4] ...
I0317 12:40:48.594327 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0c8a01ff0ac04a67f0ca7daa16df0b12a5be2d60bc00f609c695b24631e44cd4"
I0317 12:40:48.666652 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:48.687502 455052 logs.go:123] Gathering logs for coredns [9af85dc8bdce7c7605798e49add631c328e501002f7088a1c154d4d7c6829056] ...
I0317 12:40:48.687545 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9af85dc8bdce7c7605798e49add631c328e501002f7088a1c154d4d7c6829056"
I0317 12:40:48.866713 455052 logs.go:123] Gathering logs for kube-controller-manager [379f28506a87666447bb9e5a46766c5b8106bf905cd90914f25a4fdc6d2bdac8] ...
I0317 12:40:48.866758 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 379f28506a87666447bb9e5a46766c5b8106bf905cd90914f25a4fdc6d2bdac8"
I0317 12:40:48.974564 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:49.093453 455052 logs.go:123] Gathering logs for container status ...
I0317 12:40:49.093505 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0317 12:40:49.164436 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:49.278407 455052 logs.go:123] Gathering logs for describe nodes ...
I0317 12:40:49.278448 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.32.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0317 12:40:49.471253 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:49.656290 455052 logs.go:123] Gathering logs for kube-apiserver [bb5f00b7625601d21e905147e28f325d6d2eb52f6d757f39f8ce61ff4f55c983] ...
I0317 12:40:49.656363 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bb5f00b7625601d21e905147e28f325d6d2eb52f6d757f39f8ce61ff4f55c983"
I0317 12:40:49.666846 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:49.971519 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:49.985522 455052 logs.go:123] Gathering logs for kube-scheduler [5e2a09620775b2c75311fe4e7c162d2c0f322d3fd4424587a9c48ee80c51dc42] ...
I0317 12:40:49.985575 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5e2a09620775b2c75311fe4e7c162d2c0f322d3fd4424587a9c48ee80c51dc42"
I0317 12:40:50.080623 455052 logs.go:123] Gathering logs for kube-proxy [d3a2f527a68764f7f040d4b49dce23f813fbc96471794730d235e72cb3e66af3] ...
I0317 12:40:50.080664 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d3a2f527a68764f7f040d4b49dce23f813fbc96471794730d235e72cb3e66af3"
I0317 12:40:50.150398 455052 logs.go:123] Gathering logs for kindnet [9b64fcbeb6014a84017e01b17c16c6441e599c7b3f10d9b6d2654868922d1649] ...
I0317 12:40:50.150435 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9b64fcbeb6014a84017e01b17c16c6441e599c7b3f10d9b6d2654868922d1649"
I0317 12:40:50.165326 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:50.190479 455052 logs.go:123] Gathering logs for containerd ...
I0317 12:40:50.190509 455052 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0317 12:40:50.501424 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:50.664829 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:51.046634 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:51.165068 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:51.472476 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:51.664153 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:51.971633 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:52.164477 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:52.471024 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:52.664532 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:52.765578 455052 system_pods.go:59] 19 kube-system pods found
I0317 12:40:52.765623 455052 system_pods.go:61] "amd-gpu-device-plugin-vshjt" [f90dc780-3781-4dfa-aa72-9f01de540522] Running
I0317 12:40:52.765632 455052 system_pods.go:61] "coredns-668d6bf9bc-d2bx4" [3984c722-20f8-4593-8acc-69f7a96879cc] Running
I0317 12:40:52.765637 455052 system_pods.go:61] "csi-hostpath-attacher-0" [6409109a-02f5-4560-a0ce-ff758742667a] Running
I0317 12:40:52.765642 455052 system_pods.go:61] "csi-hostpath-resizer-0" [db7fcb3f-a582-496d-8f39-b4b58ac628a9] Running
I0317 12:40:52.765654 455052 system_pods.go:61] "csi-hostpathplugin-dxflx" [e4429700-36d8-4fe3-8ee4-ec430215ad55] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0317 12:40:52.765663 455052 system_pods.go:61] "etcd-addons-012219" [02330569-8d20-41f9-b759-63f8904f2f4b] Running
I0317 12:40:52.765675 455052 system_pods.go:61] "kindnet-cz7dg" [3e28249d-348a-4e40-b2b3-8b46b677ac10] Running
I0317 12:40:52.765680 455052 system_pods.go:61] "kube-apiserver-addons-012219" [d053686d-1bfb-4c4f-83a6-9550a5c50bef] Running
I0317 12:40:52.765690 455052 system_pods.go:61] "kube-controller-manager-addons-012219" [cfe19195-6038-44ef-93e8-2a3a1fa0eeb6] Running
I0317 12:40:52.765704 455052 system_pods.go:61] "kube-ingress-dns-minikube" [8cd48e7c-55b2-4237-b945-d6e7be8d3040] Running
I0317 12:40:52.765710 455052 system_pods.go:61] "kube-proxy-dd72m" [3c1ba3e7-f0a0-4520-ac21-293d84b96937] Running
I0317 12:40:52.765714 455052 system_pods.go:61] "kube-scheduler-addons-012219" [f2a8c619-ebae-4ab1-9e80-476b5bc94a7c] Running
I0317 12:40:52.765722 455052 system_pods.go:61] "metrics-server-7fbb699795-rmd9f" [457e13af-aba0-4869-9953-d240bdcf8c93] Running
I0317 12:40:52.765727 455052 system_pods.go:61] "nvidia-device-plugin-daemonset-s96nr" [dd2959e8-cb33-4011-825c-beffbbfe67f2] Running
I0317 12:40:52.765735 455052 system_pods.go:61] "registry-6c88467877-qxwgl" [455262b9-8f7c-405f-8f6a-e11619b4a82b] Running
I0317 12:40:52.765740 455052 system_pods.go:61] "registry-proxy-6mr4n" [1ff4a6b3-772a-4bb4-b071-5fda919d74bb] Running
I0317 12:40:52.765749 455052 system_pods.go:61] "snapshot-controller-68b874b76f-kqqj4" [4c44d0a7-10b5-4560-b08a-547f48a9d788] Running
I0317 12:40:52.765754 455052 system_pods.go:61] "snapshot-controller-68b874b76f-vg6qw" [83b1a84d-5b5d-4f61-9899-b115352819b6] Running
I0317 12:40:52.765762 455052 system_pods.go:61] "storage-provisioner" [2308e1c7-7aa6-49b3-ac63-c49fdf64fced] Running
I0317 12:40:52.765771 455052 system_pods.go:74] duration metric: took 4.885812296s to wait for pod list to return data ...
I0317 12:40:52.765785 455052 default_sa.go:34] waiting for default service account to be created ...
I0317 12:40:52.768498 455052 default_sa.go:45] found service account: "default"
I0317 12:40:52.768530 455052 default_sa.go:55] duration metric: took 2.736413ms for default service account to be created ...
I0317 12:40:52.768543 455052 system_pods.go:116] waiting for k8s-apps to be running ...
I0317 12:40:52.772352 455052 system_pods.go:86] 19 kube-system pods found
I0317 12:40:52.772393 455052 system_pods.go:89] "amd-gpu-device-plugin-vshjt" [f90dc780-3781-4dfa-aa72-9f01de540522] Running
I0317 12:40:52.772404 455052 system_pods.go:89] "coredns-668d6bf9bc-d2bx4" [3984c722-20f8-4593-8acc-69f7a96879cc] Running
I0317 12:40:52.772412 455052 system_pods.go:89] "csi-hostpath-attacher-0" [6409109a-02f5-4560-a0ce-ff758742667a] Running
I0317 12:40:52.772417 455052 system_pods.go:89] "csi-hostpath-resizer-0" [db7fcb3f-a582-496d-8f39-b4b58ac628a9] Running
I0317 12:40:52.772427 455052 system_pods.go:89] "csi-hostpathplugin-dxflx" [e4429700-36d8-4fe3-8ee4-ec430215ad55] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0317 12:40:52.772438 455052 system_pods.go:89] "etcd-addons-012219" [02330569-8d20-41f9-b759-63f8904f2f4b] Running
I0317 12:40:52.772445 455052 system_pods.go:89] "kindnet-cz7dg" [3e28249d-348a-4e40-b2b3-8b46b677ac10] Running
I0317 12:40:52.772453 455052 system_pods.go:89] "kube-apiserver-addons-012219" [d053686d-1bfb-4c4f-83a6-9550a5c50bef] Running
I0317 12:40:52.772459 455052 system_pods.go:89] "kube-controller-manager-addons-012219" [cfe19195-6038-44ef-93e8-2a3a1fa0eeb6] Running
I0317 12:40:52.772469 455052 system_pods.go:89] "kube-ingress-dns-minikube" [8cd48e7c-55b2-4237-b945-d6e7be8d3040] Running
I0317 12:40:52.772474 455052 system_pods.go:89] "kube-proxy-dd72m" [3c1ba3e7-f0a0-4520-ac21-293d84b96937] Running
I0317 12:40:52.772482 455052 system_pods.go:89] "kube-scheduler-addons-012219" [f2a8c619-ebae-4ab1-9e80-476b5bc94a7c] Running
I0317 12:40:52.772488 455052 system_pods.go:89] "metrics-server-7fbb699795-rmd9f" [457e13af-aba0-4869-9953-d240bdcf8c93] Running
I0317 12:40:52.772500 455052 system_pods.go:89] "nvidia-device-plugin-daemonset-s96nr" [dd2959e8-cb33-4011-825c-beffbbfe67f2] Running
I0317 12:40:52.772507 455052 system_pods.go:89] "registry-6c88467877-qxwgl" [455262b9-8f7c-405f-8f6a-e11619b4a82b] Running
I0317 12:40:52.772513 455052 system_pods.go:89] "registry-proxy-6mr4n" [1ff4a6b3-772a-4bb4-b071-5fda919d74bb] Running
I0317 12:40:52.772520 455052 system_pods.go:89] "snapshot-controller-68b874b76f-kqqj4" [4c44d0a7-10b5-4560-b08a-547f48a9d788] Running
I0317 12:40:52.772525 455052 system_pods.go:89] "snapshot-controller-68b874b76f-vg6qw" [83b1a84d-5b5d-4f61-9899-b115352819b6] Running
I0317 12:40:52.772538 455052 system_pods.go:89] "storage-provisioner" [2308e1c7-7aa6-49b3-ac63-c49fdf64fced] Running
I0317 12:40:52.772548 455052 system_pods.go:126] duration metric: took 3.997984ms to wait for k8s-apps to be running ...
I0317 12:40:52.772565 455052 system_svc.go:44] waiting for kubelet service to be running ....
I0317 12:40:52.772634 455052 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0317 12:40:52.787084 455052 system_svc.go:56] duration metric: took 14.507575ms WaitForService to wait for kubelet
I0317 12:40:52.787128 455052 kubeadm.go:582] duration metric: took 1m22.14274535s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0317 12:40:52.787164 455052 node_conditions.go:102] verifying NodePressure condition ...
I0317 12:40:52.790315 455052 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I0317 12:40:52.790344 455052 node_conditions.go:123] node cpu capacity is 8
I0317 12:40:52.790361 455052 node_conditions.go:105] duration metric: took 3.191982ms to run NodePressure ...
I0317 12:40:52.790375 455052 start.go:241] waiting for startup goroutines ...
I0317 12:40:52.970590 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:53.163873 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:53.471714 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:53.663961 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:53.971638 455052 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0317 12:40:54.165249 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:54.471187 455052 kapi.go:107] duration metric: took 1m14.504065676s to wait for app.kubernetes.io/name=ingress-nginx ...
I0317 12:40:54.663724 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:55.181177 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:55.664966 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:56.164506 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:56.664667 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0317 12:40:57.164624 455052 kapi.go:107] duration metric: took 1m14.004040538s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0317 12:41:06.981158 455052 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0317 12:41:06.981192 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:07.479529 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:07.980481 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:08.479897 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:08.979569 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:09.480236 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:09.979644 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:10.480729 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:10.979778 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:11.480055 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:11.979330 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:12.479999 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:12.979564 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:13.479411 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:13.979645 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:14.479839 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:14.979566 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:15.480082 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:15.979724 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:16.479924 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:16.979445 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:17.480370 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:17.980036 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:18.479816 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:18.979426 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:19.480457 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:19.980135 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:20.479132 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:20.980655 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:21.480199 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:21.979202 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:22.479369 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:22.980251 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:23.480213 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:23.979330 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:24.479078 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:24.979331 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:25.481117 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:25.980111 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:26.479891 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:26.979293 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:27.479178 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:27.980039 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:28.479214 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:28.979143 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:29.479377 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:29.980164 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:30.479590 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:30.980763 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:31.479508 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:31.980501 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:32.479742 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:32.979400 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:33.480015 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:33.979488 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:34.479529 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:34.979633 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:35.480481 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:35.979528 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:36.480373 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:36.979487 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:37.480121 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:37.979618 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:38.478950 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:38.980157 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:39.479388 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:39.979684 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:40.480541 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:40.979353 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:41.479656 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:41.980519 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:42.480066 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:42.979303 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:43.479590 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:43.980298 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:44.479479 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:44.979931 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:45.479240 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:45.979460 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:46.480270 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:46.979651 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:47.480643 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:47.979905 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:48.479669 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:48.980409 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:49.479066 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:49.979654 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:50.480200 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:50.980176 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:51.479890 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:51.979954 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:52.479149 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:52.979163 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:53.479477 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:53.979835 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:54.479007 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:54.979434 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:55.480051 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:55.979962 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:56.479685 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:56.980475 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:57.479720 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:57.979324 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:58.479969 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:58.978987 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:59.479112 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:41:59.979505 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:00.479949 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:00.979559 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:01.480280 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:01.980377 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:02.479976 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:02.979939 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:03.479966 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:03.980399 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:04.479483 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:04.979513 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:05.480468 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:05.980122 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:06.479553 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:06.980746 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:07.480116 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:07.979701 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:08.479565 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:08.980110 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:09.479313 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:09.980207 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:10.479669 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:10.980481 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:11.480544 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:11.980262 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:12.479701 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:12.980212 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:13.480124 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:13.979706 455052 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0317 12:42:14.480678 455052 kapi.go:107] duration metric: took 2m29.504600411s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0317 12:42:14.482276 455052 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-012219 cluster.
I0317 12:42:14.483771 455052 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0317 12:42:14.485152 455052 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0317 12:42:14.486680 455052 out.go:177] * Enabled addons: nvidia-device-plugin, amd-gpu-device-plugin, cloud-spanner, storage-provisioner, ingress-dns, default-storageclass, volcano, inspektor-gadget, metrics-server, yakd, storage-provisioner-rancher, volumesnapshots, registry, ingress, csi-hostpath-driver, gcp-auth
I0317 12:42:14.487909 455052 addons.go:514] duration metric: took 2m43.843476509s for enable addons: enabled=[nvidia-device-plugin amd-gpu-device-plugin cloud-spanner storage-provisioner ingress-dns default-storageclass volcano inspektor-gadget metrics-server yakd storage-provisioner-rancher volumesnapshots registry ingress csi-hostpath-driver gcp-auth]
I0317 12:42:14.487990 455052 start.go:246] waiting for cluster config update ...
I0317 12:42:14.488027 455052 start.go:255] writing updated cluster config ...
I0317 12:42:14.488433 455052 ssh_runner.go:195] Run: rm -f paused
I0317 12:42:14.545367 455052 start.go:600] kubectl: 1.32.3, cluster: 1.32.2 (minor skew: 0)
I0317 12:42:14.547125 455052 out.go:177] * Done! kubectl is now configured to use "addons-012219" cluster and "default" namespace by default
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
72f0986b33bff 56cc512116c8f 8 minutes ago Running busybox 0 c2583758c78ae busybox
f883a246b949a ee44bc2368033 10 minutes ago Running controller 0 33fb94840828b ingress-nginx-controller-56d7c84fd4-4z52c
3b2f143a08370 a62eeff05ba51 11 minutes ago Exited patch 0 8be1f7fa66df6 ingress-nginx-admission-patch-t76b7
a3b120baf6d20 a62eeff05ba51 11 minutes ago Exited create 0 bb57596d33854 ingress-nginx-admission-create-l6q8w
9af85dc8bdce7 c69fa2e9cbf5f 11 minutes ago Running coredns 0 fdb2ccd4b262c coredns-668d6bf9bc-d2bx4
c9fa71bfc47e4 30dd67412fdea 11 minutes ago Running minikube-ingress-dns 0 11e8588abc22d kube-ingress-dns-minikube
9b64fcbeb6014 df3849d954c98 12 minutes ago Running kindnet-cni 0 75ed382f3859f kindnet-cz7dg
7e31db05a70a8 6e38f40d628db 12 minutes ago Running storage-provisioner 0 73e2163ca213c storage-provisioner
d3a2f527a6876 f1332858868e1 12 minutes ago Running kube-proxy 0 0356e8b8272c6 kube-proxy-dd72m
bb5f00b762560 85b7a174738ba 12 minutes ago Running kube-apiserver 0 37827ade0909f kube-apiserver-addons-012219
0c8a01ff0ac04 a9e7e6b294baf 12 minutes ago Running etcd 0 5301a69037bec etcd-addons-012219
379f28506a876 b6a454c5a800d 12 minutes ago Running kube-controller-manager 0 e29b57dbb448a kube-controller-manager-addons-012219
5e2a09620775b d8e673e7c9983 12 minutes ago Running kube-scheduler 0 07e0a925b2596 kube-scheduler-addons-012219
==> containerd <==
Mar 17 12:46:58 addons-012219 containerd[864]: time="2025-03-17T12:46:58.429161026Z" level=warning msg="cleaning up after shim disconnected" id=1cad4a4a9bc312dab586ba3f4b3a521ea09319db2dd4b6264d56b403f0b5f3e7 namespace=k8s.io
Mar 17 12:46:58 addons-012219 containerd[864]: time="2025-03-17T12:46:58.429171944Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Mar 17 12:46:58 addons-012219 containerd[864]: time="2025-03-17T12:46:58.477223906Z" level=info msg="TearDown network for sandbox \"1cad4a4a9bc312dab586ba3f4b3a521ea09319db2dd4b6264d56b403f0b5f3e7\" successfully"
Mar 17 12:46:58 addons-012219 containerd[864]: time="2025-03-17T12:46:58.477260485Z" level=info msg="StopPodSandbox for \"1cad4a4a9bc312dab586ba3f4b3a521ea09319db2dd4b6264d56b403f0b5f3e7\" returns successfully"
Mar 17 12:46:59 addons-012219 containerd[864]: time="2025-03-17T12:46:59.357212676Z" level=info msg="RemoveContainer for \"2e445477a0d3a37219a92971ee9fea74bc82f78069f708a897dff3ed7d1c74f7\""
Mar 17 12:46:59 addons-012219 containerd[864]: time="2025-03-17T12:46:59.362970878Z" level=info msg="RemoveContainer for \"2e445477a0d3a37219a92971ee9fea74bc82f78069f708a897dff3ed7d1c74f7\" returns successfully"
Mar 17 12:46:59 addons-012219 containerd[864]: time="2025-03-17T12:46:59.363640568Z" level=error msg="ContainerStatus for \"2e445477a0d3a37219a92971ee9fea74bc82f78069f708a897dff3ed7d1c74f7\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find container \"2e445477a0d3a37219a92971ee9fea74bc82f78069f708a897dff3ed7d1c74f7\": not found"
Mar 17 12:47:26 addons-012219 containerd[864]: time="2025-03-17T12:47:26.767491910Z" level=info msg="StopPodSandbox for \"1cad4a4a9bc312dab586ba3f4b3a521ea09319db2dd4b6264d56b403f0b5f3e7\""
Mar 17 12:47:26 addons-012219 containerd[864]: time="2025-03-17T12:47:26.776840669Z" level=info msg="TearDown network for sandbox \"1cad4a4a9bc312dab586ba3f4b3a521ea09319db2dd4b6264d56b403f0b5f3e7\" successfully"
Mar 17 12:47:26 addons-012219 containerd[864]: time="2025-03-17T12:47:26.776894859Z" level=info msg="StopPodSandbox for \"1cad4a4a9bc312dab586ba3f4b3a521ea09319db2dd4b6264d56b403f0b5f3e7\" returns successfully"
Mar 17 12:47:26 addons-012219 containerd[864]: time="2025-03-17T12:47:26.777462331Z" level=info msg="RemovePodSandbox for \"1cad4a4a9bc312dab586ba3f4b3a521ea09319db2dd4b6264d56b403f0b5f3e7\""
Mar 17 12:47:26 addons-012219 containerd[864]: time="2025-03-17T12:47:26.777511658Z" level=info msg="Forcibly stopping sandbox \"1cad4a4a9bc312dab586ba3f4b3a521ea09319db2dd4b6264d56b403f0b5f3e7\""
Mar 17 12:47:26 addons-012219 containerd[864]: time="2025-03-17T12:47:26.787172523Z" level=info msg="TearDown network for sandbox \"1cad4a4a9bc312dab586ba3f4b3a521ea09319db2dd4b6264d56b403f0b5f3e7\" successfully"
Mar 17 12:47:26 addons-012219 containerd[864]: time="2025-03-17T12:47:26.792244737Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"1cad4a4a9bc312dab586ba3f4b3a521ea09319db2dd4b6264d56b403f0b5f3e7\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus."
Mar 17 12:47:26 addons-012219 containerd[864]: time="2025-03-17T12:47:26.792406962Z" level=info msg="RemovePodSandbox \"1cad4a4a9bc312dab586ba3f4b3a521ea09319db2dd4b6264d56b403f0b5f3e7\" returns successfully"
Mar 17 12:49:03 addons-012219 containerd[864]: time="2025-03-17T12:49:03.989435050Z" level=info msg="PullImage \"busybox:stable\""
Mar 17 12:49:03 addons-012219 containerd[864]: time="2025-03-17T12:49:03.991493051Z" level=error msg="failed to decode hosts.toml" error="invalid `host` tree"
Mar 17 12:49:04 addons-012219 containerd[864]: time="2025-03-17T12:49:04.686298751Z" level=error msg="failed to decode hosts.toml" error="invalid `host` tree"
Mar 17 12:49:06 addons-012219 containerd[864]: time="2025-03-17T12:49:06.969364470Z" level=error msg="PullImage \"busybox:stable\" failed" error="failed to pull and unpack image \"docker.io/library/busybox:stable\": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/busybox/manifests/sha256:eddbff0886ee9d637bbcf8e30612db26cfebf9fbd5d53948c7c9090b24913b4b: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit"
Mar 17 12:49:06 addons-012219 containerd[864]: time="2025-03-17T12:49:06.969442995Z" level=info msg="stop pulling image docker.io/library/busybox:stable: active requests=0, bytes read=21179"
Mar 17 12:49:28 addons-012219 containerd[864]: time="2025-03-17T12:49:28.988957824Z" level=info msg="PullImage \"docker.io/nginx:alpine\""
Mar 17 12:49:28 addons-012219 containerd[864]: time="2025-03-17T12:49:28.991004126Z" level=error msg="failed to decode hosts.toml" error="invalid `host` tree"
Mar 17 12:49:29 addons-012219 containerd[864]: time="2025-03-17T12:49:29.664579275Z" level=error msg="failed to decode hosts.toml" error="invalid `host` tree"
Mar 17 12:49:31 addons-012219 containerd[864]: time="2025-03-17T12:49:31.537449216Z" level=error msg="PullImage \"docker.io/nginx:alpine\" failed" error="failed to pull and unpack image \"docker.io/library/nginx:alpine\": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/nginx/manifests/sha256:4ff102c5d78d254a6f0da062b3cf39eaf07f01eec0927fd21e219d0af8bc0591: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit"
Mar 17 12:49:31 addons-012219 containerd[864]: time="2025-03-17T12:49:31.537522014Z" level=info msg="stop pulling image docker.io/library/nginx:alpine: active requests=0, bytes read=10967"
==> coredns [9af85dc8bdce7c7605798e49add631c328e501002f7088a1c154d4d7c6829056] <==
[INFO] 10.244.0.16:34216 - 37652 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000188479s
[INFO] 10.244.0.16:43420 - 27799 "AAAA IN registry.kube-system.svc.cluster.local.europe-west4-a.c.k8s-minikube.internal. udp 95 false 512" NXDOMAIN qr,rd,ra 95 0.004589602s
[INFO] 10.244.0.16:43420 - 27455 "A IN registry.kube-system.svc.cluster.local.europe-west4-a.c.k8s-minikube.internal. udp 95 false 512" NXDOMAIN qr,rd,ra 95 0.004741711s
[INFO] 10.244.0.16:47013 - 51640 "AAAA IN registry.kube-system.svc.cluster.local.c.k8s-minikube.internal. udp 80 false 512" NXDOMAIN qr,rd,ra 80 0.003867777s
[INFO] 10.244.0.16:47013 - 51331 "A IN registry.kube-system.svc.cluster.local.c.k8s-minikube.internal. udp 80 false 512" NXDOMAIN qr,rd,ra 80 0.004475572s
[INFO] 10.244.0.16:39077 - 47593 "AAAA IN registry.kube-system.svc.cluster.local.google.internal. udp 72 false 512" NXDOMAIN qr,rd,ra 72 0.003471984s
[INFO] 10.244.0.16:39077 - 47344 "A IN registry.kube-system.svc.cluster.local.google.internal. udp 72 false 512" NXDOMAIN qr,rd,ra 72 0.004574207s
[INFO] 10.244.0.16:39183 - 16956 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000144916s
[INFO] 10.244.0.16:39183 - 17153 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000241434s
[INFO] 10.244.0.26:34264 - 6039 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000313032s
[INFO] 10.244.0.26:55315 - 55406 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000421144s
[INFO] 10.244.0.26:46365 - 29788 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000167696s
[INFO] 10.244.0.26:40754 - 38194 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000205761s
[INFO] 10.244.0.26:49806 - 38763 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.00009024s
[INFO] 10.244.0.26:59680 - 32634 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000111996s
[INFO] 10.244.0.26:35656 - 5418 "AAAA IN storage.googleapis.com.europe-west4-a.c.k8s-minikube.internal. udp 90 false 1232" NXDOMAIN qr,rd,ra 79 0.007327485s
[INFO] 10.244.0.26:50153 - 9679 "A IN storage.googleapis.com.europe-west4-a.c.k8s-minikube.internal. udp 90 false 1232" NXDOMAIN qr,rd,ra 79 0.007599611s
[INFO] 10.244.0.26:55286 - 36934 "A IN storage.googleapis.com.c.k8s-minikube.internal. udp 75 false 1232" NXDOMAIN qr,rd,ra 64 0.006995331s
[INFO] 10.244.0.26:55921 - 56025 "AAAA IN storage.googleapis.com.c.k8s-minikube.internal. udp 75 false 1232" NXDOMAIN qr,rd,ra 64 0.007813438s
[INFO] 10.244.0.26:59506 - 19688 "AAAA IN storage.googleapis.com.google.internal. udp 67 false 1232" NXDOMAIN qr,rd,ra 56 0.004925485s
[INFO] 10.244.0.26:42060 - 55729 "A IN storage.googleapis.com.google.internal. udp 67 false 1232" NXDOMAIN qr,rd,ra 56 0.00572541s
[INFO] 10.244.0.26:42368 - 10263 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.002102149s
[INFO] 10.244.0.26:57842 - 8006 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 496 0.002237615s
[INFO] 10.244.0.31:36061 - 2 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000299324s
[INFO] 10.244.0.31:44219 - 3 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000202677s
==> describe nodes <==
Name: addons-012219
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=addons-012219
kubernetes.io/os=linux
minikube.k8s.io/commit=5a6f3d20e78a9ae03fc65e3f2e727d0ae0107b3c
minikube.k8s.io/name=addons-012219
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_03_17T12_39_26_0700
minikube.k8s.io/version=v1.35.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-012219
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Mon, 17 Mar 2025 12:39:23 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-012219
AcquireTime: <unset>
RenewTime: Mon, 17 Mar 2025 12:51:42 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Mon, 17 Mar 2025 12:48:05 +0000 Mon, 17 Mar 2025 12:39:21 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Mon, 17 Mar 2025 12:48:05 +0000 Mon, 17 Mar 2025 12:39:21 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Mon, 17 Mar 2025 12:48:05 +0000 Mon, 17 Mar 2025 12:39:21 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Mon, 17 Mar 2025 12:48:05 +0000 Mon, 17 Mar 2025 12:39:23 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-012219
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32859368Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32859368Ki
pods: 110
System Info:
Machine ID: 513f2da8e2ab4b528f20355459ada2cc
System UUID: 718990bd-83c1-42aa-9bb1-42fb8bb0fb09
Boot ID: 40219139-515e-4d1c-86e4-bab1900bd49a
Kernel Version: 5.15.0-1078-gcp
OS Image: Ubuntu 22.04.5 LTS
Operating System: linux
Architecture: amd64
Container Runtime Version: containerd://1.7.25
Kubelet Version: v1.32.2
Kube-Proxy Version: v1.32.2
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (13 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 8m48s
default nginx 0 (0%) 0 (0%) 0 (0%) 0 (0%) 8m2s
default test-local-path 0 (0%) 0 (0%) 0 (0%) 0 (0%) 8m25s
ingress-nginx ingress-nginx-controller-56d7c84fd4-4z52c 100m (1%) 0 (0%) 90Mi (0%) 0 (0%) 12m
kube-system coredns-668d6bf9bc-d2bx4 100m (1%) 0 (0%) 70Mi (0%) 170Mi (0%) 12m
kube-system etcd-addons-012219 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 12m
kube-system kindnet-cz7dg 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 12m
kube-system kube-apiserver-addons-012219 250m (3%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system kube-controller-manager-addons-012219 200m (2%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system kube-ingress-dns-minikube 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system kube-proxy-dd72m 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system kube-scheduler-addons-012219 100m (1%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (11%) 100m (1%)
memory 310Mi (0%) 220Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 12m kube-proxy
Normal NodeHasSufficientMemory 12m (x8 over 12m) kubelet Node addons-012219 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 12m (x8 over 12m) kubelet Node addons-012219 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 12m (x7 over 12m) kubelet Node addons-012219 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 12m kubelet Updated Node Allocatable limit across pods
Normal Starting 12m kubelet Starting kubelet.
Warning CgroupV1 12m kubelet cgroup v1 support is in maintenance mode, please migrate to cgroup v2
Normal NodeAllocatableEnforced 12m kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 12m kubelet Node addons-012219 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 12m kubelet Node addons-012219 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 12m kubelet Node addons-012219 status is now: NodeHasSufficientPID
Normal RegisteredNode 12m node-controller Node addons-012219 event: Registered Node addons-012219 in Controller
==> dmesg <==
[ +0.000002] ll header: 00000000: ae e5 ff 7d 16 ad 72 10 f9 69 65 e0 08 00
[ +2.171804] IPv4: martian source 10.96.0.1 from 10.244.0.4, on dev br-73d8e31699ad
[ +0.000008] ll header: 00000000: fe 1e 18 a3 e2 c7 92 c3 26 97 de 39 08 00
[ +0.000006] IPv4: martian source 10.96.0.1 from 10.244.0.4, on dev br-73d8e31699ad
[ +0.000005] ll header: 00000000: fe 1e 18 a3 e2 c7 92 c3 26 97 de 39 08 00
[ +0.000001] IPv4: martian source 10.96.0.1 from 10.244.0.4, on dev br-73d8e31699ad
[ +0.000004] ll header: 00000000: fe 1e 18 a3 e2 c7 92 c3 26 97 de 39 08 00
[ +2.047810] IPv4: martian source 10.96.0.1 from 10.244.0.3, on dev br-ab6f81b436d8
[ +0.000000] IPv4: martian source 10.96.0.1 from 10.244.0.3, on dev br-ab6f81b436d8
[ +0.000009] ll header: 00000000: ae e5 ff 7d 16 ad 72 10 f9 69 65 e0 08 00
[ +0.000001] ll header: 00000000: ae e5 ff 7d 16 ad 72 10 f9 69 65 e0 08 00
[ +0.000011] IPv4: martian source 10.96.0.1 from 10.244.0.3, on dev br-ab6f81b436d8
[ +0.000008] ll header: 00000000: ae e5 ff 7d 16 ad 72 10 f9 69 65 e0 08 00
[Mar17 12:32] IPv4: martian source 10.96.0.1 from 10.244.0.4, on dev br-73d8e31699ad
[ +0.000000] IPv4: martian source 10.96.0.1 from 10.244.0.4, on dev br-73d8e31699ad
[ +0.000000] IPv4: martian source 10.96.0.1 from 10.244.0.4, on dev br-73d8e31699ad
[ +0.000007] ll header: 00000000: fe 1e 18 a3 e2 c7 92 c3 26 97 de 39 08 00
[ +0.000000] ll header: 00000000: fe 1e 18 a3 e2 c7 92 c3 26 97 de 39 08 00
[ +0.000000] ll header: 00000000: fe 1e 18 a3 e2 c7 92 c3 26 97 de 39 08 00
[ +2.043860] IPv4: martian source 10.96.0.1 from 10.244.0.3, on dev br-ab6f81b436d8
[ +0.000007] IPv4: martian source 10.96.0.1 from 10.244.0.3, on dev br-ab6f81b436d8
[ +0.000002] ll header: 00000000: ae e5 ff 7d 16 ad 72 10 f9 69 65 e0 08 00
[ +0.000003] ll header: 00000000: ae e5 ff 7d 16 ad 72 10 f9 69 65 e0 08 00
[ +0.000006] IPv4: martian source 10.96.0.1 from 10.244.0.3, on dev br-ab6f81b436d8
[ +0.000002] ll header: 00000000: ae e5 ff 7d 16 ad 72 10 f9 69 65 e0 08 00
==> etcd [0c8a01ff0ac04a67f0ca7daa16df0b12a5be2d60bc00f609c695b24631e44cd4] <==
{"level":"info","ts":"2025-03-17T12:40:39.171794Z","caller":"traceutil/trace.go:171","msg":"trace[793474553] range","detail":"{range_begin:/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath; range_end:; response_count:1; response_revision:1241; }","duration":"102.087943ms","start":"2025-03-17T12:40:39.069692Z","end":"2025-03-17T12:40:39.171780Z","steps":["trace[793474553] 'agreement among raft nodes before linearized reading' (duration: 101.727159ms)"],"step_count":1}
{"level":"warn","ts":"2025-03-17T12:40:41.445281Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"129.039026ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-node-lease/addons-012219\" limit:1 ","response":"range_response_count:1 size:555"}
{"level":"info","ts":"2025-03-17T12:40:41.445349Z","caller":"traceutil/trace.go:171","msg":"trace[1550817072] range","detail":"{range_begin:/registry/leases/kube-node-lease/addons-012219; range_end:; response_count:1; response_revision:1251; }","duration":"129.145148ms","start":"2025-03-17T12:40:41.316187Z","end":"2025-03-17T12:40:41.445332Z","steps":["trace[1550817072] 'range keys from in-memory index tree' (duration: 128.87378ms)"],"step_count":1}
{"level":"info","ts":"2025-03-17T12:41:21.112639Z","caller":"traceutil/trace.go:171","msg":"trace[1120577109] transaction","detail":"{read_only:false; response_revision:1413; number_of_response:1; }","duration":"105.170138ms","start":"2025-03-17T12:41:21.007444Z","end":"2025-03-17T12:41:21.112614Z","steps":["trace[1120577109] 'process raft request' (duration: 105.008345ms)"],"step_count":1}
{"level":"info","ts":"2025-03-17T12:42:45.196439Z","caller":"traceutil/trace.go:171","msg":"trace[1142690297] transaction","detail":"{read_only:false; number_of_response:1; response_revision:1660; }","duration":"109.500712ms","start":"2025-03-17T12:42:45.086909Z","end":"2025-03-17T12:42:45.196409Z","steps":["trace[1142690297] 'process raft request' (duration: 109.140613ms)"],"step_count":1}
{"level":"info","ts":"2025-03-17T12:42:45.401890Z","caller":"traceutil/trace.go:171","msg":"trace[1069886062] linearizableReadLoop","detail":"{readStateIndex:1727; appliedIndex:1726; }","duration":"135.149903ms","start":"2025-03-17T12:42:45.266716Z","end":"2025-03-17T12:42:45.401866Z","steps":["trace[1069886062] 'read index received' (duration: 60.1132ms)","trace[1069886062] 'applied index is now lower than readState.Index' (duration: 75.035995ms)"],"step_count":2}
{"level":"info","ts":"2025-03-17T12:42:45.401909Z","caller":"traceutil/trace.go:171","msg":"trace[1395844034] transaction","detail":"{read_only:false; number_of_response:1; response_revision:1663; }","duration":"135.750169ms","start":"2025-03-17T12:42:45.266137Z","end":"2025-03-17T12:42:45.401887Z","steps":["trace[1395844034] 'process raft request' (duration: 60.729876ms)","trace[1395844034] 'compare' (duration: 74.868841ms)"],"step_count":2}
{"level":"warn","ts":"2025-03-17T12:42:45.402090Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"135.137849ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/endpointslices/default/kubernetes\" limit:1 ","response":"range_response_count:1 size:474"}
{"level":"info","ts":"2025-03-17T12:42:45.402137Z","caller":"traceutil/trace.go:171","msg":"trace[1936804532] range","detail":"{range_begin:/registry/endpointslices/default/kubernetes; range_end:; response_count:1; response_revision:1663; }","duration":"135.208194ms","start":"2025-03-17T12:42:45.266916Z","end":"2025-03-17T12:42:45.402125Z","steps":["trace[1936804532] 'agreement among raft nodes before linearized reading' (duration: 135.123423ms)"],"step_count":1}
{"level":"warn","ts":"2025-03-17T12:42:45.402088Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"135.220997ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/volcano-system/volcano-scheduler-service\" limit:1 ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2025-03-17T12:42:45.402284Z","caller":"traceutil/trace.go:171","msg":"trace[218181080] range","detail":"{range_begin:/registry/services/endpoints/volcano-system/volcano-scheduler-service; range_end:; response_count:0; response_revision:1663; }","duration":"135.453301ms","start":"2025-03-17T12:42:45.266818Z","end":"2025-03-17T12:42:45.402272Z","steps":["trace[218181080] 'agreement among raft nodes before linearized reading' (duration: 135.204345ms)"],"step_count":1}
{"level":"warn","ts":"2025-03-17T12:42:45.402089Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"135.36442ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/endpointslices/volcano-system/volcano-scheduler-service-6m88g\" limit:1 ","response":"range_response_count:1 size:1209"}
{"level":"info","ts":"2025-03-17T12:42:45.402392Z","caller":"traceutil/trace.go:171","msg":"trace[1412987289] range","detail":"{range_begin:/registry/endpointslices/volcano-system/volcano-scheduler-service-6m88g; range_end:; response_count:1; response_revision:1663; }","duration":"135.692569ms","start":"2025-03-17T12:42:45.266691Z","end":"2025-03-17T12:42:45.402383Z","steps":["trace[1412987289] 'agreement among raft nodes before linearized reading' (duration: 135.303131ms)"],"step_count":1}
{"level":"info","ts":"2025-03-17T12:42:45.745091Z","caller":"traceutil/trace.go:171","msg":"trace[1704665035] transaction","detail":"{read_only:false; number_of_response:1; response_revision:1684; }","duration":"175.124333ms","start":"2025-03-17T12:42:45.569942Z","end":"2025-03-17T12:42:45.745066Z","steps":["trace[1704665035] 'process raft request' (duration: 87.948789ms)","trace[1704665035] 'compare' (duration: 86.814718ms)"],"step_count":2}
{"level":"info","ts":"2025-03-17T12:43:18.625186Z","caller":"traceutil/trace.go:171","msg":"trace[1253148108] linearizableReadLoop","detail":"{readStateIndex:1983; appliedIndex:1982; }","duration":"118.524333ms","start":"2025-03-17T12:43:18.506639Z","end":"2025-03-17T12:43:18.625163Z","steps":["trace[1253148108] 'read index received' (duration: 60.110846ms)","trace[1253148108] 'applied index is now lower than readState.Index' (duration: 58.412627ms)"],"step_count":2}
{"level":"warn","ts":"2025-03-17T12:43:18.625392Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"118.702389ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/daemonsets/kube-system/nvidia-device-plugin-daemonset\" limit:1 ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2025-03-17T12:43:18.625403Z","caller":"traceutil/trace.go:171","msg":"trace[838863475] transaction","detail":"{read_only:false; number_of_response:1; response_revision:1909; }","duration":"120.334731ms","start":"2025-03-17T12:43:18.505045Z","end":"2025-03-17T12:43:18.625380Z","steps":["trace[838863475] 'process raft request' (duration: 61.76538ms)","trace[838863475] 'compare' (duration: 58.213746ms)"],"step_count":2}
{"level":"info","ts":"2025-03-17T12:43:18.625450Z","caller":"traceutil/trace.go:171","msg":"trace[1359405829] range","detail":"{range_begin:/registry/daemonsets/kube-system/nvidia-device-plugin-daemonset; range_end:; response_count:0; response_revision:1909; }","duration":"118.802749ms","start":"2025-03-17T12:43:18.506634Z","end":"2025-03-17T12:43:18.625437Z","steps":["trace[1359405829] 'agreement among raft nodes before linearized reading' (duration: 118.667931ms)"],"step_count":1}
{"level":"warn","ts":"2025-03-17T12:43:18.625550Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"118.875558ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/controllerrevisions/kube-system/nvidia-device-plugin-daemonset-6f7db97f95\" limit:1 ","response":"range_response_count:1 size:2926"}
{"level":"warn","ts":"2025-03-17T12:43:18.625598Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"118.878461ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/nvidia-device-plugin-daemonset-s96nr\" limit:1 ","response":"range_response_count:1 size:4285"}
{"level":"info","ts":"2025-03-17T12:43:18.625604Z","caller":"traceutil/trace.go:171","msg":"trace[60376047] range","detail":"{range_begin:/registry/controllerrevisions/kube-system/nvidia-device-plugin-daemonset-6f7db97f95; range_end:; response_count:1; response_revision:1909; }","duration":"118.951477ms","start":"2025-03-17T12:43:18.506642Z","end":"2025-03-17T12:43:18.625593Z","steps":["trace[60376047] 'agreement among raft nodes before linearized reading' (duration: 118.842099ms)"],"step_count":1}
{"level":"info","ts":"2025-03-17T12:43:18.625627Z","caller":"traceutil/trace.go:171","msg":"trace[766425522] range","detail":"{range_begin:/registry/pods/kube-system/nvidia-device-plugin-daemonset-s96nr; range_end:; response_count:1; response_revision:1909; }","duration":"118.933146ms","start":"2025-03-17T12:43:18.506685Z","end":"2025-03-17T12:43:18.625618Z","steps":["trace[766425522] 'agreement among raft nodes before linearized reading' (duration: 118.825396ms)"],"step_count":1}
{"level":"info","ts":"2025-03-17T12:49:22.205220Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":2412}
{"level":"info","ts":"2025-03-17T12:49:22.274301Z","caller":"mvcc/kvstore_compaction.go:72","msg":"finished scheduled compaction","compact-revision":2412,"took":"68.328298ms","hash":2335236743,"current-db-size-bytes":9986048,"current-db-size":"10 MB","current-db-size-in-use-bytes":3117056,"current-db-size-in-use":"3.1 MB"}
{"level":"info","ts":"2025-03-17T12:49:22.274357Z","caller":"mvcc/hash.go:151","msg":"storing new hash","hash":2335236743,"revision":2412,"compact-revision":-1}
==> kernel <==
12:51:43 up 2:34, 0 users, load average: 0.22, 0.51, 1.45
Linux addons-012219 5.15.0-1078-gcp #87~20.04.1-Ubuntu SMP Mon Feb 24 10:23:16 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.5 LTS"
==> kindnet [9b64fcbeb6014a84017e01b17c16c6441e599c7b3f10d9b6d2654868922d1649] <==
I0317 12:49:42.645604 1 main.go:301] handling current node
I0317 12:49:52.647543 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I0317 12:49:52.647615 1 main.go:301] handling current node
I0317 12:50:02.645183 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I0317 12:50:02.645231 1 main.go:301] handling current node
I0317 12:50:12.654202 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I0317 12:50:12.654244 1 main.go:301] handling current node
I0317 12:50:22.652417 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I0317 12:50:22.652464 1 main.go:301] handling current node
I0317 12:50:32.652450 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I0317 12:50:32.652502 1 main.go:301] handling current node
I0317 12:50:42.645798 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I0317 12:50:42.645868 1 main.go:301] handling current node
I0317 12:50:52.645611 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I0317 12:50:52.645690 1 main.go:301] handling current node
I0317 12:51:02.652446 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I0317 12:51:02.652490 1 main.go:301] handling current node
I0317 12:51:12.647976 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I0317 12:51:12.648028 1 main.go:301] handling current node
I0317 12:51:22.646433 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I0317 12:51:22.646495 1 main.go:301] handling current node
I0317 12:51:32.645029 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I0317 12:51:32.645080 1 main.go:301] handling current node
I0317 12:51:42.645976 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I0317 12:51:42.646013 1 main.go:301] handling current node
==> kube-apiserver [bb5f00b7625601d21e905147e28f325d6d2eb52f6d757f39f8ce61ff4f55c983] <==
W0317 12:42:47.051524 1 cacher.go:171] Terminating all watchers from cacher jobs.batch.volcano.sh
W0317 12:42:47.365563 1 cacher.go:171] Terminating all watchers from cacher jobflows.flow.volcano.sh
W0317 12:42:47.757473 1 cacher.go:171] Terminating all watchers from cacher jobtemplates.flow.volcano.sh
E0317 12:43:03.635813 1 conn.go:339] Error on socket receive: read tcp 192.168.49.2:8443->192.168.49.1:58138: use of closed network connection
E0317 12:43:03.818342 1 conn.go:339] Error on socket receive: read tcp 192.168.49.2:8443->192.168.49.1:58162: use of closed network connection
I0317 12:43:13.586843 1 alloc.go:330] "allocated clusterIPs" service="headlamp/headlamp" clusterIPs={"IPv4":"10.107.198.122"}
I0317 12:43:34.949156 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Nothing (removed from the queue).
I0317 12:43:41.483627 1 controller.go:615] quota admission added evaluator for: ingresses.networking.k8s.io
I0317 12:43:41.678398 1 alloc.go:330] "allocated clusterIPs" service="default/nginx" clusterIPs={"IPv4":"10.98.52.27"}
I0317 12:43:41.692581 1 handler.go:286] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager
W0317 12:43:42.711288 1 cacher.go:171] Terminating all watchers from cacher traces.gadget.kinvolk.io
I0317 12:43:50.250114 1 controller.go:615] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io
I0317 12:44:15.694314 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0317 12:44:15.694381 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0317 12:44:15.708477 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0317 12:44:15.708564 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0317 12:44:15.709759 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0317 12:44:15.709811 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0317 12:44:15.745127 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0317 12:44:15.745201 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0317 12:44:15.767186 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0317 12:44:15.767239 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
W0317 12:44:16.709982 1 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io
W0317 12:44:16.767220 1 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io
W0317 12:44:16.945072 1 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io
==> kube-controller-manager [379f28506a87666447bb9e5a46766c5b8106bf905cd90914f25a4fdc6d2bdac8] <==
E0317 12:51:26.814715 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0317 12:51:30.674954 1 reflector.go:362] The watchlist request ended with an error, falling back to the standard LIST/WATCH semantics because making progress is better than deadlocking, err = the server could not find the requested resource
E0317 12:51:30.675927 1 metadata.go:231] "The watchlist request ended with an error, falling back to the standard LIST semantics" err="the server could not find the requested resource" resource="batch.volcano.sh/v1alpha1, Resource=jobs"
W0317 12:51:30.676892 1 reflector.go:569] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0317 12:51:30.676928 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0317 12:51:32.732212 1 reflector.go:362] The watchlist request ended with an error, falling back to the standard LIST/WATCH semantics because making progress is better than deadlocking, err = the server could not find the requested resource
E0317 12:51:32.733287 1 metadata.go:231] "The watchlist request ended with an error, falling back to the standard LIST semantics" err="the server could not find the requested resource" resource="scheduling.volcano.sh/v1beta1, Resource=podgroups"
W0317 12:51:32.734254 1 reflector.go:569] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0317 12:51:32.734293 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0317 12:51:35.187648 1 reflector.go:362] The watchlist request ended with an error, falling back to the standard LIST/WATCH semantics because making progress is better than deadlocking, err = the server could not find the requested resource
E0317 12:51:35.188851 1 metadata.go:231] "The watchlist request ended with an error, falling back to the standard LIST semantics" err="the server could not find the requested resource" resource="snapshot.storage.k8s.io/v1, Resource=volumesnapshotcontents"
W0317 12:51:35.189989 1 reflector.go:569] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0317 12:51:35.190024 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0317 12:51:41.497888 1 reflector.go:362] The watchlist request ended with an error, falling back to the standard LIST/WATCH semantics because making progress is better than deadlocking, err = the server could not find the requested resource
E0317 12:51:41.498948 1 metadata.go:231] "The watchlist request ended with an error, falling back to the standard LIST semantics" err="the server could not find the requested resource" resource="bus.volcano.sh/v1alpha1, Resource=commands"
W0317 12:51:41.499865 1 reflector.go:569] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0317 12:51:41.499902 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0317 12:51:42.789693 1 reflector.go:362] The watchlist request ended with an error, falling back to the standard LIST/WATCH semantics because making progress is better than deadlocking, err = the server could not find the requested resource
E0317 12:51:42.790687 1 metadata.go:231] "The watchlist request ended with an error, falling back to the standard LIST semantics" err="the server could not find the requested resource" resource="flow.volcano.sh/v1alpha1, Resource=jobflows"
W0317 12:51:42.791520 1 reflector.go:569] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0317 12:51:42.791556 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0317 12:51:43.326641 1 reflector.go:362] The watchlist request ended with an error, falling back to the standard LIST/WATCH semantics because making progress is better than deadlocking, err = the server could not find the requested resource
E0317 12:51:43.327716 1 metadata.go:231] "The watchlist request ended with an error, falling back to the standard LIST semantics" err="the server could not find the requested resource" resource="flow.volcano.sh/v1alpha1, Resource=jobtemplates"
W0317 12:51:43.329348 1 reflector.go:569] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0317 12:51:43.329398 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
==> kube-proxy [d3a2f527a68764f7f040d4b49dce23f813fbc96471794730d235e72cb3e66af3] <==
I0317 12:39:33.459942 1 server_linux.go:66] "Using iptables proxy"
I0317 12:39:34.065102 1 server.go:698] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
E0317 12:39:34.065210 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I0317 12:39:34.462554 1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I0317 12:39:34.462648 1 server_linux.go:170] "Using iptables Proxier"
I0317 12:39:34.548519 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I0317 12:39:34.548961 1 server.go:497] "Version info" version="v1.32.2"
I0317 12:39:34.548980 1 server.go:499] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0317 12:39:34.563177 1 config.go:199] "Starting service config controller"
I0317 12:39:34.563231 1 shared_informer.go:313] Waiting for caches to sync for service config
I0317 12:39:34.563268 1 config.go:105] "Starting endpoint slice config controller"
I0317 12:39:34.563274 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0317 12:39:34.564040 1 config.go:329] "Starting node config controller"
I0317 12:39:34.564055 1 shared_informer.go:313] Waiting for caches to sync for node config
I0317 12:39:34.664095 1 shared_informer.go:320] Caches are synced for endpoint slice config
I0317 12:39:34.664167 1 shared_informer.go:320] Caches are synced for service config
I0317 12:39:37.464457 1 shared_informer.go:320] Caches are synced for node config
==> kube-scheduler [5e2a09620775b2c75311fe4e7c162d2c0f322d3fd4424587a9c48ee80c51dc42] <==
W0317 12:39:23.464420 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0317 12:39:23.466171 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0317 12:39:23.466555 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0317 12:39:23.466702 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0317 12:39:23.466938 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0317 12:39:23.466981 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0317 12:39:24.268854 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
E0317 12:39:24.268916 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0317 12:39:24.269972 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0317 12:39:24.270018 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0317 12:39:24.278129 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0317 12:39:24.278189 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0317 12:39:24.344802 1 reflector.go:569] runtime/asm_amd64.s:1700: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0317 12:39:24.344855 1 reflector.go:166] "Unhandled Error" err="runtime/asm_amd64.s:1700: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"
W0317 12:39:24.390622 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0317 12:39:24.390672 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0317 12:39:24.425578 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0317 12:39:24.425627 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0317 12:39:24.573072 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0317 12:39:24.573157 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0317 12:39:24.590139 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0317 12:39:24.590216 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0317 12:39:24.681289 1 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0317 12:39:24.681350 1 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
I0317 12:39:26.559813 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Mar 17 12:49:31 addons-012219 kubelet[1625]: E0317 12:49:31.537773 1625 kuberuntime_image.go:55] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nginx:alpine\": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/nginx/manifests/sha256:4ff102c5d78d254a6f0da062b3cf39eaf07f01eec0927fd21e219d0af8bc0591: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit" image="docker.io/nginx:alpine"
Mar 17 12:49:31 addons-012219 kubelet[1625]: E0317 12:49:31.537886 1625 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:nginx,Image:docker.io/nginx:alpine,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:,HostPort:0,ContainerPort:80,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-hh4v9,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod nginx_defaul
t(a2751ab5-cd1c-44a3-a6ba-dba98b254a96): ErrImagePull: failed to pull and unpack image \"docker.io/library/nginx:alpine\": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/nginx/manifests/sha256:4ff102c5d78d254a6f0da062b3cf39eaf07f01eec0927fd21e219d0af8bc0591: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit" logger="UnhandledError"
Mar 17 12:49:31 addons-012219 kubelet[1625]: E0317 12:49:31.539087 1625 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nginx:alpine\\\": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/nginx/manifests/sha256:4ff102c5d78d254a6f0da062b3cf39eaf07f01eec0927fd21e219d0af8bc0591: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit\"" pod="default/nginx" podUID="a2751ab5-cd1c-44a3-a6ba-dba98b254a96"
Mar 17 12:49:31 addons-012219 kubelet[1625]: E0317 12:49:31.988826 1625 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"busybox\" with ImagePullBackOff: \"Back-off pulling image \\\"busybox:stable\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/busybox:stable\\\": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/busybox/manifests/sha256:eddbff0886ee9d637bbcf8e30612db26cfebf9fbd5d53948c7c9090b24913b4b: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit\"" pod="default/test-local-path" podUID="288fd0b6-8224-4d26-9aa9-20812cfdeca9"
Mar 17 12:49:43 addons-012219 kubelet[1625]: E0317 12:49:43.988428 1625 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/nginx:alpine\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nginx:alpine\\\": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/nginx/manifests/sha256:4ff102c5d78d254a6f0da062b3cf39eaf07f01eec0927fd21e219d0af8bc0591: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit\"" pod="default/nginx" podUID="a2751ab5-cd1c-44a3-a6ba-dba98b254a96"
Mar 17 12:49:44 addons-012219 kubelet[1625]: E0317 12:49:44.988480 1625 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"busybox\" with ImagePullBackOff: \"Back-off pulling image \\\"busybox:stable\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/busybox:stable\\\": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/busybox/manifests/sha256:eddbff0886ee9d637bbcf8e30612db26cfebf9fbd5d53948c7c9090b24913b4b: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit\"" pod="default/test-local-path" podUID="288fd0b6-8224-4d26-9aa9-20812cfdeca9"
Mar 17 12:49:57 addons-012219 kubelet[1625]: E0317 12:49:57.989328 1625 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/nginx:alpine\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nginx:alpine\\\": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/nginx/manifests/sha256:4ff102c5d78d254a6f0da062b3cf39eaf07f01eec0927fd21e219d0af8bc0591: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit\"" pod="default/nginx" podUID="a2751ab5-cd1c-44a3-a6ba-dba98b254a96"
Mar 17 12:49:58 addons-012219 kubelet[1625]: E0317 12:49:58.989187 1625 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"busybox\" with ImagePullBackOff: \"Back-off pulling image \\\"busybox:stable\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/busybox:stable\\\": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/busybox/manifests/sha256:eddbff0886ee9d637bbcf8e30612db26cfebf9fbd5d53948c7c9090b24913b4b: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit\"" pod="default/test-local-path" podUID="288fd0b6-8224-4d26-9aa9-20812cfdeca9"
Mar 17 12:50:02 addons-012219 kubelet[1625]: I0317 12:50:02.987614 1625 kubelet_pods.go:1021] "Unable to retrieve pull secret, the image pull may not succeed." pod="default/busybox" secret="" err="secret \"gcp-auth\" not found"
Mar 17 12:50:11 addons-012219 kubelet[1625]: E0317 12:50:11.989220 1625 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/nginx:alpine\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nginx:alpine\\\": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/nginx/manifests/sha256:4ff102c5d78d254a6f0da062b3cf39eaf07f01eec0927fd21e219d0af8bc0591: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit\"" pod="default/nginx" podUID="a2751ab5-cd1c-44a3-a6ba-dba98b254a96"
Mar 17 12:50:13 addons-012219 kubelet[1625]: E0317 12:50:13.988913 1625 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"busybox\" with ImagePullBackOff: \"Back-off pulling image \\\"busybox:stable\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/busybox:stable\\\": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/busybox/manifests/sha256:eddbff0886ee9d637bbcf8e30612db26cfebf9fbd5d53948c7c9090b24913b4b: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit\"" pod="default/test-local-path" podUID="288fd0b6-8224-4d26-9aa9-20812cfdeca9"
Mar 17 12:50:25 addons-012219 kubelet[1625]: E0317 12:50:25.989027 1625 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/nginx:alpine\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nginx:alpine\\\": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/nginx/manifests/sha256:4ff102c5d78d254a6f0da062b3cf39eaf07f01eec0927fd21e219d0af8bc0591: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit\"" pod="default/nginx" podUID="a2751ab5-cd1c-44a3-a6ba-dba98b254a96"
Mar 17 12:50:28 addons-012219 kubelet[1625]: E0317 12:50:28.988629 1625 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"busybox\" with ImagePullBackOff: \"Back-off pulling image \\\"busybox:stable\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/busybox:stable\\\": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/busybox/manifests/sha256:eddbff0886ee9d637bbcf8e30612db26cfebf9fbd5d53948c7c9090b24913b4b: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit\"" pod="default/test-local-path" podUID="288fd0b6-8224-4d26-9aa9-20812cfdeca9"
Mar 17 12:50:37 addons-012219 kubelet[1625]: E0317 12:50:37.990730 1625 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/nginx:alpine\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nginx:alpine\\\": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/nginx/manifests/sha256:4ff102c5d78d254a6f0da062b3cf39eaf07f01eec0927fd21e219d0af8bc0591: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit\"" pod="default/nginx" podUID="a2751ab5-cd1c-44a3-a6ba-dba98b254a96"
Mar 17 12:50:42 addons-012219 kubelet[1625]: E0317 12:50:42.988637 1625 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"busybox\" with ImagePullBackOff: \"Back-off pulling image \\\"busybox:stable\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/busybox:stable\\\": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/busybox/manifests/sha256:eddbff0886ee9d637bbcf8e30612db26cfebf9fbd5d53948c7c9090b24913b4b: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit\"" pod="default/test-local-path" podUID="288fd0b6-8224-4d26-9aa9-20812cfdeca9"
Mar 17 12:50:50 addons-012219 kubelet[1625]: E0317 12:50:50.989210 1625 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/nginx:alpine\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nginx:alpine\\\": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/nginx/manifests/sha256:4ff102c5d78d254a6f0da062b3cf39eaf07f01eec0927fd21e219d0af8bc0591: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit\"" pod="default/nginx" podUID="a2751ab5-cd1c-44a3-a6ba-dba98b254a96"
Mar 17 12:50:53 addons-012219 kubelet[1625]: E0317 12:50:53.989331 1625 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"busybox\" with ImagePullBackOff: \"Back-off pulling image \\\"busybox:stable\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/busybox:stable\\\": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/busybox/manifests/sha256:eddbff0886ee9d637bbcf8e30612db26cfebf9fbd5d53948c7c9090b24913b4b: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit\"" pod="default/test-local-path" podUID="288fd0b6-8224-4d26-9aa9-20812cfdeca9"
Mar 17 12:51:02 addons-012219 kubelet[1625]: E0317 12:51:02.988736 1625 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/nginx:alpine\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nginx:alpine\\\": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/nginx/manifests/sha256:4ff102c5d78d254a6f0da062b3cf39eaf07f01eec0927fd21e219d0af8bc0591: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit\"" pod="default/nginx" podUID="a2751ab5-cd1c-44a3-a6ba-dba98b254a96"
Mar 17 12:51:07 addons-012219 kubelet[1625]: E0317 12:51:07.988655 1625 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"busybox\" with ImagePullBackOff: \"Back-off pulling image \\\"busybox:stable\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/busybox:stable\\\": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/busybox/manifests/sha256:eddbff0886ee9d637bbcf8e30612db26cfebf9fbd5d53948c7c9090b24913b4b: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit\"" pod="default/test-local-path" podUID="288fd0b6-8224-4d26-9aa9-20812cfdeca9"
Mar 17 12:51:15 addons-012219 kubelet[1625]: E0317 12:51:15.989331 1625 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/nginx:alpine\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nginx:alpine\\\": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/nginx/manifests/sha256:4ff102c5d78d254a6f0da062b3cf39eaf07f01eec0927fd21e219d0af8bc0591: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit\"" pod="default/nginx" podUID="a2751ab5-cd1c-44a3-a6ba-dba98b254a96"
Mar 17 12:51:22 addons-012219 kubelet[1625]: E0317 12:51:22.988724 1625 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"busybox\" with ImagePullBackOff: \"Back-off pulling image \\\"busybox:stable\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/busybox:stable\\\": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/busybox/manifests/sha256:eddbff0886ee9d637bbcf8e30612db26cfebf9fbd5d53948c7c9090b24913b4b: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit\"" pod="default/test-local-path" podUID="288fd0b6-8224-4d26-9aa9-20812cfdeca9"
Mar 17 12:51:27 addons-012219 kubelet[1625]: I0317 12:51:27.987301 1625 kubelet_pods.go:1021] "Unable to retrieve pull secret, the image pull may not succeed." pod="default/busybox" secret="" err="secret \"gcp-auth\" not found"
Mar 17 12:51:27 addons-012219 kubelet[1625]: E0317 12:51:27.988375 1625 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/nginx:alpine\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nginx:alpine\\\": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/nginx/manifests/sha256:4ff102c5d78d254a6f0da062b3cf39eaf07f01eec0927fd21e219d0af8bc0591: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit\"" pod="default/nginx" podUID="a2751ab5-cd1c-44a3-a6ba-dba98b254a96"
Mar 17 12:51:37 addons-012219 kubelet[1625]: E0317 12:51:37.989131 1625 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"busybox\" with ImagePullBackOff: \"Back-off pulling image \\\"busybox:stable\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/busybox:stable\\\": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/busybox/manifests/sha256:eddbff0886ee9d637bbcf8e30612db26cfebf9fbd5d53948c7c9090b24913b4b: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit\"" pod="default/test-local-path" podUID="288fd0b6-8224-4d26-9aa9-20812cfdeca9"
Mar 17 12:51:42 addons-012219 kubelet[1625]: E0317 12:51:42.988399 1625 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/nginx:alpine\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nginx:alpine\\\": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/nginx/manifests/sha256:4ff102c5d78d254a6f0da062b3cf39eaf07f01eec0927fd21e219d0af8bc0591: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit\"" pod="default/nginx" podUID="a2751ab5-cd1c-44a3-a6ba-dba98b254a96"
==> storage-provisioner [7e31db05a70a8aa2cb0f75b72d342f7e671f1ea0e1be6634ce27012647e92af9] <==
I0317 12:39:38.160831 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0317 12:39:38.264352 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0317 12:39:38.267238 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0317 12:39:38.360209 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0317 12:39:38.360490 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-012219_f580fdba-4164-417d-99e0-bbfdff8b9108!
I0317 12:39:38.361811 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"2e6be1f1-63bf-4a91-a4d7-e3d46b4cb84d", APIVersion:"v1", ResourceVersion:"638", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-012219_f580fdba-4164-417d-99e0-bbfdff8b9108 became leader
I0317 12:39:38.465181 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-012219_f580fdba-4164-417d-99e0-bbfdff8b9108!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p addons-012219 -n addons-012219
helpers_test.go:261: (dbg) Run: kubectl --context addons-012219 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: nginx test-local-path ingress-nginx-admission-create-l6q8w ingress-nginx-admission-patch-t76b7
helpers_test.go:274: ======> post-mortem[TestAddons/parallel/Ingress]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-012219 describe pod nginx test-local-path ingress-nginx-admission-create-l6q8w ingress-nginx-admission-patch-t76b7
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-012219 describe pod nginx test-local-path ingress-nginx-admission-create-l6q8w ingress-nginx-admission-patch-t76b7: exit status 1 (83.499721ms)
-- stdout --
Name: nginx
Namespace: default
Priority: 0
Service Account: default
Node: addons-012219/192.168.49.2
Start Time: Mon, 17 Mar 2025 12:43:41 +0000
Labels: run=nginx
Annotations: <none>
Status: Pending
IP: 10.244.0.34
IPs:
IP: 10.244.0.34
Containers:
nginx:
Container ID:
Image: docker.io/nginx:alpine
Image ID:
Port: 80/TCP
Host Port: 0/TCP
State: Waiting
Reason: ImagePullBackOff
Ready: False
Restart Count: 0
Environment: <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-hh4v9 (ro)
Conditions:
Type Status
PodReadyToStartContainers True
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
kube-api-access-hh4v9:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 8m3s default-scheduler Successfully assigned default/nginx to addons-012219
Normal Pulling 5m2s (x5 over 8m2s) kubelet Pulling image "docker.io/nginx:alpine"
Warning Failed 4m59s (x5 over 7m59s) kubelet Failed to pull image "docker.io/nginx:alpine": failed to pull and unpack image "docker.io/library/nginx:alpine": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/nginx/manifests/sha256:4ff102c5d78d254a6f0da062b3cf39eaf07f01eec0927fd21e219d0af8bc0591: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit
Warning Failed 4m59s (x5 over 7m59s) kubelet Error: ErrImagePull
Warning Failed 2m59s (x19 over 7m58s) kubelet Error: ImagePullBackOff
Normal BackOff 2m31s (x21 over 7m58s) kubelet Back-off pulling image "docker.io/nginx:alpine"
Name: test-local-path
Namespace: default
Priority: 0
Service Account: default
Node: addons-012219/192.168.49.2
Start Time: Mon, 17 Mar 2025 12:43:25 +0000
Labels: run=test-local-path
Annotations: <none>
Status: Pending
IP: 10.244.0.32
IPs:
IP: 10.244.0.32
Containers:
busybox:
Container ID:
Image: busybox:stable
Image ID:
Port: <none>
Host Port: <none>
Command:
sh
-c
echo 'local-path-provisioner' > /test/file1
State: Waiting
Reason: ImagePullBackOff
Ready: False
Restart Count: 0
Environment: <none>
Mounts:
/test from data (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-nft6x (ro)
Conditions:
Type Status
PodReadyToStartContainers True
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
data:
Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
ClaimName: test-pvc
ReadOnly: false
kube-api-access-nft6x:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 8m19s default-scheduler Successfully assigned default/test-local-path to addons-012219
Warning Failed 6m49s (x4 over 8m15s) kubelet Failed to pull image "busybox:stable": failed to pull and unpack image "docker.io/library/busybox:stable": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/busybox/manifests/sha256:7a5342b7662db8de99e045a2b47b889c5701b8dde0ce5ae3f1577bf57a15ed40: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit
Warning Failed 5m26s (x5 over 8m15s) kubelet Error: ErrImagePull
Warning Failed 5m26s kubelet Failed to pull image "busybox:stable": failed to pull and unpack image "docker.io/library/busybox:stable": failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/busybox/manifests/sha256:eddbff0886ee9d637bbcf8e30612db26cfebf9fbd5d53948c7c9090b24913b4b: 429 Too Many Requests - Server message: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit
Warning Failed 3m11s (x19 over 8m15s) kubelet Error: ImagePullBackOff
Normal BackOff 2m56s (x20 over 8m15s) kubelet Back-off pulling image "busybox:stable"
Normal Pulling 2m41s (x6 over 8m19s) kubelet Pulling image "busybox:stable"
-- /stdout --
** stderr **
Error from server (NotFound): pods "ingress-nginx-admission-create-l6q8w" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-t76b7" not found
** /stderr **
helpers_test.go:279: kubectl --context addons-012219 describe pod nginx test-local-path ingress-nginx-admission-create-l6q8w ingress-nginx-admission-patch-t76b7: exit status 1
addons_test.go:992: (dbg) Run: out/minikube-linux-amd64 -p addons-012219 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:992: (dbg) Run: out/minikube-linux-amd64 -p addons-012219 addons disable ingress --alsologtostderr -v=1
addons_test.go:992: (dbg) Done: out/minikube-linux-amd64 -p addons-012219 addons disable ingress --alsologtostderr -v=1: (7.727396603s)
--- FAIL: TestAddons/parallel/Ingress (491.87s)