=== RUN TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry
=== CONT TestAddons/parallel/Registry
addons_test.go:328: registry stabilized in 3.297544ms
addons_test.go:330: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-66c9cd494c-b4j85" [88d02c55-38b5-4e2b-9986-5f7887226e63] Running
addons_test.go:330: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.003528689s
addons_test.go:333: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-x8xl5" [22fc174a-6a59-45df-b8e0-fd97f697901c] Running
addons_test.go:333: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.003304211s
addons_test.go:338: (dbg) Run: kubectl --context addons-162403 delete po -l run=registry-test --now
addons_test.go:343: (dbg) Run: kubectl --context addons-162403 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:343: (dbg) Non-zero exit: kubectl --context addons-162403 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": exit status 1 (1m0.07645086s)
-- stdout --
pod "registry-test" deleted
-- /stdout --
** stderr **
error: timed out waiting for the condition
** /stderr **
addons_test.go:345: failed to hit registry.kube-system.svc.cluster.local. args "kubectl --context addons-162403 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c \"wget --spider -S http://registry.kube-system.svc.cluster.local\"" failed: exit status 1
addons_test.go:349: expected curl response be "HTTP/1.1 200", but got *pod "registry-test" deleted
*
addons_test.go:357: (dbg) Run: out/minikube-linux-amd64 -p addons-162403 ip
2024/09/20 18:30:58 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:386: (dbg) Run: out/minikube-linux-amd64 -p addons-162403 addons disable registry --alsologtostderr -v=1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestAddons/parallel/Registry]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect addons-162403
helpers_test.go:235: (dbg) docker inspect addons-162403:
-- stdout --
[
{
"Id": "106a9fd3effc28dc1b06b314d32589d00ce87bf354d54e5aa36fc020c898a4b7",
"Created": "2024-09-20T18:19:01.134918747Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 674901,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-09-20T18:19:01.25004308Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:bb3bcbaabeeeadbf6b43ae7d1d07e504b3c8a94ec024df89bcb237eba4f5e9b3",
"ResolvConfPath": "/var/lib/docker/containers/106a9fd3effc28dc1b06b314d32589d00ce87bf354d54e5aa36fc020c898a4b7/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/106a9fd3effc28dc1b06b314d32589d00ce87bf354d54e5aa36fc020c898a4b7/hostname",
"HostsPath": "/var/lib/docker/containers/106a9fd3effc28dc1b06b314d32589d00ce87bf354d54e5aa36fc020c898a4b7/hosts",
"LogPath": "/var/lib/docker/containers/106a9fd3effc28dc1b06b314d32589d00ce87bf354d54e5aa36fc020c898a4b7/106a9fd3effc28dc1b06b314d32589d00ce87bf354d54e5aa36fc020c898a4b7-json.log",
"Name": "/addons-162403",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"addons-162403:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "addons-162403",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4194304000,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8388608000,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/46b0d8ce2eae79604ea4eb97b6b4e36eeb4ca9310c61f276a053866b944a16b3-init/diff:/var/lib/docker/overlay2/eaa029c0352c09d5301213b292ed71be17ad3c7af9b304910b3afcbb6087e2a1/diff",
"MergedDir": "/var/lib/docker/overlay2/46b0d8ce2eae79604ea4eb97b6b4e36eeb4ca9310c61f276a053866b944a16b3/merged",
"UpperDir": "/var/lib/docker/overlay2/46b0d8ce2eae79604ea4eb97b6b4e36eeb4ca9310c61f276a053866b944a16b3/diff",
"WorkDir": "/var/lib/docker/overlay2/46b0d8ce2eae79604ea4eb97b6b4e36eeb4ca9310c61f276a053866b944a16b3/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "addons-162403",
"Source": "/var/lib/docker/volumes/addons-162403/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "addons-162403",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-162403",
"name.minikube.sigs.k8s.io": "addons-162403",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "488a22f7f2606afe4be623bfdfd275b5b8331f1b931576ea9ec822158b58c0ce",
"SandboxKey": "/var/run/docker/netns/488a22f7f260",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32768"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32769"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32772"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32770"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32771"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"addons-162403": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:31:02",
"DriverOpts": null,
"NetworkID": "d0901782c3c8698a9caccb5c84dc1c7ad2c5eb6d0b068119a7aad73f3dbaa435",
"EndpointID": "035274aa910e41c214a6f521c4fc53fb707a6152897b47a404b57c9e4e462cf6",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-162403",
"106a9fd3effc"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p addons-162403 -n addons-162403
helpers_test.go:244: <<< TestAddons/parallel/Registry FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/parallel/Registry]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p addons-162403 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p addons-162403 logs -n 25: (2.976667894s)
helpers_test.go:252: TestAddons/parallel/Registry logs:
-- stdout --
==> Audit <==
|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| delete | -p download-only-536443 | download-only-536443 | jenkins | v1.34.0 | 20 Sep 24 18:18 UTC | 20 Sep 24 18:18 UTC |
| start | -o=json --download-only | download-only-183655 | jenkins | v1.34.0 | 20 Sep 24 18:18 UTC | |
| | -p download-only-183655 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
| | --container-runtime=crio | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 20 Sep 24 18:18 UTC | 20 Sep 24 18:18 UTC |
| delete | -p download-only-183655 | download-only-183655 | jenkins | v1.34.0 | 20 Sep 24 18:18 UTC | 20 Sep 24 18:18 UTC |
| delete | -p download-only-536443 | download-only-536443 | jenkins | v1.34.0 | 20 Sep 24 18:18 UTC | 20 Sep 24 18:18 UTC |
| delete | -p download-only-183655 | download-only-183655 | jenkins | v1.34.0 | 20 Sep 24 18:18 UTC | 20 Sep 24 18:18 UTC |
| start | --download-only -p | download-docker-729301 | jenkins | v1.34.0 | 20 Sep 24 18:18 UTC | |
| | download-docker-729301 | | | | | |
| | --alsologtostderr | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| delete | -p download-docker-729301 | download-docker-729301 | jenkins | v1.34.0 | 20 Sep 24 18:18 UTC | 20 Sep 24 18:18 UTC |
| start | --download-only -p | binary-mirror-249385 | jenkins | v1.34.0 | 20 Sep 24 18:18 UTC | |
| | binary-mirror-249385 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:43551 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| delete | -p binary-mirror-249385 | binary-mirror-249385 | jenkins | v1.34.0 | 20 Sep 24 18:18 UTC | 20 Sep 24 18:18 UTC |
| addons | enable dashboard -p | addons-162403 | jenkins | v1.34.0 | 20 Sep 24 18:18 UTC | |
| | addons-162403 | | | | | |
| addons | disable dashboard -p | addons-162403 | jenkins | v1.34.0 | 20 Sep 24 18:18 UTC | |
| | addons-162403 | | | | | |
| start | -p addons-162403 --wait=true | addons-162403 | jenkins | v1.34.0 | 20 Sep 24 18:18 UTC | 20 Sep 24 18:21 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
| addons | disable nvidia-device-plugin | addons-162403 | jenkins | v1.34.0 | 20 Sep 24 18:29 UTC | 20 Sep 24 18:29 UTC |
| | -p addons-162403 | | | | | |
| addons | addons-162403 addons disable | addons-162403 | jenkins | v1.34.0 | 20 Sep 24 18:29 UTC | 20 Sep 24 18:29 UTC |
| | yakd --alsologtostderr -v=1 | | | | | |
| addons | disable inspektor-gadget -p | addons-162403 | jenkins | v1.34.0 | 20 Sep 24 18:30 UTC | 20 Sep 24 18:30 UTC |
| | addons-162403 | | | | | |
| ssh | addons-162403 ssh curl -s | addons-162403 | jenkins | v1.34.0 | 20 Sep 24 18:30 UTC | |
| | http://127.0.0.1/ -H 'Host: | | | | | |
| | nginx.example.com' | | | | | |
| addons | addons-162403 addons | addons-162403 | jenkins | v1.34.0 | 20 Sep 24 18:30 UTC | 20 Sep 24 18:30 UTC |
| | disable csi-hostpath-driver | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | addons-162403 addons | addons-162403 | jenkins | v1.34.0 | 20 Sep 24 18:30 UTC | 20 Sep 24 18:30 UTC |
| | disable volumesnapshots | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | disable cloud-spanner -p | addons-162403 | jenkins | v1.34.0 | 20 Sep 24 18:30 UTC | 20 Sep 24 18:30 UTC |
| | addons-162403 | | | | | |
| ssh | addons-162403 ssh cat | addons-162403 | jenkins | v1.34.0 | 20 Sep 24 18:30 UTC | 20 Sep 24 18:30 UTC |
| | /opt/local-path-provisioner/pvc-7362d9da-c19d-46d1-ab52-e395c2ebef40_default_test-pvc/file1 | | | | | |
| addons | addons-162403 addons disable | addons-162403 | jenkins | v1.34.0 | 20 Sep 24 18:30 UTC | 20 Sep 24 18:30 UTC |
| | storage-provisioner-rancher | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | enable headlamp | addons-162403 | jenkins | v1.34.0 | 20 Sep 24 18:30 UTC | 20 Sep 24 18:30 UTC |
| | -p addons-162403 | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| ip | addons-162403 ip | addons-162403 | jenkins | v1.34.0 | 20 Sep 24 18:30 UTC | 20 Sep 24 18:30 UTC |
| addons | addons-162403 addons disable | addons-162403 | jenkins | v1.34.0 | 20 Sep 24 18:30 UTC | 20 Sep 24 18:30 UTC |
| | registry --alsologtostderr | | | | | |
| | -v=1 | | | | | |
|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/09/20 18:18:38
Running on machine: ubuntu-20-agent
Binary: Built with gc go1.23.0 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0920 18:18:38.955255 674168 out.go:345] Setting OutFile to fd 1 ...
I0920 18:18:38.955393 674168 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0920 18:18:38.955405 674168 out.go:358] Setting ErrFile to fd 2...
I0920 18:18:38.955420 674168 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0920 18:18:38.955592 674168 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19678-664237/.minikube/bin
I0920 18:18:38.956218 674168 out.go:352] Setting JSON to false
I0920 18:18:38.957151 674168 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent","uptime":7263,"bootTime":1726849056,"procs":179,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1069-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0920 18:18:38.957258 674168 start.go:139] virtualization: kvm guest
I0920 18:18:38.959268 674168 out.go:177] * [addons-162403] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
I0920 18:18:38.960748 674168 notify.go:220] Checking for updates...
I0920 18:18:38.960767 674168 out.go:177] - MINIKUBE_LOCATION=19678
I0920 18:18:38.962055 674168 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0920 18:18:38.963377 674168 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19678-664237/kubeconfig
I0920 18:18:38.964538 674168 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19678-664237/.minikube
I0920 18:18:38.965672 674168 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0920 18:18:38.966885 674168 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0920 18:18:38.968185 674168 driver.go:394] Setting default libvirt URI to qemu:///system
I0920 18:18:38.989387 674168 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
I0920 18:18:38.989471 674168 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0920 18:18:39.033969 674168 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:30 OomKillDisable:true NGoroutines:45 SystemTime:2024-09-20 18:18:39.025186058 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1069-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x86
_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647939584 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I0920 18:18:39.034102 674168 docker.go:318] overlay module found
I0920 18:18:39.035798 674168 out.go:177] * Using the docker driver based on user configuration
I0920 18:18:39.037025 674168 start.go:297] selected driver: docker
I0920 18:18:39.037039 674168 start.go:901] validating driver "docker" against <nil>
I0920 18:18:39.037051 674168 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0920 18:18:39.037947 674168 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0920 18:18:39.085086 674168 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:30 OomKillDisable:true NGoroutines:45 SystemTime:2024-09-20 18:18:39.076841302 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1069-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x86
_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647939584 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I0920 18:18:39.085255 674168 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0920 18:18:39.085496 674168 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0920 18:18:39.087167 674168 out.go:177] * Using Docker driver with root privileges
I0920 18:18:39.088532 674168 cni.go:84] Creating CNI manager for ""
I0920 18:18:39.088595 674168 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0920 18:18:39.088606 674168 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0920 18:18:39.088665 674168 start.go:340] cluster config:
{Name:addons-162403 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-162403 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSH
AgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0920 18:18:39.089923 674168 out.go:177] * Starting "addons-162403" primary control-plane node in "addons-162403" cluster
I0920 18:18:39.091072 674168 cache.go:121] Beginning downloading kic base image for docker with crio
I0920 18:18:39.092598 674168 out.go:177] * Pulling base image v0.0.45-1726589491-19662 ...
I0920 18:18:39.094070 674168 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio
I0920 18:18:39.094104 674168 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 in local docker daemon
I0920 18:18:39.094121 674168 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19678-664237/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-amd64.tar.lz4
I0920 18:18:39.094133 674168 cache.go:56] Caching tarball of preloaded images
I0920 18:18:39.094252 674168 preload.go:172] Found /home/jenkins/minikube-integration/19678-664237/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0920 18:18:39.094263 674168 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on crio
I0920 18:18:39.094613 674168 profile.go:143] Saving config to /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/config.json ...
I0920 18:18:39.094639 674168 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/config.json: {Name:mka678336c738f0ad3cca0a057f366143df6dca2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:18:39.109272 674168 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 to local cache
I0920 18:18:39.109425 674168 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 in local cache directory
I0920 18:18:39.109447 674168 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 in local cache directory, skipping pull
I0920 18:18:39.109453 674168 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 exists in cache, skipping pull
I0920 18:18:39.109467 674168 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 as a tarball
I0920 18:18:39.109477 674168 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 from local cache
I0920 18:18:51.189040 674168 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 from cached tarball
I0920 18:18:51.189079 674168 cache.go:194] Successfully downloaded all kic artifacts
I0920 18:18:51.189135 674168 start.go:360] acquireMachinesLock for addons-162403: {Name:mk331c03eda7bf008a5f6618682622fc66137de8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0920 18:18:51.189234 674168 start.go:364] duration metric: took 78.073µs to acquireMachinesLock for "addons-162403"
I0920 18:18:51.189258 674168 start.go:93] Provisioning new machine with config: &{Name:addons-162403 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-162403 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQe
muFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I0920 18:18:51.189337 674168 start.go:125] createHost starting for "" (driver="docker")
I0920 18:18:51.191508 674168 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
I0920 18:18:51.191775 674168 start.go:159] libmachine.API.Create for "addons-162403" (driver="docker")
I0920 18:18:51.191808 674168 client.go:168] LocalClient.Create starting
I0920 18:18:51.191901 674168 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19678-664237/.minikube/certs/ca.pem
I0920 18:18:51.507907 674168 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19678-664237/.minikube/certs/cert.pem
I0920 18:18:51.677159 674168 cli_runner.go:164] Run: docker network inspect addons-162403 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0920 18:18:51.691915 674168 cli_runner.go:211] docker network inspect addons-162403 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0920 18:18:51.692010 674168 network_create.go:284] running [docker network inspect addons-162403] to gather additional debugging logs...
I0920 18:18:51.692035 674168 cli_runner.go:164] Run: docker network inspect addons-162403
W0920 18:18:51.707711 674168 cli_runner.go:211] docker network inspect addons-162403 returned with exit code 1
I0920 18:18:51.707746 674168 network_create.go:287] error running [docker network inspect addons-162403]: docker network inspect addons-162403: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-162403 not found
I0920 18:18:51.707769 674168 network_create.go:289] output of [docker network inspect addons-162403]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-162403 not found
** /stderr **
I0920 18:18:51.707870 674168 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0920 18:18:51.723682 674168 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc001a5f410}
I0920 18:18:51.723727 674168 network_create.go:124] attempt to create docker network addons-162403 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0920 18:18:51.723786 674168 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-162403 addons-162403
I0920 18:18:51.787135 674168 network_create.go:108] docker network addons-162403 192.168.49.0/24 created
I0920 18:18:51.787171 674168 kic.go:121] calculated static IP "192.168.49.2" for the "addons-162403" container
I0920 18:18:51.787234 674168 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0920 18:18:51.802456 674168 cli_runner.go:164] Run: docker volume create addons-162403 --label name.minikube.sigs.k8s.io=addons-162403 --label created_by.minikube.sigs.k8s.io=true
I0920 18:18:51.819456 674168 oci.go:103] Successfully created a docker volume addons-162403
I0920 18:18:51.819546 674168 cli_runner.go:164] Run: docker run --rm --name addons-162403-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-162403 --entrypoint /usr/bin/test -v addons-162403:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 -d /var/lib
I0920 18:18:56.747820 674168 cli_runner.go:217] Completed: docker run --rm --name addons-162403-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-162403 --entrypoint /usr/bin/test -v addons-162403:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 -d /var/lib: (4.92822817s)
I0920 18:18:56.747853 674168 oci.go:107] Successfully prepared a docker volume addons-162403
I0920 18:18:56.747870 674168 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio
I0920 18:18:56.747891 674168 kic.go:194] Starting extracting preloaded images to volume ...
I0920 18:18:56.747948 674168 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19678-664237/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v addons-162403:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 -I lz4 -xf /preloaded.tar -C /extractDir
I0920 18:19:01.072064 674168 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19678-664237/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v addons-162403:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 -I lz4 -xf /preloaded.tar -C /extractDir: (4.324069588s)
I0920 18:19:01.072104 674168 kic.go:203] duration metric: took 4.324208181s to extract preloaded images to volume ...
W0920 18:19:01.072245 674168 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0920 18:19:01.072342 674168 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0920 18:19:01.120121 674168 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-162403 --name addons-162403 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-162403 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-162403 --network addons-162403 --ip 192.168.49.2 --volume addons-162403:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4
I0920 18:19:01.433919 674168 cli_runner.go:164] Run: docker container inspect addons-162403 --format={{.State.Running}}
I0920 18:19:01.451773 674168 cli_runner.go:164] Run: docker container inspect addons-162403 --format={{.State.Status}}
I0920 18:19:01.468968 674168 cli_runner.go:164] Run: docker exec addons-162403 stat /var/lib/dpkg/alternatives/iptables
I0920 18:19:01.510599 674168 oci.go:144] the created container "addons-162403" has a running status.
I0920 18:19:01.510643 674168 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19678-664237/.minikube/machines/addons-162403/id_rsa...
I0920 18:19:01.839171 674168 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19678-664237/.minikube/machines/addons-162403/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0920 18:19:01.868842 674168 cli_runner.go:164] Run: docker container inspect addons-162403 --format={{.State.Status}}
I0920 18:19:01.888555 674168 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0920 18:19:01.888581 674168 kic_runner.go:114] Args: [docker exec --privileged addons-162403 chown docker:docker /home/docker/.ssh/authorized_keys]
I0920 18:19:01.951628 674168 cli_runner.go:164] Run: docker container inspect addons-162403 --format={{.State.Status}}
I0920 18:19:01.969485 674168 machine.go:93] provisionDockerMachine start ...
I0920 18:19:01.969572 674168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-162403
I0920 18:19:01.988650 674168 main.go:141] libmachine: Using SSH client type: native
I0920 18:19:01.988870 674168 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I0920 18:19:01.988884 674168 main.go:141] libmachine: About to run SSH command:
hostname
I0920 18:19:02.122640 674168 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-162403
I0920 18:19:02.122671 674168 ubuntu.go:169] provisioning hostname "addons-162403"
I0920 18:19:02.122731 674168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-162403
I0920 18:19:02.140337 674168 main.go:141] libmachine: Using SSH client type: native
I0920 18:19:02.140537 674168 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I0920 18:19:02.140557 674168 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-162403 && echo "addons-162403" | sudo tee /etc/hostname
I0920 18:19:02.286561 674168 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-162403
I0920 18:19:02.286650 674168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-162403
I0920 18:19:02.304306 674168 main.go:141] libmachine: Using SSH client type: native
I0920 18:19:02.304516 674168 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I0920 18:19:02.304533 674168 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-162403' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-162403/g' /etc/hosts;
else
echo '127.0.1.1 addons-162403' | sudo tee -a /etc/hosts;
fi
fi
I0920 18:19:02.439353 674168 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0920 18:19:02.439404 674168 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19678-664237/.minikube CaCertPath:/home/jenkins/minikube-integration/19678-664237/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19678-664237/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19678-664237/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19678-664237/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19678-664237/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19678-664237/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19678-664237/.minikube}
I0920 18:19:02.439441 674168 ubuntu.go:177] setting up certificates
I0920 18:19:02.439455 674168 provision.go:84] configureAuth start
I0920 18:19:02.439504 674168 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-162403
I0920 18:19:02.456858 674168 provision.go:143] copyHostCerts
I0920 18:19:02.456941 674168 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19678-664237/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19678-664237/.minikube/ca.pem (1078 bytes)
I0920 18:19:02.457067 674168 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19678-664237/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19678-664237/.minikube/cert.pem (1123 bytes)
I0920 18:19:02.457128 674168 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19678-664237/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19678-664237/.minikube/key.pem (1679 bytes)
I0920 18:19:02.457180 674168 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19678-664237/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19678-664237/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19678-664237/.minikube/certs/ca-key.pem org=jenkins.addons-162403 san=[127.0.0.1 192.168.49.2 addons-162403 localhost minikube]
I0920 18:19:02.568617 674168 provision.go:177] copyRemoteCerts
I0920 18:19:02.568695 674168 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0920 18:19:02.568736 674168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-162403
I0920 18:19:02.586920 674168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19678-664237/.minikube/machines/addons-162403/id_rsa Username:docker}
I0920 18:19:02.684045 674168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19678-664237/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0920 18:19:02.707472 674168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19678-664237/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0920 18:19:02.731956 674168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19678-664237/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0920 18:19:02.755601 674168 provision.go:87] duration metric: took 316.131194ms to configureAuth
I0920 18:19:02.755631 674168 ubuntu.go:193] setting minikube options for container-runtime
I0920 18:19:02.755814 674168 config.go:182] Loaded profile config "addons-162403": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0920 18:19:02.755914 674168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-162403
I0920 18:19:02.772731 674168 main.go:141] libmachine: Using SSH client type: native
I0920 18:19:02.772918 674168 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I0920 18:19:02.772936 674168 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0920 18:19:02.992259 674168 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0920 18:19:02.992298 674168 machine.go:96] duration metric: took 1.022790809s to provisionDockerMachine
I0920 18:19:02.992310 674168 client.go:171] duration metric: took 11.800496863s to LocalClient.Create
I0920 18:19:02.992331 674168 start.go:167] duration metric: took 11.800557763s to libmachine.API.Create "addons-162403"
I0920 18:19:02.992341 674168 start.go:293] postStartSetup for "addons-162403" (driver="docker")
I0920 18:19:02.992353 674168 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0920 18:19:02.992454 674168 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0920 18:19:02.992503 674168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-162403
I0920 18:19:03.008771 674168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19678-664237/.minikube/machines/addons-162403/id_rsa Username:docker}
I0920 18:19:03.104327 674168 ssh_runner.go:195] Run: cat /etc/os-release
I0920 18:19:03.107709 674168 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0920 18:19:03.107745 674168 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0920 18:19:03.107753 674168 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0920 18:19:03.107760 674168 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I0920 18:19:03.107771 674168 filesync.go:126] Scanning /home/jenkins/minikube-integration/19678-664237/.minikube/addons for local assets ...
I0920 18:19:03.107836 674168 filesync.go:126] Scanning /home/jenkins/minikube-integration/19678-664237/.minikube/files for local assets ...
I0920 18:19:03.107861 674168 start.go:296] duration metric: took 115.514633ms for postStartSetup
I0920 18:19:03.108152 674168 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-162403
I0920 18:19:03.124456 674168 profile.go:143] Saving config to /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/config.json ...
I0920 18:19:03.124718 674168 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0920 18:19:03.124760 674168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-162403
I0920 18:19:03.141718 674168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19678-664237/.minikube/machines/addons-162403/id_rsa Username:docker}
I0920 18:19:03.231925 674168 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0920 18:19:03.236351 674168 start.go:128] duration metric: took 12.046994202s to createHost
I0920 18:19:03.236388 674168 start.go:83] releasing machines lock for "addons-162403", held for 12.047138719s
I0920 18:19:03.236447 674168 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-162403
I0920 18:19:03.252823 674168 ssh_runner.go:195] Run: cat /version.json
I0920 18:19:03.252881 674168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-162403
I0920 18:19:03.252896 674168 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0920 18:19:03.252965 674168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-162403
I0920 18:19:03.270590 674168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19678-664237/.minikube/machines/addons-162403/id_rsa Username:docker}
I0920 18:19:03.270812 674168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19678-664237/.minikube/machines/addons-162403/id_rsa Username:docker}
I0920 18:19:03.431267 674168 ssh_runner.go:195] Run: systemctl --version
I0920 18:19:03.435427 674168 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0920 18:19:03.571297 674168 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0920 18:19:03.575824 674168 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0920 18:19:03.593925 674168 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
I0920 18:19:03.594008 674168 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0920 18:19:03.621210 674168 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0920 18:19:03.621241 674168 start.go:495] detecting cgroup driver to use...
I0920 18:19:03.621281 674168 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0920 18:19:03.621346 674168 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0920 18:19:03.636176 674168 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0920 18:19:03.646720 674168 docker.go:217] disabling cri-docker service (if available) ...
I0920 18:19:03.646780 674168 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0920 18:19:03.659269 674168 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0920 18:19:03.672678 674168 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0920 18:19:03.753551 674168 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0920 18:19:03.832924 674168 docker.go:233] disabling docker service ...
I0920 18:19:03.833033 674168 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0920 18:19:03.850932 674168 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0920 18:19:03.861851 674168 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0920 18:19:03.936436 674168 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0920 18:19:04.025605 674168 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0920 18:19:04.037271 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0920 18:19:04.053234 674168 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...
I0920 18:19:04.053306 674168 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"
I0920 18:19:04.062992 674168 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0920 18:19:04.063067 674168 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0920 18:19:04.073077 674168 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0920 18:19:04.082949 674168 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0920 18:19:04.093166 674168 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0920 18:19:04.102194 674168 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I0920 18:19:04.111782 674168 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I0920 18:19:04.127237 674168 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I0920 18:19:04.137185 674168 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0920 18:19:04.145365 674168 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0920 18:19:04.153756 674168 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0920 18:19:04.227978 674168 ssh_runner.go:195] Run: sudo systemctl restart crio
I0920 18:19:04.324503 674168 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0920 18:19:04.324605 674168 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0920 18:19:04.328475 674168 start.go:563] Will wait 60s for crictl version
I0920 18:19:04.328524 674168 ssh_runner.go:195] Run: which crictl
I0920 18:19:04.331866 674168 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0920 18:19:04.364842 674168 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.6
RuntimeApiVersion: v1
I0920 18:19:04.364939 674168 ssh_runner.go:195] Run: crio --version
I0920 18:19:04.404023 674168 ssh_runner.go:195] Run: crio --version
I0920 18:19:04.442587 674168 out.go:177] * Preparing Kubernetes v1.31.1 on CRI-O 1.24.6 ...
I0920 18:19:04.444061 674168 cli_runner.go:164] Run: docker network inspect addons-162403 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0920 18:19:04.460165 674168 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I0920 18:19:04.463995 674168 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0920 18:19:04.474789 674168 kubeadm.go:883] updating cluster {Name:addons-162403 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-162403 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmw
arePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0920 18:19:04.474919 674168 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio
I0920 18:19:04.474992 674168 ssh_runner.go:195] Run: sudo crictl images --output json
I0920 18:19:04.537318 674168 crio.go:514] all images are preloaded for cri-o runtime.
I0920 18:19:04.537404 674168 crio.go:433] Images already preloaded, skipping extraction
I0920 18:19:04.537459 674168 ssh_runner.go:195] Run: sudo crictl images --output json
I0920 18:19:04.571115 674168 crio.go:514] all images are preloaded for cri-o runtime.
I0920 18:19:04.571143 674168 cache_images.go:84] Images are preloaded, skipping loading
I0920 18:19:04.571153 674168 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.1 crio true true} ...
I0920 18:19:04.571259 674168 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=addons-162403 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.31.1 ClusterName:addons-162403 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0920 18:19:04.571321 674168 ssh_runner.go:195] Run: crio config
I0920 18:19:04.615201 674168 cni.go:84] Creating CNI manager for ""
I0920 18:19:04.615225 674168 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0920 18:19:04.615237 674168 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0920 18:19:04.615259 674168 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-162403 NodeName:addons-162403 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kuberne
tes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0920 18:19:04.615389 674168 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "addons-162403"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0920 18:19:04.615447 674168 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1
I0920 18:19:04.624504 674168 binaries.go:44] Found k8s binaries, skipping transfer
I0920 18:19:04.624568 674168 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0920 18:19:04.633418 674168 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (363 bytes)
I0920 18:19:04.650496 674168 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0920 18:19:04.667763 674168 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2151 bytes)
I0920 18:19:04.684808 674168 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0920 18:19:04.688259 674168 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0920 18:19:04.698716 674168 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0920 18:19:04.772157 674168 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0920 18:19:04.785010 674168 certs.go:68] Setting up /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403 for IP: 192.168.49.2
I0920 18:19:04.785034 674168 certs.go:194] generating shared ca certs ...
I0920 18:19:04.785055 674168 certs.go:226] acquiring lock for ca certs: {Name:mk4b124302946da10a6534852cdb170d2c9fff4c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:19:04.785184 674168 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19678-664237/.minikube/ca.key
I0920 18:19:04.975314 674168 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19678-664237/.minikube/ca.crt ...
I0920 18:19:04.975345 674168 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19678-664237/.minikube/ca.crt: {Name:mk70db283e13139496726ffe72d8d96dde32a822 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:19:04.975559 674168 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19678-664237/.minikube/ca.key ...
I0920 18:19:04.975584 674168 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19678-664237/.minikube/ca.key: {Name:mk35cfb4b8c77a9b5e50fcee25a6045ab52d6653 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:19:04.975700 674168 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19678-664237/.minikube/proxy-client-ca.key
I0920 18:19:05.060533 674168 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19678-664237/.minikube/proxy-client-ca.crt ...
I0920 18:19:05.060567 674168 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19678-664237/.minikube/proxy-client-ca.crt: {Name:mk71caa95e512e49d5f0bbeb9669d49d06067538 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:19:05.060774 674168 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19678-664237/.minikube/proxy-client-ca.key ...
I0920 18:19:05.060791 674168 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19678-664237/.minikube/proxy-client-ca.key: {Name:mk48c17978eac1b6467fd589c3690dfaad357164 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:19:05.060889 674168 certs.go:256] generating profile certs ...
I0920 18:19:05.060964 674168 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/client.key
I0920 18:19:05.060984 674168 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/client.crt with IP's: []
I0920 18:19:05.132709 674168 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/client.crt ...
I0920 18:19:05.132744 674168 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/client.crt: {Name:mk43ea5dca75753d8d8a5367831467eeceb0fdc3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:19:05.132939 674168 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/client.key ...
I0920 18:19:05.132959 674168 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/client.key: {Name:mk5d83dae2938d299506d1c5f284f55c2b17c66a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:19:05.133062 674168 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/apiserver.key.bc66e7af
I0920 18:19:05.133090 674168 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/apiserver.crt.bc66e7af with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I0920 18:19:05.307926 674168 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/apiserver.crt.bc66e7af ...
I0920 18:19:05.307962 674168 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/apiserver.crt.bc66e7af: {Name:mkae84dcee0d54761655975153f0afe30c8c5174 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:19:05.308152 674168 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/apiserver.key.bc66e7af ...
I0920 18:19:05.308174 674168 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/apiserver.key.bc66e7af: {Name:mkf96ba0fb78917c3ee6f7335dc544ffcc5224ee Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:19:05.308277 674168 certs.go:381] copying /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/apiserver.crt.bc66e7af -> /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/apiserver.crt
I0920 18:19:05.308379 674168 certs.go:385] copying /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/apiserver.key.bc66e7af -> /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/apiserver.key
I0920 18:19:05.308461 674168 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/proxy-client.key
I0920 18:19:05.308486 674168 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/proxy-client.crt with IP's: []
I0920 18:19:05.434100 674168 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/proxy-client.crt ...
I0920 18:19:05.434142 674168 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/proxy-client.crt: {Name:mk90e9baf01ada5513109eca2cf59bfe6b10cb9e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:19:05.434322 674168 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/proxy-client.key ...
I0920 18:19:05.434336 674168 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/proxy-client.key: {Name:mk97b476f9ae1a8b6c97412a5ae795e7d133f43b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:19:05.434511 674168 certs.go:484] found cert: /home/jenkins/minikube-integration/19678-664237/.minikube/certs/ca-key.pem (1679 bytes)
I0920 18:19:05.434549 674168 certs.go:484] found cert: /home/jenkins/minikube-integration/19678-664237/.minikube/certs/ca.pem (1078 bytes)
I0920 18:19:05.434571 674168 certs.go:484] found cert: /home/jenkins/minikube-integration/19678-664237/.minikube/certs/cert.pem (1123 bytes)
I0920 18:19:05.434592 674168 certs.go:484] found cert: /home/jenkins/minikube-integration/19678-664237/.minikube/certs/key.pem (1679 bytes)
I0920 18:19:05.435207 674168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19678-664237/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0920 18:19:05.458404 674168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19678-664237/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0920 18:19:05.481726 674168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19678-664237/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0920 18:19:05.504545 674168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19678-664237/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0920 18:19:05.526862 674168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0920 18:19:05.548944 674168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0920 18:19:05.571483 674168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0920 18:19:05.593408 674168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19678-664237/.minikube/profiles/addons-162403/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0920 18:19:05.615754 674168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19678-664237/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0920 18:19:05.638295 674168 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0920 18:19:05.654802 674168 ssh_runner.go:195] Run: openssl version
I0920 18:19:05.660087 674168 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0920 18:19:05.669718 674168 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0920 18:19:05.673149 674168 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 20 18:19 /usr/share/ca-certificates/minikubeCA.pem
I0920 18:19:05.673209 674168 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0920 18:19:05.679642 674168 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0920 18:19:05.689469 674168 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0920 18:19:05.692656 674168 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0920 18:19:05.692709 674168 kubeadm.go:392] StartCluster: {Name:addons-162403 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-162403 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmware
Path: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0920 18:19:05.692807 674168 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0920 18:19:05.692848 674168 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0920 18:19:05.726380 674168 cri.go:89] found id: ""
I0920 18:19:05.726441 674168 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0920 18:19:05.734945 674168 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0920 18:19:05.743371 674168 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0920 18:19:05.743434 674168 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0920 18:19:05.751458 674168 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0920 18:19:05.751486 674168 kubeadm.go:157] found existing configuration files:
I0920 18:19:05.751533 674168 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0920 18:19:05.759587 674168 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0920 18:19:05.759665 674168 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0920 18:19:05.767587 674168 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0920 18:19:05.775580 674168 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0920 18:19:05.775632 674168 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0920 18:19:05.783550 674168 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0920 18:19:05.791364 674168 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0920 18:19:05.791431 674168 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0920 18:19:05.799115 674168 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0920 18:19:05.806872 674168 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0920 18:19:05.806937 674168 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0920 18:19:05.814767 674168 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0920 18:19:05.849981 674168 kubeadm.go:310] [init] Using Kubernetes version: v1.31.1
I0920 18:19:05.850038 674168 kubeadm.go:310] [preflight] Running pre-flight checks
I0920 18:19:05.866359 674168 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0920 18:19:05.866451 674168 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1069-gcp[0m
I0920 18:19:05.866546 674168 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0920 18:19:05.866606 674168 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0920 18:19:05.866650 674168 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0920 18:19:05.866698 674168 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0920 18:19:05.866761 674168 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0920 18:19:05.866832 674168 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0920 18:19:05.866901 674168 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0920 18:19:05.866960 674168 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0920 18:19:05.867073 674168 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0920 18:19:05.867141 674168 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0920 18:19:05.916092 674168 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0920 18:19:05.916231 674168 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0920 18:19:05.916371 674168 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0920 18:19:05.923502 674168 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0920 18:19:05.926743 674168 out.go:235] - Generating certificates and keys ...
I0920 18:19:05.926857 674168 kubeadm.go:310] [certs] Using existing ca certificate authority
I0920 18:19:05.926930 674168 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0920 18:19:06.037108 674168 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0920 18:19:06.230359 674168 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0920 18:19:06.324616 674168 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0920 18:19:06.546085 674168 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0920 18:19:06.884456 674168 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0920 18:19:06.884577 674168 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-162403 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0920 18:19:07.307543 674168 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0920 18:19:07.307735 674168 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-162403 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0920 18:19:07.569020 674168 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0920 18:19:07.702458 674168 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0920 18:19:07.850614 674168 kubeadm.go:310] [certs] Generating "sa" key and public key
I0920 18:19:07.850743 674168 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0920 18:19:07.903971 674168 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0920 18:19:08.053888 674168 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0920 18:19:08.422419 674168 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0920 18:19:08.545791 674168 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0920 18:19:08.627541 674168 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0920 18:19:08.627956 674168 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0920 18:19:08.631231 674168 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0920 18:19:08.633449 674168 out.go:235] - Booting up control plane ...
I0920 18:19:08.633578 674168 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0920 18:19:08.633681 674168 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0920 18:19:08.633775 674168 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0920 18:19:08.645378 674168 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0920 18:19:08.650587 674168 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0920 18:19:08.650659 674168 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0920 18:19:08.727967 674168 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0920 18:19:08.728106 674168 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0920 18:19:09.229492 674168 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 501.337636ms
I0920 18:19:09.229658 674168 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0920 18:19:13.730791 674168 kubeadm.go:310] [api-check] The API server is healthy after 4.501479968s
I0920 18:19:13.742809 674168 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0920 18:19:13.755431 674168 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0920 18:19:13.774442 674168 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0920 18:19:13.774707 674168 kubeadm.go:310] [mark-control-plane] Marking the node addons-162403 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0920 18:19:13.782319 674168 kubeadm.go:310] [bootstrap-token] Using token: dfp0rr.g8klnxfszt90e7ou
I0920 18:19:13.783826 674168 out.go:235] - Configuring RBAC rules ...
I0920 18:19:13.783941 674168 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0920 18:19:13.787166 674168 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0920 18:19:13.793657 674168 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0920 18:19:13.797189 674168 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0920 18:19:13.799957 674168 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0920 18:19:13.802629 674168 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0920 18:19:14.139197 674168 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0920 18:19:14.568490 674168 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0920 18:19:15.136897 674168 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0920 18:19:15.137714 674168 kubeadm.go:310]
I0920 18:19:15.137780 674168 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0920 18:19:15.137788 674168 kubeadm.go:310]
I0920 18:19:15.137863 674168 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0920 18:19:15.137873 674168 kubeadm.go:310]
I0920 18:19:15.137906 674168 kubeadm.go:310] mkdir -p $HOME/.kube
I0920 18:19:15.138010 674168 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0920 18:19:15.138117 674168 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0920 18:19:15.138134 674168 kubeadm.go:310]
I0920 18:19:15.138208 674168 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0920 18:19:15.138217 674168 kubeadm.go:310]
I0920 18:19:15.138283 674168 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0920 18:19:15.138292 674168 kubeadm.go:310]
I0920 18:19:15.138391 674168 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0920 18:19:15.138525 674168 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0920 18:19:15.138624 674168 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0920 18:19:15.138640 674168 kubeadm.go:310]
I0920 18:19:15.138736 674168 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0920 18:19:15.138857 674168 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0920 18:19:15.138879 674168 kubeadm.go:310]
I0920 18:19:15.139024 674168 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token dfp0rr.g8klnxfszt90e7ou \
I0920 18:19:15.139190 674168 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:891ba1fd40a1e235f359f18998838e7bbc84a16cf5d5bbb3fe5b65a2c5d30bae \
I0920 18:19:15.139223 674168 kubeadm.go:310] --control-plane
I0920 18:19:15.139231 674168 kubeadm.go:310]
I0920 18:19:15.139332 674168 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0920 18:19:15.139342 674168 kubeadm.go:310]
I0920 18:19:15.139453 674168 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token dfp0rr.g8klnxfszt90e7ou \
I0920 18:19:15.139569 674168 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:891ba1fd40a1e235f359f18998838e7bbc84a16cf5d5bbb3fe5b65a2c5d30bae
I0920 18:19:15.141419 674168 kubeadm.go:310] W0920 18:19:05.847423 1289 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0920 18:19:15.141788 674168 kubeadm.go:310] W0920 18:19:05.848046 1289 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0920 18:19:15.141998 674168 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1069-gcp\n", err: exit status 1
I0920 18:19:15.142142 674168 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0920 18:19:15.142176 674168 cni.go:84] Creating CNI manager for ""
I0920 18:19:15.142184 674168 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0920 18:19:15.144217 674168 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0920 18:19:15.145705 674168 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0920 18:19:15.149559 674168 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.1/kubectl ...
I0920 18:19:15.149575 674168 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I0920 18:19:15.167148 674168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0920 18:19:15.359568 674168 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0920 18:19:15.359642 674168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 18:19:15.359669 674168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-162403 minikube.k8s.io/updated_at=2024_09_20T18_19_15_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=57d42ff8d541388826f5d9c37044129ec69c3d0a minikube.k8s.io/name=addons-162403 minikube.k8s.io/primary=true
I0920 18:19:15.367240 674168 ops.go:34] apiserver oom_adj: -16
I0920 18:19:15.462349 674168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 18:19:15.963384 674168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 18:19:16.462821 674168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 18:19:16.962540 674168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 18:19:17.463154 674168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 18:19:17.962489 674168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 18:19:18.463105 674168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 18:19:18.962640 674168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 18:19:19.463445 674168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 18:19:19.546496 674168 kubeadm.go:1113] duration metric: took 4.186919442s to wait for elevateKubeSystemPrivileges
I0920 18:19:19.546589 674168 kubeadm.go:394] duration metric: took 13.853885644s to StartCluster
I0920 18:19:19.546618 674168 settings.go:142] acquiring lock: {Name:mk3858ba4d2318954bc9bdba2ebdd7d07c1af964 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:19:19.546761 674168 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19678-664237/kubeconfig
I0920 18:19:19.547278 674168 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19678-664237/kubeconfig: {Name:mk211a7242c57e0384e62621e3b0b410c7b81ab3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:19:19.547568 674168 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I0920 18:19:19.547588 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0920 18:19:19.547603 674168 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I0920 18:19:19.547727 674168 addons.go:69] Setting cloud-spanner=true in profile "addons-162403"
I0920 18:19:19.547739 674168 addons.go:69] Setting yakd=true in profile "addons-162403"
I0920 18:19:19.547755 674168 addons.go:234] Setting addon cloud-spanner=true in "addons-162403"
I0920 18:19:19.547765 674168 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-162403"
I0920 18:19:19.547780 674168 addons.go:69] Setting metrics-server=true in profile "addons-162403"
I0920 18:19:19.547793 674168 host.go:66] Checking if "addons-162403" exists ...
I0920 18:19:19.547804 674168 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-162403"
I0920 18:19:19.547813 674168 addons.go:234] Setting addon metrics-server=true in "addons-162403"
I0920 18:19:19.547819 674168 config.go:182] Loaded profile config "addons-162403": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0920 18:19:19.547838 674168 host.go:66] Checking if "addons-162403" exists ...
I0920 18:19:19.547843 674168 host.go:66] Checking if "addons-162403" exists ...
I0920 18:19:19.547881 674168 addons.go:69] Setting storage-provisioner=true in profile "addons-162403"
I0920 18:19:19.547898 674168 addons.go:234] Setting addon storage-provisioner=true in "addons-162403"
I0920 18:19:19.547923 674168 host.go:66] Checking if "addons-162403" exists ...
I0920 18:19:19.548013 674168 addons.go:69] Setting ingress=true in profile "addons-162403"
I0920 18:19:19.548033 674168 addons.go:234] Setting addon ingress=true in "addons-162403"
I0920 18:19:19.548078 674168 host.go:66] Checking if "addons-162403" exists ...
I0920 18:19:19.548348 674168 cli_runner.go:164] Run: docker container inspect addons-162403 --format={{.State.Status}}
I0920 18:19:19.548368 674168 cli_runner.go:164] Run: docker container inspect addons-162403 --format={{.State.Status}}
I0920 18:19:19.548372 674168 cli_runner.go:164] Run: docker container inspect addons-162403 --format={{.State.Status}}
I0920 18:19:19.548394 674168 cli_runner.go:164] Run: docker container inspect addons-162403 --format={{.State.Status}}
I0920 18:19:19.548471 674168 addons.go:69] Setting default-storageclass=true in profile "addons-162403"
I0920 18:19:19.548500 674168 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-162403"
I0920 18:19:19.548533 674168 cli_runner.go:164] Run: docker container inspect addons-162403 --format={{.State.Status}}
I0920 18:19:19.548792 674168 cli_runner.go:164] Run: docker container inspect addons-162403 --format={{.State.Status}}
I0920 18:19:19.549033 674168 addons.go:69] Setting registry=true in profile "addons-162403"
I0920 18:19:19.549061 674168 addons.go:234] Setting addon registry=true in "addons-162403"
I0920 18:19:19.549095 674168 host.go:66] Checking if "addons-162403" exists ...
I0920 18:19:19.547756 674168 addons.go:234] Setting addon yakd=true in "addons-162403"
I0920 18:19:19.549524 674168 host.go:66] Checking if "addons-162403" exists ...
I0920 18:19:19.549550 674168 cli_runner.go:164] Run: docker container inspect addons-162403 --format={{.State.Status}}
I0920 18:19:19.549933 674168 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-162403"
I0920 18:19:19.549957 674168 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-162403"
I0920 18:19:19.550006 674168 cli_runner.go:164] Run: docker container inspect addons-162403 --format={{.State.Status}}
I0920 18:19:19.550197 674168 addons.go:69] Setting ingress-dns=true in profile "addons-162403"
I0920 18:19:19.550213 674168 cli_runner.go:164] Run: docker container inspect addons-162403 --format={{.State.Status}}
I0920 18:19:19.550225 674168 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-162403"
I0920 18:19:19.550238 674168 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-162403"
I0920 18:19:19.550263 674168 host.go:66] Checking if "addons-162403" exists ...
I0920 18:19:19.551201 674168 addons.go:69] Setting gcp-auth=true in profile "addons-162403"
I0920 18:19:19.554213 674168 addons.go:69] Setting inspektor-gadget=true in profile "addons-162403"
I0920 18:19:19.554281 674168 addons.go:69] Setting volcano=true in profile "addons-162403"
I0920 18:19:19.554302 674168 addons.go:234] Setting addon volcano=true in "addons-162403"
I0920 18:19:19.551386 674168 cli_runner.go:164] Run: docker container inspect addons-162403 --format={{.State.Status}}
I0920 18:19:19.550214 674168 addons.go:234] Setting addon ingress-dns=true in "addons-162403"
I0920 18:19:19.554827 674168 host.go:66] Checking if "addons-162403" exists ...
I0920 18:19:19.554304 674168 addons.go:234] Setting addon inspektor-gadget=true in "addons-162403"
I0920 18:19:19.555122 674168 host.go:66] Checking if "addons-162403" exists ...
I0920 18:19:19.555478 674168 cli_runner.go:164] Run: docker container inspect addons-162403 --format={{.State.Status}}
I0920 18:19:19.555674 674168 cli_runner.go:164] Run: docker container inspect addons-162403 --format={{.State.Status}}
I0920 18:19:19.554221 674168 mustload.go:65] Loading cluster: addons-162403
I0920 18:19:19.554183 674168 out.go:177] * Verifying Kubernetes components...
I0920 18:19:19.556337 674168 config.go:182] Loaded profile config "addons-162403": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0920 18:19:19.556799 674168 cli_runner.go:164] Run: docker container inspect addons-162403 --format={{.State.Status}}
I0920 18:19:19.554271 674168 addons.go:69] Setting volumesnapshots=true in profile "addons-162403"
I0920 18:19:19.557261 674168 addons.go:234] Setting addon volumesnapshots=true in "addons-162403"
I0920 18:19:19.557308 674168 host.go:66] Checking if "addons-162403" exists ...
I0920 18:19:19.559052 674168 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0920 18:19:19.569182 674168 host.go:66] Checking if "addons-162403" exists ...
I0920 18:19:19.588210 674168 cli_runner.go:164] Run: docker container inspect addons-162403 --format={{.State.Status}}
I0920 18:19:19.588739 674168 cli_runner.go:164] Run: docker container inspect addons-162403 --format={{.State.Status}}
I0920 18:19:19.588904 674168 out.go:177] - Using image docker.io/registry:2.8.3
I0920 18:19:19.588992 674168 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2
I0920 18:19:19.590309 674168 addons.go:234] Setting addon default-storageclass=true in "addons-162403"
I0920 18:19:19.590370 674168 host.go:66] Checking if "addons-162403" exists ...
I0920 18:19:19.590786 674168 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0920 18:19:19.590802 674168 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0920 18:19:19.590864 674168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-162403
I0920 18:19:19.590961 674168 cli_runner.go:164] Run: docker container inspect addons-162403 --format={{.State.Status}}
I0920 18:19:19.591935 674168 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
I0920 18:19:19.593751 674168 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
I0920 18:19:19.593775 674168 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I0920 18:19:19.593828 674168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-162403
I0920 18:19:19.601351 674168 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0920 18:19:19.601355 674168 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.23
I0920 18:19:19.601442 674168 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0920 18:19:19.603687 674168 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
I0920 18:19:19.603717 674168 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0920 18:19:19.603786 674168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-162403
I0920 18:19:19.604025 674168 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0920 18:19:19.608296 674168 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2
I0920 18:19:19.609371 674168 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0920 18:19:19.610117 674168 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0920 18:19:19.610142 674168 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I0920 18:19:19.610211 674168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-162403
I0920 18:19:19.612872 674168 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0920 18:19:19.614205 674168 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0920 18:19:19.615649 674168 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0920 18:19:19.616930 674168 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0920 18:19:19.618228 674168 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0920 18:19:19.618357 674168 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0920 18:19:19.619747 674168 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0920 18:19:19.619771 674168 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0920 18:19:19.619845 674168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-162403
I0920 18:19:19.620114 674168 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0920 18:19:19.624754 674168 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0920 18:19:19.624710 674168 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0920 18:19:19.624879 674168 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0920 18:19:19.624952 674168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-162403
I0920 18:19:19.628419 674168 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I0920 18:19:19.628839 674168 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0920 18:19:19.628880 674168 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0920 18:19:19.628974 674168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-162403
I0920 18:19:19.629898 674168 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
I0920 18:19:19.629920 674168 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0920 18:19:19.629986 674168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-162403
I0920 18:19:19.635925 674168 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0920 18:19:19.635951 674168 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0920 18:19:19.636128 674168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-162403
I0920 18:19:19.638673 674168 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0
I0920 18:19:19.638818 674168 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
I0920 18:19:19.641476 674168 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
I0920 18:19:19.641507 674168 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I0920 18:19:19.641586 674168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-162403
I0920 18:19:19.641902 674168 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0920 18:19:19.641918 674168 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0920 18:19:19.641968 674168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-162403
I0920 18:19:19.644063 674168 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I0920 18:19:19.647042 674168 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0920 18:19:19.647066 674168 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0920 18:19:19.647131 674168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-162403
I0920 18:19:19.651090 674168 host.go:66] Checking if "addons-162403" exists ...
I0920 18:19:19.672918 674168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19678-664237/.minikube/machines/addons-162403/id_rsa Username:docker}
I0920 18:19:19.673246 674168 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-162403"
I0920 18:19:19.673285 674168 host.go:66] Checking if "addons-162403" exists ...
I0920 18:19:19.673746 674168 cli_runner.go:164] Run: docker container inspect addons-162403 --format={{.State.Status}}
W0920 18:19:19.674079 674168 out.go:270] ! Enabling 'volcano' returned an error: running callbacks: [volcano addon does not support crio]
I0920 18:19:19.680928 674168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19678-664237/.minikube/machines/addons-162403/id_rsa Username:docker}
I0920 18:19:19.692356 674168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19678-664237/.minikube/machines/addons-162403/id_rsa Username:docker}
I0920 18:19:19.699068 674168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19678-664237/.minikube/machines/addons-162403/id_rsa Username:docker}
I0920 18:19:19.703084 674168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19678-664237/.minikube/machines/addons-162403/id_rsa Username:docker}
I0920 18:19:19.708959 674168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19678-664237/.minikube/machines/addons-162403/id_rsa Username:docker}
I0920 18:19:19.709724 674168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19678-664237/.minikube/machines/addons-162403/id_rsa Username:docker}
I0920 18:19:19.710034 674168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19678-664237/.minikube/machines/addons-162403/id_rsa Username:docker}
I0920 18:19:19.710800 674168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19678-664237/.minikube/machines/addons-162403/id_rsa Username:docker}
I0920 18:19:19.716097 674168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19678-664237/.minikube/machines/addons-162403/id_rsa Username:docker}
I0920 18:19:19.718252 674168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19678-664237/.minikube/machines/addons-162403/id_rsa Username:docker}
I0920 18:19:19.725687 674168 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0920 18:19:19.727095 674168 out.go:177] - Using image docker.io/busybox:stable
I0920 18:19:19.728444 674168 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0920 18:19:19.728469 674168 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0920 18:19:19.728535 674168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-162403
I0920 18:19:19.728936 674168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19678-664237/.minikube/machines/addons-162403/id_rsa Username:docker}
I0920 18:19:19.756378 674168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19678-664237/.minikube/machines/addons-162403/id_rsa Username:docker}
I0920 18:19:19.851667 674168 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0920 18:19:19.851869 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0920 18:19:19.958165 674168 node_ready.go:35] waiting up to 6m0s for node "addons-162403" to be "Ready" ...
I0920 18:19:20.049122 674168 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0920 18:19:20.059225 674168 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I0920 18:19:20.059328 674168 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I0920 18:19:20.143656 674168 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0920 18:19:20.143697 674168 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0920 18:19:20.162533 674168 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0920 18:19:20.248915 674168 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0920 18:19:20.252979 674168 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
I0920 18:19:20.253073 674168 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0920 18:19:20.253373 674168 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0920 18:19:20.255477 674168 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
I0920 18:19:20.255545 674168 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0920 18:19:20.344657 674168 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0920 18:19:20.344752 674168 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0920 18:19:20.344997 674168 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0920 18:19:20.347913 674168 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
I0920 18:19:20.347984 674168 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I0920 18:19:20.361494 674168 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0920 18:19:20.361598 674168 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0920 18:19:20.443778 674168 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0920 18:19:20.460111 674168 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
I0920 18:19:20.460213 674168 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0920 18:19:20.466113 674168 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0920 18:19:20.556027 674168 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
I0920 18:19:20.556125 674168 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0920 18:19:20.562330 674168 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I0920 18:19:20.562372 674168 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I0920 18:19:20.644614 674168 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0920 18:19:20.644712 674168 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0920 18:19:20.645083 674168 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0920 18:19:20.645155 674168 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0920 18:19:20.743572 674168 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0920 18:19:20.743665 674168 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0920 18:19:20.843761 674168 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0920 18:19:20.863489 674168 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I0920 18:19:20.863586 674168 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I0920 18:19:20.866991 674168 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
I0920 18:19:20.867029 674168 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0920 18:19:20.957725 674168 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0920 18:19:20.957824 674168 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0920 18:19:21.051014 674168 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0920 18:19:21.051107 674168 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0920 18:19:21.146711 674168 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0920 18:19:21.146794 674168 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0920 18:19:21.244660 674168 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I0920 18:19:21.244769 674168 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I0920 18:19:21.345912 674168 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0920 18:19:21.345949 674168 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0920 18:19:21.353497 674168 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0920 18:19:21.353530 674168 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0920 18:19:21.443980 674168 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (1.592066127s)
I0920 18:19:21.444142 674168 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I0920 18:19:21.446954 674168 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
I0920 18:19:21.447049 674168 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0920 18:19:21.451328 674168 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0920 18:19:21.556343 674168 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0920 18:19:21.567862 674168 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0920 18:19:21.643571 674168 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
I0920 18:19:21.643834 674168 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I0920 18:19:21.857128 674168 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0920 18:19:21.857204 674168 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0920 18:19:21.970271 674168 node_ready.go:53] node "addons-162403" has status "Ready":"False"
I0920 18:19:22.055373 674168 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-162403" context rescaled to 1 replicas
I0920 18:19:22.254875 674168 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0920 18:19:22.255007 674168 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0920 18:19:22.351603 674168 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
I0920 18:19:22.351644 674168 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
I0920 18:19:22.745266 674168 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0920 18:19:22.745357 674168 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0920 18:19:22.950177 674168 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0920 18:19:22.950262 674168 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0920 18:19:22.950772 674168 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I0920 18:19:22.958386 674168 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (2.909152791s)
I0920 18:19:23.143977 674168 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0920 18:19:23.144014 674168 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0920 18:19:23.344840 674168 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0920 18:19:23.344947 674168 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0920 18:19:23.463128 674168 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0920 18:19:23.463229 674168 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0920 18:19:23.654193 674168 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0920 18:19:23.862111 674168 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (3.699531854s)
I0920 18:19:24.153748 674168 node_ready.go:53] node "addons-162403" has status "Ready":"False"
I0920 18:19:25.659918 674168 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (5.410895641s)
I0920 18:19:25.659961 674168 addons.go:475] Verifying addon ingress=true in "addons-162403"
I0920 18:19:25.659999 674168 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (5.406542284s)
I0920 18:19:25.660093 674168 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (5.315030192s)
I0920 18:19:25.660129 674168 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (5.216231279s)
I0920 18:19:25.660205 674168 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (5.193997113s)
I0920 18:19:25.660276 674168 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (4.816413561s)
I0920 18:19:25.660308 674168 addons.go:475] Verifying addon registry=true in "addons-162403"
I0920 18:19:25.660382 674168 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (4.208965825s)
I0920 18:19:25.660442 674168 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (4.104058168s)
I0920 18:19:25.660445 674168 addons.go:475] Verifying addon metrics-server=true in "addons-162403"
I0920 18:19:25.661699 674168 out.go:177] * Verifying registry addon...
I0920 18:19:25.661755 674168 out.go:177] * Verifying ingress addon...
I0920 18:19:25.661868 674168 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-162403 service yakd-dashboard -n yakd-dashboard
I0920 18:19:25.663738 674168 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0920 18:19:25.664391 674168 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
W0920 18:19:25.668639 674168 out.go:270] ! Enabling 'storage-provisioner-rancher' returned an error: running callbacks: [Error making local-path the default storage class: Error while marking storage class local-path as default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]
I0920 18:19:25.668854 674168 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=registry
I0920 18:19:25.668871 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:25.768664 674168 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0920 18:19:25.768694 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:26.168189 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:26.168647 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:26.244777 674168 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (4.676860398s)
W0920 18:19:26.244890 674168 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0920 18:19:26.244939 674168 retry.go:31] will retry after 349.249211ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0920 18:19:26.244988 674168 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (3.294091803s)
I0920 18:19:26.461459 674168 node_ready.go:53] node "addons-162403" has status "Ready":"False"
I0920 18:19:26.574707 674168 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (2.92045562s)
I0920 18:19:26.574757 674168 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-162403"
I0920 18:19:26.577367 674168 out.go:177] * Verifying csi-hostpath-driver addon...
I0920 18:19:26.579563 674168 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0920 18:19:26.582943 674168 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0920 18:19:26.582960 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:26.594681 674168 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0920 18:19:26.683334 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:26.683674 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:26.858359 674168 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0920 18:19:26.858435 674168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-162403
I0920 18:19:26.875902 674168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19678-664237/.minikube/machines/addons-162403/id_rsa Username:docker}
I0920 18:19:26.984458 674168 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0920 18:19:27.001107 674168 addons.go:234] Setting addon gcp-auth=true in "addons-162403"
I0920 18:19:27.001163 674168 host.go:66] Checking if "addons-162403" exists ...
I0920 18:19:27.001520 674168 cli_runner.go:164] Run: docker container inspect addons-162403 --format={{.State.Status}}
I0920 18:19:27.018107 674168 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0920 18:19:27.018153 674168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-162403
I0920 18:19:27.035342 674168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19678-664237/.minikube/machines/addons-162403/id_rsa Username:docker}
I0920 18:19:27.083631 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:27.166744 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:27.168128 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:27.646290 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:27.669072 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:27.669418 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:28.084361 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:28.166640 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:28.168138 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:28.462238 674168 node_ready.go:53] node "addons-162403" has status "Ready":"False"
I0920 18:19:28.583099 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:28.667640 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:28.667978 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:29.084266 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:29.167817 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:29.168604 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:29.271367 674168 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.676631111s)
I0920 18:19:29.271432 674168 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (2.253291372s)
I0920 18:19:29.273273 674168 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0920 18:19:29.274673 674168 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
I0920 18:19:29.276361 674168 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0920 18:19:29.276382 674168 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0920 18:19:29.294783 674168 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0920 18:19:29.294816 674168 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0920 18:19:29.345482 674168 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0920 18:19:29.345506 674168 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I0920 18:19:29.363625 674168 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0920 18:19:29.583445 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:29.667504 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:29.668067 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:30.065330 674168 addons.go:475] Verifying addon gcp-auth=true in "addons-162403"
I0920 18:19:30.067623 674168 out.go:177] * Verifying gcp-auth addon...
I0920 18:19:30.070321 674168 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0920 18:19:30.073240 674168 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0920 18:19:30.073265 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:30.083449 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:30.167256 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:30.168040 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:30.574216 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:30.583194 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:30.667733 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:30.668045 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:30.961659 674168 node_ready.go:53] node "addons-162403" has status "Ready":"False"
I0920 18:19:31.073149 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:31.082855 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:31.168115 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:31.168666 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:31.573991 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:31.582620 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:31.667824 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:31.668352 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:32.073266 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:32.082897 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:32.167779 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:32.168380 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:32.574170 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:32.582879 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:32.667250 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:32.667809 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:33.074390 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:33.083130 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:33.168052 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:33.168329 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:33.461572 674168 node_ready.go:53] node "addons-162403" has status "Ready":"False"
I0920 18:19:33.574511 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:33.582999 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:33.667656 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:33.668054 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:34.073228 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:34.082952 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:34.168374 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:34.169326 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:34.573898 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:34.583235 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:34.666598 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:34.667851 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:35.074529 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:35.083233 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:35.166658 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:35.167884 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:35.573980 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:35.582504 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:35.667399 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:35.667855 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:35.960967 674168 node_ready.go:53] node "addons-162403" has status "Ready":"False"
I0920 18:19:36.073874 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:36.083242 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:36.166883 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:36.168404 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:36.574240 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:36.582733 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:36.667467 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:36.667953 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:37.073902 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:37.082616 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:37.167641 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:37.167921 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:37.573766 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:37.583480 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:37.666947 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:37.667458 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:37.961890 674168 node_ready.go:53] node "addons-162403" has status "Ready":"False"
I0920 18:19:38.073945 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:38.082640 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:38.167284 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:38.167840 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:38.574639 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:38.583506 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:38.667337 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:38.667789 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:39.073649 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:39.084058 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:39.167781 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:39.168107 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:39.574163 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:39.583050 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:39.666763 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:39.668155 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:40.073200 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:40.082825 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:40.167592 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:40.168195 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:40.461680 674168 node_ready.go:53] node "addons-162403" has status "Ready":"False"
I0920 18:19:40.573622 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:40.583124 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:40.666705 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:40.667590 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:41.073798 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:41.083878 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:41.167259 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:41.167696 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:41.573769 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:41.583407 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:41.667187 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:41.667621 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:42.073956 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:42.082469 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:42.167268 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:42.167773 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:42.573883 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:42.582802 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:42.667181 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:42.667648 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:42.960976 674168 node_ready.go:53] node "addons-162403" has status "Ready":"False"
I0920 18:19:43.073526 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:43.083195 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:43.167541 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:43.168076 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:43.574500 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:43.583094 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:43.667526 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:43.667955 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:44.073938 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:44.082232 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:44.167119 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:44.168254 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:44.573757 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:44.583299 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:44.666525 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:44.668092 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:44.961566 674168 node_ready.go:53] node "addons-162403" has status "Ready":"False"
I0920 18:19:45.074296 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:45.083265 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:45.166731 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:45.167803 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:45.573582 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:45.583070 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:45.666718 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:45.667763 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:46.074393 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:46.083026 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:46.167896 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:46.168469 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:46.573951 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:46.582611 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:46.667417 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:46.667835 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:47.074391 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:47.083342 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:47.167582 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:47.168016 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:47.461559 674168 node_ready.go:53] node "addons-162403" has status "Ready":"False"
I0920 18:19:47.573674 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:47.583550 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:47.667101 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:47.668093 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:48.074385 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:48.083357 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:48.166820 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:48.168052 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:48.574056 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:48.583138 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:48.667700 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:48.668170 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:49.073954 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:49.082550 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:49.167253 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:49.167689 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:49.573924 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:49.582493 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:49.667268 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:49.667713 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:49.961127 674168 node_ready.go:53] node "addons-162403" has status "Ready":"False"
I0920 18:19:50.074222 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:50.082751 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:50.167446 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:50.167837 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:50.573975 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:50.582446 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:50.667144 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:50.667725 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:51.073776 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:51.083555 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:51.167603 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:51.168082 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:51.573207 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:51.582872 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:51.667933 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:51.668639 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:51.961792 674168 node_ready.go:53] node "addons-162403" has status "Ready":"False"
I0920 18:19:52.073650 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:52.083774 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:52.167240 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:52.167803 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:52.574175 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:52.583088 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:52.667593 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:52.668073 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:53.074115 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:53.082843 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:53.167552 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:53.168250 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:53.574203 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:53.583096 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:53.666775 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:53.668043 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:54.073577 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:54.083165 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:54.166822 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:54.168120 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:54.461639 674168 node_ready.go:53] node "addons-162403" has status "Ready":"False"
I0920 18:19:54.573485 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:54.583094 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:54.667881 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:54.668272 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:55.074459 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:55.083676 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:55.167036 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:55.168063 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:55.574347 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:55.583185 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:55.666614 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:55.668023 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:56.074436 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:56.083017 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:56.167739 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:56.168067 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:56.574141 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:56.582595 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:56.667193 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:56.667702 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:56.961306 674168 node_ready.go:53] node "addons-162403" has status "Ready":"False"
I0920 18:19:57.073951 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:57.082426 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:57.167036 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:57.167619 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:57.574066 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:57.582553 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:57.667363 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:57.667862 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:58.074286 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:58.083053 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:58.168080 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:58.168562 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:58.574033 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:58.582834 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:58.667744 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:58.667977 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:59.074041 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:59.084503 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:59.167532 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:59.167866 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:19:59.461351 674168 node_ready.go:53] node "addons-162403" has status "Ready":"False"
I0920 18:19:59.574055 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:19:59.582662 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:19:59.667606 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:19:59.668345 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:00.074001 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:00.082537 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:00.167389 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:00.167781 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:00.573646 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:00.583513 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:00.667237 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:00.667751 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:01.074614 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:01.083606 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:01.167425 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:01.167849 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:01.574159 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:01.582763 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:01.667525 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:01.667967 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:01.961782 674168 node_ready.go:53] node "addons-162403" has status "Ready":"False"
I0920 18:20:02.073687 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:02.083273 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:02.167793 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:02.168126 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:02.573951 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:02.582489 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:02.667286 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:02.667673 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:03.074061 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:03.083043 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:03.167741 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:03.168186 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:03.574298 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:03.583319 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:03.667171 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:03.667926 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:03.963598 674168 node_ready.go:49] node "addons-162403" has status "Ready":"True"
I0920 18:20:03.963697 674168 node_ready.go:38] duration metric: took 44.005491387s for node "addons-162403" to be "Ready" ...
I0920 18:20:03.963739 674168 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0920 18:20:03.975991 674168 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-24mgs" in "kube-system" namespace to be "Ready" ...
I0920 18:20:04.073640 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:04.083934 674168 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0920 18:20:04.083964 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:04.166878 674168 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0920 18:20:04.166911 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:04.168046 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:04.574414 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:04.584293 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:04.668383 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:04.668692 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:05.077146 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:05.176605 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:05.176677 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:05.176971 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:05.574207 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:05.583569 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:05.668257 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:05.668609 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:05.982730 674168 pod_ready.go:93] pod "coredns-7c65d6cfc9-24mgs" in "kube-system" namespace has status "Ready":"True"
I0920 18:20:05.982753 674168 pod_ready.go:82] duration metric: took 2.006720801s for pod "coredns-7c65d6cfc9-24mgs" in "kube-system" namespace to be "Ready" ...
I0920 18:20:05.982772 674168 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-162403" in "kube-system" namespace to be "Ready" ...
I0920 18:20:05.987525 674168 pod_ready.go:93] pod "etcd-addons-162403" in "kube-system" namespace has status "Ready":"True"
I0920 18:20:05.987550 674168 pod_ready.go:82] duration metric: took 4.771792ms for pod "etcd-addons-162403" in "kube-system" namespace to be "Ready" ...
I0920 18:20:05.987564 674168 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-162403" in "kube-system" namespace to be "Ready" ...
I0920 18:20:05.992095 674168 pod_ready.go:93] pod "kube-apiserver-addons-162403" in "kube-system" namespace has status "Ready":"True"
I0920 18:20:05.992119 674168 pod_ready.go:82] duration metric: took 4.547516ms for pod "kube-apiserver-addons-162403" in "kube-system" namespace to be "Ready" ...
I0920 18:20:05.992133 674168 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-162403" in "kube-system" namespace to be "Ready" ...
I0920 18:20:05.996705 674168 pod_ready.go:93] pod "kube-controller-manager-addons-162403" in "kube-system" namespace has status "Ready":"True"
I0920 18:20:05.996728 674168 pod_ready.go:82] duration metric: took 4.58678ms for pod "kube-controller-manager-addons-162403" in "kube-system" namespace to be "Ready" ...
I0920 18:20:05.996742 674168 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-dd8cb" in "kube-system" namespace to be "Ready" ...
I0920 18:20:06.001096 674168 pod_ready.go:93] pod "kube-proxy-dd8cb" in "kube-system" namespace has status "Ready":"True"
I0920 18:20:06.001119 674168 pod_ready.go:82] duration metric: took 4.367688ms for pod "kube-proxy-dd8cb" in "kube-system" namespace to be "Ready" ...
I0920 18:20:06.001128 674168 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-162403" in "kube-system" namespace to be "Ready" ...
I0920 18:20:06.074611 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:06.084485 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:06.167894 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:06.168247 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:06.380446 674168 pod_ready.go:93] pod "kube-scheduler-addons-162403" in "kube-system" namespace has status "Ready":"True"
I0920 18:20:06.380470 674168 pod_ready.go:82] duration metric: took 379.335122ms for pod "kube-scheduler-addons-162403" in "kube-system" namespace to be "Ready" ...
I0920 18:20:06.380483 674168 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace to be "Ready" ...
I0920 18:20:06.573654 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:06.583209 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:06.669465 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:06.669865 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:07.074546 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:07.146700 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:07.168630 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:07.168936 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:07.574572 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:07.646002 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:07.668560 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:07.669087 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:08.074484 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:08.147135 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:08.168492 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:08.169815 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:08.387061 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:20:08.573949 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:08.583549 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:08.668848 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:08.669952 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:09.075164 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:09.085141 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:09.168450 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:09.168903 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:09.573956 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:09.584733 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:09.668231 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:09.668811 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:10.074046 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:10.084317 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:10.167605 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:10.168539 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:10.573990 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:10.584073 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:10.668505 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:10.668657 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:10.886466 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:20:11.074057 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:11.083511 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:11.168156 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:11.168499 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:11.574454 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:11.584057 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:11.667749 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:11.668163 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:12.074025 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:12.083478 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:12.167917 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:12.168149 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:12.573943 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:12.583638 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:12.667916 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:12.668188 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:13.074028 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:13.084332 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:13.167761 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:13.168109 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:13.385693 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:20:13.574062 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:13.675513 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:13.675988 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:13.676028 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:14.074341 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:14.083682 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:14.167388 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:14.168157 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:14.574641 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:14.584170 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:14.667163 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:14.668186 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:15.074157 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:15.083952 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:15.167738 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:15.168230 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:15.386551 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:20:15.573791 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:15.583941 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:15.667622 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:15.667966 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:16.074020 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:16.083830 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:16.167948 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:16.168175 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:16.574271 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:16.583559 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:16.668115 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:16.668332 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:17.074273 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:17.083969 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:17.167218 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:17.168238 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:17.574490 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:17.584137 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:17.667428 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:17.667780 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:17.886239 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:20:18.074428 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:18.084227 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:18.167720 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:18.168760 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:18.574681 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:18.583878 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:18.667539 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:18.668689 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:19.074506 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:19.085322 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:19.167619 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:19.168781 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:19.574399 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:19.584366 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:19.668321 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:19.669055 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:19.886419 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:20:20.074661 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:20.084728 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:20.170023 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:20.170213 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:20.574364 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:20.583499 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:20.667708 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:20.668118 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:21.074066 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:21.085062 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:21.167396 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:21.167749 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:21.573957 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:21.583844 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:21.675451 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:21.675661 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:22.073998 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:22.083732 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:22.169529 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:22.170522 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:22.386803 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:20:22.573870 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:22.584705 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:22.667943 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:22.668186 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:23.074421 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:23.175976 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:23.176483 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:23.176697 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:23.575070 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:23.584072 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:23.667372 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:23.668676 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:24.074257 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:24.083644 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:24.168228 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:24.168815 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:24.574187 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:24.583351 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:24.667456 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:24.668620 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:24.886478 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:20:25.073866 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:25.084524 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:25.168018 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:25.168513 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:25.574841 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:25.584539 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:25.667916 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:25.668455 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:26.074005 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:26.084351 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:26.167815 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:26.168130 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:26.573373 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:26.583700 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:26.667912 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:26.668223 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:27.075963 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:27.084215 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:27.167448 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:27.168236 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:27.385536 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:20:27.574802 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:27.584026 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:27.667459 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:27.667865 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:28.074427 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:28.083549 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:28.168099 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:28.168307 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:28.573283 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:28.583651 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:28.669993 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:28.670558 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:29.074299 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:29.083891 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:29.167292 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:29.168790 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:29.386904 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:20:29.574248 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:29.584292 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:29.667547 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:29.668470 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:30.073583 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:30.084840 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:30.168291 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:30.168832 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:30.573644 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:30.583792 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:30.667979 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:30.668523 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:31.073798 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:31.088101 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:31.167412 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:31.168798 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:31.574592 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:31.584104 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:31.676242 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:31.676685 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:31.886012 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:20:32.074267 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:32.083949 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:32.167984 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:32.168035 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:32.573758 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:32.584399 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:32.667787 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:32.668680 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:33.073761 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:33.084622 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:33.168481 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:33.169015 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:33.574492 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:33.584349 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:33.668163 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:33.668466 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:33.886108 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:20:34.074298 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:34.090815 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:34.168228 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:34.168607 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:34.574304 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:34.583500 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:34.667921 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:34.668346 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:35.074222 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:35.083544 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:35.168115 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:35.168346 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:35.574453 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:35.583475 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:35.668056 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:35.668420 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:36.074656 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:36.084839 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:36.175775 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:36.176052 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:36.385161 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:20:36.573863 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:36.583168 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:36.667584 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:36.667932 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:37.074532 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:37.084050 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:37.167729 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:37.168857 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:37.575013 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:37.584903 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:37.667711 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:37.670115 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:38.148918 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:38.150092 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:38.170322 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:38.171681 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:38.449562 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:20:38.647846 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:38.650638 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:38.671119 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:38.671851 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:39.073841 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:39.084303 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:39.168201 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:39.168689 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:39.574832 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:39.584265 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:39.668057 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:39.668652 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:40.075222 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:40.084398 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:40.169659 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:40.169875 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:40.573922 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:40.585047 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:40.667391 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:40.668328 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:40.885859 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:20:41.074071 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:41.084506 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:41.167576 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:41.168542 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:41.574344 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:41.584143 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:41.667456 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:41.669612 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:42.074595 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:42.086313 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:42.167749 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:42.168802 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:42.574390 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:42.584540 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:42.668039 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:42.668168 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:43.074796 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:43.084081 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:43.175684 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:43.176316 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:43.387608 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:20:43.574180 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:43.583921 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:43.668317 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:43.668557 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:44.074438 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:44.083995 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:44.175579 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:44.175990 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:44.574794 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:44.584211 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:44.667783 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:44.668012 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:45.075097 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:45.083848 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:45.167219 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:45.168396 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:45.574035 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:45.583614 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:45.667959 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:45.668489 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:45.886260 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:20:46.074149 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:46.084051 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:46.168119 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:46.168348 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:46.574489 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:46.583340 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:46.667980 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:46.668074 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:47.073991 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:47.084011 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:47.167606 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:47.167975 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:47.574409 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:47.584322 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:47.667960 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:47.668234 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:47.887147 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:20:48.074367 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:48.083559 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:48.168314 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:48.168688 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:48.574112 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:48.583378 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:48.667783 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:48.668071 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:49.074306 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:49.084220 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:49.167938 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:49.168189 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:49.574906 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:49.583879 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:49.667488 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:49.667893 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:49.887236 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:20:50.073693 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:50.084184 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:50.167541 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:50.168046 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:50.573701 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:50.584183 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:50.667813 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:50.668089 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:51.074194 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:51.083534 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:51.168108 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:51.168510 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:51.574767 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:51.584409 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:51.667685 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:51.668584 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:51.887461 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:20:52.074272 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:52.084298 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:52.167622 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:52.168343 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:52.574802 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:52.585518 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:52.667629 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:52.668294 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:53.074044 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:53.085119 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:53.167794 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:53.167902 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:53.574468 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:53.584721 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:53.668152 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:53.668429 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:54.074187 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:54.083549 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:54.167885 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:54.168463 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:54.386319 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:20:54.574862 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:54.584077 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:54.667752 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 18:20:54.668059 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:55.074806 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:55.083967 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:55.167246 674168 kapi.go:107] duration metric: took 1m29.503507069s to wait for kubernetes.io/minikube-addons=registry ...
I0920 18:20:55.168254 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:55.573690 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:55.584989 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:55.669563 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:56.159319 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:56.159900 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:56.244905 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:56.449078 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:20:56.574644 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:56.584810 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:56.668815 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:57.151274 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:57.151865 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:57.245823 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:57.648547 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:57.650051 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:57.747751 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:58.147934 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:58.148674 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:58.170132 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:58.573817 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:58.585119 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:58.668821 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:58.886841 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:20:59.074016 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:59.083075 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:59.169176 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:20:59.573960 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:20:59.586741 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:20:59.669373 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:21:00.074322 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:21:00.084055 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:21:00.168452 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:21:00.573877 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:21:00.584075 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:21:00.669220 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:21:01.074453 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:21:01.084094 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:21:01.169161 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:21:01.386983 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:21:01.574518 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:21:01.584431 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:21:01.668575 674168 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 18:21:02.074725 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:21:02.084554 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:21:02.169021 674168 kapi.go:107] duration metric: took 1m36.504626828s to wait for app.kubernetes.io/name=ingress-nginx ...
I0920 18:21:02.573607 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:21:02.584400 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:21:03.074502 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:21:03.084128 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:21:03.387306 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:21:03.574624 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:21:03.583947 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:21:04.074010 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:21:04.085435 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:21:04.574841 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 18:21:04.584904 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:21:05.074160 674168 kapi.go:107] duration metric: took 1m35.003835312s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0920 18:21:05.076015 674168 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-162403 cluster.
I0920 18:21:05.077316 674168 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0920 18:21:05.078763 674168 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0920 18:21:05.085221 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:21:05.387394 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:21:05.584431 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:21:06.084576 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:21:06.646888 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:21:07.085163 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:21:07.584837 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:21:07.887115 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:21:08.146524 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:21:08.584317 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:21:09.083918 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:21:09.584467 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:21:10.083578 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:21:10.386767 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:21:10.585465 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:21:11.084980 674168 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 18:21:11.585791 674168 kapi.go:107] duration metric: took 1m45.006228088s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0920 18:21:11.587570 674168 out.go:177] * Enabled addons: cloud-spanner, storage-provisioner, nvidia-device-plugin, ingress-dns, metrics-server, yakd, default-storageclass, inspektor-gadget, volumesnapshots, registry, ingress, gcp-auth, csi-hostpath-driver
I0920 18:21:11.588892 674168 addons.go:510] duration metric: took 1m52.041283386s for enable addons: enabled=[cloud-spanner storage-provisioner nvidia-device-plugin ingress-dns metrics-server yakd default-storageclass inspektor-gadget volumesnapshots registry ingress gcp-auth csi-hostpath-driver]
I0920 18:21:12.886529 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:21:14.886947 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:21:17.386798 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:21:19.886426 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:21:22.387024 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:21:24.886306 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:21:26.886543 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:21:28.887497 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:21:31.386454 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:21:33.886042 674168 pod_ready.go:103] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"False"
I0920 18:21:34.886898 674168 pod_ready.go:93] pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace has status "Ready":"True"
I0920 18:21:34.886922 674168 pod_ready.go:82] duration metric: took 1m28.50643262s for pod "metrics-server-84c5f94fbc-gr2ct" in "kube-system" namespace to be "Ready" ...
I0920 18:21:34.886933 674168 pod_ready.go:79] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-vkrvk" in "kube-system" namespace to be "Ready" ...
I0920 18:21:34.891249 674168 pod_ready.go:93] pod "nvidia-device-plugin-daemonset-vkrvk" in "kube-system" namespace has status "Ready":"True"
I0920 18:21:34.891272 674168 pod_ready.go:82] duration metric: took 4.331899ms for pod "nvidia-device-plugin-daemonset-vkrvk" in "kube-system" namespace to be "Ready" ...
I0920 18:21:34.891290 674168 pod_ready.go:39] duration metric: took 1m30.927531806s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0920 18:21:34.891322 674168 api_server.go:52] waiting for apiserver process to appear ...
I0920 18:21:34.891383 674168 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0920 18:21:34.891454 674168 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0920 18:21:34.925385 674168 cri.go:89] found id: "f38c04f167d002d7eaa0d6babf655173dc59197a2fdcb23e2deaf6c3ee073bc5"
I0920 18:21:34.925415 674168 cri.go:89] found id: ""
I0920 18:21:34.925427 674168 logs.go:276] 1 containers: [f38c04f167d002d7eaa0d6babf655173dc59197a2fdcb23e2deaf6c3ee073bc5]
I0920 18:21:34.925481 674168 ssh_runner.go:195] Run: which crictl
I0920 18:21:34.928881 674168 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0920 18:21:34.928961 674168 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0920 18:21:34.961773 674168 cri.go:89] found id: "c4ad43014a83bd695658fea9ff9e19cea193dfe2a46883a2dbe0413829b803b6"
I0920 18:21:34.961796 674168 cri.go:89] found id: ""
I0920 18:21:34.961806 674168 logs.go:276] 1 containers: [c4ad43014a83bd695658fea9ff9e19cea193dfe2a46883a2dbe0413829b803b6]
I0920 18:21:34.961860 674168 ssh_runner.go:195] Run: which crictl
I0920 18:21:34.965452 674168 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0920 18:21:34.965512 674168 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0920 18:21:34.997902 674168 cri.go:89] found id: "cdb59912f2e1480afebe02cdad2def98d0fc5c98298f195576dd3307877d9629"
I0920 18:21:34.997922 674168 cri.go:89] found id: ""
I0920 18:21:34.997930 674168 logs.go:276] 1 containers: [cdb59912f2e1480afebe02cdad2def98d0fc5c98298f195576dd3307877d9629]
I0920 18:21:34.997971 674168 ssh_runner.go:195] Run: which crictl
I0920 18:21:35.001467 674168 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0920 18:21:35.001538 674168 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0920 18:21:35.033709 674168 cri.go:89] found id: "249ac20417667d2249afd8ff66cf57fb6cf92d53e82089ed0ecb0e7fc1a31feb"
I0920 18:21:35.033737 674168 cri.go:89] found id: ""
I0920 18:21:35.033747 674168 logs.go:276] 1 containers: [249ac20417667d2249afd8ff66cf57fb6cf92d53e82089ed0ecb0e7fc1a31feb]
I0920 18:21:35.033796 674168 ssh_runner.go:195] Run: which crictl
I0920 18:21:35.037117 674168 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0920 18:21:35.037188 674168 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0920 18:21:35.070146 674168 cri.go:89] found id: "52c52923ef8ea0fe574b0abbae3590d5fdd4acc2ef2282c98e442504626a5fe6"
I0920 18:21:35.070171 674168 cri.go:89] found id: ""
I0920 18:21:35.070180 674168 logs.go:276] 1 containers: [52c52923ef8ea0fe574b0abbae3590d5fdd4acc2ef2282c98e442504626a5fe6]
I0920 18:21:35.070232 674168 ssh_runner.go:195] Run: which crictl
I0920 18:21:35.073666 674168 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0920 18:21:35.073742 674168 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0920 18:21:35.106480 674168 cri.go:89] found id: "4b71192f65f2de6df3616ddc8a6620b0c14723ea4d2ff122cde6d87305d3c284"
I0920 18:21:35.106505 674168 cri.go:89] found id: ""
I0920 18:21:35.106515 674168 logs.go:276] 1 containers: [4b71192f65f2de6df3616ddc8a6620b0c14723ea4d2ff122cde6d87305d3c284]
I0920 18:21:35.106579 674168 ssh_runner.go:195] Run: which crictl
I0920 18:21:35.109930 674168 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0920 18:21:35.110001 674168 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0920 18:21:35.143353 674168 cri.go:89] found id: "0a3bc23a91121ba80e4fb2bf2225373da2f40853ef60f395c1b7cc42335ba90d"
I0920 18:21:35.143373 674168 cri.go:89] found id: ""
I0920 18:21:35.143382 674168 logs.go:276] 1 containers: [0a3bc23a91121ba80e4fb2bf2225373da2f40853ef60f395c1b7cc42335ba90d]
I0920 18:21:35.143450 674168 ssh_runner.go:195] Run: which crictl
I0920 18:21:35.147158 674168 logs.go:123] Gathering logs for kube-scheduler [249ac20417667d2249afd8ff66cf57fb6cf92d53e82089ed0ecb0e7fc1a31feb] ...
I0920 18:21:35.147183 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 249ac20417667d2249afd8ff66cf57fb6cf92d53e82089ed0ecb0e7fc1a31feb"
I0920 18:21:35.186573 674168 logs.go:123] Gathering logs for kube-proxy [52c52923ef8ea0fe574b0abbae3590d5fdd4acc2ef2282c98e442504626a5fe6] ...
I0920 18:21:35.186608 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 52c52923ef8ea0fe574b0abbae3590d5fdd4acc2ef2282c98e442504626a5fe6"
I0920 18:21:35.219833 674168 logs.go:123] Gathering logs for CRI-O ...
I0920 18:21:35.219859 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0920 18:21:35.296767 674168 logs.go:123] Gathering logs for kubelet ...
I0920 18:21:35.296802 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0920 18:21:35.374733 674168 logs.go:123] Gathering logs for dmesg ...
I0920 18:21:35.374783 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0920 18:21:35.397401 674168 logs.go:123] Gathering logs for kube-apiserver [f38c04f167d002d7eaa0d6babf655173dc59197a2fdcb23e2deaf6c3ee073bc5] ...
I0920 18:21:35.397441 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f38c04f167d002d7eaa0d6babf655173dc59197a2fdcb23e2deaf6c3ee073bc5"
I0920 18:21:35.439718 674168 logs.go:123] Gathering logs for etcd [c4ad43014a83bd695658fea9ff9e19cea193dfe2a46883a2dbe0413829b803b6] ...
I0920 18:21:35.439747 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c4ad43014a83bd695658fea9ff9e19cea193dfe2a46883a2dbe0413829b803b6"
I0920 18:21:35.481086 674168 logs.go:123] Gathering logs for coredns [cdb59912f2e1480afebe02cdad2def98d0fc5c98298f195576dd3307877d9629] ...
I0920 18:21:35.481119 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cdb59912f2e1480afebe02cdad2def98d0fc5c98298f195576dd3307877d9629"
I0920 18:21:35.515899 674168 logs.go:123] Gathering logs for describe nodes ...
I0920 18:21:35.515944 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0920 18:21:35.614907 674168 logs.go:123] Gathering logs for kube-controller-manager [4b71192f65f2de6df3616ddc8a6620b0c14723ea4d2ff122cde6d87305d3c284] ...
I0920 18:21:35.614941 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4b71192f65f2de6df3616ddc8a6620b0c14723ea4d2ff122cde6d87305d3c284"
I0920 18:21:35.669956 674168 logs.go:123] Gathering logs for kindnet [0a3bc23a91121ba80e4fb2bf2225373da2f40853ef60f395c1b7cc42335ba90d] ...
I0920 18:21:35.669994 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0a3bc23a91121ba80e4fb2bf2225373da2f40853ef60f395c1b7cc42335ba90d"
I0920 18:21:35.705242 674168 logs.go:123] Gathering logs for container status ...
I0920 18:21:35.705275 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0920 18:21:38.247127 674168 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0920 18:21:38.261085 674168 api_server.go:72] duration metric: took 2m18.713476022s to wait for apiserver process to appear ...
I0920 18:21:38.261112 674168 api_server.go:88] waiting for apiserver healthz status ...
I0920 18:21:38.261153 674168 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0920 18:21:38.261198 674168 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0920 18:21:38.294652 674168 cri.go:89] found id: "f38c04f167d002d7eaa0d6babf655173dc59197a2fdcb23e2deaf6c3ee073bc5"
I0920 18:21:38.294675 674168 cri.go:89] found id: ""
I0920 18:21:38.294683 674168 logs.go:276] 1 containers: [f38c04f167d002d7eaa0d6babf655173dc59197a2fdcb23e2deaf6c3ee073bc5]
I0920 18:21:38.294728 674168 ssh_runner.go:195] Run: which crictl
I0920 18:21:38.297926 674168 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0920 18:21:38.298005 674168 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0920 18:21:38.330857 674168 cri.go:89] found id: "c4ad43014a83bd695658fea9ff9e19cea193dfe2a46883a2dbe0413829b803b6"
I0920 18:21:38.330877 674168 cri.go:89] found id: ""
I0920 18:21:38.330887 674168 logs.go:276] 1 containers: [c4ad43014a83bd695658fea9ff9e19cea193dfe2a46883a2dbe0413829b803b6]
I0920 18:21:38.330948 674168 ssh_runner.go:195] Run: which crictl
I0920 18:21:38.334140 674168 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0920 18:21:38.334194 674168 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0920 18:21:38.367218 674168 cri.go:89] found id: "cdb59912f2e1480afebe02cdad2def98d0fc5c98298f195576dd3307877d9629"
I0920 18:21:38.367245 674168 cri.go:89] found id: ""
I0920 18:21:38.367252 674168 logs.go:276] 1 containers: [cdb59912f2e1480afebe02cdad2def98d0fc5c98298f195576dd3307877d9629]
I0920 18:21:38.367293 674168 ssh_runner.go:195] Run: which crictl
I0920 18:21:38.370531 674168 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0920 18:21:38.370590 674168 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0920 18:21:38.403339 674168 cri.go:89] found id: "249ac20417667d2249afd8ff66cf57fb6cf92d53e82089ed0ecb0e7fc1a31feb"
I0920 18:21:38.403370 674168 cri.go:89] found id: ""
I0920 18:21:38.403378 674168 logs.go:276] 1 containers: [249ac20417667d2249afd8ff66cf57fb6cf92d53e82089ed0ecb0e7fc1a31feb]
I0920 18:21:38.403433 674168 ssh_runner.go:195] Run: which crictl
I0920 18:21:38.406801 674168 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0920 18:21:38.406872 674168 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0920 18:21:38.439882 674168 cri.go:89] found id: "52c52923ef8ea0fe574b0abbae3590d5fdd4acc2ef2282c98e442504626a5fe6"
I0920 18:21:38.439903 674168 cri.go:89] found id: ""
I0920 18:21:38.439912 674168 logs.go:276] 1 containers: [52c52923ef8ea0fe574b0abbae3590d5fdd4acc2ef2282c98e442504626a5fe6]
I0920 18:21:38.439969 674168 ssh_runner.go:195] Run: which crictl
I0920 18:21:38.443320 674168 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0920 18:21:38.443402 674168 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0920 18:21:38.476678 674168 cri.go:89] found id: "4b71192f65f2de6df3616ddc8a6620b0c14723ea4d2ff122cde6d87305d3c284"
I0920 18:21:38.476703 674168 cri.go:89] found id: ""
I0920 18:21:38.476712 674168 logs.go:276] 1 containers: [4b71192f65f2de6df3616ddc8a6620b0c14723ea4d2ff122cde6d87305d3c284]
I0920 18:21:38.476769 674168 ssh_runner.go:195] Run: which crictl
I0920 18:21:38.479997 674168 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0920 18:21:38.480061 674168 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0920 18:21:38.515213 674168 cri.go:89] found id: "0a3bc23a91121ba80e4fb2bf2225373da2f40853ef60f395c1b7cc42335ba90d"
I0920 18:21:38.515238 674168 cri.go:89] found id: ""
I0920 18:21:38.515246 674168 logs.go:276] 1 containers: [0a3bc23a91121ba80e4fb2bf2225373da2f40853ef60f395c1b7cc42335ba90d]
I0920 18:21:38.515302 674168 ssh_runner.go:195] Run: which crictl
I0920 18:21:38.518573 674168 logs.go:123] Gathering logs for kube-controller-manager [4b71192f65f2de6df3616ddc8a6620b0c14723ea4d2ff122cde6d87305d3c284] ...
I0920 18:21:38.518593 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4b71192f65f2de6df3616ddc8a6620b0c14723ea4d2ff122cde6d87305d3c284"
I0920 18:21:38.574209 674168 logs.go:123] Gathering logs for kubelet ...
I0920 18:21:38.574251 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0920 18:21:38.652350 674168 logs.go:123] Gathering logs for dmesg ...
I0920 18:21:38.652388 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0920 18:21:38.674362 674168 logs.go:123] Gathering logs for kube-apiserver [f38c04f167d002d7eaa0d6babf655173dc59197a2fdcb23e2deaf6c3ee073bc5] ...
I0920 18:21:38.674398 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f38c04f167d002d7eaa0d6babf655173dc59197a2fdcb23e2deaf6c3ee073bc5"
I0920 18:21:38.718009 674168 logs.go:123] Gathering logs for etcd [c4ad43014a83bd695658fea9ff9e19cea193dfe2a46883a2dbe0413829b803b6] ...
I0920 18:21:38.718043 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c4ad43014a83bd695658fea9ff9e19cea193dfe2a46883a2dbe0413829b803b6"
I0920 18:21:38.759722 674168 logs.go:123] Gathering logs for coredns [cdb59912f2e1480afebe02cdad2def98d0fc5c98298f195576dd3307877d9629] ...
I0920 18:21:38.759754 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cdb59912f2e1480afebe02cdad2def98d0fc5c98298f195576dd3307877d9629"
I0920 18:21:38.796446 674168 logs.go:123] Gathering logs for kube-scheduler [249ac20417667d2249afd8ff66cf57fb6cf92d53e82089ed0ecb0e7fc1a31feb] ...
I0920 18:21:38.796475 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 249ac20417667d2249afd8ff66cf57fb6cf92d53e82089ed0ecb0e7fc1a31feb"
I0920 18:21:38.840305 674168 logs.go:123] Gathering logs for describe nodes ...
I0920 18:21:38.840344 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0920 18:21:38.940656 674168 logs.go:123] Gathering logs for kube-proxy [52c52923ef8ea0fe574b0abbae3590d5fdd4acc2ef2282c98e442504626a5fe6] ...
I0920 18:21:38.940691 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 52c52923ef8ea0fe574b0abbae3590d5fdd4acc2ef2282c98e442504626a5fe6"
I0920 18:21:38.974579 674168 logs.go:123] Gathering logs for kindnet [0a3bc23a91121ba80e4fb2bf2225373da2f40853ef60f395c1b7cc42335ba90d] ...
I0920 18:21:38.974605 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0a3bc23a91121ba80e4fb2bf2225373da2f40853ef60f395c1b7cc42335ba90d"
I0920 18:21:39.009360 674168 logs.go:123] Gathering logs for CRI-O ...
I0920 18:21:39.009388 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0920 18:21:39.081734 674168 logs.go:123] Gathering logs for container status ...
I0920 18:21:39.081781 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0920 18:21:41.622849 674168 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I0920 18:21:41.627422 674168 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I0920 18:21:41.628424 674168 api_server.go:141] control plane version: v1.31.1
I0920 18:21:41.628450 674168 api_server.go:131] duration metric: took 3.367330033s to wait for apiserver health ...
I0920 18:21:41.628460 674168 system_pods.go:43] waiting for kube-system pods to appear ...
I0920 18:21:41.628488 674168 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0920 18:21:41.628545 674168 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0920 18:21:41.661458 674168 cri.go:89] found id: "f38c04f167d002d7eaa0d6babf655173dc59197a2fdcb23e2deaf6c3ee073bc5"
I0920 18:21:41.661477 674168 cri.go:89] found id: ""
I0920 18:21:41.661485 674168 logs.go:276] 1 containers: [f38c04f167d002d7eaa0d6babf655173dc59197a2fdcb23e2deaf6c3ee073bc5]
I0920 18:21:41.661531 674168 ssh_runner.go:195] Run: which crictl
I0920 18:21:41.664866 674168 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0920 18:21:41.664947 674168 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0920 18:21:41.699349 674168 cri.go:89] found id: "c4ad43014a83bd695658fea9ff9e19cea193dfe2a46883a2dbe0413829b803b6"
I0920 18:21:41.699374 674168 cri.go:89] found id: ""
I0920 18:21:41.699391 674168 logs.go:276] 1 containers: [c4ad43014a83bd695658fea9ff9e19cea193dfe2a46883a2dbe0413829b803b6]
I0920 18:21:41.699448 674168 ssh_runner.go:195] Run: which crictl
I0920 18:21:41.702834 674168 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0920 18:21:41.702894 674168 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0920 18:21:41.736614 674168 cri.go:89] found id: "cdb59912f2e1480afebe02cdad2def98d0fc5c98298f195576dd3307877d9629"
I0920 18:21:41.736638 674168 cri.go:89] found id: ""
I0920 18:21:41.736648 674168 logs.go:276] 1 containers: [cdb59912f2e1480afebe02cdad2def98d0fc5c98298f195576dd3307877d9629]
I0920 18:21:41.736696 674168 ssh_runner.go:195] Run: which crictl
I0920 18:21:41.740481 674168 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0920 18:21:41.740540 674168 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0920 18:21:41.775612 674168 cri.go:89] found id: "249ac20417667d2249afd8ff66cf57fb6cf92d53e82089ed0ecb0e7fc1a31feb"
I0920 18:21:41.775636 674168 cri.go:89] found id: ""
I0920 18:21:41.775644 674168 logs.go:276] 1 containers: [249ac20417667d2249afd8ff66cf57fb6cf92d53e82089ed0ecb0e7fc1a31feb]
I0920 18:21:41.775692 674168 ssh_runner.go:195] Run: which crictl
I0920 18:21:41.779048 674168 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0920 18:21:41.779108 674168 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0920 18:21:41.811224 674168 cri.go:89] found id: "52c52923ef8ea0fe574b0abbae3590d5fdd4acc2ef2282c98e442504626a5fe6"
I0920 18:21:41.811253 674168 cri.go:89] found id: ""
I0920 18:21:41.811261 674168 logs.go:276] 1 containers: [52c52923ef8ea0fe574b0abbae3590d5fdd4acc2ef2282c98e442504626a5fe6]
I0920 18:21:41.811313 674168 ssh_runner.go:195] Run: which crictl
I0920 18:21:41.814683 674168 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0920 18:21:41.814756 674168 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0920 18:21:41.847730 674168 cri.go:89] found id: "4b71192f65f2de6df3616ddc8a6620b0c14723ea4d2ff122cde6d87305d3c284"
I0920 18:21:41.847751 674168 cri.go:89] found id: ""
I0920 18:21:41.847761 674168 logs.go:276] 1 containers: [4b71192f65f2de6df3616ddc8a6620b0c14723ea4d2ff122cde6d87305d3c284]
I0920 18:21:41.847811 674168 ssh_runner.go:195] Run: which crictl
I0920 18:21:41.851164 674168 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0920 18:21:41.851221 674168 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0920 18:21:41.885935 674168 cri.go:89] found id: "0a3bc23a91121ba80e4fb2bf2225373da2f40853ef60f395c1b7cc42335ba90d"
I0920 18:21:41.885956 674168 cri.go:89] found id: ""
I0920 18:21:41.885964 674168 logs.go:276] 1 containers: [0a3bc23a91121ba80e4fb2bf2225373da2f40853ef60f395c1b7cc42335ba90d]
I0920 18:21:41.886013 674168 ssh_runner.go:195] Run: which crictl
I0920 18:21:41.889575 674168 logs.go:123] Gathering logs for coredns [cdb59912f2e1480afebe02cdad2def98d0fc5c98298f195576dd3307877d9629] ...
I0920 18:21:41.889598 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cdb59912f2e1480afebe02cdad2def98d0fc5c98298f195576dd3307877d9629"
I0920 18:21:41.924023 674168 logs.go:123] Gathering logs for kube-proxy [52c52923ef8ea0fe574b0abbae3590d5fdd4acc2ef2282c98e442504626a5fe6] ...
I0920 18:21:41.924054 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 52c52923ef8ea0fe574b0abbae3590d5fdd4acc2ef2282c98e442504626a5fe6"
I0920 18:21:41.957638 674168 logs.go:123] Gathering logs for kube-controller-manager [4b71192f65f2de6df3616ddc8a6620b0c14723ea4d2ff122cde6d87305d3c284] ...
I0920 18:21:41.957665 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4b71192f65f2de6df3616ddc8a6620b0c14723ea4d2ff122cde6d87305d3c284"
I0920 18:21:42.013803 674168 logs.go:123] Gathering logs for kindnet [0a3bc23a91121ba80e4fb2bf2225373da2f40853ef60f395c1b7cc42335ba90d] ...
I0920 18:21:42.013840 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0a3bc23a91121ba80e4fb2bf2225373da2f40853ef60f395c1b7cc42335ba90d"
I0920 18:21:42.052343 674168 logs.go:123] Gathering logs for kubelet ...
I0920 18:21:42.052375 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0920 18:21:42.135981 674168 logs.go:123] Gathering logs for dmesg ...
I0920 18:21:42.136020 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0920 18:21:42.164238 674168 logs.go:123] Gathering logs for describe nodes ...
I0920 18:21:42.164272 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0920 18:21:42.365506 674168 logs.go:123] Gathering logs for kube-apiserver [f38c04f167d002d7eaa0d6babf655173dc59197a2fdcb23e2deaf6c3ee073bc5] ...
I0920 18:21:42.365547 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f38c04f167d002d7eaa0d6babf655173dc59197a2fdcb23e2deaf6c3ee073bc5"
I0920 18:21:42.460595 674168 logs.go:123] Gathering logs for etcd [c4ad43014a83bd695658fea9ff9e19cea193dfe2a46883a2dbe0413829b803b6] ...
I0920 18:21:42.460631 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c4ad43014a83bd695658fea9ff9e19cea193dfe2a46883a2dbe0413829b803b6"
I0920 18:21:42.502829 674168 logs.go:123] Gathering logs for kube-scheduler [249ac20417667d2249afd8ff66cf57fb6cf92d53e82089ed0ecb0e7fc1a31feb] ...
I0920 18:21:42.502868 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 249ac20417667d2249afd8ff66cf57fb6cf92d53e82089ed0ecb0e7fc1a31feb"
I0920 18:21:42.557032 674168 logs.go:123] Gathering logs for CRI-O ...
I0920 18:21:42.557069 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0920 18:21:42.629398 674168 logs.go:123] Gathering logs for container status ...
I0920 18:21:42.629442 674168 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0920 18:21:45.182962 674168 system_pods.go:59] 18 kube-system pods found
I0920 18:21:45.183040 674168 system_pods.go:61] "coredns-7c65d6cfc9-24mgs" [ec3e74ab-0ca2-4944-a0ba-ab3e2e552a1f] Running
I0920 18:21:45.183051 674168 system_pods.go:61] "csi-hostpath-attacher-0" [057910a4-ea07-40ab-9129-a3c79903a5f9] Running
I0920 18:21:45.183057 674168 system_pods.go:61] "csi-hostpath-resizer-0" [2a6e070f-8f67-46ad-8e2e-e738b9224362] Running
I0920 18:21:45.183062 674168 system_pods.go:61] "csi-hostpathplugin-hgq4x" [d78d2043-38be-4774-a4e1-8f366b694e3f] Running
I0920 18:21:45.183069 674168 system_pods.go:61] "etcd-addons-162403" [cd967cd6-498a-436c-8ebf-10e541085240] Running
I0920 18:21:45.183078 674168 system_pods.go:61] "kindnet-j7fr4" [300d7753-4ee6-44db-818d-fdb1f602488b] Running
I0920 18:21:45.183085 674168 system_pods.go:61] "kube-apiserver-addons-162403" [057055c6-3f96-4763-b006-b61092360aef] Running
I0920 18:21:45.183094 674168 system_pods.go:61] "kube-controller-manager-addons-162403" [84fb95f0-0529-4bd3-8dd5-457189ef56cc] Running
I0920 18:21:45.183101 674168 system_pods.go:61] "kube-ingress-dns-minikube" [254c4909-b4eb-4c2a-9eaa-90c7d14bd7e5] Running
I0920 18:21:45.183110 674168 system_pods.go:61] "kube-proxy-dd8cb" [3cac319c-9057-4e29-ae2c-fb7870227b4b] Running
I0920 18:21:45.183116 674168 system_pods.go:61] "kube-scheduler-addons-162403" [aa393b8a-49e5-4aba-bb03-3843d62ed2d2] Running
I0920 18:21:45.183122 674168 system_pods.go:61] "metrics-server-84c5f94fbc-gr2ct" [aadc0160-94e3-4273-9d42-d0552af7ad61] Running
I0920 18:21:45.183129 674168 system_pods.go:61] "nvidia-device-plugin-daemonset-vkrvk" [e7dcaefe-b427-4947-b9f7-651ee1b219f8] Running
I0920 18:21:45.183137 674168 system_pods.go:61] "registry-66c9cd494c-b4j85" [88d02c55-38b5-4e2b-9986-5f7887226e63] Running
I0920 18:21:45.183144 674168 system_pods.go:61] "registry-proxy-x8xl5" [22fc174a-6a59-45df-b8e0-fd97f697901c] Running
I0920 18:21:45.183152 674168 system_pods.go:61] "snapshot-controller-56fcc65765-pdqqq" [a8386b62-336b-4071-af36-a2737b7f6933] Running
I0920 18:21:45.183158 674168 system_pods.go:61] "snapshot-controller-56fcc65765-qx6cd" [369755b7-0a45-437e-93c3-c52c7bc63bfd] Running
I0920 18:21:45.183165 674168 system_pods.go:61] "storage-provisioner" [f20bb24d-0c61-4464-93b8-2f32abbe2465] Running
I0920 18:21:45.183175 674168 system_pods.go:74] duration metric: took 3.554706193s to wait for pod list to return data ...
I0920 18:21:45.183191 674168 default_sa.go:34] waiting for default service account to be created ...
I0920 18:21:45.185616 674168 default_sa.go:45] found service account: "default"
I0920 18:21:45.185637 674168 default_sa.go:55] duration metric: took 2.436616ms for default service account to be created ...
I0920 18:21:45.185645 674168 system_pods.go:116] waiting for k8s-apps to be running ...
I0920 18:21:45.193659 674168 system_pods.go:86] 18 kube-system pods found
I0920 18:21:45.193684 674168 system_pods.go:89] "coredns-7c65d6cfc9-24mgs" [ec3e74ab-0ca2-4944-a0ba-ab3e2e552a1f] Running
I0920 18:21:45.193693 674168 system_pods.go:89] "csi-hostpath-attacher-0" [057910a4-ea07-40ab-9129-a3c79903a5f9] Running
I0920 18:21:45.193697 674168 system_pods.go:89] "csi-hostpath-resizer-0" [2a6e070f-8f67-46ad-8e2e-e738b9224362] Running
I0920 18:21:45.193700 674168 system_pods.go:89] "csi-hostpathplugin-hgq4x" [d78d2043-38be-4774-a4e1-8f366b694e3f] Running
I0920 18:21:45.193704 674168 system_pods.go:89] "etcd-addons-162403" [cd967cd6-498a-436c-8ebf-10e541085240] Running
I0920 18:21:45.193708 674168 system_pods.go:89] "kindnet-j7fr4" [300d7753-4ee6-44db-818d-fdb1f602488b] Running
I0920 18:21:45.193712 674168 system_pods.go:89] "kube-apiserver-addons-162403" [057055c6-3f96-4763-b006-b61092360aef] Running
I0920 18:21:45.193715 674168 system_pods.go:89] "kube-controller-manager-addons-162403" [84fb95f0-0529-4bd3-8dd5-457189ef56cc] Running
I0920 18:21:45.193719 674168 system_pods.go:89] "kube-ingress-dns-minikube" [254c4909-b4eb-4c2a-9eaa-90c7d14bd7e5] Running
I0920 18:21:45.193723 674168 system_pods.go:89] "kube-proxy-dd8cb" [3cac319c-9057-4e29-ae2c-fb7870227b4b] Running
I0920 18:21:45.193726 674168 system_pods.go:89] "kube-scheduler-addons-162403" [aa393b8a-49e5-4aba-bb03-3843d62ed2d2] Running
I0920 18:21:45.193730 674168 system_pods.go:89] "metrics-server-84c5f94fbc-gr2ct" [aadc0160-94e3-4273-9d42-d0552af7ad61] Running
I0920 18:21:45.193733 674168 system_pods.go:89] "nvidia-device-plugin-daemonset-vkrvk" [e7dcaefe-b427-4947-b9f7-651ee1b219f8] Running
I0920 18:21:45.193737 674168 system_pods.go:89] "registry-66c9cd494c-b4j85" [88d02c55-38b5-4e2b-9986-5f7887226e63] Running
I0920 18:21:45.193741 674168 system_pods.go:89] "registry-proxy-x8xl5" [22fc174a-6a59-45df-b8e0-fd97f697901c] Running
I0920 18:21:45.193744 674168 system_pods.go:89] "snapshot-controller-56fcc65765-pdqqq" [a8386b62-336b-4071-af36-a2737b7f6933] Running
I0920 18:21:45.193749 674168 system_pods.go:89] "snapshot-controller-56fcc65765-qx6cd" [369755b7-0a45-437e-93c3-c52c7bc63bfd] Running
I0920 18:21:45.193755 674168 system_pods.go:89] "storage-provisioner" [f20bb24d-0c61-4464-93b8-2f32abbe2465] Running
I0920 18:21:45.193761 674168 system_pods.go:126] duration metric: took 8.110899ms to wait for k8s-apps to be running ...
I0920 18:21:45.193769 674168 system_svc.go:44] waiting for kubelet service to be running ....
I0920 18:21:45.193838 674168 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0920 18:21:45.204913 674168 system_svc.go:56] duration metric: took 11.134209ms WaitForService to wait for kubelet
I0920 18:21:45.204952 674168 kubeadm.go:582] duration metric: took 2m25.657338244s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0920 18:21:45.204980 674168 node_conditions.go:102] verifying NodePressure condition ...
I0920 18:21:45.208110 674168 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I0920 18:21:45.208138 674168 node_conditions.go:123] node cpu capacity is 8
I0920 18:21:45.208151 674168 node_conditions.go:105] duration metric: took 3.164779ms to run NodePressure ...
I0920 18:21:45.208162 674168 start.go:241] waiting for startup goroutines ...
I0920 18:21:45.208172 674168 start.go:246] waiting for cluster config update ...
I0920 18:21:45.208187 674168 start.go:255] writing updated cluster config ...
I0920 18:21:45.208459 674168 ssh_runner.go:195] Run: rm -f paused
I0920 18:21:45.256980 674168 start.go:600] kubectl: 1.31.1, cluster: 1.31.1 (minor skew: 0)
I0920 18:21:45.259386 674168 out.go:177] * Done! kubectl is now configured to use "addons-162403" cluster and "default" namespace by default
==> CRI-O <==
Sep 20 18:30:58 addons-162403 crio[1027]: time="2024-09-20 18:30:58.265826346Z" level=info msg="Stopped pod sandbox: 6d6823671fbf5b3c97f34185ba1699644ee30f5d998917b1efeaaafd6f87508c" id=e94bedda-6682-45be-ae27-af226a6d2192 name=/runtime.v1.RuntimeService/StopPodSandbox
Sep 20 18:30:58 addons-162403 crio[1027]: time="2024-09-20 18:30:58.637617225Z" level=info msg="Stopping pod sandbox: 0ba9d92a886666e277d1a77473280b858470edf50139ad59e4725b9410fde026" id=86d54b08-b23d-426d-92c0-d940d855114c name=/runtime.v1.RuntimeService/StopPodSandbox
Sep 20 18:30:58 addons-162403 crio[1027]: time="2024-09-20 18:30:58.637895739Z" level=info msg="Got pod network &{Name:helper-pod-delete-pvc-7362d9da-c19d-46d1-ab52-e395c2ebef40 Namespace:local-path-storage ID:0ba9d92a886666e277d1a77473280b858470edf50139ad59e4725b9410fde026 UID:eb65929f-27e6-4012-a9f1-921e7fddf300 NetNS:/var/run/netns/1ec72951-c564-4216-b835-88ef618f08d0 Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
Sep 20 18:30:58 addons-162403 crio[1027]: time="2024-09-20 18:30:58.638025166Z" level=info msg="Deleting pod local-path-storage_helper-pod-delete-pvc-7362d9da-c19d-46d1-ab52-e395c2ebef40 from CNI network \"kindnet\" (type=ptp)"
Sep 20 18:30:58 addons-162403 crio[1027]: time="2024-09-20 18:30:58.673021091Z" level=info msg="Stopped pod sandbox: 0ba9d92a886666e277d1a77473280b858470edf50139ad59e4725b9410fde026" id=86d54b08-b23d-426d-92c0-d940d855114c name=/runtime.v1.RuntimeService/StopPodSandbox
Sep 20 18:30:58 addons-162403 crio[1027]: time="2024-09-20 18:30:58.844915037Z" level=info msg="Stopping container: 9a925ce8e486b92b61470f49566a300f40c75d174636e393e75f8ce8457c995c (timeout: 30s)" id=29a1b552-d7f3-4ee5-a45d-13390428b801 name=/runtime.v1.RuntimeService/StopContainer
Sep 20 18:30:58 addons-162403 crio[1027]: time="2024-09-20 18:30:58.852829616Z" level=info msg="Stopping container: d21fcca2d833bfd9ad19b75aa19b9517b2e11e7fcb5f84ad75e68fe174a3c9ab (timeout: 30s)" id=d7a0da22-f8ca-42e1-8a68-95b1a0f240c6 name=/runtime.v1.RuntimeService/StopContainer
Sep 20 18:30:58 addons-162403 conmon[3602]: conmon 9a925ce8e486b92b6147 <ninfo>: container 3614 exited with status 2
Sep 20 18:30:58 addons-162403 crio[1027]: time="2024-09-20 18:30:58.983168221Z" level=info msg="Stopped container 9a925ce8e486b92b61470f49566a300f40c75d174636e393e75f8ce8457c995c: kube-system/registry-66c9cd494c-b4j85/registry" id=29a1b552-d7f3-4ee5-a45d-13390428b801 name=/runtime.v1.RuntimeService/StopContainer
Sep 20 18:30:58 addons-162403 crio[1027]: time="2024-09-20 18:30:58.983741443Z" level=info msg="Stopping pod sandbox: 85a92a0cdec73c0a27917fe6236b4fabbf97c0ff38c1a1faae33280858276530" id=d445248a-e213-4803-9a1c-228ca13699b1 name=/runtime.v1.RuntimeService/StopPodSandbox
Sep 20 18:30:58 addons-162403 crio[1027]: time="2024-09-20 18:30:58.983990476Z" level=info msg="Got pod network &{Name:registry-66c9cd494c-b4j85 Namespace:kube-system ID:85a92a0cdec73c0a27917fe6236b4fabbf97c0ff38c1a1faae33280858276530 UID:88d02c55-38b5-4e2b-9986-5f7887226e63 NetNS:/var/run/netns/0fe4863b-d363-458f-b9a7-f27f7a5401e2 Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
Sep 20 18:30:58 addons-162403 crio[1027]: time="2024-09-20 18:30:58.984119591Z" level=info msg="Deleting pod kube-system_registry-66c9cd494c-b4j85 from CNI network \"kindnet\" (type=ptp)"
Sep 20 18:30:58 addons-162403 crio[1027]: time="2024-09-20 18:30:58.995695871Z" level=info msg="Stopped container d21fcca2d833bfd9ad19b75aa19b9517b2e11e7fcb5f84ad75e68fe174a3c9ab: kube-system/registry-proxy-x8xl5/registry-proxy" id=d7a0da22-f8ca-42e1-8a68-95b1a0f240c6 name=/runtime.v1.RuntimeService/StopContainer
Sep 20 18:30:58 addons-162403 crio[1027]: time="2024-09-20 18:30:58.996210806Z" level=info msg="Stopping pod sandbox: 84e1a75570af9fa78d3504540cca639b8463a0b59560146e3f5128be842bacef" id=fb0f533f-97d4-4917-8714-a7739840fff4 name=/runtime.v1.RuntimeService/StopPodSandbox
Sep 20 18:30:58 addons-162403 crio[1027]: time="2024-09-20 18:30:58.999501071Z" level=info msg="Restoring iptables rules: *nat\n:KUBE-HP-4SI7UYJFV3VI6VVJ - [0:0]\n:KUBE-HP-CES6DKWF2DTVLYWJ - [0:0]\n:KUBE-HOSTPORTS - [0:0]\n:KUBE-HP-BGP27PFMIVWJTECO - [0:0]\n-A KUBE-HOSTPORTS -p tcp -m comment --comment \"k8s_ingress-nginx-controller-bc57996ff-wxtns_ingress-nginx_682363dd-9574-4aa6-b0df-2d77ce4696a9_0_ hostport 443\" -m tcp --dport 443 -j KUBE-HP-BGP27PFMIVWJTECO\n-A KUBE-HOSTPORTS -p tcp -m comment --comment \"k8s_ingress-nginx-controller-bc57996ff-wxtns_ingress-nginx_682363dd-9574-4aa6-b0df-2d77ce4696a9_0_ hostport 80\" -m tcp --dport 80 -j KUBE-HP-4SI7UYJFV3VI6VVJ\n-A KUBE-HP-4SI7UYJFV3VI6VVJ -s 10.244.0.19/32 -m comment --comment \"k8s_ingress-nginx-controller-bc57996ff-wxtns_ingress-nginx_682363dd-9574-4aa6-b0df-2d77ce4696a9_0_ hostport 80\" -j KUBE-MARK-MASQ\n-A KUBE-HP-4SI7UYJFV3VI6VVJ -p tcp -m comment --comment \"k8s_ingress-nginx-controller-bc57996ff-wxtns_ingress-nginx_682363dd-9574-4aa6-b0
df-2d77ce4696a9_0_ hostport 80\" -m tcp -j DNAT --to-destination 10.244.0.19:80\n-A KUBE-HP-BGP27PFMIVWJTECO -s 10.244.0.19/32 -m comment --comment \"k8s_ingress-nginx-controller-bc57996ff-wxtns_ingress-nginx_682363dd-9574-4aa6-b0df-2d77ce4696a9_0_ hostport 443\" -j KUBE-MARK-MASQ\n-A KUBE-HP-BGP27PFMIVWJTECO -p tcp -m comment --comment \"k8s_ingress-nginx-controller-bc57996ff-wxtns_ingress-nginx_682363dd-9574-4aa6-b0df-2d77ce4696a9_0_ hostport 443\" -m tcp -j DNAT --to-destination 10.244.0.19:443\n-X KUBE-HP-CES6DKWF2DTVLYWJ\nCOMMIT\n"
Sep 20 18:30:59 addons-162403 crio[1027]: time="2024-09-20 18:30:59.003099511Z" level=info msg="Closing host port tcp:5000"
Sep 20 18:30:59 addons-162403 crio[1027]: time="2024-09-20 18:30:59.004878643Z" level=info msg="Host port tcp:5000 does not have an open socket"
Sep 20 18:30:59 addons-162403 crio[1027]: time="2024-09-20 18:30:59.005033946Z" level=info msg="Got pod network &{Name:registry-proxy-x8xl5 Namespace:kube-system ID:84e1a75570af9fa78d3504540cca639b8463a0b59560146e3f5128be842bacef UID:22fc174a-6a59-45df-b8e0-fd97f697901c NetNS:/var/run/netns/d37aa70d-347e-4c0c-8475-2791b22672d0 Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
Sep 20 18:30:59 addons-162403 crio[1027]: time="2024-09-20 18:30:59.005164366Z" level=info msg="Deleting pod kube-system_registry-proxy-x8xl5 from CNI network \"kindnet\" (type=ptp)"
Sep 20 18:30:59 addons-162403 crio[1027]: time="2024-09-20 18:30:59.020158499Z" level=info msg="Stopped pod sandbox: 85a92a0cdec73c0a27917fe6236b4fabbf97c0ff38c1a1faae33280858276530" id=d445248a-e213-4803-9a1c-228ca13699b1 name=/runtime.v1.RuntimeService/StopPodSandbox
Sep 20 18:30:59 addons-162403 crio[1027]: time="2024-09-20 18:30:59.052498702Z" level=info msg="Stopped pod sandbox: 84e1a75570af9fa78d3504540cca639b8463a0b59560146e3f5128be842bacef" id=fb0f533f-97d4-4917-8714-a7739840fff4 name=/runtime.v1.RuntimeService/StopPodSandbox
Sep 20 18:30:59 addons-162403 crio[1027]: time="2024-09-20 18:30:59.651413131Z" level=info msg="Removing container: 9a925ce8e486b92b61470f49566a300f40c75d174636e393e75f8ce8457c995c" id=402e4e64-935f-41ed-a7ef-028b85e0b175 name=/runtime.v1.RuntimeService/RemoveContainer
Sep 20 18:31:00 addons-162403 crio[1027]: time="2024-09-20 18:31:00.156414820Z" level=info msg="Removed container 9a925ce8e486b92b61470f49566a300f40c75d174636e393e75f8ce8457c995c: kube-system/registry-66c9cd494c-b4j85/registry" id=402e4e64-935f-41ed-a7ef-028b85e0b175 name=/runtime.v1.RuntimeService/RemoveContainer
Sep 20 18:31:00 addons-162403 crio[1027]: time="2024-09-20 18:31:00.167188428Z" level=info msg="Removing container: d21fcca2d833bfd9ad19b75aa19b9517b2e11e7fcb5f84ad75e68fe174a3c9ab" id=a1ed3052-82eb-4ee1-bd52-60111fdb2ffd name=/runtime.v1.RuntimeService/RemoveContainer
Sep 20 18:31:00 addons-162403 crio[1027]: time="2024-09-20 18:31:00.184163663Z" level=info msg="Removed container d21fcca2d833bfd9ad19b75aa19b9517b2e11e7fcb5f84ad75e68fe174a3c9ab: kube-system/registry-proxy-x8xl5/registry-proxy" id=a1ed3052-82eb-4ee1-bd52-60111fdb2ffd name=/runtime.v1.RuntimeService/RemoveContainer
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
4f0ceefe2e514 a416a98b71e224a31ee99cff8e16063554498227d2b696152a9c3e0aa65e5824 4 seconds ago Exited helper-pod 0 0ba9d92a88666 helper-pod-delete-pvc-7362d9da-c19d-46d1-ab52-e395c2ebef40
c25d2267ccfdd docker.io/library/nginx@sha256:074604130336e3c431b7c6b5b551b5a6ae5b67db13b3d223c6db638f85c7ff56 44 seconds ago Running nginx 0 6293a840e0f65 nginx
167a7699d2ad7 gcr.io/k8s-minikube/gcp-auth-webhook@sha256:507b9d2f77a65700ff2462a02aa2c83780ff74ecb06c9275c5b5b9b1fa44269b 9 minutes ago Running gcp-auth 0 cff5d95699f6e gcp-auth-89d5ffd79-742xn
4e295275fa2d8 registry.k8s.io/ingress-nginx/controller@sha256:401d25a09ee8fe9fd9d33c5051531e8ebfa4ded95ff09830af8cc48c8e5aeaa6 9 minutes ago Running controller 0 09e264dfd2260 ingress-nginx-controller-bc57996ff-wxtns
5e23c290c5292 registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:1b792367d0e1350ee869b15f851d9e4de17db10f33fadaef628db3e6457aa012 10 minutes ago Exited patch 0 13a96ce846052 ingress-nginx-admission-patch-8jqwt
5d495cc4d007d docker.io/rancher/local-path-provisioner@sha256:73f712e7af12b06720c35ce75217f904f00e4bd96de79f8db1cf160112e667ef 10 minutes ago Running local-path-provisioner 0 2a8ec889be7b5 local-path-provisioner-86d989889c-v5k84
acca616b5cd64 registry.k8s.io/metrics-server/metrics-server@sha256:78e46b57096ec75e302fbc853e36359555df5c827bb009ecfe66f97474cc2a5a 10 minutes ago Running metrics-server 0 6a8890c1b1e3b metrics-server-84c5f94fbc-gr2ct
2cb6bb0b06bb3 registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:1b792367d0e1350ee869b15f851d9e4de17db10f33fadaef628db3e6457aa012 10 minutes ago Exited create 0 fe30db5645655 ingress-nginx-admission-create-ct9rs
bffafc70e2bfb gcr.io/k8s-minikube/minikube-ingress-dns@sha256:07c8f5b205a3f8971bfc6d460978ae00de35f17e5d5392b1de8de02356f85dab 10 minutes ago Running minikube-ingress-dns 0 677f6adbe7c56 kube-ingress-dns-minikube
cdb59912f2e14 c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6 10 minutes ago Running coredns 0 10529a41c309c coredns-7c65d6cfc9-24mgs
525f045aa748e 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 10 minutes ago Running storage-provisioner 0 612ce81908c78 storage-provisioner
0a3bc23a91121 12968670680f4561ef6818782391eb120d6e3365cf3f967aad58749f95381a4f 11 minutes ago Running kindnet-cni 0 7f6e1d53fda98 kindnet-j7fr4
52c52923ef8ea 60c005f310ff3ad6d131805170f07d2946095307063eaaa5eedcaf06a0a89561 11 minutes ago Running kube-proxy 0 ae303bad1ebff kube-proxy-dd8cb
4b71192f65f2d 175ffd71cce3d90bae95904b55260db941b10007a4e5471a19f3135b30aa9cd1 11 minutes ago Running kube-controller-manager 0 2a41178034cbc kube-controller-manager-addons-162403
249ac20417667 9aa1fad941575eed91ab13d44f3e4cb5b1ff4e09cbbe954ea63002289416a13b 11 minutes ago Running kube-scheduler 0 e48f7866753bd kube-scheduler-addons-162403
c4ad43014a83b 2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4 11 minutes ago Running etcd 0 bdef69edf9acd etcd-addons-162403
f38c04f167d00 6bab7719df1001fdcc7e39f1decfa1f73b7f3af2757a91c5bafa1aaea29d1aee 11 minutes ago Running kube-apiserver 0 c3f039afa24e9 kube-apiserver-addons-162403
==> coredns [cdb59912f2e1480afebe02cdad2def98d0fc5c98298f195576dd3307877d9629] <==
[INFO] 10.244.0.18:52396 - 19852 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000128047s
[INFO] 10.244.0.18:44347 - 60145 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000068286s
[INFO] 10.244.0.18:44347 - 17143 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000094705s
[INFO] 10.244.0.18:46410 - 18873 "A IN registry.kube-system.svc.cluster.local.europe-west1-b.c.k8s-minikube.internal. udp 95 false 512" NXDOMAIN qr,rd,ra 95 0.005052499s
[INFO] 10.244.0.18:46410 - 26037 "AAAA IN registry.kube-system.svc.cluster.local.europe-west1-b.c.k8s-minikube.internal. udp 95 false 512" NXDOMAIN qr,rd,ra 95 0.007222025s
[INFO] 10.244.0.18:34432 - 34096 "A IN registry.kube-system.svc.cluster.local.c.k8s-minikube.internal. udp 80 false 512" NXDOMAIN qr,rd,ra 80 0.00440361s
[INFO] 10.244.0.18:34432 - 33069 "AAAA IN registry.kube-system.svc.cluster.local.c.k8s-minikube.internal. udp 80 false 512" NXDOMAIN qr,rd,ra 80 0.006320363s
[INFO] 10.244.0.18:48014 - 36175 "A IN registry.kube-system.svc.cluster.local.google.internal. udp 72 false 512" NXDOMAIN qr,rd,ra 72 0.004973376s
[INFO] 10.244.0.18:48014 - 51266 "AAAA IN registry.kube-system.svc.cluster.local.google.internal. udp 72 false 512" NXDOMAIN qr,rd,ra 72 0.006232888s
[INFO] 10.244.0.18:55384 - 9190 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000082322s
[INFO] 10.244.0.18:55384 - 6628 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000129501s
[INFO] 10.244.0.20:48448 - 47225 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000223503s
[INFO] 10.244.0.20:55693 - 31699 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000271037s
[INFO] 10.244.0.20:57762 - 4868 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000147825s
[INFO] 10.244.0.20:41977 - 42962 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000138482s
[INFO] 10.244.0.20:35780 - 25623 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000090618s
[INFO] 10.244.0.20:35231 - 28557 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000160324s
[INFO] 10.244.0.20:37823 - 1338 "AAAA IN storage.googleapis.com.europe-west1-b.c.k8s-minikube.internal. udp 90 false 1232" NXDOMAIN qr,rd,ra 79 0.005223073s
[INFO] 10.244.0.20:35707 - 7420 "A IN storage.googleapis.com.europe-west1-b.c.k8s-minikube.internal. udp 90 false 1232" NXDOMAIN qr,rd,ra 79 0.00534569s
[INFO] 10.244.0.20:59126 - 24034 "A IN storage.googleapis.com.c.k8s-minikube.internal. udp 75 false 1232" NXDOMAIN qr,rd,ra 64 0.005715821s
[INFO] 10.244.0.20:41947 - 25595 "AAAA IN storage.googleapis.com.c.k8s-minikube.internal. udp 75 false 1232" NXDOMAIN qr,rd,ra 64 0.006074152s
[INFO] 10.244.0.20:60551 - 48110 "AAAA IN storage.googleapis.com.google.internal. udp 67 false 1232" NXDOMAIN qr,rd,ra 56 0.004720674s
[INFO] 10.244.0.20:47355 - 8992 "A IN storage.googleapis.com.google.internal. udp 67 false 1232" NXDOMAIN qr,rd,ra 56 0.005126856s
[INFO] 10.244.0.20:41941 - 3315 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 116 0.002301451s
[INFO] 10.244.0.20:35273 - 35195 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 140 0.002359301s
==> describe nodes <==
Name: addons-162403
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=addons-162403
kubernetes.io/os=linux
minikube.k8s.io/commit=57d42ff8d541388826f5d9c37044129ec69c3d0a
minikube.k8s.io/name=addons-162403
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_09_20T18_19_15_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-162403
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Fri, 20 Sep 2024 18:19:12 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-162403
AcquireTime: <unset>
RenewTime: Fri, 20 Sep 2024 18:30:58 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Fri, 20 Sep 2024 18:30:48 +0000 Fri, 20 Sep 2024 18:19:10 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Fri, 20 Sep 2024 18:30:48 +0000 Fri, 20 Sep 2024 18:19:10 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Fri, 20 Sep 2024 18:30:48 +0000 Fri, 20 Sep 2024 18:19:10 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Fri, 20 Sep 2024 18:30:48 +0000 Fri, 20 Sep 2024 18:20:03 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-162403
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32859316Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32859316Ki
pods: 110
System Info:
Machine ID: 84fc0251f2cc47d9b8eafd449e71e23a
System UUID: a1b78626-3ab2-4437-8dfa-b9488af04241
Boot ID: 1090cbe7-7e52-40cc-b00d-227cb699fd1e
Kernel Version: 5.15.0-1069-gcp
OS Image: Ubuntu 22.04.5 LTS
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.6
Kubelet Version: v1.31.1
Kube-Proxy Version: v1.31.1
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (16 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 9m16s
default nginx 0 (0%) 0 (0%) 0 (0%) 0 (0%) 49s
gcp-auth gcp-auth-89d5ffd79-742xn 0 (0%) 0 (0%) 0 (0%) 0 (0%) 11m
headlamp headlamp-7b5c95b59d-jz68p 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4s
ingress-nginx ingress-nginx-controller-bc57996ff-wxtns 100m (1%) 0 (0%) 90Mi (0%) 0 (0%) 11m
kube-system coredns-7c65d6cfc9-24mgs 100m (1%) 0 (0%) 70Mi (0%) 170Mi (0%) 11m
kube-system etcd-addons-162403 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 11m
kube-system kindnet-j7fr4 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 11m
kube-system kube-apiserver-addons-162403 250m (3%) 0 (0%) 0 (0%) 0 (0%) 11m
kube-system kube-controller-manager-addons-162403 200m (2%) 0 (0%) 0 (0%) 0 (0%) 11m
kube-system kube-ingress-dns-minikube 0 (0%) 0 (0%) 0 (0%) 0 (0%) 11m
kube-system kube-proxy-dd8cb 0 (0%) 0 (0%) 0 (0%) 0 (0%) 11m
kube-system kube-scheduler-addons-162403 100m (1%) 0 (0%) 0 (0%) 0 (0%) 11m
kube-system metrics-server-84c5f94fbc-gr2ct 100m (1%) 0 (0%) 200Mi (0%) 0 (0%) 11m
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 11m
local-path-storage local-path-provisioner-86d989889c-v5k84 0 (0%) 0 (0%) 0 (0%) 0 (0%) 11m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 1050m (13%) 100m (1%)
memory 510Mi (1%) 220Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 11m kube-proxy
Normal Starting 11m kubelet Starting kubelet.
Warning CgroupV1 11m kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeHasSufficientMemory 11m (x8 over 11m) kubelet Node addons-162403 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 11m (x8 over 11m) kubelet Node addons-162403 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 11m (x7 over 11m) kubelet Node addons-162403 status is now: NodeHasSufficientPID
Normal Starting 11m kubelet Starting kubelet.
Warning CgroupV1 11m kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeHasSufficientMemory 11m kubelet Node addons-162403 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 11m kubelet Node addons-162403 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 11m kubelet Node addons-162403 status is now: NodeHasSufficientPID
Normal RegisteredNode 11m node-controller Node addons-162403 event: Registered Node addons-162403 in Controller
Normal NodeReady 10m kubelet Node addons-162403 status is now: NodeReady
==> dmesg <==
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9e 27 ff 4b df 20 08 06
[ +0.082755] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff a6 16 6d e1 19 46 08 06
[ +6.907947] IPv4: martian source 10.244.0.1 from 10.244.0.5, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff c2 0c fb 31 c2 61 08 06
[ +27.701132] IPv4: martian source 10.244.0.1 from 10.244.0.4, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff fa 51 e2 82 fa 23 08 06
[ +0.958821] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff c6 b8 e7 f5 d7 b1 08 06
[ +0.036400] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff 8a e8 33 86 c0 c3 08 06
[Sep20 18:07] IPv4: martian source 10.244.0.1 from 10.244.0.5, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff b6 77 f7 48 11 3e 08 06
[Sep20 18:30] IPv4: martian source 10.244.0.19 from 127.0.0.1, on dev eth0
[ +0.000008] ll header: 00000000: 4a 85 8e a6 75 f5 b2 32 09 fe 04 5a 08 00
[ +1.015314] IPv4: martian source 10.244.0.19 from 127.0.0.1, on dev eth0
[ +0.000005] ll header: 00000000: 4a 85 8e a6 75 f5 b2 32 09 fe 04 5a 08 00
[ +2.011792] IPv4: martian source 10.244.0.19 from 127.0.0.1, on dev eth0
[ +0.000007] ll header: 00000000: 4a 85 8e a6 75 f5 b2 32 09 fe 04 5a 08 00
[ +4.255527] IPv4: martian source 10.244.0.19 from 127.0.0.1, on dev eth0
[ +0.000006] ll header: 00000000: 4a 85 8e a6 75 f5 b2 32 09 fe 04 5a 08 00
[ +8.195086] IPv4: martian source 10.244.0.19 from 127.0.0.1, on dev eth0
[ +0.000006] ll header: 00000000: 4a 85 8e a6 75 f5 b2 32 09 fe 04 5a 08 00
[ +16.122214] IPv4: martian source 10.244.0.19 from 127.0.0.1, on dev eth0
[ +0.000007] ll header: 00000000: 4a 85 8e a6 75 f5 b2 32 09 fe 04 5a 08 00
==> etcd [c4ad43014a83bd695658fea9ff9e19cea193dfe2a46883a2dbe0413829b803b6] <==
{"level":"info","ts":"2024-09-20T18:19:21.249218Z","caller":"traceutil/trace.go:171","msg":"trace[1967390529] transaction","detail":"{read_only:false; response_revision:389; number_of_response:1; }","duration":"203.55059ms","start":"2024-09-20T18:19:21.045640Z","end":"2024-09-20T18:19:21.249190Z","steps":["trace[1967390529] 'process raft request' (duration: 16.993754ms)","trace[1967390529] 'compare' (duration: 90.373951ms)"],"step_count":2}
{"level":"info","ts":"2024-09-20T18:19:21.551948Z","caller":"traceutil/trace.go:171","msg":"trace[804211122] transaction","detail":"{read_only:false; response_revision:394; number_of_response:1; }","duration":"107.356574ms","start":"2024-09-20T18:19:21.444570Z","end":"2024-09-20T18:19:21.551927Z","steps":["trace[804211122] 'process raft request' (duration: 100.501186ms)"],"step_count":1}
{"level":"warn","ts":"2024-09-20T18:19:21.552185Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"105.503897ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/deployments/kube-system/coredns\" ","response":"range_response_count:1 size:4034"}
{"level":"info","ts":"2024-09-20T18:19:21.552216Z","caller":"traceutil/trace.go:171","msg":"trace[1547814754] range","detail":"{range_begin:/registry/deployments/kube-system/coredns; range_end:; response_count:1; response_revision:394; }","duration":"105.546848ms","start":"2024-09-20T18:19:21.446660Z","end":"2024-09-20T18:19:21.552207Z","steps":["trace[1547814754] 'agreement among raft nodes before linearized reading' (duration: 105.471396ms)"],"step_count":1}
{"level":"warn","ts":"2024-09-20T18:19:21.552378Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"108.065959ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/namespaces/kube-system\" ","response":"range_response_count:1 size:351"}
{"level":"info","ts":"2024-09-20T18:19:21.554478Z","caller":"traceutil/trace.go:171","msg":"trace[813399487] range","detail":"{range_begin:/registry/namespaces/kube-system; range_end:; response_count:1; response_revision:394; }","duration":"110.162094ms","start":"2024-09-20T18:19:21.444302Z","end":"2024-09-20T18:19:21.554464Z","steps":["trace[813399487] 'agreement among raft nodes before linearized reading' (duration: 108.03856ms)"],"step_count":1}
{"level":"info","ts":"2024-09-20T18:19:21.961265Z","caller":"traceutil/trace.go:171","msg":"trace[125269741] linearizableReadLoop","detail":"{readStateIndex:413; appliedIndex:411; }","duration":"106.622713ms","start":"2024-09-20T18:19:21.854600Z","end":"2024-09-20T18:19:21.961223Z","steps":["trace[125269741] 'read index received' (duration: 10.382865ms)","trace[125269741] 'applied index is now lower than readState.Index' (duration: 96.239015ms)"],"step_count":2}
{"level":"info","ts":"2024-09-20T18:19:21.962257Z","caller":"traceutil/trace.go:171","msg":"trace[622144423] transaction","detail":"{read_only:false; response_revision:406; number_of_response:1; }","duration":"105.453568ms","start":"2024-09-20T18:19:21.856784Z","end":"2024-09-20T18:19:21.962238Z","steps":["trace[622144423] 'process raft request' (duration: 104.328353ms)"],"step_count":1}
{"level":"info","ts":"2024-09-20T18:19:21.962484Z","caller":"traceutil/trace.go:171","msg":"trace[1676311620] transaction","detail":"{read_only:false; response_revision:404; number_of_response:1; }","duration":"107.945568ms","start":"2024-09-20T18:19:21.854521Z","end":"2024-09-20T18:19:21.962467Z","steps":["trace[1676311620] 'process raft request' (duration: 106.387415ms)"],"step_count":1}
{"level":"warn","ts":"2024-09-20T18:19:21.963144Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"108.476893ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2024-09-20T18:19:21.964893Z","caller":"traceutil/trace.go:171","msg":"trace[911468214] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:409; }","duration":"110.230982ms","start":"2024-09-20T18:19:21.854646Z","end":"2024-09-20T18:19:21.964877Z","steps":["trace[911468214] 'agreement among raft nodes before linearized reading' (duration: 108.318206ms)"],"step_count":1}
{"level":"warn","ts":"2024-09-20T18:19:21.963644Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"109.037025ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/coredns-7c65d6cfc9-66scz\" ","response":"range_response_count:1 size:3993"}
{"level":"info","ts":"2024-09-20T18:19:21.961930Z","caller":"traceutil/trace.go:171","msg":"trace[1847307825] transaction","detail":"{read_only:false; response_revision:405; number_of_response:1; }","duration":"107.308099ms","start":"2024-09-20T18:19:21.854610Z","end":"2024-09-20T18:19:21.961918Z","steps":["trace[1847307825] 'process raft request' (duration: 106.453351ms)"],"step_count":1}
{"level":"info","ts":"2024-09-20T18:19:21.965508Z","caller":"traceutil/trace.go:171","msg":"trace[534112644] range","detail":"{range_begin:/registry/pods/kube-system/coredns-7c65d6cfc9-66scz; range_end:; response_count:1; response_revision:409; }","duration":"110.908607ms","start":"2024-09-20T18:19:21.854588Z","end":"2024-09-20T18:19:21.965497Z","steps":["trace[534112644] 'agreement among raft nodes before linearized reading' (duration: 109.014234ms)"],"step_count":1}
{"level":"info","ts":"2024-09-20T18:19:22.259610Z","caller":"traceutil/trace.go:171","msg":"trace[515300591] transaction","detail":"{read_only:false; response_revision:411; number_of_response:1; }","duration":"197.066865ms","start":"2024-09-20T18:19:22.062522Z","end":"2024-09-20T18:19:22.259589Z","steps":["trace[515300591] 'process raft request' (duration: 97.886637ms)","trace[515300591] 'compare' (duration: 98.78174ms)"],"step_count":2}
{"level":"info","ts":"2024-09-20T18:19:22.259756Z","caller":"traceutil/trace.go:171","msg":"trace[414203013] linearizableReadLoop","detail":"{readStateIndex:420; appliedIndex:419; }","duration":"196.971979ms","start":"2024-09-20T18:19:22.062775Z","end":"2024-09-20T18:19:22.259747Z","steps":["trace[414203013] 'read index received' (duration: 84.675819ms)","trace[414203013] 'applied index is now lower than readState.Index' (duration: 112.295168ms)"],"step_count":2}
{"level":"warn","ts":"2024-09-20T18:19:22.259853Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"197.062034ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/specs/default/cloud-spanner-emulator\" ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2024-09-20T18:19:22.259884Z","caller":"traceutil/trace.go:171","msg":"trace[1096776429] range","detail":"{range_begin:/registry/services/specs/default/cloud-spanner-emulator; range_end:; response_count:0; response_revision:413; }","duration":"197.105208ms","start":"2024-09-20T18:19:22.062771Z","end":"2024-09-20T18:19:22.259876Z","steps":["trace[1096776429] 'agreement among raft nodes before linearized reading' (duration: 197.01208ms)"],"step_count":1}
{"level":"info","ts":"2024-09-20T18:19:22.260069Z","caller":"traceutil/trace.go:171","msg":"trace[1236995037] transaction","detail":"{read_only:false; response_revision:412; number_of_response:1; }","duration":"108.527632ms","start":"2024-09-20T18:19:22.151533Z","end":"2024-09-20T18:19:22.260061Z","steps":["trace[1236995037] 'process raft request' (duration: 107.765823ms)"],"step_count":1}
{"level":"info","ts":"2024-09-20T18:19:23.355227Z","caller":"traceutil/trace.go:171","msg":"trace[850183716] transaction","detail":"{read_only:false; response_revision:467; number_of_response:1; }","duration":"102.197243ms","start":"2024-09-20T18:19:23.253005Z","end":"2024-09-20T18:19:23.355202Z","steps":[],"step_count":0}
{"level":"info","ts":"2024-09-20T18:19:23.355525Z","caller":"traceutil/trace.go:171","msg":"trace[673964805] transaction","detail":"{read_only:false; response_revision:466; number_of_response:1; }","duration":"102.739687ms","start":"2024-09-20T18:19:23.252776Z","end":"2024-09-20T18:19:23.355515Z","steps":[],"step_count":0}
{"level":"info","ts":"2024-09-20T18:20:56.075302Z","caller":"traceutil/trace.go:171","msg":"trace[1129311574] transaction","detail":"{read_only:false; response_revision:1139; number_of_response:1; }","duration":"107.719546ms","start":"2024-09-20T18:20:55.967566Z","end":"2024-09-20T18:20:56.075286Z","steps":["trace[1129311574] 'process raft request' (duration: 107.623877ms)"],"step_count":1}
{"level":"info","ts":"2024-09-20T18:29:10.697461Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1534}
{"level":"info","ts":"2024-09-20T18:29:10.721647Z","caller":"mvcc/kvstore_compaction.go:69","msg":"finished scheduled compaction","compact-revision":1534,"took":"23.706571ms","hash":2292866617,"current-db-size-bytes":6184960,"current-db-size":"6.2 MB","current-db-size-in-use-bytes":3268608,"current-db-size-in-use":"3.3 MB"}
{"level":"info","ts":"2024-09-20T18:29:10.721703Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":2292866617,"revision":1534,"compact-revision":-1}
==> gcp-auth [167a7699d2ad79a24795ae8d77140ef7ac5625e2824cc3968217f95fcb44cb62] <==
2024/09/20 18:21:45 Ready to write response ...
2024/09/20 18:21:45 Ready to marshal response ...
2024/09/20 18:21:45 Ready to write response ...
2024/09/20 18:21:45 Ready to marshal response ...
2024/09/20 18:21:45 Ready to write response ...
2024/09/20 18:29:56 Ready to marshal response ...
2024/09/20 18:29:56 Ready to write response ...
2024/09/20 18:29:58 Ready to marshal response ...
2024/09/20 18:29:58 Ready to write response ...
2024/09/20 18:30:12 Ready to marshal response ...
2024/09/20 18:30:12 Ready to write response ...
2024/09/20 18:30:22 Ready to marshal response ...
2024/09/20 18:30:22 Ready to write response ...
2024/09/20 18:30:44 Ready to marshal response ...
2024/09/20 18:30:44 Ready to write response ...
2024/09/20 18:30:44 Ready to marshal response ...
2024/09/20 18:30:44 Ready to write response ...
2024/09/20 18:30:56 Ready to marshal response ...
2024/09/20 18:30:56 Ready to write response ...
2024/09/20 18:30:57 Ready to marshal response ...
2024/09/20 18:30:57 Ready to write response ...
2024/09/20 18:30:57 Ready to marshal response ...
2024/09/20 18:30:57 Ready to write response ...
2024/09/20 18:30:57 Ready to marshal response ...
2024/09/20 18:30:57 Ready to write response ...
==> kernel <==
18:31:01 up 2:13, 0 users, load average: 1.50, 0.64, 1.02
Linux addons-162403 5.15.0-1069-gcp #77~20.04.1-Ubuntu SMP Sun Sep 1 19:39:16 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.5 LTS"
==> kindnet [0a3bc23a91121ba80e4fb2bf2225373da2f40853ef60f395c1b7cc42335ba90d] <==
I0920 18:28:53.647111 1 main.go:299] handling current node
I0920 18:29:03.649358 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0920 18:29:03.649399 1 main.go:299] handling current node
I0920 18:29:13.644535 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0920 18:29:13.644577 1 main.go:299] handling current node
I0920 18:29:23.644427 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0920 18:29:23.644598 1 main.go:299] handling current node
I0920 18:29:33.651807 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0920 18:29:33.651843 1 main.go:299] handling current node
I0920 18:29:43.644687 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0920 18:29:43.644730 1 main.go:299] handling current node
I0920 18:29:53.644997 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0920 18:29:53.645055 1 main.go:299] handling current node
I0920 18:30:03.644816 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0920 18:30:03.644862 1 main.go:299] handling current node
I0920 18:30:13.644183 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0920 18:30:13.644231 1 main.go:299] handling current node
I0920 18:30:23.644523 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0920 18:30:23.644553 1 main.go:299] handling current node
I0920 18:30:33.644213 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0920 18:30:33.644258 1 main.go:299] handling current node
I0920 18:30:43.647104 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0920 18:30:43.647138 1 main.go:299] handling current node
I0920 18:30:53.644203 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0920 18:30:53.644254 1 main.go:299] handling current node
==> kube-apiserver [f38c04f167d002d7eaa0d6babf655173dc59197a2fdcb23e2deaf6c3ee073bc5] <==
E0920 18:21:34.560201 1 controller.go:146] "Unhandled Error" err=<
Error updating APIService "v1beta1.metrics.k8s.io" with err: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
> logger="UnhandledError"
E0920 18:21:34.561794 1 remote_available_controller.go:448] "Unhandled Error" err="v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.102.35.12:443/apis/metrics.k8s.io/v1beta1: Get \"https://10.102.35.12:443/apis/metrics.k8s.io/v1beta1\": dial tcp 10.102.35.12:443: connect: connection refused" logger="UnhandledError"
I0920 18:21:34.599060 1 handler.go:286] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
I0920 18:30:06.424489 1 handler.go:286] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager
W0920 18:30:07.441395 1 cacher.go:171] Terminating all watchers from cacher traces.gadget.kinvolk.io
I0920 18:30:09.437271 1 controller.go:615] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io
I0920 18:30:11.895465 1 controller.go:615] quota admission added evaluator for: ingresses.networking.k8s.io
I0920 18:30:12.151933 1 alloc.go:330] "allocated clusterIPs" service="default/nginx" clusterIPs={"IPv4":"10.99.87.74"}
I0920 18:30:37.871661 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0920 18:30:37.871723 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0920 18:30:37.887033 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0920 18:30:37.887175 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0920 18:30:37.892360 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0920 18:30:37.892420 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0920 18:30:37.898321 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0920 18:30:37.898486 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0920 18:30:37.949118 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0920 18:30:37.949160 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
W0920 18:30:38.893058 1 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io
W0920 18:30:38.950022 1 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io
W0920 18:30:38.957732 1 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io
I0920 18:30:57.308382 1 alloc.go:330] "allocated clusterIPs" service="headlamp/headlamp" clusterIPs={"IPv4":"10.103.229.203"}
==> kube-controller-manager [4b71192f65f2de6df3616ddc8a6620b0c14723ea4d2ff122cde6d87305d3c284] <==
I0920 18:30:44.532131 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/cloud-spanner-emulator-769b77f747" duration="5.45µs"
W0920 18:30:45.433875 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0920 18:30:45.433932 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0920 18:30:46.280127 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0920 18:30:46.280169 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0920 18:30:46.844482 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0920 18:30:46.844532 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0920 18:30:48.580553 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0920 18:30:48.580595 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
I0920 18:30:48.651250 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-162403"
I0920 18:30:49.133857 1 shared_informer.go:313] Waiting for caches to sync for resource quota
I0920 18:30:49.133895 1 shared_informer.go:320] Caches are synced for resource quota
I0920 18:30:49.543310 1 shared_informer.go:313] Waiting for caches to sync for garbage collector
I0920 18:30:49.543351 1 shared_informer.go:320] Caches are synced for garbage collector
W0920 18:30:55.978056 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0920 18:30:55.978106 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0920 18:30:56.910430 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0920 18:30:56.910472 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
I0920 18:30:57.349398 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="headlamp/headlamp-7b5c95b59d" duration="27.268831ms"
I0920 18:30:57.354514 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="headlamp/headlamp-7b5c95b59d" duration="5.069307ms"
I0920 18:30:57.354590 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="headlamp/headlamp-7b5c95b59d" duration="41.808µs"
I0920 18:30:57.359040 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="headlamp/headlamp-7b5c95b59d" duration="115.472µs"
W0920 18:30:57.503367 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0920 18:30:57.503412 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
I0920 18:30:58.835370 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/registry-66c9cd494c" duration="4.498µs"
==> kube-proxy [52c52923ef8ea0fe574b0abbae3590d5fdd4acc2ef2282c98e442504626a5fe6] <==
I0920 18:19:23.348890 1 server_linux.go:66] "Using iptables proxy"
I0920 18:19:24.053513 1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
E0920 18:19:24.053686 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I0920 18:19:24.461765 1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I0920 18:19:24.461911 1 server_linux.go:169] "Using iptables Proxier"
I0920 18:19:24.544987 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I0920 18:19:24.545696 1 server.go:483] "Version info" version="v1.31.1"
I0920 18:19:24.545778 1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0920 18:19:24.547965 1 config.go:199] "Starting service config controller"
I0920 18:19:24.549760 1 shared_informer.go:313] Waiting for caches to sync for service config
I0920 18:19:24.549176 1 config.go:328] "Starting node config controller"
I0920 18:19:24.549328 1 config.go:105] "Starting endpoint slice config controller"
I0920 18:19:24.549802 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0920 18:19:24.549809 1 shared_informer.go:313] Waiting for caches to sync for node config
I0920 18:19:24.651660 1 shared_informer.go:320] Caches are synced for node config
I0920 18:19:24.651660 1 shared_informer.go:320] Caches are synced for endpoint slice config
I0920 18:19:24.651702 1 shared_informer.go:320] Caches are synced for service config
==> kube-scheduler [249ac20417667d2249afd8ff66cf57fb6cf92d53e82089ed0ecb0e7fc1a31feb] <==
W0920 18:19:12.051578 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
W0920 18:19:12.051599 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0920 18:19:12.051631 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"
E0920 18:19:12.051630 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0920 18:19:12.052648 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0920 18:19:12.052678 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError"
W0920 18:19:12.052829 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0920 18:19:12.052843 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0920 18:19:12.855801 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0920 18:19:12.855855 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0920 18:19:12.864661 1 reflector.go:561] runtime/asm_amd64.s:1695: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0920 18:19:12.864714 1 reflector.go:158] "Unhandled Error" err="runtime/asm_amd64.s:1695: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"
W0920 18:19:12.882432 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0920 18:19:12.882477 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0920 18:19:12.910952 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0920 18:19:12.911024 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0920 18:19:12.925403 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0920 18:19:12.925449 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0920 18:19:13.010499 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0920 18:19:13.010542 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0920 18:19:13.081617 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0920 18:19:13.081680 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0920 18:19:13.166464 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
E0920 18:19:13.166510 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
I0920 18:19:15.650022 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Sep 20 18:30:58 addons-162403 kubelet[1624]: I0920 18:30:58.730745 1624 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb65929f-27e6-4012-a9f1-921e7fddf300-script" (OuterVolumeSpecName: "script") pod "eb65929f-27e6-4012-a9f1-921e7fddf300" (UID: "eb65929f-27e6-4012-a9f1-921e7fddf300"). InnerVolumeSpecName "script". PluginName "kubernetes.io/configmap", VolumeGidValue ""
Sep 20 18:30:58 addons-162403 kubelet[1624]: I0920 18:30:58.732313 1624 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb65929f-27e6-4012-a9f1-921e7fddf300-kube-api-access-htwtr" (OuterVolumeSpecName: "kube-api-access-htwtr") pod "eb65929f-27e6-4012-a9f1-921e7fddf300" (UID: "eb65929f-27e6-4012-a9f1-921e7fddf300"). InnerVolumeSpecName "kube-api-access-htwtr". PluginName "kubernetes.io/projected", VolumeGidValue ""
Sep 20 18:30:58 addons-162403 kubelet[1624]: I0920 18:30:58.831349 1624 reconciler_common.go:288] "Volume detached for volume \"script\" (UniqueName: \"kubernetes.io/configmap/eb65929f-27e6-4012-a9f1-921e7fddf300-script\") on node \"addons-162403\" DevicePath \"\""
Sep 20 18:30:58 addons-162403 kubelet[1624]: I0920 18:30:58.831395 1624 reconciler_common.go:288] "Volume detached for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/eb65929f-27e6-4012-a9f1-921e7fddf300-gcp-creds\") on node \"addons-162403\" DevicePath \"\""
Sep 20 18:30:58 addons-162403 kubelet[1624]: I0920 18:30:58.831409 1624 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-htwtr\" (UniqueName: \"kubernetes.io/projected/eb65929f-27e6-4012-a9f1-921e7fddf300-kube-api-access-htwtr\") on node \"addons-162403\" DevicePath \"\""
Sep 20 18:30:58 addons-162403 kubelet[1624]: I0920 18:30:58.831422 1624 reconciler_common.go:288] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/host-path/eb65929f-27e6-4012-a9f1-921e7fddf300-data\") on node \"addons-162403\" DevicePath \"\""
Sep 20 18:30:59 addons-162403 kubelet[1624]: I0920 18:30:59.133439 1624 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9wsg\" (UniqueName: \"kubernetes.io/projected/88d02c55-38b5-4e2b-9986-5f7887226e63-kube-api-access-h9wsg\") pod \"88d02c55-38b5-4e2b-9986-5f7887226e63\" (UID: \"88d02c55-38b5-4e2b-9986-5f7887226e63\") "
Sep 20 18:30:59 addons-162403 kubelet[1624]: I0920 18:30:59.133490 1624 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldcfx\" (UniqueName: \"kubernetes.io/projected/22fc174a-6a59-45df-b8e0-fd97f697901c-kube-api-access-ldcfx\") pod \"22fc174a-6a59-45df-b8e0-fd97f697901c\" (UID: \"22fc174a-6a59-45df-b8e0-fd97f697901c\") "
Sep 20 18:30:59 addons-162403 kubelet[1624]: I0920 18:30:59.135857 1624 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22fc174a-6a59-45df-b8e0-fd97f697901c-kube-api-access-ldcfx" (OuterVolumeSpecName: "kube-api-access-ldcfx") pod "22fc174a-6a59-45df-b8e0-fd97f697901c" (UID: "22fc174a-6a59-45df-b8e0-fd97f697901c"). InnerVolumeSpecName "kube-api-access-ldcfx". PluginName "kubernetes.io/projected", VolumeGidValue ""
Sep 20 18:30:59 addons-162403 kubelet[1624]: I0920 18:30:59.135896 1624 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88d02c55-38b5-4e2b-9986-5f7887226e63-kube-api-access-h9wsg" (OuterVolumeSpecName: "kube-api-access-h9wsg") pod "88d02c55-38b5-4e2b-9986-5f7887226e63" (UID: "88d02c55-38b5-4e2b-9986-5f7887226e63"). InnerVolumeSpecName "kube-api-access-h9wsg". PluginName "kubernetes.io/projected", VolumeGidValue ""
Sep 20 18:30:59 addons-162403 kubelet[1624]: I0920 18:30:59.234367 1624 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-h9wsg\" (UniqueName: \"kubernetes.io/projected/88d02c55-38b5-4e2b-9986-5f7887226e63-kube-api-access-h9wsg\") on node \"addons-162403\" DevicePath \"\""
Sep 20 18:30:59 addons-162403 kubelet[1624]: I0920 18:30:59.234414 1624 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-ldcfx\" (UniqueName: \"kubernetes.io/projected/22fc174a-6a59-45df-b8e0-fd97f697901c-kube-api-access-ldcfx\") on node \"addons-162403\" DevicePath \"\""
Sep 20 18:30:59 addons-162403 kubelet[1624]: I0920 18:30:59.648351 1624 scope.go:117] "RemoveContainer" containerID="9a925ce8e486b92b61470f49566a300f40c75d174636e393e75f8ce8457c995c"
Sep 20 18:30:59 addons-162403 kubelet[1624]: I0920 18:30:59.654466 1624 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ba9d92a886666e277d1a77473280b858470edf50139ad59e4725b9410fde026"
Sep 20 18:31:00 addons-162403 kubelet[1624]: I0920 18:31:00.156711 1624 scope.go:117] "RemoveContainer" containerID="9a925ce8e486b92b61470f49566a300f40c75d174636e393e75f8ce8457c995c"
Sep 20 18:31:00 addons-162403 kubelet[1624]: E0920 18:31:00.159450 1624 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a925ce8e486b92b61470f49566a300f40c75d174636e393e75f8ce8457c995c\": container with ID starting with 9a925ce8e486b92b61470f49566a300f40c75d174636e393e75f8ce8457c995c not found: ID does not exist" containerID="9a925ce8e486b92b61470f49566a300f40c75d174636e393e75f8ce8457c995c"
Sep 20 18:31:00 addons-162403 kubelet[1624]: I0920 18:31:00.159513 1624 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a925ce8e486b92b61470f49566a300f40c75d174636e393e75f8ce8457c995c"} err="failed to get container status \"9a925ce8e486b92b61470f49566a300f40c75d174636e393e75f8ce8457c995c\": rpc error: code = NotFound desc = could not find container \"9a925ce8e486b92b61470f49566a300f40c75d174636e393e75f8ce8457c995c\": container with ID starting with 9a925ce8e486b92b61470f49566a300f40c75d174636e393e75f8ce8457c995c not found: ID does not exist"
Sep 20 18:31:00 addons-162403 kubelet[1624]: I0920 18:31:00.159551 1624 scope.go:117] "RemoveContainer" containerID="d21fcca2d833bfd9ad19b75aa19b9517b2e11e7fcb5f84ad75e68fe174a3c9ab"
Sep 20 18:31:00 addons-162403 kubelet[1624]: I0920 18:31:00.243368 1624 scope.go:117] "RemoveContainer" containerID="d21fcca2d833bfd9ad19b75aa19b9517b2e11e7fcb5f84ad75e68fe174a3c9ab"
Sep 20 18:31:00 addons-162403 kubelet[1624]: E0920 18:31:00.243914 1624 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d21fcca2d833bfd9ad19b75aa19b9517b2e11e7fcb5f84ad75e68fe174a3c9ab\": container with ID starting with d21fcca2d833bfd9ad19b75aa19b9517b2e11e7fcb5f84ad75e68fe174a3c9ab not found: ID does not exist" containerID="d21fcca2d833bfd9ad19b75aa19b9517b2e11e7fcb5f84ad75e68fe174a3c9ab"
Sep 20 18:31:00 addons-162403 kubelet[1624]: I0920 18:31:00.243964 1624 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d21fcca2d833bfd9ad19b75aa19b9517b2e11e7fcb5f84ad75e68fe174a3c9ab"} err="failed to get container status \"d21fcca2d833bfd9ad19b75aa19b9517b2e11e7fcb5f84ad75e68fe174a3c9ab\": rpc error: code = NotFound desc = could not find container \"d21fcca2d833bfd9ad19b75aa19b9517b2e11e7fcb5f84ad75e68fe174a3c9ab\": container with ID starting with d21fcca2d833bfd9ad19b75aa19b9517b2e11e7fcb5f84ad75e68fe174a3c9ab not found: ID does not exist"
Sep 20 18:31:00 addons-162403 kubelet[1624]: I0920 18:31:00.447209 1624 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a2a058a-de1d-4ca8-9b9b-ec1797eb38fd" path="/var/lib/kubelet/pods/0a2a058a-de1d-4ca8-9b9b-ec1797eb38fd/volumes"
Sep 20 18:31:00 addons-162403 kubelet[1624]: I0920 18:31:00.447689 1624 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22fc174a-6a59-45df-b8e0-fd97f697901c" path="/var/lib/kubelet/pods/22fc174a-6a59-45df-b8e0-fd97f697901c/volumes"
Sep 20 18:31:00 addons-162403 kubelet[1624]: I0920 18:31:00.448162 1624 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88d02c55-38b5-4e2b-9986-5f7887226e63" path="/var/lib/kubelet/pods/88d02c55-38b5-4e2b-9986-5f7887226e63/volumes"
Sep 20 18:31:00 addons-162403 kubelet[1624]: I0920 18:31:00.448623 1624 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb65929f-27e6-4012-a9f1-921e7fddf300" path="/var/lib/kubelet/pods/eb65929f-27e6-4012-a9f1-921e7fddf300/volumes"
==> storage-provisioner [525f045aa748e6ea6058a19f28604c5472b307505ab4e997fc5024dd5e9d9ef2] <==
I0920 18:20:05.073668 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0920 18:20:05.085517 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0920 18:20:05.085586 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0920 18:20:05.094317 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0920 18:20:05.094479 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-162403_d7c3519d-575e-4dbc-aeb4-229d05571c06!
I0920 18:20:05.094902 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"6a6c3edb-f643-4302-b044-b3279df05602", APIVersion:"v1", ResourceVersion:"934", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-162403_d7c3519d-575e-4dbc-aeb4-229d05571c06 became leader
I0920 18:20:05.195504 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-162403_d7c3519d-575e-4dbc-aeb4-229d05571c06!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p addons-162403 -n addons-162403
helpers_test.go:261: (dbg) Run: kubectl --context addons-162403 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: busybox headlamp-7b5c95b59d-jz68p ingress-nginx-admission-create-ct9rs ingress-nginx-admission-patch-8jqwt
helpers_test.go:274: ======> post-mortem[TestAddons/parallel/Registry]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-162403 describe pod busybox headlamp-7b5c95b59d-jz68p ingress-nginx-admission-create-ct9rs ingress-nginx-admission-patch-8jqwt
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-162403 describe pod busybox headlamp-7b5c95b59d-jz68p ingress-nginx-admission-create-ct9rs ingress-nginx-admission-patch-8jqwt: exit status 1 (72.600139ms)
-- stdout --
Name: busybox
Namespace: default
Priority: 0
Service Account: default
Node: addons-162403/192.168.49.2
Start Time: Fri, 20 Sep 2024 18:21:45 +0000
Labels: integration-test=busybox
Annotations: <none>
Status: Pending
IP: 10.244.0.21
IPs:
IP: 10.244.0.21
Containers:
busybox:
Container ID:
Image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
Image ID:
Port: <none>
Host Port: <none>
Command:
sleep
3600
State: Waiting
Reason: ImagePullBackOff
Ready: False
Restart Count: 0
Environment:
GOOGLE_APPLICATION_CREDENTIALS: /google-app-creds.json
PROJECT_ID: this_is_fake
GCP_PROJECT: this_is_fake
GCLOUD_PROJECT: this_is_fake
GOOGLE_CLOUD_PROJECT: this_is_fake
CLOUDSDK_CORE_PROJECT: this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-p4hs2 (ro)
Conditions:
Type Status
PodReadyToStartContainers True
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
kube-api-access-p4hs2:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
gcp-creds:
Type: HostPath (bare host directory volume)
Path: /var/lib/minikube/google_application_credentials.json
HostPathType: File
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 9m17s default-scheduler Successfully assigned default/busybox to addons-162403
Normal Pulling 7m47s (x4 over 9m16s) kubelet Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"
Warning Failed 7m47s (x4 over 9m16s) kubelet Failed to pull image "gcr.io/k8s-minikube/busybox:1.28.4-glibc": unable to retrieve auth token: invalid username/password: unauthorized: authentication failed
Warning Failed 7m47s (x4 over 9m16s) kubelet Error: ErrImagePull
Warning Failed 7m33s (x6 over 9m15s) kubelet Error: ImagePullBackOff
Normal BackOff 4m11s (x20 over 9m15s) kubelet Back-off pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"
-- /stdout --
** stderr **
Error from server (NotFound): pods "headlamp-7b5c95b59d-jz68p" not found
Error from server (NotFound): pods "ingress-nginx-admission-create-ct9rs" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-8jqwt" not found
** /stderr **
helpers_test.go:279: kubectl --context addons-162403 describe pod busybox headlamp-7b5c95b59d-jz68p ingress-nginx-admission-create-ct9rs ingress-nginx-admission-patch-8jqwt: exit status 1
--- FAIL: TestAddons/parallel/Registry (74.71s)