=== RUN TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry
=== CONT TestAddons/parallel/Registry
addons_test.go:328: registry stabilized in 4.572585ms
addons_test.go:330: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-66c9cd494c-mft4z" [054e4117-a309-4e89-afe0-a65369055074] Running
addons_test.go:330: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.004596395s
addons_test.go:333: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-5t6vq" [e46d96a1-6871-401a-a71d-00cd0539506c] Running
addons_test.go:333: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 6.006125346s
addons_test.go:338: (dbg) Run: kubectl --context addons-949062 delete po -l run=registry-test --now
addons_test.go:343: (dbg) Run: kubectl --context addons-949062 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:343: (dbg) Non-zero exit: kubectl --context addons-949062 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": exit status 1 (1m0.111343476s)
-- stdout --
pod "registry-test" deleted
-- /stdout --
** stderr **
error: timed out waiting for the condition
** /stderr **
addons_test.go:345: failed to hit registry.kube-system.svc.cluster.local. args "kubectl --context addons-949062 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c \"wget --spider -S http://registry.kube-system.svc.cluster.local\"" failed: exit status 1
addons_test.go:349: expected curl response be "HTTP/1.1 200", but got *pod "registry-test" deleted
*
addons_test.go:357: (dbg) Run: out/minikube-linux-arm64 -p addons-949062 ip
addons_test.go:386: (dbg) Run: out/minikube-linux-arm64 -p addons-949062 addons disable registry --alsologtostderr -v=1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestAddons/parallel/Registry]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect addons-949062
helpers_test.go:235: (dbg) docker inspect addons-949062:
-- stdout --
[
{
"Id": "15377d5b3403b003b9220d85b203641cfae669831acf9bb174a49e7f93ab8fbe",
"Created": "2024-09-23T11:46:59.221610581Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 446131,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-09-23T11:46:59.356533883Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:c94982da1293baee77c00993711af197ed62d6b1a4ee12c0caa4f57c70de4fdc",
"ResolvConfPath": "/var/lib/docker/containers/15377d5b3403b003b9220d85b203641cfae669831acf9bb174a49e7f93ab8fbe/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/15377d5b3403b003b9220d85b203641cfae669831acf9bb174a49e7f93ab8fbe/hostname",
"HostsPath": "/var/lib/docker/containers/15377d5b3403b003b9220d85b203641cfae669831acf9bb174a49e7f93ab8fbe/hosts",
"LogPath": "/var/lib/docker/containers/15377d5b3403b003b9220d85b203641cfae669831acf9bb174a49e7f93ab8fbe/15377d5b3403b003b9220d85b203641cfae669831acf9bb174a49e7f93ab8fbe-json.log",
"Name": "/addons-949062",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"addons-949062:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "addons-949062",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4194304000,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8388608000,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/47ff60ab67f6e0ed613956be9cd24339bb229d893331c322e62ece686adcffc6-init/diff:/var/lib/docker/overlay2/aa6506bfdcc3e3bf1c437c686d239838d975235b868c2cbec84eeddc6bd833d4/diff",
"MergedDir": "/var/lib/docker/overlay2/47ff60ab67f6e0ed613956be9cd24339bb229d893331c322e62ece686adcffc6/merged",
"UpperDir": "/var/lib/docker/overlay2/47ff60ab67f6e0ed613956be9cd24339bb229d893331c322e62ece686adcffc6/diff",
"WorkDir": "/var/lib/docker/overlay2/47ff60ab67f6e0ed613956be9cd24339bb229d893331c322e62ece686adcffc6/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "addons-949062",
"Source": "/var/lib/docker/volumes/addons-949062/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "addons-949062",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-949062",
"name.minikube.sigs.k8s.io": "addons-949062",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "b9a3db319971ee150275d98d4d4e6692ceb4b645eb9a150083c950f32efc6b28",
"SandboxKey": "/var/run/docker/netns/b9a3db319971",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33163"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33164"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33167"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33165"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33166"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"addons-949062": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:31:02",
"DriverOpts": null,
"NetworkID": "2309c2d65c459e6744e1b529df34e5691c44b134f4f578b100aab96df55838e7",
"EndpointID": "49b6d49d44df3ec2e743a73988b79c91168870b0e0519ce1b11954f6163173af",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-949062",
"15377d5b3403"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p addons-949062 -n addons-949062
helpers_test.go:244: <<< TestAddons/parallel/Registry FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/parallel/Registry]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p addons-949062 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-949062 logs -n 25: (1.676250715s)
helpers_test.go:252: TestAddons/parallel/Registry logs:
-- stdout --
==> Audit <==
|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| start | -o=json --download-only | download-only-411446 | jenkins | v1.34.0 | 23 Sep 24 11:46 UTC | |
| | -p download-only-411446 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| | --container-runtime=crio | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 23 Sep 24 11:46 UTC | 23 Sep 24 11:46 UTC |
| delete | -p download-only-411446 | download-only-411446 | jenkins | v1.34.0 | 23 Sep 24 11:46 UTC | 23 Sep 24 11:46 UTC |
| start | -o=json --download-only | download-only-864108 | jenkins | v1.34.0 | 23 Sep 24 11:46 UTC | |
| | -p download-only-864108 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
| | --container-runtime=crio | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 23 Sep 24 11:46 UTC | 23 Sep 24 11:46 UTC |
| delete | -p download-only-864108 | download-only-864108 | jenkins | v1.34.0 | 23 Sep 24 11:46 UTC | 23 Sep 24 11:46 UTC |
| delete | -p download-only-411446 | download-only-411446 | jenkins | v1.34.0 | 23 Sep 24 11:46 UTC | 23 Sep 24 11:46 UTC |
| delete | -p download-only-864108 | download-only-864108 | jenkins | v1.34.0 | 23 Sep 24 11:46 UTC | 23 Sep 24 11:46 UTC |
| start | --download-only -p | download-docker-299983 | jenkins | v1.34.0 | 23 Sep 24 11:46 UTC | |
| | download-docker-299983 | | | | | |
| | --alsologtostderr | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| delete | -p download-docker-299983 | download-docker-299983 | jenkins | v1.34.0 | 23 Sep 24 11:46 UTC | 23 Sep 24 11:46 UTC |
| start | --download-only -p | binary-mirror-264226 | jenkins | v1.34.0 | 23 Sep 24 11:46 UTC | |
| | binary-mirror-264226 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:38673 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| delete | -p binary-mirror-264226 | binary-mirror-264226 | jenkins | v1.34.0 | 23 Sep 24 11:46 UTC | 23 Sep 24 11:46 UTC |
| addons | disable dashboard -p | addons-949062 | jenkins | v1.34.0 | 23 Sep 24 11:46 UTC | |
| | addons-949062 | | | | | |
| addons | enable dashboard -p | addons-949062 | jenkins | v1.34.0 | 23 Sep 24 11:46 UTC | |
| | addons-949062 | | | | | |
| start | -p addons-949062 --wait=true | addons-949062 | jenkins | v1.34.0 | 23 Sep 24 11:46 UTC | 23 Sep 24 11:49 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
| addons | addons-949062 addons disable | addons-949062 | jenkins | v1.34.0 | 23 Sep 24 11:58 UTC | 23 Sep 24 11:58 UTC |
| | yakd --alsologtostderr -v=1 | | | | | |
| addons | addons-949062 addons | addons-949062 | jenkins | v1.34.0 | 23 Sep 24 11:58 UTC | 23 Sep 24 11:58 UTC |
| | disable csi-hostpath-driver | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | addons-949062 addons | addons-949062 | jenkins | v1.34.0 | 23 Sep 24 11:58 UTC | 23 Sep 24 11:58 UTC |
| | disable volumesnapshots | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | disable nvidia-device-plugin | addons-949062 | jenkins | v1.34.0 | 23 Sep 24 11:58 UTC | 23 Sep 24 11:59 UTC |
| | -p addons-949062 | | | | | |
| ip | addons-949062 ip | addons-949062 | jenkins | v1.34.0 | 23 Sep 24 11:59 UTC | 23 Sep 24 11:59 UTC |
| addons | addons-949062 addons disable | addons-949062 | jenkins | v1.34.0 | 23 Sep 24 11:59 UTC | 23 Sep 24 11:59 UTC |
| | registry --alsologtostderr | | | | | |
| | -v=1 | | | | | |
| ssh | addons-949062 ssh cat | addons-949062 | jenkins | v1.34.0 | 23 Sep 24 11:59 UTC | 23 Sep 24 11:59 UTC |
| | /opt/local-path-provisioner/pvc-a360d212-2322-4a7c-8e95-840a1216a052_default_test-pvc/file1 | | | | | |
| addons | addons-949062 addons disable | addons-949062 | jenkins | v1.34.0 | 23 Sep 24 11:59 UTC | |
| | storage-provisioner-rancher | | | | | |
| | --alsologtostderr -v=1 | | | | | |
|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/09/23 11:46:33
Running on machine: ip-172-31-30-239
Binary: Built with gc go1.23.0 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0923 11:46:33.806242 445639 out.go:345] Setting OutFile to fd 1 ...
I0923 11:46:33.806442 445639 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0923 11:46:33.806468 445639 out.go:358] Setting ErrFile to fd 2...
I0923 11:46:33.806486 445639 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0923 11:46:33.806782 445639 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19688-439483/.minikube/bin
I0923 11:46:33.807245 445639 out.go:352] Setting JSON to false
I0923 11:46:33.808197 445639 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":5342,"bootTime":1727086652,"procs":197,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
I0923 11:46:33.808293 445639 start.go:139] virtualization:
I0923 11:46:33.811286 445639 out.go:177] * [addons-949062] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I0923 11:46:33.814525 445639 out.go:177] - MINIKUBE_LOCATION=19688
I0923 11:46:33.814586 445639 notify.go:220] Checking for updates...
I0923 11:46:33.819769 445639 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0923 11:46:33.822494 445639 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19688-439483/kubeconfig
I0923 11:46:33.824726 445639 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19688-439483/.minikube
I0923 11:46:33.826872 445639 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0923 11:46:33.829164 445639 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0923 11:46:33.831738 445639 driver.go:394] Setting default libvirt URI to qemu:///system
I0923 11:46:33.862660 445639 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
I0923 11:46:33.862790 445639 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0923 11:46:33.913858 445639 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-23 11:46:33.9044837 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge
-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I0923 11:46:33.913993 445639 docker.go:318] overlay module found
I0923 11:46:33.918154 445639 out.go:177] * Using the docker driver based on user configuration
I0923 11:46:33.920623 445639 start.go:297] selected driver: docker
I0923 11:46:33.920644 445639 start.go:901] validating driver "docker" against <nil>
I0923 11:46:33.920660 445639 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0923 11:46:33.921515 445639 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0923 11:46:33.973683 445639 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-23 11:46:33.96459562 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aa
rch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridg
e-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I0923 11:46:33.973887 445639 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0923 11:46:33.974131 445639 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0923 11:46:33.976444 445639 out.go:177] * Using Docker driver with root privileges
I0923 11:46:33.978428 445639 cni.go:84] Creating CNI manager for ""
I0923 11:46:33.978496 445639 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0923 11:46:33.978510 445639 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0923 11:46:33.978609 445639 start.go:340] cluster config:
{Name:addons-949062 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-949062 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSH
AgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0923 11:46:33.980741 445639 out.go:177] * Starting "addons-949062" primary control-plane node in "addons-949062" cluster
I0923 11:46:33.983285 445639 cache.go:121] Beginning downloading kic base image for docker with crio
I0923 11:46:33.985115 445639 out.go:177] * Pulling base image v0.0.45-1726784731-19672 ...
I0923 11:46:33.986846 445639 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio
I0923 11:46:33.986900 445639 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19688-439483/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-arm64.tar.lz4
I0923 11:46:33.986912 445639 cache.go:56] Caching tarball of preloaded images
I0923 11:46:33.986910 445639 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed in local docker daemon
I0923 11:46:33.986995 445639 preload.go:172] Found /home/jenkins/minikube-integration/19688-439483/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-arm64.tar.lz4 in cache, skipping download
I0923 11:46:33.987006 445639 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on crio
I0923 11:46:33.987369 445639 profile.go:143] Saving config to /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/config.json ...
I0923 11:46:33.987401 445639 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/config.json: {Name:mk0d39df56db07d691a4092c51c2eb5ba3e85bce Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 11:46:34.002596 445639 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed to local cache
I0923 11:46:34.002738 445639 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed in local cache directory
I0923 11:46:34.002759 445639 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed in local cache directory, skipping pull
I0923 11:46:34.002765 445639 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed exists in cache, skipping pull
I0923 11:46:34.002772 445639 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed as a tarball
I0923 11:46:34.002778 445639 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed from local cache
I0923 11:46:51.484890 445639 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed from cached tarball
I0923 11:46:51.484930 445639 cache.go:194] Successfully downloaded all kic artifacts
I0923 11:46:51.484976 445639 start.go:360] acquireMachinesLock for addons-949062: {Name:mkc7ffd2e305e02e09a3d93d768f3a214671463f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0923 11:46:51.485106 445639 start.go:364] duration metric: took 110.391µs to acquireMachinesLock for "addons-949062"
I0923 11:46:51.485132 445639 start.go:93] Provisioning new machine with config: &{Name:addons-949062 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-949062 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQe
muFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I0923 11:46:51.485212 445639 start.go:125] createHost starting for "" (driver="docker")
I0923 11:46:51.487846 445639 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
I0923 11:46:51.488111 445639 start.go:159] libmachine.API.Create for "addons-949062" (driver="docker")
I0923 11:46:51.488149 445639 client.go:168] LocalClient.Create starting
I0923 11:46:51.488270 445639 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19688-439483/.minikube/certs/ca.pem
I0923 11:46:52.371948 445639 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19688-439483/.minikube/certs/cert.pem
I0923 11:46:52.879396 445639 cli_runner.go:164] Run: docker network inspect addons-949062 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0923 11:46:52.893480 445639 cli_runner.go:211] docker network inspect addons-949062 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0923 11:46:52.893566 445639 network_create.go:284] running [docker network inspect addons-949062] to gather additional debugging logs...
I0923 11:46:52.893588 445639 cli_runner.go:164] Run: docker network inspect addons-949062
W0923 11:46:52.908354 445639 cli_runner.go:211] docker network inspect addons-949062 returned with exit code 1
I0923 11:46:52.908398 445639 network_create.go:287] error running [docker network inspect addons-949062]: docker network inspect addons-949062: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-949062 not found
I0923 11:46:52.908413 445639 network_create.go:289] output of [docker network inspect addons-949062]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-949062 not found
** /stderr **
I0923 11:46:52.908531 445639 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0923 11:46:52.922509 445639 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40018510e0}
I0923 11:46:52.922550 445639 network_create.go:124] attempt to create docker network addons-949062 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0923 11:46:52.922607 445639 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-949062 addons-949062
I0923 11:46:52.997670 445639 network_create.go:108] docker network addons-949062 192.168.49.0/24 created
I0923 11:46:52.997704 445639 kic.go:121] calculated static IP "192.168.49.2" for the "addons-949062" container
I0923 11:46:52.997787 445639 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0923 11:46:53.018534 445639 cli_runner.go:164] Run: docker volume create addons-949062 --label name.minikube.sigs.k8s.io=addons-949062 --label created_by.minikube.sigs.k8s.io=true
I0923 11:46:53.039019 445639 oci.go:103] Successfully created a docker volume addons-949062
I0923 11:46:53.039123 445639 cli_runner.go:164] Run: docker run --rm --name addons-949062-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-949062 --entrypoint /usr/bin/test -v addons-949062:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed -d /var/lib
I0923 11:46:55.052353 445639 cli_runner.go:217] Completed: docker run --rm --name addons-949062-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-949062 --entrypoint /usr/bin/test -v addons-949062:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed -d /var/lib: (2.013181677s)
I0923 11:46:55.052383 445639 oci.go:107] Successfully prepared a docker volume addons-949062
I0923 11:46:55.052417 445639 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio
I0923 11:46:55.052440 445639 kic.go:194] Starting extracting preloaded images to volume ...
I0923 11:46:55.052508 445639 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19688-439483/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-arm64.tar.lz4:/preloaded.tar:ro -v addons-949062:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed -I lz4 -xf /preloaded.tar -C /extractDir
I0923 11:46:59.152153 445639 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19688-439483/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-cri-o-overlay-arm64.tar.lz4:/preloaded.tar:ro -v addons-949062:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed -I lz4 -xf /preloaded.tar -C /extractDir: (4.099605566s)
I0923 11:46:59.152184 445639 kic.go:203] duration metric: took 4.099741205s to extract preloaded images to volume ...
W0923 11:46:59.152322 445639 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0923 11:46:59.152435 445639 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0923 11:46:59.207392 445639 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-949062 --name addons-949062 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-949062 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-949062 --network addons-949062 --ip 192.168.49.2 --volume addons-949062:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed
I0923 11:46:59.511137 445639 cli_runner.go:164] Run: docker container inspect addons-949062 --format={{.State.Running}}
I0923 11:46:59.540351 445639 cli_runner.go:164] Run: docker container inspect addons-949062 --format={{.State.Status}}
I0923 11:46:59.561206 445639 cli_runner.go:164] Run: docker exec addons-949062 stat /var/lib/dpkg/alternatives/iptables
I0923 11:46:59.628365 445639 oci.go:144] the created container "addons-949062" has a running status.
I0923 11:46:59.628392 445639 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19688-439483/.minikube/machines/addons-949062/id_rsa...
I0923 11:47:00.584153 445639 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19688-439483/.minikube/machines/addons-949062/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0923 11:47:00.614708 445639 cli_runner.go:164] Run: docker container inspect addons-949062 --format={{.State.Status}}
I0923 11:47:00.635614 445639 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0923 11:47:00.635634 445639 kic_runner.go:114] Args: [docker exec --privileged addons-949062 chown docker:docker /home/docker/.ssh/authorized_keys]
I0923 11:47:00.707595 445639 cli_runner.go:164] Run: docker container inspect addons-949062 --format={{.State.Status}}
I0923 11:47:00.728068 445639 machine.go:93] provisionDockerMachine start ...
I0923 11:47:00.728175 445639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-949062
I0923 11:47:00.747832 445639 main.go:141] libmachine: Using SSH client type: native
I0923 11:47:00.748089 445639 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33163 <nil> <nil>}
I0923 11:47:00.748098 445639 main.go:141] libmachine: About to run SSH command:
hostname
I0923 11:47:00.881198 445639 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-949062
I0923 11:47:00.881272 445639 ubuntu.go:169] provisioning hostname "addons-949062"
I0923 11:47:00.881384 445639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-949062
I0923 11:47:00.905400 445639 main.go:141] libmachine: Using SSH client type: native
I0923 11:47:00.905670 445639 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33163 <nil> <nil>}
I0923 11:47:00.905691 445639 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-949062 && echo "addons-949062" | sudo tee /etc/hostname
I0923 11:47:01.053111 445639 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-949062
I0923 11:47:01.053233 445639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-949062
I0923 11:47:01.071241 445639 main.go:141] libmachine: Using SSH client type: native
I0923 11:47:01.071501 445639 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33163 <nil> <nil>}
I0923 11:47:01.071524 445639 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-949062' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-949062/g' /etc/hosts;
else
echo '127.0.1.1 addons-949062' | sudo tee -a /etc/hosts;
fi
fi
I0923 11:47:01.205263 445639 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0923 11:47:01.205293 445639 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19688-439483/.minikube CaCertPath:/home/jenkins/minikube-integration/19688-439483/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19688-439483/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19688-439483/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19688-439483/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19688-439483/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19688-439483/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19688-439483/.minikube}
I0923 11:47:01.205324 445639 ubuntu.go:177] setting up certificates
I0923 11:47:01.205333 445639 provision.go:84] configureAuth start
I0923 11:47:01.205398 445639 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-949062
I0923 11:47:01.223395 445639 provision.go:143] copyHostCerts
I0923 11:47:01.223488 445639 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19688-439483/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19688-439483/.minikube/key.pem (1679 bytes)
I0923 11:47:01.223622 445639 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19688-439483/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19688-439483/.minikube/ca.pem (1078 bytes)
I0923 11:47:01.223699 445639 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19688-439483/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19688-439483/.minikube/cert.pem (1123 bytes)
I0923 11:47:01.223767 445639 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19688-439483/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19688-439483/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19688-439483/.minikube/certs/ca-key.pem org=jenkins.addons-949062 san=[127.0.0.1 192.168.49.2 addons-949062 localhost minikube]
I0923 11:47:01.428380 445639 provision.go:177] copyRemoteCerts
I0923 11:47:01.428463 445639 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0923 11:47:01.428508 445639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-949062
I0923 11:47:01.445964 445639 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33163 SSHKeyPath:/home/jenkins/minikube-integration/19688-439483/.minikube/machines/addons-949062/id_rsa Username:docker}
I0923 11:47:01.543128 445639 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19688-439483/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0923 11:47:01.567388 445639 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19688-439483/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0923 11:47:01.592010 445639 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19688-439483/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0923 11:47:01.616592 445639 provision.go:87] duration metric: took 411.241552ms to configureAuth
I0923 11:47:01.616664 445639 ubuntu.go:193] setting minikube options for container-runtime
I0923 11:47:01.616925 445639 config.go:182] Loaded profile config "addons-949062": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0923 11:47:01.617110 445639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-949062
I0923 11:47:01.644000 445639 main.go:141] libmachine: Using SSH client type: native
I0923 11:47:01.644259 445639 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33163 <nil> <nil>}
I0923 11:47:01.644283 445639 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0923 11:47:01.875783 445639 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0923 11:47:01.875848 445639 machine.go:96] duration metric: took 1.147759935s to provisionDockerMachine
I0923 11:47:01.875872 445639 client.go:171] duration metric: took 10.387713659s to LocalClient.Create
I0923 11:47:01.875897 445639 start.go:167] duration metric: took 10.387787087s to libmachine.API.Create "addons-949062"
I0923 11:47:01.875930 445639 start.go:293] postStartSetup for "addons-949062" (driver="docker")
I0923 11:47:01.875963 445639 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0923 11:47:01.876107 445639 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0923 11:47:01.876171 445639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-949062
I0923 11:47:01.893241 445639 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33163 SSHKeyPath:/home/jenkins/minikube-integration/19688-439483/.minikube/machines/addons-949062/id_rsa Username:docker}
I0923 11:47:01.990441 445639 ssh_runner.go:195] Run: cat /etc/os-release
I0923 11:47:01.994314 445639 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0923 11:47:01.994402 445639 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0923 11:47:01.994429 445639 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0923 11:47:01.994467 445639 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I0923 11:47:01.994502 445639 filesync.go:126] Scanning /home/jenkins/minikube-integration/19688-439483/.minikube/addons for local assets ...
I0923 11:47:01.994619 445639 filesync.go:126] Scanning /home/jenkins/minikube-integration/19688-439483/.minikube/files for local assets ...
I0923 11:47:01.994664 445639 start.go:296] duration metric: took 118.707262ms for postStartSetup
I0923 11:47:01.995051 445639 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-949062
I0923 11:47:02.017608 445639 profile.go:143] Saving config to /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/config.json ...
I0923 11:47:02.017961 445639 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0923 11:47:02.018023 445639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-949062
I0923 11:47:02.034879 445639 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33163 SSHKeyPath:/home/jenkins/minikube-integration/19688-439483/.minikube/machines/addons-949062/id_rsa Username:docker}
I0923 11:47:02.125842 445639 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0923 11:47:02.130609 445639 start.go:128] duration metric: took 10.645382121s to createHost
I0923 11:47:02.130633 445639 start.go:83] releasing machines lock for "addons-949062", held for 10.645517579s
I0923 11:47:02.130704 445639 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-949062
I0923 11:47:02.148529 445639 ssh_runner.go:195] Run: cat /version.json
I0923 11:47:02.148547 445639 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0923 11:47:02.148585 445639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-949062
I0923 11:47:02.148609 445639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-949062
I0923 11:47:02.167265 445639 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33163 SSHKeyPath:/home/jenkins/minikube-integration/19688-439483/.minikube/machines/addons-949062/id_rsa Username:docker}
I0923 11:47:02.182688 445639 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33163 SSHKeyPath:/home/jenkins/minikube-integration/19688-439483/.minikube/machines/addons-949062/id_rsa Username:docker}
I0923 11:47:02.384384 445639 ssh_runner.go:195] Run: systemctl --version
I0923 11:47:02.388723 445639 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0923 11:47:02.528417 445639 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0923 11:47:02.532805 445639 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0923 11:47:02.556131 445639 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
I0923 11:47:02.556234 445639 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0923 11:47:02.588285 445639 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0923 11:47:02.588310 445639 start.go:495] detecting cgroup driver to use...
I0923 11:47:02.588365 445639 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0923 11:47:02.588440 445639 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0923 11:47:02.604456 445639 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0923 11:47:02.615691 445639 docker.go:217] disabling cri-docker service (if available) ...
I0923 11:47:02.615818 445639 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0923 11:47:02.630311 445639 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0923 11:47:02.644691 445639 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0923 11:47:02.727643 445639 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0923 11:47:02.824898 445639 docker.go:233] disabling docker service ...
I0923 11:47:02.825016 445639 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0923 11:47:02.844770 445639 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0923 11:47:02.857357 445639 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0923 11:47:02.948994 445639 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0923 11:47:03.055516 445639 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0923 11:47:03.069029 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0923 11:47:03.086794 445639 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...
I0923 11:47:03.086865 445639 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"
I0923 11:47:03.097572 445639 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0923 11:47:03.097702 445639 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0923 11:47:03.108371 445639 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0923 11:47:03.124931 445639 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0923 11:47:03.135562 445639 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0923 11:47:03.145123 445639 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I0923 11:47:03.155610 445639 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I0923 11:47:03.172186 445639 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I0923 11:47:03.182475 445639 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0923 11:47:03.191293 445639 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0923 11:47:03.199896 445639 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0923 11:47:03.288643 445639 ssh_runner.go:195] Run: sudo systemctl restart crio
I0923 11:47:03.414491 445639 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0923 11:47:03.414584 445639 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0923 11:47:03.418311 445639 start.go:563] Will wait 60s for crictl version
I0923 11:47:03.418425 445639 ssh_runner.go:195] Run: which crictl
I0923 11:47:03.422311 445639 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0923 11:47:03.463261 445639 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.6
RuntimeApiVersion: v1
I0923 11:47:03.463365 445639 ssh_runner.go:195] Run: crio --version
I0923 11:47:03.503697 445639 ssh_runner.go:195] Run: crio --version
I0923 11:47:03.542394 445639 out.go:177] * Preparing Kubernetes v1.31.1 on CRI-O 1.24.6 ...
I0923 11:47:03.544254 445639 cli_runner.go:164] Run: docker network inspect addons-949062 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0923 11:47:03.559734 445639 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I0923 11:47:03.563258 445639 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0923 11:47:03.573759 445639 kubeadm.go:883] updating cluster {Name:addons-949062 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-949062 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmw
arePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0923 11:47:03.573878 445639 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio
I0923 11:47:03.573943 445639 ssh_runner.go:195] Run: sudo crictl images --output json
I0923 11:47:03.645037 445639 crio.go:514] all images are preloaded for cri-o runtime.
I0923 11:47:03.645062 445639 crio.go:433] Images already preloaded, skipping extraction
I0923 11:47:03.645124 445639 ssh_runner.go:195] Run: sudo crictl images --output json
I0923 11:47:03.682682 445639 crio.go:514] all images are preloaded for cri-o runtime.
I0923 11:47:03.682708 445639 cache_images.go:84] Images are preloaded, skipping loading
I0923 11:47:03.682717 445639 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.1 crio true true} ...
I0923 11:47:03.682818 445639 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=addons-949062 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.31.1 ClusterName:addons-949062 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0923 11:47:03.682905 445639 ssh_runner.go:195] Run: crio config
I0923 11:47:03.749558 445639 cni.go:84] Creating CNI manager for ""
I0923 11:47:03.749582 445639 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0923 11:47:03.749592 445639 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0923 11:47:03.749615 445639 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-949062 NodeName:addons-949062 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kuberne
tes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0923 11:47:03.749758 445639 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "addons-949062"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0923 11:47:03.749832 445639 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1
I0923 11:47:03.758754 445639 binaries.go:44] Found k8s binaries, skipping transfer
I0923 11:47:03.758861 445639 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0923 11:47:03.767733 445639 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (363 bytes)
I0923 11:47:03.785605 445639 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0923 11:47:03.804598 445639 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2151 bytes)
I0923 11:47:03.823383 445639 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0923 11:47:03.826720 445639 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0923 11:47:03.837578 445639 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0923 11:47:03.920967 445639 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0923 11:47:03.935037 445639 certs.go:68] Setting up /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062 for IP: 192.168.49.2
I0923 11:47:03.935108 445639 certs.go:194] generating shared ca certs ...
I0923 11:47:03.935139 445639 certs.go:226] acquiring lock for ca certs: {Name:mk8886b7f4079fe3380ff87fbe608ebcf7a50150 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 11:47:03.935304 445639 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19688-439483/.minikube/ca.key
I0923 11:47:04.300186 445639 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19688-439483/.minikube/ca.crt ...
I0923 11:47:04.300217 445639 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19688-439483/.minikube/ca.crt: {Name:mkc163e0736acb4ab6c90a2621714f039ca25eb5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 11:47:04.300418 445639 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19688-439483/.minikube/ca.key ...
I0923 11:47:04.300430 445639 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19688-439483/.minikube/ca.key: {Name:mk56c01250d89e3f2925baedaf4f263e4273477a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 11:47:04.301097 445639 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19688-439483/.minikube/proxy-client-ca.key
I0923 11:47:04.476043 445639 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19688-439483/.minikube/proxy-client-ca.crt ...
I0923 11:47:04.476077 445639 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19688-439483/.minikube/proxy-client-ca.crt: {Name:mk01bc672072174ac83940873f84c662f94dff46 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 11:47:04.476257 445639 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19688-439483/.minikube/proxy-client-ca.key ...
I0923 11:47:04.476270 445639 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19688-439483/.minikube/proxy-client-ca.key: {Name:mk315f2d14088a80003ac768611d4c83fa0f1c63 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 11:47:04.476354 445639 certs.go:256] generating profile certs ...
I0923 11:47:04.476415 445639 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/client.key
I0923 11:47:04.476435 445639 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/client.crt with IP's: []
I0923 11:47:04.731481 445639 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/client.crt ...
I0923 11:47:04.731513 445639 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/client.crt: {Name:mk1490c19f8381a64e99a74c5ee248576c5c2ee6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 11:47:04.731732 445639 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/client.key ...
I0923 11:47:04.731745 445639 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/client.key: {Name:mk2202fa1c77f046946637138cd739c4a47cd48e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 11:47:04.731836 445639 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/apiserver.key.1c1dc788
I0923 11:47:04.731858 445639 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/apiserver.crt.1c1dc788 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I0923 11:47:05.351108 445639 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/apiserver.crt.1c1dc788 ...
I0923 11:47:05.351141 445639 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/apiserver.crt.1c1dc788: {Name:mk4216f1f2c9fc1b684c441f57f188446c0621bb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 11:47:05.351325 445639 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/apiserver.key.1c1dc788 ...
I0923 11:47:05.351343 445639 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/apiserver.key.1c1dc788: {Name:mka3309cf97f0fe83bcf4d91386dffb2f810e96e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 11:47:05.351435 445639 certs.go:381] copying /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/apiserver.crt.1c1dc788 -> /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/apiserver.crt
I0923 11:47:05.351526 445639 certs.go:385] copying /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/apiserver.key.1c1dc788 -> /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/apiserver.key
I0923 11:47:05.351582 445639 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/proxy-client.key
I0923 11:47:05.351603 445639 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/proxy-client.crt with IP's: []
I0923 11:47:06.355674 445639 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/proxy-client.crt ...
I0923 11:47:06.355710 445639 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/proxy-client.crt: {Name:mkf53dbefd9f18b1111237760556a22457c94215 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 11:47:06.355906 445639 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/proxy-client.key ...
I0923 11:47:06.355921 445639 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/proxy-client.key: {Name:mk62014910fd4cb6698550052f021081d2979d56 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 11:47:06.356112 445639 certs.go:484] found cert: /home/jenkins/minikube-integration/19688-439483/.minikube/certs/ca-key.pem (1679 bytes)
I0923 11:47:06.356158 445639 certs.go:484] found cert: /home/jenkins/minikube-integration/19688-439483/.minikube/certs/ca.pem (1078 bytes)
I0923 11:47:06.356190 445639 certs.go:484] found cert: /home/jenkins/minikube-integration/19688-439483/.minikube/certs/cert.pem (1123 bytes)
I0923 11:47:06.356218 445639 certs.go:484] found cert: /home/jenkins/minikube-integration/19688-439483/.minikube/certs/key.pem (1679 bytes)
I0923 11:47:06.356896 445639 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19688-439483/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0923 11:47:06.382662 445639 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19688-439483/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0923 11:47:06.407659 445639 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19688-439483/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0923 11:47:06.432247 445639 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19688-439483/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0923 11:47:06.456893 445639 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0923 11:47:06.481763 445639 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0923 11:47:06.506778 445639 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0923 11:47:06.532417 445639 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19688-439483/.minikube/profiles/addons-949062/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0923 11:47:06.559058 445639 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19688-439483/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0923 11:47:06.584012 445639 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0923 11:47:06.602857 445639 ssh_runner.go:195] Run: openssl version
I0923 11:47:06.608334 445639 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0923 11:47:06.618136 445639 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0923 11:47:06.622439 445639 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 23 11:47 /usr/share/ca-certificates/minikubeCA.pem
I0923 11:47:06.622511 445639 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0923 11:47:06.630121 445639 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0923 11:47:06.639633 445639 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0923 11:47:06.643153 445639 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0923 11:47:06.643205 445639 kubeadm.go:392] StartCluster: {Name:addons-949062 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-949062 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmware
Path: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0923 11:47:06.643283 445639 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0923 11:47:06.643339 445639 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0923 11:47:06.682408 445639 cri.go:89] found id: ""
I0923 11:47:06.682536 445639 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0923 11:47:06.691370 445639 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0923 11:47:06.700129 445639 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0923 11:47:06.700223 445639 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0923 11:47:06.709029 445639 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0923 11:47:06.709100 445639 kubeadm.go:157] found existing configuration files:
I0923 11:47:06.709158 445639 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0923 11:47:06.718007 445639 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0923 11:47:06.718081 445639 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0923 11:47:06.727238 445639 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0923 11:47:06.736478 445639 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0923 11:47:06.736569 445639 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0923 11:47:06.745179 445639 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0923 11:47:06.753869 445639 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0923 11:47:06.753954 445639 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0923 11:47:06.762453 445639 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0923 11:47:06.771165 445639 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0923 11:47:06.771254 445639 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0923 11:47:06.779956 445639 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0923 11:47:06.818721 445639 kubeadm.go:310] W0923 11:47:06.817994 1185 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0923 11:47:06.819537 445639 kubeadm.go:310] W0923 11:47:06.819007 1185 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0923 11:47:06.853459 445639 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1070-aws\n", err: exit status 1
I0923 11:47:06.919288 445639 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0923 11:47:20.492137 445639 kubeadm.go:310] [init] Using Kubernetes version: v1.31.1
I0923 11:47:20.492205 445639 kubeadm.go:310] [preflight] Running pre-flight checks
I0923 11:47:20.492332 445639 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0923 11:47:20.492409 445639 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1070-aws[0m
I0923 11:47:20.492472 445639 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0923 11:47:20.492543 445639 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0923 11:47:20.492615 445639 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0923 11:47:20.492708 445639 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0923 11:47:20.492783 445639 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0923 11:47:20.492855 445639 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0923 11:47:20.493017 445639 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0923 11:47:20.493077 445639 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0923 11:47:20.493132 445639 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0923 11:47:20.493189 445639 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0923 11:47:20.493268 445639 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0923 11:47:20.493403 445639 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0923 11:47:20.493513 445639 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0923 11:47:20.493583 445639 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0923 11:47:20.497700 445639 out.go:235] - Generating certificates and keys ...
I0923 11:47:20.497807 445639 kubeadm.go:310] [certs] Using existing ca certificate authority
I0923 11:47:20.497883 445639 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0923 11:47:20.497961 445639 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0923 11:47:20.498023 445639 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0923 11:47:20.498087 445639 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0923 11:47:20.498166 445639 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0923 11:47:20.498247 445639 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0923 11:47:20.498380 445639 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-949062 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0923 11:47:20.498441 445639 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0923 11:47:20.498577 445639 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-949062 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0923 11:47:20.498649 445639 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0923 11:47:20.498745 445639 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0923 11:47:20.498806 445639 kubeadm.go:310] [certs] Generating "sa" key and public key
I0923 11:47:20.498868 445639 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0923 11:47:20.498924 445639 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0923 11:47:20.498990 445639 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0923 11:47:20.499056 445639 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0923 11:47:20.499133 445639 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0923 11:47:20.499193 445639 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0923 11:47:20.499293 445639 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0923 11:47:20.499379 445639 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0923 11:47:20.501872 445639 out.go:235] - Booting up control plane ...
I0923 11:47:20.501997 445639 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0923 11:47:20.502080 445639 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0923 11:47:20.502152 445639 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0923 11:47:20.502356 445639 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0923 11:47:20.502469 445639 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0923 11:47:20.502514 445639 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0923 11:47:20.502654 445639 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0923 11:47:20.502767 445639 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0923 11:47:20.502848 445639 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.001623584s
I0923 11:47:20.502986 445639 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0923 11:47:20.503064 445639 kubeadm.go:310] [api-check] The API server is healthy after 6.001467918s
I0923 11:47:20.503185 445639 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0923 11:47:20.503325 445639 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0923 11:47:20.503396 445639 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0923 11:47:20.503594 445639 kubeadm.go:310] [mark-control-plane] Marking the node addons-949062 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0923 11:47:20.503657 445639 kubeadm.go:310] [bootstrap-token] Using token: 5hfhnb.yczp8avbg6zznrz5
I0923 11:47:20.505826 445639 out.go:235] - Configuring RBAC rules ...
I0923 11:47:20.505951 445639 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0923 11:47:20.506040 445639 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0923 11:47:20.506183 445639 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0923 11:47:20.506326 445639 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0923 11:47:20.506447 445639 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0923 11:47:20.506535 445639 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0923 11:47:20.506652 445639 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0923 11:47:20.506701 445639 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0923 11:47:20.506753 445639 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0923 11:47:20.506760 445639 kubeadm.go:310]
I0923 11:47:20.506823 445639 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0923 11:47:20.506832 445639 kubeadm.go:310]
I0923 11:47:20.506909 445639 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0923 11:47:20.506916 445639 kubeadm.go:310]
I0923 11:47:20.506942 445639 kubeadm.go:310] mkdir -p $HOME/.kube
I0923 11:47:20.507003 445639 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0923 11:47:20.507056 445639 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0923 11:47:20.507064 445639 kubeadm.go:310]
I0923 11:47:20.507117 445639 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0923 11:47:20.507127 445639 kubeadm.go:310]
I0923 11:47:20.507175 445639 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0923 11:47:20.507183 445639 kubeadm.go:310]
I0923 11:47:20.507235 445639 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0923 11:47:20.507312 445639 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0923 11:47:20.507392 445639 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0923 11:47:20.507400 445639 kubeadm.go:310]
I0923 11:47:20.507483 445639 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0923 11:47:20.507564 445639 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0923 11:47:20.507572 445639 kubeadm.go:310]
I0923 11:47:20.507658 445639 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token 5hfhnb.yczp8avbg6zznrz5 \
I0923 11:47:20.507762 445639 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:e56966a64450bab0610dd6243262c3db7cc7afb656414179dba6b1f3d6d53051 \
I0923 11:47:20.507786 445639 kubeadm.go:310] --control-plane
I0923 11:47:20.507794 445639 kubeadm.go:310]
I0923 11:47:20.507878 445639 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0923 11:47:20.507886 445639 kubeadm.go:310]
I0923 11:47:20.507967 445639 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token 5hfhnb.yczp8avbg6zznrz5 \
I0923 11:47:20.508086 445639 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:e56966a64450bab0610dd6243262c3db7cc7afb656414179dba6b1f3d6d53051
I0923 11:47:20.508099 445639 cni.go:84] Creating CNI manager for ""
I0923 11:47:20.508106 445639 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0923 11:47:20.510372 445639 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0923 11:47:20.512758 445639 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0923 11:47:20.516740 445639 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.1/kubectl ...
I0923 11:47:20.516760 445639 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I0923 11:47:20.537047 445639 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0923 11:47:20.831795 445639 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0923 11:47:20.831931 445639 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0923 11:47:20.832045 445639 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-949062 minikube.k8s.io/updated_at=2024_09_23T11_47_20_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=a36553b39c7bbbd910f6bfb97f7b698be94b4e6e minikube.k8s.io/name=addons-949062 minikube.k8s.io/primary=true
I0923 11:47:20.982024 445639 ops.go:34] apiserver oom_adj: -16
I0923 11:47:20.982214 445639 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0923 11:47:21.483054 445639 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0923 11:47:21.982325 445639 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0923 11:47:22.482326 445639 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0923 11:47:22.983021 445639 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0923 11:47:23.483095 445639 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0923 11:47:23.983264 445639 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0923 11:47:24.482361 445639 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0923 11:47:24.982968 445639 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0923 11:47:25.103477 445639 kubeadm.go:1113] duration metric: took 4.271592558s to wait for elevateKubeSystemPrivileges
I0923 11:47:25.103516 445639 kubeadm.go:394] duration metric: took 18.460309427s to StartCluster
I0923 11:47:25.103535 445639 settings.go:142] acquiring lock: {Name:mk02e1628c86a1770378892d7a3154d0c52b89bd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 11:47:25.103651 445639 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19688-439483/kubeconfig
I0923 11:47:25.104105 445639 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19688-439483/kubeconfig: {Name:mk9e4fe276763425cb8cd915eff87c9d41b7f36a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 11:47:25.104994 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0923 11:47:25.105325 445639 config.go:182] Loaded profile config "addons-949062": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0923 11:47:25.105378 445639 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I0923 11:47:25.105430 445639 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I0923 11:47:25.105668 445639 addons.go:69] Setting yakd=true in profile "addons-949062"
I0923 11:47:25.105690 445639 addons.go:234] Setting addon yakd=true in "addons-949062"
I0923 11:47:25.105725 445639 host.go:66] Checking if "addons-949062" exists ...
I0923 11:47:25.106229 445639 cli_runner.go:164] Run: docker container inspect addons-949062 --format={{.State.Status}}
I0923 11:47:25.106525 445639 addons.go:69] Setting inspektor-gadget=true in profile "addons-949062"
I0923 11:47:25.106551 445639 addons.go:234] Setting addon inspektor-gadget=true in "addons-949062"
I0923 11:47:25.106580 445639 host.go:66] Checking if "addons-949062" exists ...
I0923 11:47:25.107017 445639 cli_runner.go:164] Run: docker container inspect addons-949062 --format={{.State.Status}}
I0923 11:47:25.107337 445639 addons.go:69] Setting metrics-server=true in profile "addons-949062"
I0923 11:47:25.107400 445639 addons.go:234] Setting addon metrics-server=true in "addons-949062"
I0923 11:47:25.107426 445639 host.go:66] Checking if "addons-949062" exists ...
I0923 11:47:25.107516 445639 addons.go:69] Setting cloud-spanner=true in profile "addons-949062"
I0923 11:47:25.107536 445639 addons.go:234] Setting addon cloud-spanner=true in "addons-949062"
I0923 11:47:25.107564 445639 host.go:66] Checking if "addons-949062" exists ...
I0923 11:47:25.107857 445639 cli_runner.go:164] Run: docker container inspect addons-949062 --format={{.State.Status}}
I0923 11:47:25.107980 445639 cli_runner.go:164] Run: docker container inspect addons-949062 --format={{.State.Status}}
I0923 11:47:25.109750 445639 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-949062"
I0923 11:47:25.109794 445639 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-949062"
I0923 11:47:25.109831 445639 host.go:66] Checking if "addons-949062" exists ...
I0923 11:47:25.110346 445639 cli_runner.go:164] Run: docker container inspect addons-949062 --format={{.State.Status}}
I0923 11:47:25.117101 445639 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-949062"
I0923 11:47:25.124804 445639 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-949062"
I0923 11:47:25.124849 445639 host.go:66] Checking if "addons-949062" exists ...
I0923 11:47:25.125415 445639 cli_runner.go:164] Run: docker container inspect addons-949062 --format={{.State.Status}}
I0923 11:47:25.125627 445639 out.go:177] * Verifying Kubernetes components...
I0923 11:47:25.132722 445639 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0923 11:47:25.122697 445639 addons.go:69] Setting default-storageclass=true in profile "addons-949062"
I0923 11:47:25.132904 445639 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-949062"
I0923 11:47:25.134746 445639 cli_runner.go:164] Run: docker container inspect addons-949062 --format={{.State.Status}}
I0923 11:47:25.122717 445639 addons.go:69] Setting gcp-auth=true in profile "addons-949062"
I0923 11:47:25.159391 445639 mustload.go:65] Loading cluster: addons-949062
I0923 11:47:25.159657 445639 config.go:182] Loaded profile config "addons-949062": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0923 11:47:25.160039 445639 cli_runner.go:164] Run: docker container inspect addons-949062 --format={{.State.Status}}
I0923 11:47:25.122725 445639 addons.go:69] Setting ingress=true in profile "addons-949062"
I0923 11:47:25.192430 445639 addons.go:234] Setting addon ingress=true in "addons-949062"
I0923 11:47:25.192550 445639 host.go:66] Checking if "addons-949062" exists ...
I0923 11:47:25.193087 445639 cli_runner.go:164] Run: docker container inspect addons-949062 --format={{.State.Status}}
I0923 11:47:25.122729 445639 addons.go:69] Setting ingress-dns=true in profile "addons-949062"
I0923 11:47:25.200727 445639 addons.go:234] Setting addon ingress-dns=true in "addons-949062"
I0923 11:47:25.200793 445639 host.go:66] Checking if "addons-949062" exists ...
I0923 11:47:25.204525 445639 cli_runner.go:164] Run: docker container inspect addons-949062 --format={{.State.Status}}
I0923 11:47:25.124390 445639 addons.go:69] Setting registry=true in profile "addons-949062"
I0923 11:47:25.214866 445639 addons.go:234] Setting addon registry=true in "addons-949062"
I0923 11:47:25.214927 445639 host.go:66] Checking if "addons-949062" exists ...
I0923 11:47:25.215432 445639 cli_runner.go:164] Run: docker container inspect addons-949062 --format={{.State.Status}}
I0923 11:47:25.222564 445639 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0
I0923 11:47:25.229932 445639 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
I0923 11:47:25.229960 445639 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I0923 11:47:25.230032 445639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-949062
I0923 11:47:25.124403 445639 addons.go:69] Setting storage-provisioner=true in profile "addons-949062"
I0923 11:47:25.233168 445639 addons.go:234] Setting addon storage-provisioner=true in "addons-949062"
I0923 11:47:25.233207 445639 host.go:66] Checking if "addons-949062" exists ...
I0923 11:47:25.233668 445639 cli_runner.go:164] Run: docker container inspect addons-949062 --format={{.State.Status}}
I0923 11:47:25.124410 445639 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-949062"
I0923 11:47:25.253054 445639 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-949062"
I0923 11:47:25.253402 445639 cli_runner.go:164] Run: docker container inspect addons-949062 --format={{.State.Status}}
I0923 11:47:25.124414 445639 addons.go:69] Setting volcano=true in profile "addons-949062"
I0923 11:47:25.277153 445639 addons.go:234] Setting addon volcano=true in "addons-949062"
I0923 11:47:25.277207 445639 host.go:66] Checking if "addons-949062" exists ...
I0923 11:47:25.124417 445639 addons.go:69] Setting volumesnapshots=true in profile "addons-949062"
I0923 11:47:25.280439 445639 addons.go:234] Setting addon volumesnapshots=true in "addons-949062"
I0923 11:47:25.280486 445639 host.go:66] Checking if "addons-949062" exists ...
I0923 11:47:25.281006 445639 cli_runner.go:164] Run: docker container inspect addons-949062 --format={{.State.Status}}
I0923 11:47:25.307719 445639 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2
I0923 11:47:25.309027 445639 cli_runner.go:164] Run: docker container inspect addons-949062 --format={{.State.Status}}
I0923 11:47:25.309206 445639 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I0923 11:47:25.309379 445639 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.24
I0923 11:47:25.338238 445639 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0923 11:47:25.343217 445639 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0923 11:47:25.344501 445639 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
I0923 11:47:25.344570 445639 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0923 11:47:25.344680 445639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-949062
I0923 11:47:25.356992 445639 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0923 11:47:25.357028 445639 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0923 11:47:25.357144 445639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-949062
I0923 11:47:25.371116 445639 addons.go:234] Setting addon default-storageclass=true in "addons-949062"
I0923 11:47:25.371155 445639 host.go:66] Checking if "addons-949062" exists ...
I0923 11:47:25.371683 445639 cli_runner.go:164] Run: docker container inspect addons-949062 --format={{.State.Status}}
I0923 11:47:25.394732 445639 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
I0923 11:47:25.394753 445639 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0923 11:47:25.394814 445639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-949062
I0923 11:47:25.397575 445639 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0923 11:47:25.401411 445639 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0923 11:47:25.404886 445639 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0923 11:47:25.407403 445639 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0923 11:47:25.411249 445639 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
I0923 11:47:25.413278 445639 host.go:66] Checking if "addons-949062" exists ...
I0923 11:47:25.420743 445639 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I0923 11:47:25.420997 445639 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0923 11:47:25.421013 445639 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0923 11:47:25.421076 445639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-949062
I0923 11:47:25.421252 445639 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0923 11:47:25.422140 445639 out.go:177] - Using image docker.io/registry:2.8.3
I0923 11:47:25.423221 445639 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0923 11:47:25.423241 445639 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0923 11:47:25.423305 445639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-949062
I0923 11:47:25.428654 445639 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-949062"
I0923 11:47:25.428753 445639 host.go:66] Checking if "addons-949062" exists ...
I0923 11:47:25.429162 445639 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0923 11:47:25.431534 445639 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0923 11:47:25.431605 445639 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0923 11:47:25.431710 445639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-949062
I0923 11:47:25.438933 445639 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
I0923 11:47:25.446897 445639 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
I0923 11:47:25.446970 445639 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I0923 11:47:25.447065 445639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-949062
I0923 11:47:25.461218 445639 cli_runner.go:164] Run: docker container inspect addons-949062 --format={{.State.Status}}
I0923 11:47:25.483251 445639 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33163 SSHKeyPath:/home/jenkins/minikube-integration/19688-439483/.minikube/machines/addons-949062/id_rsa Username:docker}
I0923 11:47:25.492584 445639 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0923 11:47:25.492660 445639 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0923 11:47:25.496621 445639 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0923 11:47:25.496650 445639 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0923 11:47:25.496744 445639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-949062
I0923 11:47:25.498725 445639 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2
I0923 11:47:25.500629 445639 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0923 11:47:25.502963 445639 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0923 11:47:25.502988 445639 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I0923 11:47:25.503053 445639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-949062
I0923 11:47:25.546113 445639 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33163 SSHKeyPath:/home/jenkins/minikube-integration/19688-439483/.minikube/machines/addons-949062/id_rsa Username:docker}
I0923 11:47:25.556096 445639 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33163 SSHKeyPath:/home/jenkins/minikube-integration/19688-439483/.minikube/machines/addons-949062/id_rsa Username:docker}
I0923 11:47:25.574587 445639 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0923 11:47:25.576812 445639 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0923 11:47:25.576836 445639 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0923 11:47:25.576904 445639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-949062
W0923 11:47:25.621946 445639 out.go:270] ! Enabling 'volcano' returned an error: running callbacks: [volcano addon does not support crio]
I0923 11:47:25.690616 445639 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0923 11:47:25.690641 445639 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0923 11:47:25.690705 445639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-949062
I0923 11:47:25.712179 445639 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33163 SSHKeyPath:/home/jenkins/minikube-integration/19688-439483/.minikube/machines/addons-949062/id_rsa Username:docker}
I0923 11:47:25.713170 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0923 11:47:25.725724 445639 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33163 SSHKeyPath:/home/jenkins/minikube-integration/19688-439483/.minikube/machines/addons-949062/id_rsa Username:docker}
I0923 11:47:25.729261 445639 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33163 SSHKeyPath:/home/jenkins/minikube-integration/19688-439483/.minikube/machines/addons-949062/id_rsa Username:docker}
I0923 11:47:25.729663 445639 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33163 SSHKeyPath:/home/jenkins/minikube-integration/19688-439483/.minikube/machines/addons-949062/id_rsa Username:docker}
I0923 11:47:25.762635 445639 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33163 SSHKeyPath:/home/jenkins/minikube-integration/19688-439483/.minikube/machines/addons-949062/id_rsa Username:docker}
I0923 11:47:25.770422 445639 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0923 11:47:25.773100 445639 out.go:177] - Using image docker.io/busybox:stable
I0923 11:47:25.775897 445639 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0923 11:47:25.775920 445639 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0923 11:47:25.775999 445639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-949062
I0923 11:47:25.780781 445639 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33163 SSHKeyPath:/home/jenkins/minikube-integration/19688-439483/.minikube/machines/addons-949062/id_rsa Username:docker}
I0923 11:47:25.784006 445639 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33163 SSHKeyPath:/home/jenkins/minikube-integration/19688-439483/.minikube/machines/addons-949062/id_rsa Username:docker}
I0923 11:47:25.788537 445639 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33163 SSHKeyPath:/home/jenkins/minikube-integration/19688-439483/.minikube/machines/addons-949062/id_rsa Username:docker}
I0923 11:47:25.815383 445639 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33163 SSHKeyPath:/home/jenkins/minikube-integration/19688-439483/.minikube/machines/addons-949062/id_rsa Username:docker}
I0923 11:47:25.821574 445639 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33163 SSHKeyPath:/home/jenkins/minikube-integration/19688-439483/.minikube/machines/addons-949062/id_rsa Username:docker}
I0923 11:47:25.847524 445639 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0923 11:47:25.847545 445639 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0923 11:47:25.864050 445639 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0923 11:47:25.894862 445639 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0923 11:47:25.997125 445639 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0923 11:47:25.997199 445639 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0923 11:47:26.056246 445639 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I0923 11:47:26.056322 445639 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I0923 11:47:26.083696 445639 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0923 11:47:26.083778 445639 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0923 11:47:26.204465 445639 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0923 11:47:26.204541 445639 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0923 11:47:26.210937 445639 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
I0923 11:47:26.211015 445639 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I0923 11:47:26.219957 445639 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
I0923 11:47:26.220032 445639 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0923 11:47:26.223822 445639 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0923 11:47:26.227123 445639 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
I0923 11:47:26.227195 445639 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0923 11:47:26.243917 445639 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0923 11:47:26.265203 445639 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0923 11:47:26.294961 445639 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0923 11:47:26.325201 445639 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0923 11:47:26.325274 445639 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0923 11:47:26.331267 445639 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0923 11:47:26.331462 445639 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0923 11:47:26.403593 445639 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I0923 11:47:26.403668 445639 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I0923 11:47:26.444228 445639 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0923 11:47:26.444301 445639 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0923 11:47:26.447454 445639 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0923 11:47:26.450185 445639 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0923 11:47:26.450254 445639 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0923 11:47:26.463525 445639 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
I0923 11:47:26.463594 445639 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0923 11:47:26.475971 445639 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
I0923 11:47:26.476047 445639 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0923 11:47:26.573336 445639 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I0923 11:47:26.573414 445639 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I0923 11:47:26.579252 445639 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0923 11:47:26.579335 445639 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0923 11:47:26.587100 445639 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0923 11:47:26.587172 445639 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0923 11:47:26.591301 445639 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
I0923 11:47:26.591370 445639 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0923 11:47:26.678086 445639 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0923 11:47:26.725108 445639 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0923 11:47:26.725189 445639 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0923 11:47:26.748715 445639 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
I0923 11:47:26.748787 445639 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0923 11:47:26.760455 445639 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0923 11:47:26.760529 445639 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0923 11:47:26.777749 445639 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I0923 11:47:26.777828 445639 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I0923 11:47:26.920454 445639 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0923 11:47:26.920525 445639 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0923 11:47:26.933107 445639 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0923 11:47:26.933183 445639 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0923 11:47:26.939593 445639 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0923 11:47:26.954672 445639 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
I0923 11:47:26.954745 445639 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I0923 11:47:26.996992 445639 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0923 11:47:26.997067 445639 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0923 11:47:27.035269 445639 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0923 11:47:27.055321 445639 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0923 11:47:27.055403 445639 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0923 11:47:27.063115 445639 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
I0923 11:47:27.063189 445639 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
I0923 11:47:27.155878 445639 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I0923 11:47:27.210096 445639 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0923 11:47:27.210170 445639 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0923 11:47:27.313133 445639 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0923 11:47:27.313205 445639 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0923 11:47:27.414647 445639 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0923 11:47:27.414724 445639 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0923 11:47:27.536958 445639 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0923 11:47:28.576461 445639 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (2.7123482s)
I0923 11:47:28.576721 445639 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.863525117s)
I0923 11:47:28.576784 445639 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I0923 11:47:28.578673 445639 node_ready.go:35] waiting up to 6m0s for node "addons-949062" to be "Ready" ...
I0923 11:47:29.366984 445639 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-949062" context rescaled to 1 replicas
I0923 11:47:29.608022 445639 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (3.713053614s)
I0923 11:47:29.853419 445639 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (3.629515759s)
I0923 11:47:30.463477 445639 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (4.198189434s)
I0923 11:47:30.463550 445639 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (4.168517675s)
I0923 11:47:30.463592 445639 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (4.132256692s)
I0923 11:47:30.463934 445639 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (4.219941975s)
I0923 11:47:30.463981 445639 addons.go:475] Verifying addon metrics-server=true in "addons-949062"
I0923 11:47:30.602316 445639 node_ready.go:53] node "addons-949062" has status "Ready":"False"
I0923 11:47:31.226978 445639 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (4.895462339s)
I0923 11:47:31.227059 445639 addons.go:475] Verifying addon ingress=true in "addons-949062"
I0923 11:47:31.227422 445639 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (4.287757679s)
I0923 11:47:31.227207 445639 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (4.779598683s)
I0923 11:47:31.227255 445639 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (4.549094678s)
I0923 11:47:31.227779 445639 addons.go:475] Verifying addon registry=true in "addons-949062"
I0923 11:47:31.229699 445639 out.go:177] * Verifying registry addon...
I0923 11:47:31.229801 445639 out.go:177] * Verifying ingress addon...
I0923 11:47:31.229846 445639 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-949062 service yakd-dashboard -n yakd-dashboard
I0923 11:47:31.233265 445639 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0923 11:47:31.234332 445639 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0923 11:47:31.250191 445639 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=registry
I0923 11:47:31.250280 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:31.275807 445639 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0923 11:47:31.275879 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:31.436196 445639 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (4.400830271s)
W0923 11:47:31.436281 445639 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0923 11:47:31.436339 445639 retry.go:31] will retry after 182.969163ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0923 11:47:31.436446 445639 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (4.280489573s)
I0923 11:47:31.620371 445639 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0923 11:47:31.759277 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:31.773206 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:31.858963 445639 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (4.321902611s)
I0923 11:47:31.859046 445639 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-949062"
I0923 11:47:31.865822 445639 out.go:177] * Verifying csi-hostpath-driver addon...
I0923 11:47:31.869037 445639 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0923 11:47:31.912969 445639 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0923 11:47:31.912991 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:32.251090 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:32.252452 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:32.373204 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:32.739425 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:32.740447 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:32.873911 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:33.083808 445639 node_ready.go:53] node "addons-949062" has status "Ready":"False"
I0923 11:47:33.241628 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:33.338821 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:33.373555 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:33.739639 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:33.741032 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:33.876015 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:34.239516 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:34.241410 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:34.387963 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:34.753957 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:34.754462 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:34.821576 445639 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (3.201064593s)
I0923 11:47:34.874034 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:35.087494 445639 node_ready.go:53] node "addons-949062" has status "Ready":"False"
I0923 11:47:35.236329 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:35.239078 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:35.373115 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:35.738029 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:35.739680 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:35.844517 445639 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0923 11:47:35.844602 445639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-949062
I0923 11:47:35.865028 445639 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33163 SSHKeyPath:/home/jenkins/minikube-integration/19688-439483/.minikube/machines/addons-949062/id_rsa Username:docker}
I0923 11:47:35.874321 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:35.978873 445639 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0923 11:47:35.997265 445639 addons.go:234] Setting addon gcp-auth=true in "addons-949062"
I0923 11:47:35.997317 445639 host.go:66] Checking if "addons-949062" exists ...
I0923 11:47:35.997795 445639 cli_runner.go:164] Run: docker container inspect addons-949062 --format={{.State.Status}}
I0923 11:47:36.019821 445639 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0923 11:47:36.019901 445639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-949062
I0923 11:47:36.039339 445639 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33163 SSHKeyPath:/home/jenkins/minikube-integration/19688-439483/.minikube/machines/addons-949062/id_rsa Username:docker}
I0923 11:47:36.160367 445639 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0923 11:47:36.162350 445639 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
I0923 11:47:36.164274 445639 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0923 11:47:36.164306 445639 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0923 11:47:36.191375 445639 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0923 11:47:36.191404 445639 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0923 11:47:36.210745 445639 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0923 11:47:36.210770 445639 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I0923 11:47:36.233178 445639 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0923 11:47:36.237921 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:36.244112 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:36.374376 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:36.742008 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:36.743471 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:36.875740 445639 addons.go:475] Verifying addon gcp-auth=true in "addons-949062"
I0923 11:47:36.877861 445639 out.go:177] * Verifying gcp-auth addon...
I0923 11:47:36.880821 445639 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0923 11:47:36.882673 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:36.990251 445639 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0923 11:47:36.990345 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:37.237425 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:37.238222 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:37.373425 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:37.384399 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:37.583461 445639 node_ready.go:53] node "addons-949062" has status "Ready":"False"
I0923 11:47:37.737687 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:37.738911 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:37.872662 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:37.884681 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:38.236686 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:38.238137 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:38.372763 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:38.383816 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:38.737311 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:38.738305 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:38.872038 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:38.884316 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:39.237259 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:39.238077 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:39.372472 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:39.384642 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:39.736235 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:39.737651 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:39.872219 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:39.884073 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:40.082413 445639 node_ready.go:53] node "addons-949062" has status "Ready":"False"
I0923 11:47:40.236640 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:40.238427 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:40.372869 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:40.383890 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:40.737593 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:40.738702 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:40.873082 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:40.884414 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:41.238710 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:41.240566 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:41.372880 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:41.383900 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:41.737050 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:41.738015 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:41.872513 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:41.884753 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:42.082755 445639 node_ready.go:53] node "addons-949062" has status "Ready":"False"
I0923 11:47:42.236904 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:42.239321 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:42.373188 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:42.384506 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:42.737611 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:42.738231 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:42.873843 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:42.884134 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:43.236544 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:43.238842 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:43.373119 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:43.385043 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:43.736341 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:43.738186 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:43.873092 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:43.884010 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:44.236665 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:44.238294 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:44.372710 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:44.384169 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:44.582242 445639 node_ready.go:53] node "addons-949062" has status "Ready":"False"
I0923 11:47:44.736346 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:44.738296 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:44.873223 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:44.884429 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:45.254432 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:45.256045 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:45.374232 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:45.385675 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:45.737168 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:45.738776 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:45.872483 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:45.885038 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:46.237413 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:46.238367 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:46.373296 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:46.384057 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:46.582633 445639 node_ready.go:53] node "addons-949062" has status "Ready":"False"
I0923 11:47:46.736472 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:46.738928 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:46.872872 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:46.884683 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:47.237179 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:47.238377 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:47.372980 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:47.384413 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:47.737870 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:47.739341 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:47.873143 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:47.884615 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:48.237023 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:48.239390 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:48.373652 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:48.385114 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:48.737923 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:48.739279 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:48.873353 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:48.884809 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:49.082242 445639 node_ready.go:53] node "addons-949062" has status "Ready":"False"
I0923 11:47:49.237510 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:49.238406 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:49.373189 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:49.384471 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:49.736829 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:49.738393 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:49.872880 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:49.884255 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:50.237738 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:50.238524 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:50.373612 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:50.384387 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:50.737703 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:50.738954 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:50.872513 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:50.885090 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:51.083052 445639 node_ready.go:53] node "addons-949062" has status "Ready":"False"
I0923 11:47:51.236861 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:51.238472 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:51.373234 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:51.384869 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:51.737045 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:51.738848 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:51.872707 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:51.883990 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:52.236767 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:52.239142 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:52.372717 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:52.384797 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:52.737318 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:52.738016 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:52.872763 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:52.883676 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:53.238246 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:53.239287 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:53.372895 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:53.384510 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:53.582553 445639 node_ready.go:53] node "addons-949062" has status "Ready":"False"
I0923 11:47:53.738166 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:53.738651 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:53.874600 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:53.884271 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:54.239246 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:54.240750 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:54.377222 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:54.387248 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:54.737766 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:54.739430 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:54.873269 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:54.885123 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:55.239216 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:55.239397 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:55.373113 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:55.384631 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:55.582894 445639 node_ready.go:53] node "addons-949062" has status "Ready":"False"
I0923 11:47:55.737187 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:55.738936 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:55.872460 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:55.883952 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:56.237026 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:56.238037 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:56.372331 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:56.384674 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:56.737308 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:56.738033 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:56.872628 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:56.883894 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:57.236561 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:57.239007 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:57.372676 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:57.384244 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:57.582961 445639 node_ready.go:53] node "addons-949062" has status "Ready":"False"
I0923 11:47:57.736851 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:57.738917 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:57.873176 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:57.884209 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:58.237760 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:58.238749 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:58.372330 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:58.384236 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:58.737782 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:58.738014 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:58.872781 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:58.886812 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:59.236474 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:59.238552 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:59.373060 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:59.384069 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:47:59.737992 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:47:59.738973 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:47:59.872638 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:47:59.884246 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:00.088146 445639 node_ready.go:53] node "addons-949062" has status "Ready":"False"
I0923 11:48:00.242891 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:00.251897 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:00.408240 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:00.408764 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:00.736449 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:00.738431 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:00.874357 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:00.885104 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:01.236709 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:01.238869 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:01.373568 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:01.384030 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:01.737829 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:01.738765 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:01.873284 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:01.886016 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:02.238135 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:02.239058 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:02.373317 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:02.384626 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:02.582664 445639 node_ready.go:53] node "addons-949062" has status "Ready":"False"
I0923 11:48:02.738305 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:02.738470 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:02.873100 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:02.884714 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:03.237489 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:03.239699 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:03.372977 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:03.384432 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:03.737260 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:03.738563 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:03.872510 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:03.883998 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:04.236847 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:04.238551 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:04.375576 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:04.384090 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:04.582804 445639 node_ready.go:53] node "addons-949062" has status "Ready":"False"
I0923 11:48:04.737427 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:04.738947 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:04.872911 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:04.884145 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:05.236500 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:05.238455 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:05.373130 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:05.384492 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:05.737407 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:05.738220 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:05.872756 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:05.884497 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:06.237088 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:06.239369 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:06.373181 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:06.384245 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:06.582883 445639 node_ready.go:53] node "addons-949062" has status "Ready":"False"
I0923 11:48:06.737765 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:06.738740 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:06.872306 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:06.884051 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:07.236609 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:07.238872 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:07.373309 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:07.384238 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:07.615041 445639 node_ready.go:49] node "addons-949062" has status "Ready":"True"
I0923 11:48:07.615070 445639 node_ready.go:38] duration metric: took 39.036239338s for node "addons-949062" to be "Ready" ...
I0923 11:48:07.615082 445639 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0923 11:48:07.625604 445639 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-jcsz4" in "kube-system" namespace to be "Ready" ...
I0923 11:48:07.748130 445639 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0923 11:48:07.748156 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:07.749160 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:07.958610 445639 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0923 11:48:07.958763 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:07.958968 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:08.239254 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:08.240243 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:08.404389 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:08.406602 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:08.738178 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:08.739936 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:08.874318 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:08.889596 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:09.239826 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:09.241018 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:09.383976 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:09.385333 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:09.633691 445639 pod_ready.go:103] pod "coredns-7c65d6cfc9-jcsz4" in "kube-system" namespace has status "Ready":"False"
I0923 11:48:09.749644 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:09.752426 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:09.874268 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:09.894683 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:10.244402 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:10.248337 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:10.378151 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:10.384017 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:10.632399 445639 pod_ready.go:93] pod "coredns-7c65d6cfc9-jcsz4" in "kube-system" namespace has status "Ready":"True"
I0923 11:48:10.632424 445639 pod_ready.go:82] duration metric: took 3.006784184s for pod "coredns-7c65d6cfc9-jcsz4" in "kube-system" namespace to be "Ready" ...
I0923 11:48:10.632444 445639 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-949062" in "kube-system" namespace to be "Ready" ...
I0923 11:48:10.640126 445639 pod_ready.go:93] pod "etcd-addons-949062" in "kube-system" namespace has status "Ready":"True"
I0923 11:48:10.640151 445639 pod_ready.go:82] duration metric: took 7.698877ms for pod "etcd-addons-949062" in "kube-system" namespace to be "Ready" ...
I0923 11:48:10.640165 445639 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-949062" in "kube-system" namespace to be "Ready" ...
I0923 11:48:10.645825 445639 pod_ready.go:93] pod "kube-apiserver-addons-949062" in "kube-system" namespace has status "Ready":"True"
I0923 11:48:10.645853 445639 pod_ready.go:82] duration metric: took 5.678902ms for pod "kube-apiserver-addons-949062" in "kube-system" namespace to be "Ready" ...
I0923 11:48:10.645865 445639 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-949062" in "kube-system" namespace to be "Ready" ...
I0923 11:48:10.651610 445639 pod_ready.go:93] pod "kube-controller-manager-addons-949062" in "kube-system" namespace has status "Ready":"True"
I0923 11:48:10.651639 445639 pod_ready.go:82] duration metric: took 5.765844ms for pod "kube-controller-manager-addons-949062" in "kube-system" namespace to be "Ready" ...
I0923 11:48:10.651654 445639 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-lpdls" in "kube-system" namespace to be "Ready" ...
I0923 11:48:10.657159 445639 pod_ready.go:93] pod "kube-proxy-lpdls" in "kube-system" namespace has status "Ready":"True"
I0923 11:48:10.657186 445639 pod_ready.go:82] duration metric: took 5.500351ms for pod "kube-proxy-lpdls" in "kube-system" namespace to be "Ready" ...
I0923 11:48:10.657198 445639 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-949062" in "kube-system" namespace to be "Ready" ...
I0923 11:48:10.738959 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:10.740010 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:10.875406 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:10.884451 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:11.030576 445639 pod_ready.go:93] pod "kube-scheduler-addons-949062" in "kube-system" namespace has status "Ready":"True"
I0923 11:48:11.030607 445639 pod_ready.go:82] duration metric: took 373.40035ms for pod "kube-scheduler-addons-949062" in "kube-system" namespace to be "Ready" ...
I0923 11:48:11.030620 445639 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace to be "Ready" ...
I0923 11:48:11.239591 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:11.242650 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:11.375673 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:11.384373 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:11.738608 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:11.741735 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:11.874416 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:11.884740 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:12.239162 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:12.241829 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:12.375811 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:12.475166 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:12.740241 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:12.742569 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:12.874607 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:12.884849 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:13.038524 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:48:13.240205 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:13.241801 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:13.377018 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:13.390238 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:13.748024 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:13.756302 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:13.880104 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:13.900900 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:14.239672 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:14.240640 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:14.376186 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:14.386769 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:14.742408 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:14.743361 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:14.874324 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:14.884383 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:15.040307 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:48:15.238331 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:15.239388 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:15.381540 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:15.384063 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:15.738025 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:15.738959 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:15.874276 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:15.884651 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:16.238614 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:16.248541 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:16.375022 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:16.384920 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:16.738664 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:16.739961 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:16.874687 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:16.884727 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:17.238651 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:17.239513 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:17.375305 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:17.384594 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:17.536836 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:48:17.737466 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:17.738775 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:17.874226 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:17.884503 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:18.236846 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:18.239313 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:18.374226 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:18.391595 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:18.738503 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:18.739894 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:18.873975 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:18.884589 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:19.238378 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:19.240215 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:19.373918 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:19.385097 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:19.537576 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:48:19.737569 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:19.742250 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:19.874625 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:19.884994 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:20.239578 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:20.241355 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:20.375448 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:20.385266 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:20.740221 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:20.741532 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:20.874332 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:20.884228 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:21.241562 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:21.241686 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:21.374941 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:21.385433 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:21.741228 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:21.742329 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:21.873739 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:21.885002 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:22.037528 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:48:22.237503 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:22.240194 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:22.375157 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:22.384808 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:22.739694 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:22.742204 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:22.875012 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:22.885128 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:23.239034 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:23.240246 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:23.374272 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:23.385168 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:23.739976 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:23.742821 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:23.873828 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:23.884086 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:24.038735 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:48:24.237617 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:24.239654 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:24.386591 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:24.394869 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:24.740517 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:24.742719 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:24.875574 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:24.885840 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:25.244167 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:25.244760 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:25.374397 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:25.384740 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:25.737927 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:25.740407 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:25.875754 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:25.883878 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:26.237920 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:26.238879 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:26.376466 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:26.384604 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:26.537250 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:48:26.744408 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:26.748067 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:26.873793 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:26.884243 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:27.240287 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:27.242089 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:27.375419 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:27.385290 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:27.738120 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:27.739379 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:27.874700 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:27.884546 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:28.238563 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:28.239896 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:28.374580 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:28.385275 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:28.537441 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:48:28.739113 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:28.740134 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:28.873976 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:28.886824 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:29.238458 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:29.239913 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:29.375380 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:29.384688 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:29.738347 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:29.739290 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:29.875516 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:29.885084 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:30.238842 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:30.241028 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:30.376535 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:30.386306 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:30.742581 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:30.743238 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:30.875021 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:30.889209 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:31.040582 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:48:31.238711 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:31.244239 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:31.376848 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:31.385574 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:31.767016 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:31.768422 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:31.874612 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:31.885229 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:32.240121 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:32.242822 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:32.375010 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:32.385700 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:32.737657 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:32.742607 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:32.880801 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:32.887602 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:33.041721 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:48:33.237117 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:33.241241 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:33.374103 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:33.384512 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:33.739059 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:33.740076 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:33.874272 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:33.884407 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:34.237443 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:34.239180 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:34.373662 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:34.384565 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:34.740803 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:34.741815 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:34.876049 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:34.885303 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:35.238759 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:35.240189 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:35.374463 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:35.385175 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:35.537459 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:48:35.739056 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:35.740256 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:35.874027 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:35.884838 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:36.252221 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:36.253420 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:36.374278 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:36.384693 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:36.738423 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:36.740023 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:36.874693 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:36.884806 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:37.238538 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:37.242551 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:37.375221 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:37.384625 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:37.540018 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:48:37.738923 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:37.739905 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:37.874602 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:37.885153 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:38.240127 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:38.240545 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:38.373842 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:38.384261 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:38.739174 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:38.739710 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:38.874196 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:38.883880 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:39.239398 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:39.240086 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:39.373949 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:39.384636 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:39.739216 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:39.740063 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:39.880563 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:39.884815 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:40.058905 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:48:40.237970 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:40.239334 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:40.375595 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:40.385916 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:40.754278 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:40.758759 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:40.876306 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:40.886814 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:41.240876 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:41.245089 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:41.375792 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:41.386228 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:41.740102 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:41.740443 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:41.874928 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:41.884566 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:42.063594 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:48:42.237586 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:42.240974 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:42.374551 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:42.385662 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:42.739360 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:42.740835 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:42.878275 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:42.885883 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:43.238551 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:43.241737 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:43.386566 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:43.388195 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:43.738913 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:43.740870 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:43.874995 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:43.885288 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:44.238821 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:44.240300 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:44.386841 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:44.394431 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:44.541353 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:48:44.740727 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:44.742088 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:44.877075 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:44.884723 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:45.248054 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:45.249800 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:45.377592 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:45.388398 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:45.739191 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:45.739572 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:45.874520 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:45.884595 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:46.237776 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:46.240236 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:46.382300 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:46.485683 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:46.738773 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:46.739736 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:46.874346 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:46.886721 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:47.042132 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:48:47.238832 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:47.239660 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:47.374360 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:47.384184 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:47.739115 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:47.739687 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:47.873717 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:47.884838 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:48.238399 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:48.239100 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:48.374001 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:48.386650 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:48.739201 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:48.740011 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:48.874891 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:48.884351 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:49.244185 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:49.247374 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:49.374557 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:49.386184 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:49.537511 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:48:49.739453 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:49.740039 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:49.873718 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:49.886213 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:50.238838 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:50.240058 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:50.374603 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:50.387818 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:50.738796 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:50.742114 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:50.874217 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:50.886690 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:51.239732 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:51.241483 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:51.375156 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:51.385790 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:51.538381 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:48:51.741356 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:51.744008 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:51.874453 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:51.884936 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:52.239658 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:52.240490 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:52.374467 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:52.385336 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:52.738479 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 11:48:52.738825 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:52.885842 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:52.887676 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:53.238908 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:53.239715 445639 kapi.go:107] duration metric: took 1m22.006449606s to wait for kubernetes.io/minikube-addons=registry ...
I0923 11:48:53.374181 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:53.385597 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:53.539431 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:48:53.746680 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:53.874900 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:53.885462 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:54.238927 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:54.374393 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:54.384130 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:54.738960 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:54.873653 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:54.886029 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:55.239586 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:55.374250 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:55.384811 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:55.739059 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:55.876142 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:55.885550 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:56.038520 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:48:56.240258 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:56.380491 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:56.391936 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:56.739936 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:56.874579 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:56.885132 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:57.242272 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:57.376559 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:57.387030 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:57.738936 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:57.877313 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:57.884677 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:58.039877 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:48:58.239398 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:58.375819 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:58.385745 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:58.739155 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:58.873836 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:58.885904 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:59.238516 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:59.377235 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:59.392053 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:48:59.739920 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:48:59.875569 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:48:59.884587 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:49:00.052753 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:49:00.378261 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:49:00.448186 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:00.449254 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:49:00.739758 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:49:00.874222 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:00.884446 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:49:01.239481 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:49:01.374486 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:01.385708 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:49:01.739642 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:49:01.874511 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:01.885182 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:49:02.246502 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:49:02.378993 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:02.384890 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:49:02.538909 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:49:02.740486 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:49:02.876212 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:02.888458 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:49:03.241259 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:49:03.376141 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:03.388731 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:49:03.740382 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:49:03.876240 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:03.885036 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:49:04.238984 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:49:04.375160 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:04.384865 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:49:04.539090 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:49:04.740291 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:49:04.874556 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:04.885090 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:49:05.248215 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:49:05.375587 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:05.385715 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:49:05.740187 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:49:05.875663 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:05.901457 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:49:06.239455 445639 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 11:49:06.374248 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:06.385979 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:49:06.546825 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:49:06.740097 445639 kapi.go:107] duration metric: took 1m35.505761343s to wait for app.kubernetes.io/name=ingress-nginx ...
I0923 11:49:06.876109 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:06.885568 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:49:07.375987 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:07.384752 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:49:07.874037 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:07.884776 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:49:08.374303 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:08.384391 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:49:08.874008 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:08.885955 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:49:09.041678 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:49:09.375279 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:09.384600 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:49:09.874440 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:09.885091 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:49:10.373729 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:10.384487 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 11:49:10.874375 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:10.884724 445639 kapi.go:107] duration metric: took 1m34.00389875s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0923 11:49:10.887410 445639 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-949062 cluster.
I0923 11:49:10.890021 445639 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0923 11:49:10.892273 445639 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0923 11:49:11.375810 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:11.536927 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:49:11.874233 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:12.374650 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:12.874640 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:13.375274 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:13.539298 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:49:13.876748 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:14.375379 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:14.874127 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:15.376119 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:15.542628 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:49:15.875648 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:16.375209 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:16.874292 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:17.374242 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:17.874623 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:18.047166 445639 pod_ready.go:103] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"False"
I0923 11:49:18.393586 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:18.540594 445639 pod_ready.go:93] pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace has status "Ready":"True"
I0923 11:49:18.540627 445639 pod_ready.go:82] duration metric: took 1m7.50999316s for pod "metrics-server-84c5f94fbc-bnjfn" in "kube-system" namespace to be "Ready" ...
I0923 11:49:18.540663 445639 pod_ready.go:39] duration metric: took 1m10.925566484s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0923 11:49:18.540686 445639 api_server.go:52] waiting for apiserver process to appear ...
I0923 11:49:18.540736 445639 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0923 11:49:18.540820 445639 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0923 11:49:18.620691 445639 cri.go:89] found id: "f01e8c743f9c393432831b5cf6a18d60aeec0b794af11cc59645f781ef744300"
I0923 11:49:18.620716 445639 cri.go:89] found id: ""
I0923 11:49:18.620725 445639 logs.go:276] 1 containers: [f01e8c743f9c393432831b5cf6a18d60aeec0b794af11cc59645f781ef744300]
I0923 11:49:18.620816 445639 ssh_runner.go:195] Run: which crictl
I0923 11:49:18.624273 445639 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0923 11:49:18.624367 445639 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0923 11:49:18.662744 445639 cri.go:89] found id: "91756d36809ddf111e1ea01a91afd27894111f8d88b30c1559789771044fdf31"
I0923 11:49:18.662766 445639 cri.go:89] found id: ""
I0923 11:49:18.662774 445639 logs.go:276] 1 containers: [91756d36809ddf111e1ea01a91afd27894111f8d88b30c1559789771044fdf31]
I0923 11:49:18.662861 445639 ssh_runner.go:195] Run: which crictl
I0923 11:49:18.666320 445639 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0923 11:49:18.666451 445639 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0923 11:49:18.704630 445639 cri.go:89] found id: "6e75514e9a125cad3d7d0f53041cd69f7134d95af21367e27986ef926903a005"
I0923 11:49:18.704654 445639 cri.go:89] found id: ""
I0923 11:49:18.704662 445639 logs.go:276] 1 containers: [6e75514e9a125cad3d7d0f53041cd69f7134d95af21367e27986ef926903a005]
I0923 11:49:18.704744 445639 ssh_runner.go:195] Run: which crictl
I0923 11:49:18.708237 445639 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0923 11:49:18.708339 445639 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0923 11:49:18.757556 445639 cri.go:89] found id: "4425a3b8595675b0095ea3d707c89fd9884337c9f856bc18b89b109fcee52ee9"
I0923 11:49:18.757581 445639 cri.go:89] found id: ""
I0923 11:49:18.757590 445639 logs.go:276] 1 containers: [4425a3b8595675b0095ea3d707c89fd9884337c9f856bc18b89b109fcee52ee9]
I0923 11:49:18.757682 445639 ssh_runner.go:195] Run: which crictl
I0923 11:49:18.761164 445639 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0923 11:49:18.761234 445639 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0923 11:49:18.799012 445639 cri.go:89] found id: "feeee7ef089ea49ba13ba3dc06cb204e3d2595c1c0287cf25b1a00b016f93bc4"
I0923 11:49:18.799045 445639 cri.go:89] found id: ""
I0923 11:49:18.799053 445639 logs.go:276] 1 containers: [feeee7ef089ea49ba13ba3dc06cb204e3d2595c1c0287cf25b1a00b016f93bc4]
I0923 11:49:18.799132 445639 ssh_runner.go:195] Run: which crictl
I0923 11:49:18.802734 445639 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0923 11:49:18.802817 445639 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0923 11:49:18.846226 445639 cri.go:89] found id: "e38a88dde28e49d61a5e1561cf3a2f4aa5b86823826c275210299874bb8e26f3"
I0923 11:49:18.846251 445639 cri.go:89] found id: ""
I0923 11:49:18.846272 445639 logs.go:276] 1 containers: [e38a88dde28e49d61a5e1561cf3a2f4aa5b86823826c275210299874bb8e26f3]
I0923 11:49:18.846370 445639 ssh_runner.go:195] Run: which crictl
I0923 11:49:18.850038 445639 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0923 11:49:18.850142 445639 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0923 11:49:18.879534 445639 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 11:49:18.923519 445639 cri.go:89] found id: "3025434caf0067f0c48f9d98e75ca5f22b91cffe56b857f46556c50c8619f1e7"
I0923 11:49:18.923560 445639 cri.go:89] found id: ""
I0923 11:49:18.923569 445639 logs.go:276] 1 containers: [3025434caf0067f0c48f9d98e75ca5f22b91cffe56b857f46556c50c8619f1e7]
I0923 11:49:18.923691 445639 ssh_runner.go:195] Run: which crictl
I0923 11:49:18.928989 445639 logs.go:123] Gathering logs for CRI-O ...
I0923 11:49:18.929061 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0923 11:49:19.041596 445639 logs.go:123] Gathering logs for container status ...
I0923 11:49:19.041635 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0923 11:49:19.091158 445639 logs.go:123] Gathering logs for kubelet ...
I0923 11:49:19.091196 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0923 11:49:19.135687 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: W0923 11:48:07.589914 1483 reflector.go:561] object-"kube-system"/"coredns": failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:addons-949062" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'addons-949062' and this object
W0923 11:49:19.135947 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: E0923 11:48:07.589972 1483 reflector.go:158] "Unhandled Error" err="object-\"kube-system\"/\"coredns\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"coredns\" is forbidden: User \"system:node:addons-949062\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'addons-949062' and this object" logger="UnhandledError"
W0923 11:49:19.136138 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: W0923 11:48:07.590020 1483 reflector.go:561] object-"gcp-auth"/"gcp-auth-certs": failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-949062" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-949062' and this object
W0923 11:49:19.136355 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: E0923 11:48:07.590034 1483 reflector.go:158] "Unhandled Error" err="object-\"gcp-auth\"/\"gcp-auth-certs\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"gcp-auth-certs\" is forbidden: User \"system:node:addons-949062\" cannot list resource \"secrets\" in API group \"\" in the namespace \"gcp-auth\": no relationship found between node 'addons-949062' and this object" logger="UnhandledError"
W0923 11:49:19.136545 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: W0923 11:48:07.608406 1483 reflector.go:561] object-"local-path-storage"/"local-path-config": failed to list *v1.ConfigMap: configmaps "local-path-config" is forbidden: User "system:node:addons-949062" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-949062' and this object
W0923 11:49:19.136777 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: E0923 11:48:07.608455 1483 reflector.go:158] "Unhandled Error" err="object-\"local-path-storage\"/\"local-path-config\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"local-path-config\" is forbidden: User \"system:node:addons-949062\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"local-path-storage\": no relationship found between node 'addons-949062' and this object" logger="UnhandledError"
W0923 11:49:19.136978 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: W0923 11:48:07.610454 1483 reflector.go:561] object-"local-path-storage"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-949062" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-949062' and this object
W0923 11:49:19.137211 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: E0923 11:48:07.610503 1483 reflector.go:158] "Unhandled Error" err="object-\"local-path-storage\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-949062\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"local-path-storage\": no relationship found between node 'addons-949062' and this object" logger="UnhandledError"
W0923 11:49:19.137396 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: W0923 11:48:07.612923 1483 reflector.go:561] object-"yakd-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-949062" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-949062' and this object
W0923 11:49:19.137629 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: E0923 11:48:07.612992 1483 reflector.go:158] "Unhandled Error" err="object-\"yakd-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-949062\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"yakd-dashboard\": no relationship found between node 'addons-949062' and this object" logger="UnhandledError"
I0923 11:49:19.186886 445639 logs.go:123] Gathering logs for dmesg ...
I0923 11:49:19.186924 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0923 11:49:19.203835 445639 logs.go:123] Gathering logs for describe nodes ...
I0923 11:49:19.203866 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0923 11:49:19.376591 445639 kapi.go:107] duration metric: took 1m47.507549638s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0923 11:49:19.379518 445639 out.go:177] * Enabled addons: cloud-spanner, ingress-dns, nvidia-device-plugin, storage-provisioner, metrics-server, storage-provisioner-rancher, yakd, default-storageclass, inspektor-gadget, volumesnapshots, registry, ingress, gcp-auth, csi-hostpath-driver
I0923 11:49:19.382024 445639 addons.go:510] duration metric: took 1m54.276584476s for enable addons: enabled=[cloud-spanner ingress-dns nvidia-device-plugin storage-provisioner metrics-server storage-provisioner-rancher yakd default-storageclass inspektor-gadget volumesnapshots registry ingress gcp-auth csi-hostpath-driver]
I0923 11:49:19.406063 445639 logs.go:123] Gathering logs for coredns [6e75514e9a125cad3d7d0f53041cd69f7134d95af21367e27986ef926903a005] ...
I0923 11:49:19.406093 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6e75514e9a125cad3d7d0f53041cd69f7134d95af21367e27986ef926903a005"
I0923 11:49:19.463679 445639 logs.go:123] Gathering logs for kube-scheduler [4425a3b8595675b0095ea3d707c89fd9884337c9f856bc18b89b109fcee52ee9] ...
I0923 11:49:19.463707 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4425a3b8595675b0095ea3d707c89fd9884337c9f856bc18b89b109fcee52ee9"
I0923 11:49:19.507728 445639 logs.go:123] Gathering logs for kindnet [3025434caf0067f0c48f9d98e75ca5f22b91cffe56b857f46556c50c8619f1e7] ...
I0923 11:49:19.507760 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3025434caf0067f0c48f9d98e75ca5f22b91cffe56b857f46556c50c8619f1e7"
I0923 11:49:19.551351 445639 logs.go:123] Gathering logs for kube-apiserver [f01e8c743f9c393432831b5cf6a18d60aeec0b794af11cc59645f781ef744300] ...
I0923 11:49:19.551385 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f01e8c743f9c393432831b5cf6a18d60aeec0b794af11cc59645f781ef744300"
I0923 11:49:19.605539 445639 logs.go:123] Gathering logs for etcd [91756d36809ddf111e1ea01a91afd27894111f8d88b30c1559789771044fdf31] ...
I0923 11:49:19.605573 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 91756d36809ddf111e1ea01a91afd27894111f8d88b30c1559789771044fdf31"
I0923 11:49:19.657214 445639 logs.go:123] Gathering logs for kube-proxy [feeee7ef089ea49ba13ba3dc06cb204e3d2595c1c0287cf25b1a00b016f93bc4] ...
I0923 11:49:19.657246 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 feeee7ef089ea49ba13ba3dc06cb204e3d2595c1c0287cf25b1a00b016f93bc4"
I0923 11:49:19.705225 445639 logs.go:123] Gathering logs for kube-controller-manager [e38a88dde28e49d61a5e1561cf3a2f4aa5b86823826c275210299874bb8e26f3] ...
I0923 11:49:19.705257 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e38a88dde28e49d61a5e1561cf3a2f4aa5b86823826c275210299874bb8e26f3"
I0923 11:49:19.814417 445639 out.go:358] Setting ErrFile to fd 2...
I0923 11:49:19.814447 445639 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0923 11:49:19.814525 445639 out.go:270] X Problems detected in kubelet:
W0923 11:49:19.814544 445639 out.go:270] Sep 23 11:48:07 addons-949062 kubelet[1483]: E0923 11:48:07.608455 1483 reflector.go:158] "Unhandled Error" err="object-\"local-path-storage\"/\"local-path-config\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"local-path-config\" is forbidden: User \"system:node:addons-949062\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"local-path-storage\": no relationship found between node 'addons-949062' and this object" logger="UnhandledError"
W0923 11:49:19.814562 445639 out.go:270] Sep 23 11:48:07 addons-949062 kubelet[1483]: W0923 11:48:07.610454 1483 reflector.go:561] object-"local-path-storage"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-949062" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-949062' and this object
W0923 11:49:19.814576 445639 out.go:270] Sep 23 11:48:07 addons-949062 kubelet[1483]: E0923 11:48:07.610503 1483 reflector.go:158] "Unhandled Error" err="object-\"local-path-storage\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-949062\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"local-path-storage\": no relationship found between node 'addons-949062' and this object" logger="UnhandledError"
W0923 11:49:19.814583 445639 out.go:270] Sep 23 11:48:07 addons-949062 kubelet[1483]: W0923 11:48:07.612923 1483 reflector.go:561] object-"yakd-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-949062" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-949062' and this object
W0923 11:49:19.814589 445639 out.go:270] Sep 23 11:48:07 addons-949062 kubelet[1483]: E0923 11:48:07.612992 1483 reflector.go:158] "Unhandled Error" err="object-\"yakd-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-949062\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"yakd-dashboard\": no relationship found between node 'addons-949062' and this object" logger="UnhandledError"
I0923 11:49:19.814598 445639 out.go:358] Setting ErrFile to fd 2...
I0923 11:49:19.814605 445639 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0923 11:49:29.815362 445639 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0923 11:49:29.829344 445639 api_server.go:72] duration metric: took 2m4.723927549s to wait for apiserver process to appear ...
I0923 11:49:29.829371 445639 api_server.go:88] waiting for apiserver healthz status ...
I0923 11:49:29.829407 445639 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0923 11:49:29.829467 445639 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0923 11:49:29.871938 445639 cri.go:89] found id: "f01e8c743f9c393432831b5cf6a18d60aeec0b794af11cc59645f781ef744300"
I0923 11:49:29.871962 445639 cri.go:89] found id: ""
I0923 11:49:29.871970 445639 logs.go:276] 1 containers: [f01e8c743f9c393432831b5cf6a18d60aeec0b794af11cc59645f781ef744300]
I0923 11:49:29.872027 445639 ssh_runner.go:195] Run: which crictl
I0923 11:49:29.876064 445639 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0923 11:49:29.876137 445639 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0923 11:49:29.918480 445639 cri.go:89] found id: "91756d36809ddf111e1ea01a91afd27894111f8d88b30c1559789771044fdf31"
I0923 11:49:29.918500 445639 cri.go:89] found id: ""
I0923 11:49:29.918508 445639 logs.go:276] 1 containers: [91756d36809ddf111e1ea01a91afd27894111f8d88b30c1559789771044fdf31]
I0923 11:49:29.918564 445639 ssh_runner.go:195] Run: which crictl
I0923 11:49:29.922149 445639 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0923 11:49:29.922226 445639 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0923 11:49:29.961403 445639 cri.go:89] found id: "6e75514e9a125cad3d7d0f53041cd69f7134d95af21367e27986ef926903a005"
I0923 11:49:29.961427 445639 cri.go:89] found id: ""
I0923 11:49:29.961435 445639 logs.go:276] 1 containers: [6e75514e9a125cad3d7d0f53041cd69f7134d95af21367e27986ef926903a005]
I0923 11:49:29.961524 445639 ssh_runner.go:195] Run: which crictl
I0923 11:49:29.965267 445639 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0923 11:49:29.965341 445639 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0923 11:49:30.093489 445639 cri.go:89] found id: "4425a3b8595675b0095ea3d707c89fd9884337c9f856bc18b89b109fcee52ee9"
I0923 11:49:30.093512 445639 cri.go:89] found id: ""
I0923 11:49:30.093520 445639 logs.go:276] 1 containers: [4425a3b8595675b0095ea3d707c89fd9884337c9f856bc18b89b109fcee52ee9]
I0923 11:49:30.093592 445639 ssh_runner.go:195] Run: which crictl
I0923 11:49:30.124191 445639 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0923 11:49:30.124280 445639 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0923 11:49:30.186408 445639 cri.go:89] found id: "feeee7ef089ea49ba13ba3dc06cb204e3d2595c1c0287cf25b1a00b016f93bc4"
I0923 11:49:30.186436 445639 cri.go:89] found id: ""
I0923 11:49:30.186447 445639 logs.go:276] 1 containers: [feeee7ef089ea49ba13ba3dc06cb204e3d2595c1c0287cf25b1a00b016f93bc4]
I0923 11:49:30.186516 445639 ssh_runner.go:195] Run: which crictl
I0923 11:49:30.190974 445639 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0923 11:49:30.191079 445639 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0923 11:49:30.232732 445639 cri.go:89] found id: "e38a88dde28e49d61a5e1561cf3a2f4aa5b86823826c275210299874bb8e26f3"
I0923 11:49:30.232753 445639 cri.go:89] found id: ""
I0923 11:49:30.232762 445639 logs.go:276] 1 containers: [e38a88dde28e49d61a5e1561cf3a2f4aa5b86823826c275210299874bb8e26f3]
I0923 11:49:30.232828 445639 ssh_runner.go:195] Run: which crictl
I0923 11:49:30.237003 445639 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0923 11:49:30.237085 445639 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0923 11:49:30.280016 445639 cri.go:89] found id: "3025434caf0067f0c48f9d98e75ca5f22b91cffe56b857f46556c50c8619f1e7"
I0923 11:49:30.280050 445639 cri.go:89] found id: ""
I0923 11:49:30.280059 445639 logs.go:276] 1 containers: [3025434caf0067f0c48f9d98e75ca5f22b91cffe56b857f46556c50c8619f1e7]
I0923 11:49:30.280120 445639 ssh_runner.go:195] Run: which crictl
I0923 11:49:30.284200 445639 logs.go:123] Gathering logs for kubelet ...
I0923 11:49:30.284228 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0923 11:49:30.331412 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: W0923 11:48:07.589914 1483 reflector.go:561] object-"kube-system"/"coredns": failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:addons-949062" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'addons-949062' and this object
W0923 11:49:30.331646 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: E0923 11:48:07.589972 1483 reflector.go:158] "Unhandled Error" err="object-\"kube-system\"/\"coredns\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"coredns\" is forbidden: User \"system:node:addons-949062\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'addons-949062' and this object" logger="UnhandledError"
W0923 11:49:30.331822 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: W0923 11:48:07.590020 1483 reflector.go:561] object-"gcp-auth"/"gcp-auth-certs": failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-949062" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-949062' and this object
W0923 11:49:30.332036 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: E0923 11:48:07.590034 1483 reflector.go:158] "Unhandled Error" err="object-\"gcp-auth\"/\"gcp-auth-certs\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"gcp-auth-certs\" is forbidden: User \"system:node:addons-949062\" cannot list resource \"secrets\" in API group \"\" in the namespace \"gcp-auth\": no relationship found between node 'addons-949062' and this object" logger="UnhandledError"
W0923 11:49:30.332224 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: W0923 11:48:07.608406 1483 reflector.go:561] object-"local-path-storage"/"local-path-config": failed to list *v1.ConfigMap: configmaps "local-path-config" is forbidden: User "system:node:addons-949062" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-949062' and this object
W0923 11:49:30.332453 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: E0923 11:48:07.608455 1483 reflector.go:158] "Unhandled Error" err="object-\"local-path-storage\"/\"local-path-config\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"local-path-config\" is forbidden: User \"system:node:addons-949062\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"local-path-storage\": no relationship found between node 'addons-949062' and this object" logger="UnhandledError"
W0923 11:49:30.332638 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: W0923 11:48:07.610454 1483 reflector.go:561] object-"local-path-storage"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-949062" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-949062' and this object
W0923 11:49:30.332865 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: E0923 11:48:07.610503 1483 reflector.go:158] "Unhandled Error" err="object-\"local-path-storage\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-949062\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"local-path-storage\": no relationship found between node 'addons-949062' and this object" logger="UnhandledError"
W0923 11:49:30.333059 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: W0923 11:48:07.612923 1483 reflector.go:561] object-"yakd-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-949062" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-949062' and this object
W0923 11:49:30.333284 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: E0923 11:48:07.612992 1483 reflector.go:158] "Unhandled Error" err="object-\"yakd-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-949062\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"yakd-dashboard\": no relationship found between node 'addons-949062' and this object" logger="UnhandledError"
I0923 11:49:30.384459 445639 logs.go:123] Gathering logs for kube-apiserver [f01e8c743f9c393432831b5cf6a18d60aeec0b794af11cc59645f781ef744300] ...
I0923 11:49:30.384498 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f01e8c743f9c393432831b5cf6a18d60aeec0b794af11cc59645f781ef744300"
I0923 11:49:30.456588 445639 logs.go:123] Gathering logs for kube-proxy [feeee7ef089ea49ba13ba3dc06cb204e3d2595c1c0287cf25b1a00b016f93bc4] ...
I0923 11:49:30.456627 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 feeee7ef089ea49ba13ba3dc06cb204e3d2595c1c0287cf25b1a00b016f93bc4"
I0923 11:49:30.512746 445639 logs.go:123] Gathering logs for CRI-O ...
I0923 11:49:30.512777 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0923 11:49:30.608657 445639 logs.go:123] Gathering logs for kube-scheduler [4425a3b8595675b0095ea3d707c89fd9884337c9f856bc18b89b109fcee52ee9] ...
I0923 11:49:30.608696 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4425a3b8595675b0095ea3d707c89fd9884337c9f856bc18b89b109fcee52ee9"
I0923 11:49:30.657143 445639 logs.go:123] Gathering logs for kube-controller-manager [e38a88dde28e49d61a5e1561cf3a2f4aa5b86823826c275210299874bb8e26f3] ...
I0923 11:49:30.657225 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e38a88dde28e49d61a5e1561cf3a2f4aa5b86823826c275210299874bb8e26f3"
I0923 11:49:30.728445 445639 logs.go:123] Gathering logs for kindnet [3025434caf0067f0c48f9d98e75ca5f22b91cffe56b857f46556c50c8619f1e7] ...
I0923 11:49:30.728483 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3025434caf0067f0c48f9d98e75ca5f22b91cffe56b857f46556c50c8619f1e7"
I0923 11:49:30.778437 445639 logs.go:123] Gathering logs for container status ...
I0923 11:49:30.778466 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0923 11:49:30.829608 445639 logs.go:123] Gathering logs for dmesg ...
I0923 11:49:30.829638 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0923 11:49:30.845889 445639 logs.go:123] Gathering logs for describe nodes ...
I0923 11:49:30.845924 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0923 11:49:30.988340 445639 logs.go:123] Gathering logs for etcd [91756d36809ddf111e1ea01a91afd27894111f8d88b30c1559789771044fdf31] ...
I0923 11:49:30.988374 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 91756d36809ddf111e1ea01a91afd27894111f8d88b30c1559789771044fdf31"
I0923 11:49:31.050164 445639 logs.go:123] Gathering logs for coredns [6e75514e9a125cad3d7d0f53041cd69f7134d95af21367e27986ef926903a005] ...
I0923 11:49:31.050205 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6e75514e9a125cad3d7d0f53041cd69f7134d95af21367e27986ef926903a005"
I0923 11:49:31.096403 445639 out.go:358] Setting ErrFile to fd 2...
I0923 11:49:31.096432 445639 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0923 11:49:31.096529 445639 out.go:270] X Problems detected in kubelet:
W0923 11:49:31.096547 445639 out.go:270] Sep 23 11:48:07 addons-949062 kubelet[1483]: E0923 11:48:07.608455 1483 reflector.go:158] "Unhandled Error" err="object-\"local-path-storage\"/\"local-path-config\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"local-path-config\" is forbidden: User \"system:node:addons-949062\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"local-path-storage\": no relationship found between node 'addons-949062' and this object" logger="UnhandledError"
W0923 11:49:31.096554 445639 out.go:270] Sep 23 11:48:07 addons-949062 kubelet[1483]: W0923 11:48:07.610454 1483 reflector.go:561] object-"local-path-storage"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-949062" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-949062' and this object
W0923 11:49:31.096590 445639 out.go:270] Sep 23 11:48:07 addons-949062 kubelet[1483]: E0923 11:48:07.610503 1483 reflector.go:158] "Unhandled Error" err="object-\"local-path-storage\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-949062\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"local-path-storage\": no relationship found between node 'addons-949062' and this object" logger="UnhandledError"
W0923 11:49:31.096600 445639 out.go:270] Sep 23 11:48:07 addons-949062 kubelet[1483]: W0923 11:48:07.612923 1483 reflector.go:561] object-"yakd-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-949062" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-949062' and this object
W0923 11:49:31.096607 445639 out.go:270] Sep 23 11:48:07 addons-949062 kubelet[1483]: E0923 11:48:07.612992 1483 reflector.go:158] "Unhandled Error" err="object-\"yakd-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-949062\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"yakd-dashboard\": no relationship found between node 'addons-949062' and this object" logger="UnhandledError"
I0923 11:49:31.096618 445639 out.go:358] Setting ErrFile to fd 2...
I0923 11:49:31.096626 445639 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0923 11:49:41.097506 445639 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I0923 11:49:41.107305 445639 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I0923 11:49:41.108323 445639 api_server.go:141] control plane version: v1.31.1
I0923 11:49:41.108350 445639 api_server.go:131] duration metric: took 11.278970036s to wait for apiserver health ...
I0923 11:49:41.108359 445639 system_pods.go:43] waiting for kube-system pods to appear ...
I0923 11:49:41.108381 445639 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0923 11:49:41.108449 445639 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0923 11:49:41.192519 445639 cri.go:89] found id: "f01e8c743f9c393432831b5cf6a18d60aeec0b794af11cc59645f781ef744300"
I0923 11:49:41.192547 445639 cri.go:89] found id: ""
I0923 11:49:41.192555 445639 logs.go:276] 1 containers: [f01e8c743f9c393432831b5cf6a18d60aeec0b794af11cc59645f781ef744300]
I0923 11:49:41.192649 445639 ssh_runner.go:195] Run: which crictl
I0923 11:49:41.198871 445639 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0923 11:49:41.198966 445639 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0923 11:49:41.252979 445639 cri.go:89] found id: "91756d36809ddf111e1ea01a91afd27894111f8d88b30c1559789771044fdf31"
I0923 11:49:41.253004 445639 cri.go:89] found id: ""
I0923 11:49:41.253013 445639 logs.go:276] 1 containers: [91756d36809ddf111e1ea01a91afd27894111f8d88b30c1559789771044fdf31]
I0923 11:49:41.253101 445639 ssh_runner.go:195] Run: which crictl
I0923 11:49:41.260324 445639 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0923 11:49:41.260419 445639 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0923 11:49:41.323604 445639 cri.go:89] found id: "6e75514e9a125cad3d7d0f53041cd69f7134d95af21367e27986ef926903a005"
I0923 11:49:41.323625 445639 cri.go:89] found id: ""
I0923 11:49:41.323633 445639 logs.go:276] 1 containers: [6e75514e9a125cad3d7d0f53041cd69f7134d95af21367e27986ef926903a005]
I0923 11:49:41.323750 445639 ssh_runner.go:195] Run: which crictl
I0923 11:49:41.327871 445639 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0923 11:49:41.328003 445639 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0923 11:49:41.404566 445639 cri.go:89] found id: "4425a3b8595675b0095ea3d707c89fd9884337c9f856bc18b89b109fcee52ee9"
I0923 11:49:41.404602 445639 cri.go:89] found id: ""
I0923 11:49:41.404610 445639 logs.go:276] 1 containers: [4425a3b8595675b0095ea3d707c89fd9884337c9f856bc18b89b109fcee52ee9]
I0923 11:49:41.404694 445639 ssh_runner.go:195] Run: which crictl
I0923 11:49:41.411453 445639 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0923 11:49:41.411556 445639 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0923 11:49:41.467708 445639 cri.go:89] found id: "feeee7ef089ea49ba13ba3dc06cb204e3d2595c1c0287cf25b1a00b016f93bc4"
I0923 11:49:41.467729 445639 cri.go:89] found id: ""
I0923 11:49:41.467737 445639 logs.go:276] 1 containers: [feeee7ef089ea49ba13ba3dc06cb204e3d2595c1c0287cf25b1a00b016f93bc4]
I0923 11:49:41.467849 445639 ssh_runner.go:195] Run: which crictl
I0923 11:49:41.472127 445639 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0923 11:49:41.472238 445639 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0923 11:49:41.523925 445639 cri.go:89] found id: "e38a88dde28e49d61a5e1561cf3a2f4aa5b86823826c275210299874bb8e26f3"
I0923 11:49:41.523947 445639 cri.go:89] found id: ""
I0923 11:49:41.523955 445639 logs.go:276] 1 containers: [e38a88dde28e49d61a5e1561cf3a2f4aa5b86823826c275210299874bb8e26f3]
I0923 11:49:41.524039 445639 ssh_runner.go:195] Run: which crictl
I0923 11:49:41.531765 445639 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0923 11:49:41.531873 445639 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0923 11:49:41.587514 445639 cri.go:89] found id: "3025434caf0067f0c48f9d98e75ca5f22b91cffe56b857f46556c50c8619f1e7"
I0923 11:49:41.587539 445639 cri.go:89] found id: ""
I0923 11:49:41.587560 445639 logs.go:276] 1 containers: [3025434caf0067f0c48f9d98e75ca5f22b91cffe56b857f46556c50c8619f1e7]
I0923 11:49:41.587658 445639 ssh_runner.go:195] Run: which crictl
I0923 11:49:41.594058 445639 logs.go:123] Gathering logs for kube-apiserver [f01e8c743f9c393432831b5cf6a18d60aeec0b794af11cc59645f781ef744300] ...
I0923 11:49:41.594083 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f01e8c743f9c393432831b5cf6a18d60aeec0b794af11cc59645f781ef744300"
I0923 11:49:41.673536 445639 logs.go:123] Gathering logs for coredns [6e75514e9a125cad3d7d0f53041cd69f7134d95af21367e27986ef926903a005] ...
I0923 11:49:41.673572 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6e75514e9a125cad3d7d0f53041cd69f7134d95af21367e27986ef926903a005"
I0923 11:49:41.738976 445639 logs.go:123] Gathering logs for kube-proxy [feeee7ef089ea49ba13ba3dc06cb204e3d2595c1c0287cf25b1a00b016f93bc4] ...
I0923 11:49:41.739059 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 feeee7ef089ea49ba13ba3dc06cb204e3d2595c1c0287cf25b1a00b016f93bc4"
I0923 11:49:41.797156 445639 logs.go:123] Gathering logs for kindnet [3025434caf0067f0c48f9d98e75ca5f22b91cffe56b857f46556c50c8619f1e7] ...
I0923 11:49:41.797229 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3025434caf0067f0c48f9d98e75ca5f22b91cffe56b857f46556c50c8619f1e7"
I0923 11:49:41.838521 445639 logs.go:123] Gathering logs for CRI-O ...
I0923 11:49:41.838611 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0923 11:49:41.936380 445639 logs.go:123] Gathering logs for kubelet ...
I0923 11:49:41.936419 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0923 11:49:41.986339 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: W0923 11:48:07.589914 1483 reflector.go:561] object-"kube-system"/"coredns": failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:addons-949062" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'addons-949062' and this object
W0923 11:49:41.986622 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: E0923 11:48:07.589972 1483 reflector.go:158] "Unhandled Error" err="object-\"kube-system\"/\"coredns\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"coredns\" is forbidden: User \"system:node:addons-949062\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'addons-949062' and this object" logger="UnhandledError"
W0923 11:49:41.986815 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: W0923 11:48:07.590020 1483 reflector.go:561] object-"gcp-auth"/"gcp-auth-certs": failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-949062" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-949062' and this object
W0923 11:49:41.987032 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: E0923 11:48:07.590034 1483 reflector.go:158] "Unhandled Error" err="object-\"gcp-auth\"/\"gcp-auth-certs\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"gcp-auth-certs\" is forbidden: User \"system:node:addons-949062\" cannot list resource \"secrets\" in API group \"\" in the namespace \"gcp-auth\": no relationship found between node 'addons-949062' and this object" logger="UnhandledError"
W0923 11:49:41.987221 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: W0923 11:48:07.608406 1483 reflector.go:561] object-"local-path-storage"/"local-path-config": failed to list *v1.ConfigMap: configmaps "local-path-config" is forbidden: User "system:node:addons-949062" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-949062' and this object
W0923 11:49:41.987452 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: E0923 11:48:07.608455 1483 reflector.go:158] "Unhandled Error" err="object-\"local-path-storage\"/\"local-path-config\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"local-path-config\" is forbidden: User \"system:node:addons-949062\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"local-path-storage\": no relationship found between node 'addons-949062' and this object" logger="UnhandledError"
W0923 11:49:41.987638 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: W0923 11:48:07.610454 1483 reflector.go:561] object-"local-path-storage"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-949062" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-949062' and this object
W0923 11:49:41.988047 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: E0923 11:48:07.610503 1483 reflector.go:158] "Unhandled Error" err="object-\"local-path-storage\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-949062\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"local-path-storage\": no relationship found between node 'addons-949062' and this object" logger="UnhandledError"
W0923 11:49:41.988238 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: W0923 11:48:07.612923 1483 reflector.go:561] object-"yakd-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-949062" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-949062' and this object
W0923 11:49:41.988464 445639 logs.go:138] Found kubelet problem: Sep 23 11:48:07 addons-949062 kubelet[1483]: E0923 11:48:07.612992 1483 reflector.go:158] "Unhandled Error" err="object-\"yakd-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-949062\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"yakd-dashboard\": no relationship found between node 'addons-949062' and this object" logger="UnhandledError"
I0923 11:49:42.047057 445639 logs.go:123] Gathering logs for dmesg ...
I0923 11:49:42.047096 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0923 11:49:42.067948 445639 logs.go:123] Gathering logs for describe nodes ...
I0923 11:49:42.068044 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0923 11:49:42.256749 445639 logs.go:123] Gathering logs for etcd [91756d36809ddf111e1ea01a91afd27894111f8d88b30c1559789771044fdf31] ...
I0923 11:49:42.256790 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 91756d36809ddf111e1ea01a91afd27894111f8d88b30c1559789771044fdf31"
I0923 11:49:42.339965 445639 logs.go:123] Gathering logs for kube-scheduler [4425a3b8595675b0095ea3d707c89fd9884337c9f856bc18b89b109fcee52ee9] ...
I0923 11:49:42.340011 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4425a3b8595675b0095ea3d707c89fd9884337c9f856bc18b89b109fcee52ee9"
I0923 11:49:42.389979 445639 logs.go:123] Gathering logs for kube-controller-manager [e38a88dde28e49d61a5e1561cf3a2f4aa5b86823826c275210299874bb8e26f3] ...
I0923 11:49:42.390021 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e38a88dde28e49d61a5e1561cf3a2f4aa5b86823826c275210299874bb8e26f3"
I0923 11:49:42.484551 445639 logs.go:123] Gathering logs for container status ...
I0923 11:49:42.484591 445639 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0923 11:49:42.535703 445639 out.go:358] Setting ErrFile to fd 2...
I0923 11:49:42.535731 445639 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0923 11:49:42.535784 445639 out.go:270] X Problems detected in kubelet:
W0923 11:49:42.535797 445639 out.go:270] Sep 23 11:48:07 addons-949062 kubelet[1483]: E0923 11:48:07.608455 1483 reflector.go:158] "Unhandled Error" err="object-\"local-path-storage\"/\"local-path-config\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"local-path-config\" is forbidden: User \"system:node:addons-949062\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"local-path-storage\": no relationship found between node 'addons-949062' and this object" logger="UnhandledError"
W0923 11:49:42.535804 445639 out.go:270] Sep 23 11:48:07 addons-949062 kubelet[1483]: W0923 11:48:07.610454 1483 reflector.go:561] object-"local-path-storage"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-949062" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-949062' and this object
W0923 11:49:42.535811 445639 out.go:270] Sep 23 11:48:07 addons-949062 kubelet[1483]: E0923 11:48:07.610503 1483 reflector.go:158] "Unhandled Error" err="object-\"local-path-storage\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-949062\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"local-path-storage\": no relationship found between node 'addons-949062' and this object" logger="UnhandledError"
W0923 11:49:42.535823 445639 out.go:270] Sep 23 11:48:07 addons-949062 kubelet[1483]: W0923 11:48:07.612923 1483 reflector.go:561] object-"yakd-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-949062" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-949062' and this object
W0923 11:49:42.535829 445639 out.go:270] Sep 23 11:48:07 addons-949062 kubelet[1483]: E0923 11:48:07.612992 1483 reflector.go:158] "Unhandled Error" err="object-\"yakd-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-949062\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"yakd-dashboard\": no relationship found between node 'addons-949062' and this object" logger="UnhandledError"
I0923 11:49:42.535835 445639 out.go:358] Setting ErrFile to fd 2...
I0923 11:49:42.535848 445639 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0923 11:49:52.547782 445639 system_pods.go:59] 18 kube-system pods found
I0923 11:49:52.547829 445639 system_pods.go:61] "coredns-7c65d6cfc9-jcsz4" [974756c3-74c7-4e77-843c-296ebdedac6e] Running
I0923 11:49:52.547837 445639 system_pods.go:61] "csi-hostpath-attacher-0" [43344344-adbe-417a-a2af-3d01d115e233] Running
I0923 11:49:52.547867 445639 system_pods.go:61] "csi-hostpath-resizer-0" [1447cf48-1b0b-4add-86de-f967a6b66e60] Running
I0923 11:49:52.547876 445639 system_pods.go:61] "csi-hostpathplugin-nc48x" [07972406-a73a-453d-a5aa-c4502dc12257] Running
I0923 11:49:52.547883 445639 system_pods.go:61] "etcd-addons-949062" [7dd20eb6-6bb8-46aa-8284-4bd18f454ced] Running
I0923 11:49:52.547887 445639 system_pods.go:61] "kindnet-crb6d" [82dbd0f8-49fe-4cc5-afec-4fae54953851] Running
I0923 11:49:52.547899 445639 system_pods.go:61] "kube-apiserver-addons-949062" [bbed76aa-7118-4b7e-aa17-8e6ad5f7c2f7] Running
I0923 11:49:52.547903 445639 system_pods.go:61] "kube-controller-manager-addons-949062" [9c029cce-d54a-41ed-90a0-40af14721737] Running
I0923 11:49:52.547908 445639 system_pods.go:61] "kube-ingress-dns-minikube" [fdbadef9-d6ba-4f4f-a38f-f8783cc02691] Running
I0923 11:49:52.547915 445639 system_pods.go:61] "kube-proxy-lpdls" [57abcfe0-56c0-45c6-8311-079ba9375f34] Running
I0923 11:49:52.547919 445639 system_pods.go:61] "kube-scheduler-addons-949062" [f0c11a1c-5069-4c0e-b6fb-fc34678e264c] Running
I0923 11:49:52.547940 445639 system_pods.go:61] "metrics-server-84c5f94fbc-bnjfn" [b5eddef8-2c84-4c7e-aa81-1538cdd1737b] Running
I0923 11:49:52.547954 445639 system_pods.go:61] "nvidia-device-plugin-daemonset-whvkq" [c0f4d7f5-47d2-4fb7-8174-7b04a7172064] Running
I0923 11:49:52.547959 445639 system_pods.go:61] "registry-66c9cd494c-mft4z" [054e4117-a309-4e89-afe0-a65369055074] Running
I0923 11:49:52.547974 445639 system_pods.go:61] "registry-proxy-5t6vq" [e46d96a1-6871-401a-a71d-00cd0539506c] Running
I0923 11:49:52.547984 445639 system_pods.go:61] "snapshot-controller-56fcc65765-n696x" [4a6183d3-090c-468a-bc63-63def54751e8] Running
I0923 11:49:52.547989 445639 system_pods.go:61] "snapshot-controller-56fcc65765-zwmp9" [f1ae6ae3-a860-4868-aa32-65f9422824cd] Running
I0923 11:49:52.547992 445639 system_pods.go:61] "storage-provisioner" [a9cab2a6-87d9-418a-b2e7-9b31de2b1030] Running
I0923 11:49:52.547998 445639 system_pods.go:74] duration metric: took 11.439632606s to wait for pod list to return data ...
I0923 11:49:52.548010 445639 default_sa.go:34] waiting for default service account to be created ...
I0923 11:49:52.550622 445639 default_sa.go:45] found service account: "default"
I0923 11:49:52.550649 445639 default_sa.go:55] duration metric: took 2.632806ms for default service account to be created ...
I0923 11:49:52.550658 445639 system_pods.go:116] waiting for k8s-apps to be running ...
I0923 11:49:52.560605 445639 system_pods.go:86] 18 kube-system pods found
I0923 11:49:52.560643 445639 system_pods.go:89] "coredns-7c65d6cfc9-jcsz4" [974756c3-74c7-4e77-843c-296ebdedac6e] Running
I0923 11:49:52.560650 445639 system_pods.go:89] "csi-hostpath-attacher-0" [43344344-adbe-417a-a2af-3d01d115e233] Running
I0923 11:49:52.560655 445639 system_pods.go:89] "csi-hostpath-resizer-0" [1447cf48-1b0b-4add-86de-f967a6b66e60] Running
I0923 11:49:52.560660 445639 system_pods.go:89] "csi-hostpathplugin-nc48x" [07972406-a73a-453d-a5aa-c4502dc12257] Running
I0923 11:49:52.560666 445639 system_pods.go:89] "etcd-addons-949062" [7dd20eb6-6bb8-46aa-8284-4bd18f454ced] Running
I0923 11:49:52.560670 445639 system_pods.go:89] "kindnet-crb6d" [82dbd0f8-49fe-4cc5-afec-4fae54953851] Running
I0923 11:49:52.560675 445639 system_pods.go:89] "kube-apiserver-addons-949062" [bbed76aa-7118-4b7e-aa17-8e6ad5f7c2f7] Running
I0923 11:49:52.560679 445639 system_pods.go:89] "kube-controller-manager-addons-949062" [9c029cce-d54a-41ed-90a0-40af14721737] Running
I0923 11:49:52.560684 445639 system_pods.go:89] "kube-ingress-dns-minikube" [fdbadef9-d6ba-4f4f-a38f-f8783cc02691] Running
I0923 11:49:52.560688 445639 system_pods.go:89] "kube-proxy-lpdls" [57abcfe0-56c0-45c6-8311-079ba9375f34] Running
I0923 11:49:52.560692 445639 system_pods.go:89] "kube-scheduler-addons-949062" [f0c11a1c-5069-4c0e-b6fb-fc34678e264c] Running
I0923 11:49:52.560697 445639 system_pods.go:89] "metrics-server-84c5f94fbc-bnjfn" [b5eddef8-2c84-4c7e-aa81-1538cdd1737b] Running
I0923 11:49:52.560702 445639 system_pods.go:89] "nvidia-device-plugin-daemonset-whvkq" [c0f4d7f5-47d2-4fb7-8174-7b04a7172064] Running
I0923 11:49:52.560706 445639 system_pods.go:89] "registry-66c9cd494c-mft4z" [054e4117-a309-4e89-afe0-a65369055074] Running
I0923 11:49:52.560710 445639 system_pods.go:89] "registry-proxy-5t6vq" [e46d96a1-6871-401a-a71d-00cd0539506c] Running
I0923 11:49:52.560724 445639 system_pods.go:89] "snapshot-controller-56fcc65765-n696x" [4a6183d3-090c-468a-bc63-63def54751e8] Running
I0923 11:49:52.560728 445639 system_pods.go:89] "snapshot-controller-56fcc65765-zwmp9" [f1ae6ae3-a860-4868-aa32-65f9422824cd] Running
I0923 11:49:52.560732 445639 system_pods.go:89] "storage-provisioner" [a9cab2a6-87d9-418a-b2e7-9b31de2b1030] Running
I0923 11:49:52.560746 445639 system_pods.go:126] duration metric: took 10.080845ms to wait for k8s-apps to be running ...
I0923 11:49:52.560754 445639 system_svc.go:44] waiting for kubelet service to be running ....
I0923 11:49:52.560816 445639 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0923 11:49:52.572825 445639 system_svc.go:56] duration metric: took 12.060623ms WaitForService to wait for kubelet
I0923 11:49:52.572918 445639 kubeadm.go:582] duration metric: took 2m27.467496293s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0923 11:49:52.572989 445639 node_conditions.go:102] verifying NodePressure condition ...
I0923 11:49:52.576297 445639 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0923 11:49:52.576333 445639 node_conditions.go:123] node cpu capacity is 2
I0923 11:49:52.576345 445639 node_conditions.go:105] duration metric: took 3.349785ms to run NodePressure ...
I0923 11:49:52.576358 445639 start.go:241] waiting for startup goroutines ...
I0923 11:49:52.576366 445639 start.go:246] waiting for cluster config update ...
I0923 11:49:52.576383 445639 start.go:255] writing updated cluster config ...
I0923 11:49:52.576674 445639 ssh_runner.go:195] Run: rm -f paused
I0923 11:49:52.902843 445639 start.go:600] kubectl: 1.31.1, cluster: 1.31.1 (minor skew: 0)
I0923 11:49:52.906671 445639 out.go:177] * Done! kubectl is now configured to use "addons-949062" cluster and "default" namespace by default
==> CRI-O <==
Sep 23 11:59:09 addons-949062 crio[966]: time="2024-09-23 11:59:09.141177418Z" level=info msg="Checking image status: docker.io/busybox:stable@sha256:3fbc632167424a6d997e74f52b878d7cc478225cffac6bc977eedfe51c7f4e79" id=69408950-6d7f-4f68-998f-f33540826e31 name=/runtime.v1.ImageService/ImageStatus
Sep 23 11:59:09 addons-949062 crio[966]: time="2024-09-23 11:59:09.142446994Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:fc9db2894f4e4b8c296b8c9dab7e18a6e78de700d21bc0cfaf5c78484226db9c,RepoTags:[],RepoDigests:[docker.io/library/busybox@sha256:1fa89c01cd0473cedbd1a470abb8c139eeb80920edf1bc55de87851bfb63ea11 docker.io/library/busybox@sha256:3fbc632167424a6d997e74f52b878d7cc478225cffac6bc977eedfe51c7f4e79],Size_:4277463,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=69408950-6d7f-4f68-998f-f33540826e31 name=/runtime.v1.ImageService/ImageStatus
Sep 23 11:59:09 addons-949062 crio[966]: time="2024-09-23 11:59:09.147408280Z" level=info msg="Checking image status: docker.io/busybox:stable@sha256:3fbc632167424a6d997e74f52b878d7cc478225cffac6bc977eedfe51c7f4e79" id=58ab44cc-2a80-4a9a-9952-ad78f02ab65d name=/runtime.v1.ImageService/ImageStatus
Sep 23 11:59:09 addons-949062 crio[966]: time="2024-09-23 11:59:09.148533554Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:fc9db2894f4e4b8c296b8c9dab7e18a6e78de700d21bc0cfaf5c78484226db9c,RepoTags:[],RepoDigests:[docker.io/library/busybox@sha256:1fa89c01cd0473cedbd1a470abb8c139eeb80920edf1bc55de87851bfb63ea11 docker.io/library/busybox@sha256:3fbc632167424a6d997e74f52b878d7cc478225cffac6bc977eedfe51c7f4e79],Size_:4277463,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=58ab44cc-2a80-4a9a-9952-ad78f02ab65d name=/runtime.v1.ImageService/ImageStatus
Sep 23 11:59:09 addons-949062 crio[966]: time="2024-09-23 11:59:09.150938636Z" level=info msg="Creating container: local-path-storage/helper-pod-delete-pvc-a360d212-2322-4a7c-8e95-840a1216a052/helper-pod" id=d254b9a5-977a-496b-971b-60f1944ed2ed name=/runtime.v1.RuntimeService/CreateContainer
Sep 23 11:59:09 addons-949062 crio[966]: time="2024-09-23 11:59:09.151049077Z" level=warning msg="Allowed annotations are specified for workload []"
Sep 23 11:59:09 addons-949062 crio[966]: time="2024-09-23 11:59:09.212869174Z" level=info msg="Stopped pod sandbox: 9d9d8f82269e4f95f0cefcacf88bffd4041411c9ddc99b430a47ce9e1e345f8b" id=d49db463-94d6-4f60-b6cb-57ebe5033c9c name=/runtime.v1.RuntimeService/StopPodSandbox
Sep 23 11:59:09 addons-949062 crio[966]: time="2024-09-23 11:59:09.260580910Z" level=info msg="Stopped container 3fc5b859779638ca14e87b1170c99350b910bc178becc236697d41f3f096be57: kube-system/registry-proxy-5t6vq/registry-proxy" id=3eaab96d-56fb-4abc-9e4d-06b913a340d7 name=/runtime.v1.RuntimeService/StopContainer
Sep 23 11:59:09 addons-949062 crio[966]: time="2024-09-23 11:59:09.261167198Z" level=info msg="Stopping pod sandbox: 465510d796584aca51d6a8dec088a1dcb90e2e71e2810b398730cc27e19d04da" id=5cc61f00-7bd5-48ae-8ecc-9fcaaf93ecb7 name=/runtime.v1.RuntimeService/StopPodSandbox
Sep 23 11:59:09 addons-949062 crio[966]: time="2024-09-23 11:59:09.271910593Z" level=info msg="Restoring iptables rules: *nat\n:KUBE-HP-26XTWWFYVD24JI2C - [0:0]\n:KUBE-HP-NCJPZSSL4DVKVWNQ - [0:0]\n:KUBE-HOSTPORTS - [0:0]\n:KUBE-HP-ZU5J4ITKIQG4MSAM - [0:0]\n-A KUBE-HOSTPORTS -p tcp -m comment --comment \"k8s_ingress-nginx-controller-bc57996ff-x7thd_ingress-nginx_b2896d65-91cf-4e93-b5a0-f0b79c086a7d_0_ hostport 443\" -m tcp --dport 443 -j KUBE-HP-NCJPZSSL4DVKVWNQ\n-A KUBE-HOSTPORTS -p tcp -m comment --comment \"k8s_ingress-nginx-controller-bc57996ff-x7thd_ingress-nginx_b2896d65-91cf-4e93-b5a0-f0b79c086a7d_0_ hostport 80\" -m tcp --dport 80 -j KUBE-HP-ZU5J4ITKIQG4MSAM\n-A KUBE-HP-NCJPZSSL4DVKVWNQ -s 10.244.0.19/32 -m comment --comment \"k8s_ingress-nginx-controller-bc57996ff-x7thd_ingress-nginx_b2896d65-91cf-4e93-b5a0-f0b79c086a7d_0_ hostport 443\" -j KUBE-MARK-MASQ\n-A KUBE-HP-NCJPZSSL4DVKVWNQ -p tcp -m comment --comment \"k8s_ingress-nginx-controller-bc57996ff-x7thd_ingress-nginx_b2896d65-91cf-4e93-b5
a0-f0b79c086a7d_0_ hostport 443\" -m tcp -j DNAT --to-destination 10.244.0.19:443\n-A KUBE-HP-ZU5J4ITKIQG4MSAM -s 10.244.0.19/32 -m comment --comment \"k8s_ingress-nginx-controller-bc57996ff-x7thd_ingress-nginx_b2896d65-91cf-4e93-b5a0-f0b79c086a7d_0_ hostport 80\" -j KUBE-MARK-MASQ\n-A KUBE-HP-ZU5J4ITKIQG4MSAM -p tcp -m comment --comment \"k8s_ingress-nginx-controller-bc57996ff-x7thd_ingress-nginx_b2896d65-91cf-4e93-b5a0-f0b79c086a7d_0_ hostport 80\" -m tcp -j DNAT --to-destination 10.244.0.19:80\n-X KUBE-HP-26XTWWFYVD24JI2C\nCOMMIT\n"
Sep 23 11:59:09 addons-949062 crio[966]: time="2024-09-23 11:59:09.290656170Z" level=info msg="Closing host port tcp:5000"
Sep 23 11:59:09 addons-949062 crio[966]: time="2024-09-23 11:59:09.299230364Z" level=info msg="Host port tcp:5000 does not have an open socket"
Sep 23 11:59:09 addons-949062 crio[966]: time="2024-09-23 11:59:09.299451738Z" level=info msg="Got pod network &{Name:registry-proxy-5t6vq Namespace:kube-system ID:465510d796584aca51d6a8dec088a1dcb90e2e71e2810b398730cc27e19d04da UID:e46d96a1-6871-401a-a71d-00cd0539506c NetNS:/var/run/netns/0f7e2073-09b8-464d-b6f7-9bf99ba6c0a4 Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
Sep 23 11:59:09 addons-949062 crio[966]: time="2024-09-23 11:59:09.299605321Z" level=info msg="Deleting pod kube-system_registry-proxy-5t6vq from CNI network \"kindnet\" (type=ptp)"
Sep 23 11:59:09 addons-949062 crio[966]: time="2024-09-23 11:59:09.333376336Z" level=info msg="Stopped pod sandbox: 465510d796584aca51d6a8dec088a1dcb90e2e71e2810b398730cc27e19d04da" id=5cc61f00-7bd5-48ae-8ecc-9fcaaf93ecb7 name=/runtime.v1.RuntimeService/StopPodSandbox
Sep 23 11:59:09 addons-949062 crio[966]: time="2024-09-23 11:59:09.370746268Z" level=info msg="Created container 22a18784d1c2e3e16936feee24e0efd371f24cd27fd2015afc4fe2756bf69f68: local-path-storage/helper-pod-delete-pvc-a360d212-2322-4a7c-8e95-840a1216a052/helper-pod" id=d254b9a5-977a-496b-971b-60f1944ed2ed name=/runtime.v1.RuntimeService/CreateContainer
Sep 23 11:59:09 addons-949062 crio[966]: time="2024-09-23 11:59:09.371429196Z" level=info msg="Starting container: 22a18784d1c2e3e16936feee24e0efd371f24cd27fd2015afc4fe2756bf69f68" id=2b1e42ad-1e6c-482a-a081-592da3db0d5d name=/runtime.v1.RuntimeService/StartContainer
Sep 23 11:59:09 addons-949062 crio[966]: time="2024-09-23 11:59:09.394329489Z" level=info msg="Started container" PID=7792 containerID=22a18784d1c2e3e16936feee24e0efd371f24cd27fd2015afc4fe2756bf69f68 description=local-path-storage/helper-pod-delete-pvc-a360d212-2322-4a7c-8e95-840a1216a052/helper-pod id=2b1e42ad-1e6c-482a-a081-592da3db0d5d name=/runtime.v1.RuntimeService/StartContainer sandboxID=7a73d69e63b2ad71a93878cf39f7873c12fd2068b605636bbd2331e321c9f7c9
Sep 23 11:59:09 addons-949062 crio[966]: time="2024-09-23 11:59:09.542389430Z" level=info msg="Removing container: fadd1124d32cae66bf54afd45cf3e2ea6d8ae742a77b5df3725bc78684dfc92e" id=5330fce9-7cc8-4fda-be9c-c3e6c47f8339 name=/runtime.v1.RuntimeService/RemoveContainer
Sep 23 11:59:09 addons-949062 crio[966]: time="2024-09-23 11:59:09.566920045Z" level=info msg="Removed container fadd1124d32cae66bf54afd45cf3e2ea6d8ae742a77b5df3725bc78684dfc92e: kube-system/registry-66c9cd494c-mft4z/registry" id=5330fce9-7cc8-4fda-be9c-c3e6c47f8339 name=/runtime.v1.RuntimeService/RemoveContainer
Sep 23 11:59:09 addons-949062 crio[966]: time="2024-09-23 11:59:09.571953922Z" level=info msg="Removing container: 3fc5b859779638ca14e87b1170c99350b910bc178becc236697d41f3f096be57" id=81f2de02-4847-49e7-8f58-ceb560c439dd name=/runtime.v1.RuntimeService/RemoveContainer
Sep 23 11:59:09 addons-949062 crio[966]: time="2024-09-23 11:59:09.628005128Z" level=info msg="Removed container 3fc5b859779638ca14e87b1170c99350b910bc178becc236697d41f3f096be57: kube-system/registry-proxy-5t6vq/registry-proxy" id=81f2de02-4847-49e7-8f58-ceb560c439dd name=/runtime.v1.RuntimeService/RemoveContainer
Sep 23 11:59:09 addons-949062 crio[966]: time="2024-09-23 11:59:09.793931100Z" level=info msg="Stopping container: 7067f9215c9c9d1a2d15d5ab4dc3056668c2d9402804280437984600d7d9feb9 (timeout: 30s)" id=66759b5e-6aeb-4b84-a345-33dd7b94991d name=/runtime.v1.RuntimeService/StopContainer
Sep 23 11:59:09 addons-949062 crio[966]: time="2024-09-23 11:59:09.868697492Z" level=info msg="Checking image status: gcr.io/k8s-minikube/busybox:1.28.4-glibc" id=7b832354-2567-44dd-83ec-72c4457b078b name=/runtime.v1.ImageService/ImageStatus
Sep 23 11:59:09 addons-949062 crio[966]: time="2024-09-23 11:59:09.868922977Z" level=info msg="Image gcr.io/k8s-minikube/busybox:1.28.4-glibc not found" id=7b832354-2567-44dd-83ec-72c4457b078b name=/runtime.v1.ImageService/ImageStatus
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
22a18784d1c2e fc9db2894f4e4b8c296b8c9dab7e18a6e78de700d21bc0cfaf5c78484226db9c 1 second ago Exited helper-pod 0 7a73d69e63b2a helper-pod-delete-pvc-a360d212-2322-4a7c-8e95-840a1216a052
75b6cc5f59b5f ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec 4 seconds ago Exited gadget 7 2376e5ec374a8 gadget-jmdtd
59a5cf30abd71 docker.io/library/busybox@sha256:71e065368796c7368a99a072019b9fe73e28e225ae9882430579ec49a1e46235 4 seconds ago Exited busybox 0 3d86408266a88 test-local-path
f0f25f615a90f docker.io/library/busybox@sha256:1fa89c01cd0473cedbd1a470abb8c139eeb80920edf1bc55de87851bfb63ea11 8 seconds ago Exited helper-pod 0 68e8ca5dd1dc5 helper-pod-create-pvc-a360d212-2322-4a7c-8e95-840a1216a052
5e66fdd30cb30 gcr.io/k8s-minikube/gcp-auth-webhook@sha256:a40e1a121ee367d1712ac3a54ec9c38c405a65dde923c98e5fa6368fa82c4b69 10 minutes ago Running gcp-auth 0 e2743dba6ce2f gcp-auth-89d5ffd79-ngrj4
d0726f8d2a428 registry.k8s.io/ingress-nginx/controller@sha256:22f9d129ae8c89a2cabbd13af3c1668944f3dd68fec186199b7024a0a2fc75b3 10 minutes ago Running controller 0 7731779e7a96b ingress-nginx-controller-bc57996ff-x7thd
7067f9215c9c9 docker.io/rancher/local-path-provisioner@sha256:689a2489a24e74426e4a4666e611c988202c5fa995908b0c60133aca3eb87d98 10 minutes ago Running local-path-provisioner 0 48e2891c8e46f local-path-provisioner-86d989889c-2lw8p
74d5aa53486bd 420193b27261a8d37b9fb1faeed45094cefa47e72a7538fd5a6c05e8b5ce192e 10 minutes ago Exited patch 2 5d8631b387c44 ingress-nginx-admission-patch-tr6mp
5568505e831a6 registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:7c4c1a6ca8855c524a64983eaf590e126a669ae12df83ad65de281c9beee13d3 10 minutes ago Exited create 0 027af99d19728 ingress-nginx-admission-create-gbsch
9dc32497078db gcr.io/cloud-spanner-emulator/emulator@sha256:6ce1265c73355797b34d2531c7146eed3996346f860517e35d1434182eb5f01d 10 minutes ago Running cloud-spanner-emulator 0 67107d0113bba cloud-spanner-emulator-5b584cc74-tkw9m
4f6b61fa3207e gcr.io/k8s-minikube/minikube-ingress-dns@sha256:4211a1de532376c881851542238121b26792225faa36a7b02dccad88fd05797c 10 minutes ago Running minikube-ingress-dns 0 1faba4530b730 kube-ingress-dns-minikube
6fc3f48fd9a57 registry.k8s.io/metrics-server/metrics-server@sha256:048bcf48fc2cce517a61777e22bac782ba59ea5e9b9a54bcb42dbee99566a91f 10 minutes ago Running metrics-server 0 95e955c1b77e6 metrics-server-84c5f94fbc-bnjfn
6e75514e9a125 2f6c962e7b8311337352d9fdea917da2184d9919f4da7695bc2a6517cf392fe4 11 minutes ago Running coredns 0 d2e1e2c2a03e5 coredns-7c65d6cfc9-jcsz4
f22feaa12d01b ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6 11 minutes ago Running storage-provisioner 0 e2518070e6a52 storage-provisioner
3025434caf006 6a23fa8fd2b78ab58e42ba273808edc936a9c53d8ac4a919f6337be094843a51 11 minutes ago Running kindnet-cni 0 265c0c18f131a kindnet-crb6d
feeee7ef089ea 24a140c548c075e487e45d0ee73b1aa89f8bfb40c08a57e05975559728822b1d 11 minutes ago Running kube-proxy 0 4b6db7c6ec78d kube-proxy-lpdls
e38a88dde28e4 279f381cb37365bbbcd133c9531fba9c2beb0f38dbbe6ddfcd0b1b1643d3450e 11 minutes ago Running kube-controller-manager 0 1f83731f5a636 kube-controller-manager-addons-949062
91756d36809dd 27e3830e1402783674d8b594038967deea9d51f0d91b34c93c8f39d2f68af7da 11 minutes ago Running etcd 0 027c4d4026357 etcd-addons-949062
f01e8c743f9c3 d3f53a98c0a9d9163c4848bcf34b2d2f5e1e3691b79f3d1dd6d0206809e02853 11 minutes ago Running kube-apiserver 0 ec6544bfbe742 kube-apiserver-addons-949062
4425a3b859567 7f8aa378bb47dffcf430f3a601abe39137e88aee0238e23ed8530fdd18dab82d 11 minutes ago Running kube-scheduler 0 296ca53b7c96c kube-scheduler-addons-949062
==> coredns [6e75514e9a125cad3d7d0f53041cd69f7134d95af21367e27986ef926903a005] <==
[INFO] 10.244.0.13:39517 - 58486 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000107471s
[INFO] 10.244.0.13:35326 - 44451 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002495559s
[INFO] 10.244.0.13:35326 - 36261 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002558525s
[INFO] 10.244.0.13:33119 - 15751 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000152508s
[INFO] 10.244.0.13:33119 - 50050 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000901823s
[INFO] 10.244.0.13:51484 - 16281 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000118432s
[INFO] 10.244.0.13:51484 - 52629 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000178765s
[INFO] 10.244.0.13:37639 - 4554 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000062851s
[INFO] 10.244.0.13:37639 - 7880 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000033707s
[INFO] 10.244.0.13:48824 - 6614 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000057067s
[INFO] 10.244.0.13:48824 - 54487 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000138067s
[INFO] 10.244.0.13:45851 - 25610 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001436886s
[INFO] 10.244.0.13:45851 - 776 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001622593s
[INFO] 10.244.0.13:50334 - 53131 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000062096s
[INFO] 10.244.0.13:50334 - 35725 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000052258s
[INFO] 10.244.0.20:49801 - 18899 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000873327s
[INFO] 10.244.0.20:52682 - 28540 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000920564s
[INFO] 10.244.0.20:33285 - 61683 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000130067s
[INFO] 10.244.0.20:41482 - 11675 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000134883s
[INFO] 10.244.0.20:45942 - 52379 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000196562s
[INFO] 10.244.0.20:47769 - 27652 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000183728s
[INFO] 10.244.0.20:35099 - 8702 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.003947223s
[INFO] 10.244.0.20:46119 - 23575 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.004169196s
[INFO] 10.244.0.20:37099 - 53691 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 648 0.001733846s
[INFO] 10.244.0.20:56793 - 36966 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.001769136s
==> describe nodes <==
Name: addons-949062
Roles: control-plane
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=addons-949062
kubernetes.io/os=linux
minikube.k8s.io/commit=a36553b39c7bbbd910f6bfb97f7b698be94b4e6e
minikube.k8s.io/name=addons-949062
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_09_23T11_47_20_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-949062
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Mon, 23 Sep 2024 11:47:17 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-949062
AcquireTime: <unset>
RenewTime: Mon, 23 Sep 2024 11:59:04 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Mon, 23 Sep 2024 11:58:24 +0000 Mon, 23 Sep 2024 11:47:14 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Mon, 23 Sep 2024 11:58:24 +0000 Mon, 23 Sep 2024 11:47:14 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Mon, 23 Sep 2024 11:58:24 +0000 Mon, 23 Sep 2024 11:47:14 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Mon, 23 Sep 2024 11:58:24 +0000 Mon, 23 Sep 2024 11:48:07 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-949062
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022300Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022300Ki
pods: 110
System Info:
Machine ID: 4fea63fffa1049769b4894f4f9d9f01c
System UUID: b903b7cd-b68c-4881-b475-86a0d25c8063
Boot ID: a368a3b9-64b6-4915-adf4-926cc803503e
Kernel Version: 5.15.0-1070-aws
OS Image: Ubuntu 22.04.5 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: cri-o://1.24.6
Kubelet Version: v1.31.1
Kube-Proxy Version: v1.31.1
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (16 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 9m17s
default cloud-spanner-emulator-5b584cc74-tkw9m 0 (0%) 0 (0%) 0 (0%) 0 (0%) 11m
gadget gadget-jmdtd 0 (0%) 0 (0%) 0 (0%) 0 (0%) 11m
gcp-auth gcp-auth-89d5ffd79-ngrj4 0 (0%) 0 (0%) 0 (0%) 0 (0%) 11m
ingress-nginx ingress-nginx-controller-bc57996ff-x7thd 100m (5%) 0 (0%) 90Mi (1%) 0 (0%) 11m
kube-system coredns-7c65d6cfc9-jcsz4 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 11m
kube-system etcd-addons-949062 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 11m
kube-system kindnet-crb6d 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 11m
kube-system kube-apiserver-addons-949062 250m (12%) 0 (0%) 0 (0%) 0 (0%) 11m
kube-system kube-controller-manager-addons-949062 200m (10%) 0 (0%) 0 (0%) 0 (0%) 11m
kube-system kube-ingress-dns-minikube 0 (0%) 0 (0%) 0 (0%) 0 (0%) 11m
kube-system kube-proxy-lpdls 0 (0%) 0 (0%) 0 (0%) 0 (0%) 11m
kube-system kube-scheduler-addons-949062 100m (5%) 0 (0%) 0 (0%) 0 (0%) 11m
kube-system metrics-server-84c5f94fbc-bnjfn 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 11m
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 11m
local-path-storage local-path-provisioner-86d989889c-2lw8p 0 (0%) 0 (0%) 0 (0%) 0 (0%) 11m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 1050m (52%) 100m (5%)
memory 510Mi (6%) 220Mi (2%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 11m kube-proxy
Normal Starting 11m kubelet Starting kubelet.
Warning CgroupV1 11m kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeHasSufficientMemory 11m kubelet Node addons-949062 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 11m kubelet Node addons-949062 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 11m kubelet Node addons-949062 status is now: NodeHasSufficientPID
Normal RegisteredNode 11m node-controller Node addons-949062 event: Registered Node addons-949062 in Controller
Normal NodeReady 11m kubelet Node addons-949062 status is now: NodeReady
==> dmesg <==
[Sep23 10:37] hrtimer: interrupt took 15299626 ns
[Sep23 11:17] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
[Sep23 11:18] overlayfs: '/var/lib/docker/overlay2/l/WCSESTVH3U25P3IZ5LAJCY2BWZ' not a directory
[ +0.008103] overlayfs: '/var/lib/docker/overlay2/l/WCSESTVH3U25P3IZ5LAJCY2BWZ' not a directory
[ +0.007654] overlayfs: '/var/lib/docker/overlay2/l/WCSESTVH3U25P3IZ5LAJCY2BWZ' not a directory
[ +0.118029] overlayfs: '/var/lib/docker/overlay2/l/WCSESTVH3U25P3IZ5LAJCY2BWZ' not a directory
==> etcd [91756d36809ddf111e1ea01a91afd27894111f8d88b30c1559789771044fdf31] <==
{"level":"info","ts":"2024-09-23T11:47:26.507722Z","caller":"traceutil/trace.go:171","msg":"trace[1819306561] transaction","detail":"{read_only:false; response_revision:335; number_of_response:1; }","duration":"354.534892ms","start":"2024-09-23T11:47:26.153173Z","end":"2024-09-23T11:47:26.507708Z","steps":["trace[1819306561] 'process raft request' (duration: 173.427296ms)","trace[1819306561] 'compare' (duration: 161.826424ms)"],"step_count":2}
{"level":"info","ts":"2024-09-23T11:47:26.507780Z","caller":"traceutil/trace.go:171","msg":"trace[294115114] transaction","detail":"{read_only:false; response_revision:336; number_of_response:1; }","duration":"354.528246ms","start":"2024-09-23T11:47:26.153246Z","end":"2024-09-23T11:47:26.507774Z","steps":["trace[294115114] 'process raft request' (duration: 354.382146ms)"],"step_count":1}
{"level":"warn","ts":"2024-09-23T11:47:26.507817Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2024-09-23T11:47:26.153239Z","time spent":"354.559031ms","remote":"127.0.0.1:44866","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":3505,"response count":0,"response size":40,"request content":"compare:<target:MOD key:\"/registry/pods/kube-system/coredns-7c65d6cfc9-qlrbm\" mod_revision:0 > success:<request_put:<key:\"/registry/pods/kube-system/coredns-7c65d6cfc9-qlrbm\" value_size:3446 >> failure:<>"}
{"level":"warn","ts":"2024-09-23T11:47:26.507860Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2024-09-23T11:47:26.153152Z","time spent":"354.692036ms","remote":"127.0.0.1:44762","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":704,"response count":0,"response size":40,"request content":"compare:<target:MOD key:\"/registry/events/kube-system/coredns-7c65d6cfc9.17f7dd10a7aab59c\" mod_revision:0 > success:<request_put:<key:\"/registry/events/kube-system/coredns-7c65d6cfc9.17f7dd10a7aab59c\" value_size:622 lease:8128032088080808499 >> failure:<>"}
{"level":"info","ts":"2024-09-23T11:47:26.718544Z","caller":"traceutil/trace.go:171","msg":"trace[1785803683] transaction","detail":"{read_only:false; response_revision:337; number_of_response:1; }","duration":"102.378317ms","start":"2024-09-23T11:47:26.614788Z","end":"2024-09-23T11:47:26.717166Z","steps":["trace[1785803683] 'process raft request' (duration: 10.226861ms)","trace[1785803683] 'compare' (duration: 91.878029ms)"],"step_count":2}
{"level":"info","ts":"2024-09-23T11:47:27.593162Z","caller":"traceutil/trace.go:171","msg":"trace[1882345274] transaction","detail":"{read_only:false; response_revision:345; number_of_response:1; }","duration":"106.60864ms","start":"2024-09-23T11:47:27.486535Z","end":"2024-09-23T11:47:27.593144Z","steps":["trace[1882345274] 'process raft request' (duration: 86.614764ms)","trace[1882345274] 'compare' (duration: 19.731658ms)"],"step_count":2}
{"level":"info","ts":"2024-09-23T11:47:27.791882Z","caller":"traceutil/trace.go:171","msg":"trace[138325997] transaction","detail":"{read_only:false; response_revision:347; number_of_response:1; }","duration":"137.905609ms","start":"2024-09-23T11:47:27.653957Z","end":"2024-09-23T11:47:27.791863Z","steps":["trace[138325997] 'process raft request' (duration: 130.114877ms)"],"step_count":1}
{"level":"info","ts":"2024-09-23T11:47:29.300549Z","caller":"traceutil/trace.go:171","msg":"trace[2147342535] transaction","detail":"{read_only:false; response_revision:370; number_of_response:1; }","duration":"260.021943ms","start":"2024-09-23T11:47:29.040513Z","end":"2024-09-23T11:47:29.300535Z","steps":["trace[2147342535] 'process raft request' (duration: 166.006836ms)","trace[2147342535] 'compare' (duration: 93.412425ms)"],"step_count":2}
{"level":"info","ts":"2024-09-23T11:47:29.305330Z","caller":"traceutil/trace.go:171","msg":"trace[258696848] transaction","detail":"{read_only:false; response_revision:371; number_of_response:1; }","duration":"245.521582ms","start":"2024-09-23T11:47:29.059790Z","end":"2024-09-23T11:47:29.305311Z","steps":["trace[258696848] 'process raft request' (duration: 240.218031ms)"],"step_count":1}
{"level":"info","ts":"2024-09-23T11:47:29.305483Z","caller":"traceutil/trace.go:171","msg":"trace[833664895] transaction","detail":"{read_only:false; response_revision:372; number_of_response:1; }","duration":"245.413776ms","start":"2024-09-23T11:47:29.060063Z","end":"2024-09-23T11:47:29.305476Z","steps":["trace[833664895] 'process raft request' (duration: 239.977129ms)"],"step_count":1}
{"level":"info","ts":"2024-09-23T11:47:29.305506Z","caller":"traceutil/trace.go:171","msg":"trace[1679492280] linearizableReadLoop","detail":"{readStateIndex:382; appliedIndex:379; }","duration":"243.147738ms","start":"2024-09-23T11:47:29.062352Z","end":"2024-09-23T11:47:29.305500Z","steps":["trace[1679492280] 'read index received' (duration: 127.062938ms)","trace[1679492280] 'applied index is now lower than readState.Index' (duration: 116.084242ms)"],"step_count":2}
{"level":"warn","ts":"2024-09-23T11:47:29.305561Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"243.187698ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/ranges/servicenodeports\" ","response":"range_response_count:1 size:118"}
{"level":"info","ts":"2024-09-23T11:47:29.323187Z","caller":"traceutil/trace.go:171","msg":"trace[1959083122] range","detail":"{range_begin:/registry/ranges/servicenodeports; range_end:; response_count:1; response_revision:378; }","duration":"260.821211ms","start":"2024-09-23T11:47:29.062348Z","end":"2024-09-23T11:47:29.323169Z","steps":["trace[1959083122] 'agreement among raft nodes before linearized reading' (duration: 243.168005ms)"],"step_count":1}
{"level":"warn","ts":"2024-09-23T11:47:29.325435Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"227.89022ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/ranges/serviceips\" ","response":"range_response_count:1 size:5502"}
{"level":"info","ts":"2024-09-23T11:47:29.325539Z","caller":"traceutil/trace.go:171","msg":"trace[998825978] range","detail":"{range_begin:/registry/ranges/serviceips; range_end:; response_count:1; response_revision:378; }","duration":"228.001226ms","start":"2024-09-23T11:47:29.097526Z","end":"2024-09-23T11:47:29.325528Z","steps":["trace[998825978] 'agreement among raft nodes before linearized reading' (duration: 227.837682ms)"],"step_count":1}
{"level":"info","ts":"2024-09-23T11:47:29.305662Z","caller":"traceutil/trace.go:171","msg":"trace[1940082300] transaction","detail":"{read_only:false; response_revision:373; number_of_response:1; }","duration":"160.488319ms","start":"2024-09-23T11:47:29.145167Z","end":"2024-09-23T11:47:29.305655Z","steps":["trace[1940082300] 'process raft request' (duration: 154.939525ms)"],"step_count":1}
{"level":"warn","ts":"2024-09-23T11:47:29.326285Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"118.51832ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/namespaces/kube-system\" ","response":"range_response_count:1 size:351"}
{"level":"info","ts":"2024-09-23T11:47:29.331495Z","caller":"traceutil/trace.go:171","msg":"trace[1681955623] range","detail":"{range_begin:/registry/namespaces/kube-system; range_end:; response_count:1; response_revision:378; }","duration":"123.713893ms","start":"2024-09-23T11:47:29.207753Z","end":"2024-09-23T11:47:29.331467Z","steps":["trace[1681955623] 'agreement among raft nodes before linearized reading' (duration: 118.500573ms)"],"step_count":1}
{"level":"warn","ts":"2024-09-23T11:47:29.331810Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"125.122094ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/deployments/kube-system/registry\" ","response":"range_response_count:1 size:3351"}
{"level":"info","ts":"2024-09-23T11:47:29.331978Z","caller":"traceutil/trace.go:171","msg":"trace[1090535919] range","detail":"{range_begin:/registry/deployments/kube-system/registry; range_end:; response_count:1; response_revision:378; }","duration":"125.298775ms","start":"2024-09-23T11:47:29.206670Z","end":"2024-09-23T11:47:29.331968Z","steps":["trace[1090535919] 'agreement among raft nodes before linearized reading' (duration: 125.081766ms)"],"step_count":1}
{"level":"warn","ts":"2024-09-23T11:47:29.332165Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"234.609119ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts\" limit:1 ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2024-09-23T11:47:29.332291Z","caller":"traceutil/trace.go:171","msg":"trace[303543787] range","detail":"{range_begin:/registry/serviceaccounts; range_end:; response_count:0; response_revision:378; }","duration":"234.738054ms","start":"2024-09-23T11:47:29.097544Z","end":"2024-09-23T11:47:29.332282Z","steps":["trace[303543787] 'agreement among raft nodes before linearized reading' (duration: 234.592865ms)"],"step_count":1}
{"level":"info","ts":"2024-09-23T11:57:14.433189Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1531}
{"level":"info","ts":"2024-09-23T11:57:14.462706Z","caller":"mvcc/kvstore_compaction.go:69","msg":"finished scheduled compaction","compact-revision":1531,"took":"28.940304ms","hash":3244333237,"current-db-size-bytes":6201344,"current-db-size":"6.2 MB","current-db-size-in-use-bytes":3289088,"current-db-size-in-use":"3.3 MB"}
{"level":"info","ts":"2024-09-23T11:57:14.462759Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":3244333237,"revision":1531,"compact-revision":-1}
==> gcp-auth [5e66fdd30cb307eedadaee7ec875a36cfb388767297c5074b1808ec03dd20931] <==
2024/09/23 11:49:10 GCP Auth Webhook started!
2024/09/23 11:49:53 Ready to marshal response ...
2024/09/23 11:49:53 Ready to write response ...
2024/09/23 11:49:53 Ready to marshal response ...
2024/09/23 11:49:53 Ready to write response ...
2024/09/23 11:49:53 Ready to marshal response ...
2024/09/23 11:49:53 Ready to write response ...
2024/09/23 11:58:07 Ready to marshal response ...
2024/09/23 11:58:07 Ready to write response ...
2024/09/23 11:58:09 Ready to marshal response ...
2024/09/23 11:58:09 Ready to write response ...
2024/09/23 11:58:37 Ready to marshal response ...
2024/09/23 11:58:37 Ready to write response ...
2024/09/23 11:59:00 Ready to marshal response ...
2024/09/23 11:59:00 Ready to write response ...
2024/09/23 11:59:00 Ready to marshal response ...
2024/09/23 11:59:00 Ready to write response ...
2024/09/23 11:59:08 Ready to marshal response ...
2024/09/23 11:59:08 Ready to write response ...
==> kernel <==
11:59:10 up 1:41, 0 users, load average: 1.66, 0.82, 1.72
Linux addons-949062 5.15.0-1070-aws #76~20.04.1-Ubuntu SMP Mon Sep 2 12:20:48 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.5 LTS"
==> kindnet [3025434caf0067f0c48f9d98e75ca5f22b91cffe56b857f46556c50c8619f1e7] <==
I0923 11:57:06.951135 1 main.go:299] handling current node
I0923 11:57:16.952137 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0923 11:57:16.952175 1 main.go:299] handling current node
I0923 11:57:26.951392 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0923 11:57:26.951427 1 main.go:299] handling current node
I0923 11:57:36.956477 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0923 11:57:36.956509 1 main.go:299] handling current node
I0923 11:57:46.950740 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0923 11:57:46.950772 1 main.go:299] handling current node
I0923 11:57:56.955713 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0923 11:57:56.955746 1 main.go:299] handling current node
I0923 11:58:06.950926 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0923 11:58:06.951051 1 main.go:299] handling current node
I0923 11:58:16.951803 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0923 11:58:16.951838 1 main.go:299] handling current node
I0923 11:58:26.950692 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0923 11:58:26.950733 1 main.go:299] handling current node
I0923 11:58:36.950738 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0923 11:58:36.950772 1 main.go:299] handling current node
I0923 11:58:46.951639 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0923 11:58:46.951679 1 main.go:299] handling current node
I0923 11:58:56.952650 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0923 11:58:56.952797 1 main.go:299] handling current node
I0923 11:59:06.950714 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0923 11:59:06.950854 1 main.go:299] handling current node
==> kube-apiserver [f01e8c743f9c393432831b5cf6a18d60aeec0b794af11cc59645f781ef744300] <==
E0923 11:49:18.246111 1 remote_available_controller.go:448] "Unhandled Error" err="v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.99.123.245:443/apis/metrics.k8s.io/v1beta1: Get \"https://10.99.123.245:443/apis/metrics.k8s.io/v1beta1\": dial tcp 10.99.123.245:443: connect: connection refused" logger="UnhandledError"
W0923 11:49:18.246430 1 handler_proxy.go:99] no RequestInfo found in the context
E0923 11:49:18.246506 1 controller.go:146] "Unhandled Error" err=<
Error updating APIService "v1beta1.metrics.k8s.io" with err: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
> logger="UnhandledError"
E0923 11:49:18.248915 1 remote_available_controller.go:448] "Unhandled Error" err="v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.99.123.245:443/apis/metrics.k8s.io/v1beta1: Get \"https://10.99.123.245:443/apis/metrics.k8s.io/v1beta1\": dial tcp 10.99.123.245:443: connect: connection refused" logger="UnhandledError"
E0923 11:49:18.256446 1 remote_available_controller.go:448] "Unhandled Error" err="v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.99.123.245:443/apis/metrics.k8s.io/v1beta1: Get \"https://10.99.123.245:443/apis/metrics.k8s.io/v1beta1\": dial tcp 10.99.123.245:443: connect: connection refused" logger="UnhandledError"
E0923 11:49:18.266972 1 remote_available_controller.go:448] "Unhandled Error" err="v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.99.123.245:443/apis/metrics.k8s.io/v1beta1: Get \"https://10.99.123.245:443/apis/metrics.k8s.io/v1beta1\": dial tcp 10.99.123.245:443: connect: connection refused" logger="UnhandledError"
I0923 11:49:18.462459 1 handler.go:286] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
I0923 11:58:19.914786 1 controller.go:615] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io
E0923 11:58:21.707588 1 watch.go:250] "Unhandled Error" err="http2: stream closed" logger="UnhandledError"
I0923 11:58:53.162659 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0923 11:58:53.162791 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0923 11:58:53.187560 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0923 11:58:53.187742 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0923 11:58:53.217554 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0923 11:58:53.217812 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0923 11:58:53.312776 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0923 11:58:53.312890 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0923 11:58:53.323196 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0923 11:58:53.323233 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
W0923 11:58:54.313542 1 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io
W0923 11:58:54.324111 1 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io
W0923 11:58:54.413702 1 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io
==> kube-controller-manager [e38a88dde28e49d61a5e1561cf3a2f4aa5b86823826c275210299874bb8e26f3] <==
I0923 11:58:54.589731 1 shared_informer.go:320] Caches are synced for resource quota
I0923 11:58:55.056065 1 shared_informer.go:313] Waiting for caches to sync for garbage collector
I0923 11:58:55.056196 1 shared_informer.go:320] Caches are synced for garbage collector
W0923 11:58:55.562791 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0923 11:58:55.562839 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0923 11:58:55.609170 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0923 11:58:55.609227 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0923 11:58:55.655254 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0923 11:58:55.655296 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0923 11:58:57.323218 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0923 11:58:57.323353 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0923 11:58:57.583299 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0923 11:58:57.583348 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0923 11:58:58.639578 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0923 11:58:58.639619 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0923 11:59:02.321243 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0923 11:59:02.321292 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0923 11:59:02.517239 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0923 11:59:02.517285 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0923 11:59:04.361529 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0923 11:59:04.361704 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
I0923 11:59:08.831127 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/registry-66c9cd494c" duration="4.439µs"
I0923 11:59:09.770174 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="local-path-storage/local-path-provisioner-86d989889c" duration="7.754µs"
W0923 11:59:10.700378 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0923 11:59:10.700436 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
==> kube-proxy [feeee7ef089ea49ba13ba3dc06cb204e3d2595c1c0287cf25b1a00b016f93bc4] <==
I0923 11:47:29.758316 1 server_linux.go:66] "Using iptables proxy"
I0923 11:47:30.543856 1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
E0923 11:47:30.543923 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I0923 11:47:30.621898 1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I0923 11:47:30.621958 1 server_linux.go:169] "Using iptables Proxier"
I0923 11:47:30.623684 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I0923 11:47:30.624113 1 server.go:483] "Version info" version="v1.31.1"
I0923 11:47:30.624128 1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0923 11:47:30.630896 1 config.go:199] "Starting service config controller"
I0923 11:47:30.630927 1 shared_informer.go:313] Waiting for caches to sync for service config
I0923 11:47:30.630946 1 config.go:105] "Starting endpoint slice config controller"
I0923 11:47:30.630951 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0923 11:47:30.631298 1 config.go:328] "Starting node config controller"
I0923 11:47:30.631314 1 shared_informer.go:313] Waiting for caches to sync for node config
I0923 11:47:30.732015 1 shared_informer.go:320] Caches are synced for node config
I0923 11:47:30.732063 1 shared_informer.go:320] Caches are synced for service config
I0923 11:47:30.732105 1 shared_informer.go:320] Caches are synced for endpoint slice config
==> kube-scheduler [4425a3b8595675b0095ea3d707c89fd9884337c9f856bc18b89b109fcee52ee9] <==
W0923 11:47:18.193333 1 reflector.go:561] runtime/asm_arm64.s:1222: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0923 11:47:18.194017 1 reflector.go:158] "Unhandled Error" err="runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"
W0923 11:47:18.193471 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0923 11:47:18.194100 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0923 11:47:18.193509 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0923 11:47:18.194184 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0923 11:47:18.193678 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0923 11:47:18.194257 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0923 11:47:18.195096 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0923 11:47:18.195175 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0923 11:47:18.195731 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0923 11:47:18.196000 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0923 11:47:18.195810 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
E0923 11:47:18.196115 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0923 11:47:18.195847 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0923 11:47:18.196211 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError"
W0923 11:47:18.195884 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0923 11:47:18.196314 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0923 11:47:18.198411 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0923 11:47:18.198651 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0923 11:47:18.198574 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0923 11:47:18.198793 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0923 11:47:18.198617 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0923 11:47:18.198897 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
I0923 11:47:19.686582 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Sep 23 11:59:09 addons-949062 kubelet[1483]: I0923 11:59:09.568582 1483 scope.go:117] "RemoveContainer" containerID="3fc5b859779638ca14e87b1170c99350b910bc178becc236697d41f3f096be57"
Sep 23 11:59:09 addons-949062 kubelet[1483]: I0923 11:59:09.629197 1483 scope.go:117] "RemoveContainer" containerID="3fc5b859779638ca14e87b1170c99350b910bc178becc236697d41f3f096be57"
Sep 23 11:59:09 addons-949062 kubelet[1483]: E0923 11:59:09.630129 1483 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fc5b859779638ca14e87b1170c99350b910bc178becc236697d41f3f096be57\": container with ID starting with 3fc5b859779638ca14e87b1170c99350b910bc178becc236697d41f3f096be57 not found: ID does not exist" containerID="3fc5b859779638ca14e87b1170c99350b910bc178becc236697d41f3f096be57"
Sep 23 11:59:09 addons-949062 kubelet[1483]: I0923 11:59:09.630181 1483 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fc5b859779638ca14e87b1170c99350b910bc178becc236697d41f3f096be57"} err="failed to get container status \"3fc5b859779638ca14e87b1170c99350b910bc178becc236697d41f3f096be57\": rpc error: code = NotFound desc = could not find container \"3fc5b859779638ca14e87b1170c99350b910bc178becc236697d41f3f096be57\": container with ID starting with 3fc5b859779638ca14e87b1170c99350b910bc178becc236697d41f3f096be57 not found: ID does not exist"
Sep 23 11:59:09 addons-949062 kubelet[1483]: I0923 11:59:09.868324 1483 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="054e4117-a309-4e89-afe0-a65369055074" path="/var/lib/kubelet/pods/054e4117-a309-4e89-afe0-a65369055074/volumes"
Sep 23 11:59:09 addons-949062 kubelet[1483]: E0923 11:59:09.869333 1483 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"busybox\" with ImagePullBackOff: \"Back-off pulling image \\\"gcr.io/k8s-minikube/busybox:1.28.4-glibc\\\"\"" pod="default/busybox" podUID="bf8113fa-3198-4bf0-ae25-3ee36d7d5474"
Sep 23 11:59:09 addons-949062 kubelet[1483]: I0923 11:59:09.870919 1483 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a8cc18c-0aa9-4763-9714-d4ca4703f4bf" path="/var/lib/kubelet/pods/5a8cc18c-0aa9-4763-9714-d4ca4703f4bf/volumes"
Sep 23 11:59:09 addons-949062 kubelet[1483]: I0923 11:59:09.871314 1483 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="888eb47e-107b-41d0-9fbf-e8434dc27eae" path="/var/lib/kubelet/pods/888eb47e-107b-41d0-9fbf-e8434dc27eae/volumes"
Sep 23 11:59:09 addons-949062 kubelet[1483]: I0923 11:59:09.871816 1483 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e46d96a1-6871-401a-a71d-00cd0539506c" path="/var/lib/kubelet/pods/e46d96a1-6871-401a-a71d-00cd0539506c/volumes"
Sep 23 11:59:10 addons-949062 kubelet[1483]: E0923 11:59:10.213535 1483 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727092750213307506,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:517763,},InodesUsed:&UInt64Value{Value:201,},},},ContainerFilesystems:[]*FilesystemUsage{},}"
Sep 23 11:59:10 addons-949062 kubelet[1483]: E0923 11:59:10.213568 1483 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1727092750213307506,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:517763,},InodesUsed:&UInt64Value{Value:201,},},},ContainerFilesystems:[]*FilesystemUsage{},}"
Sep 23 11:59:10 addons-949062 kubelet[1483]: I0923 11:59:10.729497 1483 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-975bm\" (UniqueName: \"kubernetes.io/projected/56db15e6-8ed1-4858-b9ef-670b8ad7fd9d-kube-api-access-975bm\") pod \"56db15e6-8ed1-4858-b9ef-670b8ad7fd9d\" (UID: \"56db15e6-8ed1-4858-b9ef-670b8ad7fd9d\") "
Sep 23 11:59:10 addons-949062 kubelet[1483]: I0923 11:59:10.729577 1483 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/56db15e6-8ed1-4858-b9ef-670b8ad7fd9d-gcp-creds\") pod \"56db15e6-8ed1-4858-b9ef-670b8ad7fd9d\" (UID: \"56db15e6-8ed1-4858-b9ef-670b8ad7fd9d\") "
Sep 23 11:59:10 addons-949062 kubelet[1483]: I0923 11:59:10.729599 1483 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/host-path/56db15e6-8ed1-4858-b9ef-670b8ad7fd9d-data\") pod \"56db15e6-8ed1-4858-b9ef-670b8ad7fd9d\" (UID: \"56db15e6-8ed1-4858-b9ef-670b8ad7fd9d\") "
Sep 23 11:59:10 addons-949062 kubelet[1483]: I0923 11:59:10.729622 1483 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"script\" (UniqueName: \"kubernetes.io/configmap/56db15e6-8ed1-4858-b9ef-670b8ad7fd9d-script\") pod \"56db15e6-8ed1-4858-b9ef-670b8ad7fd9d\" (UID: \"56db15e6-8ed1-4858-b9ef-670b8ad7fd9d\") "
Sep 23 11:59:10 addons-949062 kubelet[1483]: I0923 11:59:10.730050 1483 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56db15e6-8ed1-4858-b9ef-670b8ad7fd9d-script" (OuterVolumeSpecName: "script") pod "56db15e6-8ed1-4858-b9ef-670b8ad7fd9d" (UID: "56db15e6-8ed1-4858-b9ef-670b8ad7fd9d"). InnerVolumeSpecName "script". PluginName "kubernetes.io/configmap", VolumeGidValue ""
Sep 23 11:59:10 addons-949062 kubelet[1483]: I0923 11:59:10.730365 1483 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/56db15e6-8ed1-4858-b9ef-670b8ad7fd9d-gcp-creds" (OuterVolumeSpecName: "gcp-creds") pod "56db15e6-8ed1-4858-b9ef-670b8ad7fd9d" (UID: "56db15e6-8ed1-4858-b9ef-670b8ad7fd9d"). InnerVolumeSpecName "gcp-creds". PluginName "kubernetes.io/host-path", VolumeGidValue ""
Sep 23 11:59:10 addons-949062 kubelet[1483]: I0923 11:59:10.730408 1483 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/56db15e6-8ed1-4858-b9ef-670b8ad7fd9d-data" (OuterVolumeSpecName: "data") pod "56db15e6-8ed1-4858-b9ef-670b8ad7fd9d" (UID: "56db15e6-8ed1-4858-b9ef-670b8ad7fd9d"). InnerVolumeSpecName "data". PluginName "kubernetes.io/host-path", VolumeGidValue ""
Sep 23 11:59:10 addons-949062 kubelet[1483]: I0923 11:59:10.732498 1483 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56db15e6-8ed1-4858-b9ef-670b8ad7fd9d-kube-api-access-975bm" (OuterVolumeSpecName: "kube-api-access-975bm") pod "56db15e6-8ed1-4858-b9ef-670b8ad7fd9d" (UID: "56db15e6-8ed1-4858-b9ef-670b8ad7fd9d"). InnerVolumeSpecName "kube-api-access-975bm". PluginName "kubernetes.io/projected", VolumeGidValue ""
Sep 23 11:59:10 addons-949062 kubelet[1483]: I0923 11:59:10.830553 1483 reconciler_common.go:288] "Volume detached for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/56db15e6-8ed1-4858-b9ef-670b8ad7fd9d-gcp-creds\") on node \"addons-949062\" DevicePath \"\""
Sep 23 11:59:10 addons-949062 kubelet[1483]: I0923 11:59:10.830588 1483 reconciler_common.go:288] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/host-path/56db15e6-8ed1-4858-b9ef-670b8ad7fd9d-data\") on node \"addons-949062\" DevicePath \"\""
Sep 23 11:59:10 addons-949062 kubelet[1483]: I0923 11:59:10.830599 1483 reconciler_common.go:288] "Volume detached for volume \"script\" (UniqueName: \"kubernetes.io/configmap/56db15e6-8ed1-4858-b9ef-670b8ad7fd9d-script\") on node \"addons-949062\" DevicePath \"\""
Sep 23 11:59:10 addons-949062 kubelet[1483]: I0923 11:59:10.830609 1483 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-975bm\" (UniqueName: \"kubernetes.io/projected/56db15e6-8ed1-4858-b9ef-670b8ad7fd9d-kube-api-access-975bm\") on node \"addons-949062\" DevicePath \"\""
Sep 23 11:59:10 addons-949062 kubelet[1483]: I0923 11:59:10.886973 1483 scope.go:117] "RemoveContainer" containerID="75b6cc5f59b5fe2374cac38ad2838ebf53c37bb5bd81e7efe26913e1800a2639"
Sep 23 11:59:10 addons-949062 kubelet[1483]: E0923 11:59:10.887164 1483 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=gadget pod=gadget-jmdtd_gadget(2ae42920-71b5-4136-b3ca-c2ea5fbe3768)\"" pod="gadget/gadget-jmdtd" podUID="2ae42920-71b5-4136-b3ca-c2ea5fbe3768"
==> storage-provisioner [f22feaa12d01b9b59f02657ec4c931d6aaf39d341ad65db38462e67fafe90a1c] <==
I0923 11:48:08.485067 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0923 11:48:08.500084 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0923 11:48:08.500215 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0923 11:48:08.527237 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0923 11:48:08.532688 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-949062_2b1d4212-8d85-44e0-9a4c-c4d2f8057ce4!
I0923 11:48:08.534249 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"929d7d2f-847b-49ca-ba97-484181e758f5", APIVersion:"v1", ResourceVersion:"890", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-949062_2b1d4212-8d85-44e0-9a4c-c4d2f8057ce4 became leader
I0923 11:48:08.633906 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-949062_2b1d4212-8d85-44e0-9a4c-c4d2f8057ce4!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-949062 -n addons-949062
helpers_test.go:261: (dbg) Run: kubectl --context addons-949062 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: busybox ingress-nginx-admission-create-gbsch ingress-nginx-admission-patch-tr6mp helper-pod-delete-pvc-a360d212-2322-4a7c-8e95-840a1216a052
helpers_test.go:274: ======> post-mortem[TestAddons/parallel/Registry]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-949062 describe pod busybox ingress-nginx-admission-create-gbsch ingress-nginx-admission-patch-tr6mp helper-pod-delete-pvc-a360d212-2322-4a7c-8e95-840a1216a052
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-949062 describe pod busybox ingress-nginx-admission-create-gbsch ingress-nginx-admission-patch-tr6mp helper-pod-delete-pvc-a360d212-2322-4a7c-8e95-840a1216a052: exit status 1 (108.445723ms)
-- stdout --
Name: busybox
Namespace: default
Priority: 0
Service Account: default
Node: addons-949062/192.168.49.2
Start Time: Mon, 23 Sep 2024 11:49:53 +0000
Labels: integration-test=busybox
Annotations: <none>
Status: Pending
IP: 10.244.0.21
IPs:
IP: 10.244.0.21
Containers:
busybox:
Container ID:
Image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
Image ID:
Port: <none>
Host Port: <none>
Command:
sleep
3600
State: Waiting
Reason: ImagePullBackOff
Ready: False
Restart Count: 0
Environment:
GOOGLE_APPLICATION_CREDENTIALS: /google-app-creds.json
PROJECT_ID: this_is_fake
GCP_PROJECT: this_is_fake
GCLOUD_PROJECT: this_is_fake
GOOGLE_CLOUD_PROJECT: this_is_fake
CLOUDSDK_CORE_PROJECT: this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-p8s9n (ro)
Conditions:
Type Status
PodReadyToStartContainers True
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
kube-api-access-p8s9n:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
gcp-creds:
Type: HostPath (bare host directory volume)
Path: /var/lib/minikube/google_application_credentials.json
HostPathType: File
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 9m19s default-scheduler Successfully assigned default/busybox to addons-949062
Normal Pulling 7m57s (x4 over 9m19s) kubelet Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"
Warning Failed 7m56s (x4 over 9m19s) kubelet Failed to pull image "gcr.io/k8s-minikube/busybox:1.28.4-glibc": unable to retrieve auth token: invalid username/password: unauthorized: authentication failed
Warning Failed 7m56s (x4 over 9m19s) kubelet Error: ErrImagePull
Warning Failed 7m29s (x6 over 9m19s) kubelet Error: ImagePullBackOff
Normal BackOff 4m13s (x20 over 9m19s) kubelet Back-off pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"
-- /stdout --
** stderr **
Error from server (NotFound): pods "ingress-nginx-admission-create-gbsch" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-tr6mp" not found
Error from server (NotFound): pods "helper-pod-delete-pvc-a360d212-2322-4a7c-8e95-840a1216a052" not found
** /stderr **
helpers_test.go:279: kubectl --context addons-949062 describe pod busybox ingress-nginx-admission-create-gbsch ingress-nginx-admission-patch-tr6mp helper-pod-delete-pvc-a360d212-2322-4a7c-8e95-840a1216a052: exit status 1
--- FAIL: TestAddons/parallel/Registry (75.40s)