=== RUN TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry
=== CONT TestAddons/parallel/Registry
addons_test.go:332: registry stabilized in 3.54181ms
addons_test.go:334: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-66c9cd494c-bl6xf" [afcec85d-6c6f-4a38-9678-3749bc69d2a3] Running
addons_test.go:334: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.01009265s
addons_test.go:337: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-g4vdc" [4153d723-3ce2-48ca-929d-b85b94b0b7ff] Running
addons_test.go:337: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 6.00473387s
addons_test.go:342: (dbg) Run: kubectl --context addons-521995 delete po -l run=registry-test --now
addons_test.go:347: (dbg) Run: kubectl --context addons-521995 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:347: (dbg) Non-zero exit: kubectl --context addons-521995 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": exit status 1 (1m0.143842582s)
-- stdout --
pod "registry-test" deleted
-- /stdout --
** stderr **
error: timed out waiting for the condition
** /stderr **
addons_test.go:349: failed to hit registry.kube-system.svc.cluster.local. args "kubectl --context addons-521995 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c \"wget --spider -S http://registry.kube-system.svc.cluster.local\"" failed: exit status 1
addons_test.go:353: expected curl response be "HTTP/1.1 200", but got *pod "registry-test" deleted
*
addons_test.go:361: (dbg) Run: out/minikube-linux-amd64 -p addons-521995 ip
2024/09/10 18:01:53 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:390: (dbg) Run: out/minikube-linux-amd64 -p addons-521995 addons disable registry --alsologtostderr -v=1
addons_test.go:390: (dbg) Done: out/minikube-linux-amd64 -p addons-521995 addons disable registry --alsologtostderr -v=1: (1.038086699s)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestAddons/parallel/Registry]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect addons-521995
helpers_test.go:235: (dbg) docker inspect addons-521995:
-- stdout --
[
{
"Id": "d11bceaff426993a2258597a61d073789361e81f0462971b12488679810821fa",
"Created": "2024-09-10T17:48:12.595572638Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 72084,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-09-10T17:48:12.768024993Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:81bbf527fa1222fda707ad6c719d13a0d8bd3ffc934d975c9155a6ffac7840c6",
"ResolvConfPath": "/var/lib/docker/containers/d11bceaff426993a2258597a61d073789361e81f0462971b12488679810821fa/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/d11bceaff426993a2258597a61d073789361e81f0462971b12488679810821fa/hostname",
"HostsPath": "/var/lib/docker/containers/d11bceaff426993a2258597a61d073789361e81f0462971b12488679810821fa/hosts",
"LogPath": "/var/lib/docker/containers/d11bceaff426993a2258597a61d073789361e81f0462971b12488679810821fa/d11bceaff426993a2258597a61d073789361e81f0462971b12488679810821fa-json.log",
"Name": "/addons-521995",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"addons-521995:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "addons-521995",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4194304000,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8388608000,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/80841e19ddf2953eeb538a4c0631e4230d10f3e89c8781147b922191326984bf-init/diff:/var/lib/docker/overlay2/4c9b91e1d44807acbab0b2d0f73db9549ebde06e6c4a58a1199e1583e7e3e909/diff",
"MergedDir": "/var/lib/docker/overlay2/80841e19ddf2953eeb538a4c0631e4230d10f3e89c8781147b922191326984bf/merged",
"UpperDir": "/var/lib/docker/overlay2/80841e19ddf2953eeb538a4c0631e4230d10f3e89c8781147b922191326984bf/diff",
"WorkDir": "/var/lib/docker/overlay2/80841e19ddf2953eeb538a4c0631e4230d10f3e89c8781147b922191326984bf/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "addons-521995",
"Source": "/var/lib/docker/volumes/addons-521995/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "addons-521995",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-521995",
"name.minikube.sigs.k8s.io": "addons-521995",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "b1cf89d4f8ab4ae8c7c8ce60d311b5009fa9124eb5583c1ff07ecf60e9048bda",
"SandboxKey": "/var/run/docker/netns/b1cf89d4f8ab",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32788"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32789"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32792"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32790"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32791"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"addons-521995": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:31:02",
"DriverOpts": null,
"NetworkID": "a40c2fc8d03f4504f360e85bbad76875404baafd667c91daf86ede0d204af5cc",
"EndpointID": "d357c37fec83a6c357a3c98ac3225e3c7c67b15b67f7f1e729d39b9bae632fc4",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-521995",
"d11bceaff426"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p addons-521995 -n addons-521995
helpers_test.go:244: <<< TestAddons/parallel/Registry FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/parallel/Registry]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p addons-521995 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p addons-521995 logs -n 25: (1.685453152s)
helpers_test.go:252: TestAddons/parallel/Registry logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------|---------------|-----------------------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------|---------------|-----------------------|---------|---------------------|---------------------|
| addons | enable dashboard -p | addons-521995 | g528047478195_compute | v1.34.0 | 10 Sep 24 17:47 UTC | |
| | addons-521995 | | | | | |
| addons | disable dashboard -p | addons-521995 | g528047478195_compute | v1.34.0 | 10 Sep 24 17:47 UTC | |
| | addons-521995 | | | | | |
| start | -p addons-521995 --wait=true | addons-521995 | g528047478195_compute | v1.34.0 | 10 Sep 24 17:47 UTC | 10 Sep 24 17:51 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
| | --addons=helm-tiller | | | | | |
| addons | addons-521995 addons disable | addons-521995 | g528047478195_compute | v1.34.0 | 10 Sep 24 17:52 UTC | 10 Sep 24 17:52 UTC |
| | volcano --alsologtostderr -v=1 | | | | | |
| addons | addons-521995 addons | addons-521995 | g528047478195_compute | v1.34.0 | 10 Sep 24 18:01 UTC | 10 Sep 24 18:01 UTC |
| | disable csi-hostpath-driver | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | addons-521995 addons | addons-521995 | g528047478195_compute | v1.34.0 | 10 Sep 24 18:01 UTC | 10 Sep 24 18:01 UTC |
| | disable volumesnapshots | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | addons-521995 addons disable | addons-521995 | g528047478195_compute | v1.34.0 | 10 Sep 24 18:01 UTC | 10 Sep 24 18:01 UTC |
| | helm-tiller --alsologtostderr | | | | | |
| | -v=1 | | | | | |
| addons | addons-521995 addons | addons-521995 | g528047478195_compute | v1.34.0 | 10 Sep 24 18:01 UTC | 10 Sep 24 18:01 UTC |
| | disable metrics-server | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| ip | addons-521995 ip | addons-521995 | g528047478195_compute | v1.34.0 | 10 Sep 24 18:01 UTC | 10 Sep 24 18:01 UTC |
| addons | addons-521995 addons disable | addons-521995 | g528047478195_compute | v1.34.0 | 10 Sep 24 18:01 UTC | 10 Sep 24 18:01 UTC |
| | registry --alsologtostderr | | | | | |
| | -v=1 | | | | | |
|---------|--------------------------------------|---------------|-----------------------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/09/10 17:47:22
Running on machine: cs-905301410258-default
Binary: Built with gc go1.22.5 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0910 17:47:22.338769 71609 out.go:345] Setting OutFile to fd 1 ...
I0910 17:47:22.338991 71609 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0910 17:47:22.339008 71609 out.go:358] Setting ErrFile to fd 2...
I0910 17:47:22.339017 71609 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0910 17:47:22.339470 71609 root.go:338] Updating PATH: /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/bin
W0910 17:47:22.339881 71609 root.go:314] Error reading config file at /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/config/config.json: open /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/config/config.json: no such file or directory
I0910 17:47:22.340480 71609 out.go:352] Setting JSON to false
I0910 17:47:22.341497 71609 start.go:129] hostinfo: {"hostname":"cs-905301410258-default","uptime":3416,"bootTime":1725987026,"procs":20,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.1.100+","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"guest","hostId":"88b15d6b-fddc-40bb-b1ad-a90cb2566e38"}
I0910 17:47:22.341583 71609 start.go:139] virtualization: guest
I0910 17:47:22.345573 71609 out.go:177] * [addons-521995] minikube v1.34.0 on Ubuntu 22.04 (amd64)
W0910 17:47:22.349567 71609 preload.go:293] Failed to list preload files: open /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/cache/preloaded-tarball: no such file or directory
I0910 17:47:22.349608 71609 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0910 17:47:22.349658 71609 notify.go:220] Checking for updates...
I0910 17:47:22.356633 71609 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0910 17:47:22.360643 71609 out.go:177] - KUBECONFIG=/home/g528047478195_compute/minikube-integration/19598-61662/kubeconfig
I0910 17:47:22.364023 71609 out.go:177] - MINIKUBE_HOME=/home/g528047478195_compute/minikube-integration/19598-61662/.minikube
I0910 17:47:22.367209 71609 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0910 17:47:22.370763 71609 out.go:177] - MINIKUBE_WANTUPDATENOTIFICATION=false
I0910 17:47:22.374647 71609 driver.go:394] Setting default libvirt URI to qemu:///system
I0910 17:47:22.425033 71609 docker.go:123] docker version: linux-27.1.2:Docker Engine - Community
I0910 17:47:22.425224 71609 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0910 17:47:22.535218 71609 info.go:266] docker info: {ID:18f0b981-8f81-43aa-9a7f-6076618b15dd Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:false NGoroutines:47 SystemTime:2024-09-10 17:47:22.517100051 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.1.100+ OperatingSystem:Ubuntu 22.04.4 LTS (containerized) OSType:linux Architecture:x86_64 IndexSer
verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[https://us-mirror.gcr.io/] Secure:true Official:true}} Mirrors:[https://us-mirror.gcr.io/]} NCPU:2 MemTotal:8337174528 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:cs-905301410258-default Labels:[] ExperimentalBuild:false ServerVersion:27.1.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8fc6bcff51318944179630522a095cc9dbf9f353 Expected:8fc6bcff51318944179630522a095cc9dbf9f353} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builti
n name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0910 17:47:22.535483 71609 docker.go:318] overlay module found
I0910 17:47:22.539749 71609 out.go:177] * Using the docker driver based on user configuration
I0910 17:47:22.542790 71609 start.go:297] selected driver: docker
I0910 17:47:22.542826 71609 start.go:901] validating driver "docker" against <nil>
I0910 17:47:22.542852 71609 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0910 17:47:22.543536 71609 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0910 17:47:22.635949 71609 info.go:266] docker info: {ID:18f0b981-8f81-43aa-9a7f-6076618b15dd Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:false NGoroutines:47 SystemTime:2024-09-10 17:47:22.619441465 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.1.100+ OperatingSystem:Ubuntu 22.04.4 LTS (containerized) OSType:linux Architecture:x86_64 IndexSer
verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[https://us-mirror.gcr.io/] Secure:true Official:true}} Mirrors:[https://us-mirror.gcr.io/]} NCPU:2 MemTotal:8337174528 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:cs-905301410258-default Labels:[] ExperimentalBuild:false ServerVersion:27.1.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8fc6bcff51318944179630522a095cc9dbf9f353 Expected:8fc6bcff51318944179630522a095cc9dbf9f353} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builti
n name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0910 17:47:22.636235 71609 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0910 17:47:22.636637 71609 start_flags.go:421] setting extra-config: kubelet.cgroups-per-qos=false
I0910 17:47:22.636655 71609 start_flags.go:421] setting extra-config: kubelet.enforce-node-allocatable=""
I0910 17:47:22.636711 71609 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0910 17:47:22.640547 71609 out.go:177] * Using Docker driver with root privileges
I0910 17:47:22.643615 71609 cni.go:84] Creating CNI manager for ""
I0910 17:47:22.643689 71609 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0910 17:47:22.643713 71609 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0910 17:47:22.643883 71609 start.go:340] cluster config:
{Name:addons-521995 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-521995 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cgroups-per-qos Value:false} {Component:kubelet Key:enforce-node-allocatable Value:""}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/g528047478195_compute:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOpti
mizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0910 17:47:22.647054 71609 out.go:177] * Starting "addons-521995" primary control-plane node in "addons-521995" cluster
I0910 17:47:22.650232 71609 cache.go:121] Beginning downloading kic base image for docker with docker
I0910 17:47:22.653557 71609 out.go:177] * Pulling base image v0.0.45-1725963390-19606 ...
I0910 17:47:22.657114 71609 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
I0910 17:47:22.657221 71609 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 in local docker daemon
I0910 17:47:22.683440 71609 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 to local cache
I0910 17:47:22.683861 71609 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 in local cache directory
I0910 17:47:22.684011 71609 image.go:148] Writing gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 to local cache
I0910 17:47:22.688894 71609 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.31.0/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-amd64.tar.lz4
I0910 17:47:22.688925 71609 cache.go:56] Caching tarball of preloaded images
I0910 17:47:22.689342 71609 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
I0910 17:47:22.692760 71609 out.go:177] * Downloading Kubernetes v1.31.0 preload ...
I0910 17:47:22.695574 71609 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.31.0-docker-overlay2-amd64.tar.lz4 ...
I0910 17:47:22.731690 71609 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.31.0/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-amd64.tar.lz4?checksum=md5:2dd98f97b896d7a4f012ee403b477cc8 -> /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-amd64.tar.lz4
I0910 17:47:26.064351 71609 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.31.0-docker-overlay2-amd64.tar.lz4 ...
I0910 17:47:26.064596 71609 preload.go:254] verifying checksum of /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-amd64.tar.lz4 ...
I0910 17:47:27.127574 71609 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
I0910 17:47:27.128054 71609 profile.go:143] Saving config to /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/config.json ...
I0910 17:47:27.128107 71609 lock.go:35] WriteFile acquiring /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/config.json: {Name:mkbcfbebacc7936f473ef39c6cb66b79e9109da9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 17:47:34.295680 71609 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 as a tarball
I0910 17:47:34.295740 71609 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 from local cache
I0910 17:47:59.833993 71609 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 from cached tarball
I0910 17:47:59.834064 71609 cache.go:194] Successfully downloaded all kic artifacts
I0910 17:47:59.834130 71609 start.go:360] acquireMachinesLock for addons-521995: {Name:mkb98d97d9677be5214c8943d310202e95212ea7 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0910 17:47:59.834476 71609 start.go:364] duration metric: took 312.738µs to acquireMachinesLock for "addons-521995"
I0910 17:47:59.834528 71609 start.go:93] Provisioning new machine with config: &{Name:addons-521995 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-521995 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cgroups-per-qos Value:false} {Component:kubelet Key:enforce-node-allocatable Value:""}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/g528047478195_compute:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144
MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0910 17:47:59.834692 71609 start.go:125] createHost starting for "" (driver="docker")
I0910 17:47:59.838594 71609 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
I0910 17:47:59.839038 71609 start.go:159] libmachine.API.Create for "addons-521995" (driver="docker")
I0910 17:47:59.839095 71609 client.go:168] LocalClient.Create starting
I0910 17:47:59.839242 71609 main.go:141] libmachine: Creating CA: /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/certs/ca.pem
I0910 17:47:59.999967 71609 main.go:141] libmachine: Creating client certificate: /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/certs/cert.pem
I0910 17:48:00.352966 71609 cli_runner.go:164] Run: docker network inspect addons-521995 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0910 17:48:00.378335 71609 cli_runner.go:211] docker network inspect addons-521995 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0910 17:48:00.378500 71609 network_create.go:284] running [docker network inspect addons-521995] to gather additional debugging logs...
I0910 17:48:00.378536 71609 cli_runner.go:164] Run: docker network inspect addons-521995
W0910 17:48:00.404984 71609 cli_runner.go:211] docker network inspect addons-521995 returned with exit code 1
I0910 17:48:00.405026 71609 network_create.go:287] error running [docker network inspect addons-521995]: docker network inspect addons-521995: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-521995 not found
I0910 17:48:00.405067 71609 network_create.go:289] output of [docker network inspect addons-521995]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-521995 not found
** /stderr **
I0910 17:48:00.405234 71609 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0910 17:48:00.433607 71609 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00180ea40}
I0910 17:48:00.433660 71609 network_create.go:124] attempt to create docker network addons-521995 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1460 ...
I0910 17:48:00.433792 71609 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1460 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-521995 addons-521995
I0910 17:48:00.537633 71609 network_create.go:108] docker network addons-521995 192.168.49.0/24 created
I0910 17:48:00.537694 71609 kic.go:121] calculated static IP "192.168.49.2" for the "addons-521995" container
I0910 17:48:00.537881 71609 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0910 17:48:00.563586 71609 cli_runner.go:164] Run: docker volume create addons-521995 --label name.minikube.sigs.k8s.io=addons-521995 --label created_by.minikube.sigs.k8s.io=true
I0910 17:48:00.591195 71609 oci.go:103] Successfully created a docker volume addons-521995
I0910 17:48:00.591345 71609 cli_runner.go:164] Run: docker run --rm --name addons-521995-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-521995 --entrypoint /usr/bin/test -v addons-521995:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 -d /var/lib
I0910 17:48:04.666635 71609 cli_runner.go:217] Completed: docker run --rm --name addons-521995-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-521995 --entrypoint /usr/bin/test -v addons-521995:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 -d /var/lib: (4.075233351s)
I0910 17:48:04.666673 71609 oci.go:107] Successfully prepared a docker volume addons-521995
I0910 17:48:04.666716 71609 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
I0910 17:48:04.666751 71609 kic.go:194] Starting extracting preloaded images to volume ...
I0910 17:48:04.666874 71609 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v addons-521995:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 -I lz4 -xf /preloaded.tar -C /extractDir
I0910 17:48:12.475305 71609 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v addons-521995:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 -I lz4 -xf /preloaded.tar -C /extractDir: (7.808353229s)
I0910 17:48:12.475351 71609 kic.go:203] duration metric: took 7.808601635s to extract preloaded images to volume ...
W0910 17:48:12.475492 71609 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
W0910 17:48:12.475555 71609 oci.go:243] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
I0910 17:48:12.475651 71609 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0910 17:48:12.569903 71609 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-521995 --name addons-521995 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-521995 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-521995 --network addons-521995 --ip 192.168.49.2 --volume addons-521995:/var --security-opt apparmor=unconfined --memory=4000mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9
I0910 17:48:12.961078 71609 cli_runner.go:164] Run: docker container inspect addons-521995 --format={{.State.Running}}
I0910 17:48:13.003753 71609 cli_runner.go:164] Run: docker container inspect addons-521995 --format={{.State.Status}}
I0910 17:48:13.046531 71609 cli_runner.go:164] Run: docker exec addons-521995 stat /var/lib/dpkg/alternatives/iptables
I0910 17:48:13.155074 71609 oci.go:144] the created container "addons-521995" has a running status.
I0910 17:48:13.155114 71609 kic.go:225] Creating ssh key for kic: /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/addons-521995/id_rsa...
I0910 17:48:13.633937 71609 kic_runner.go:191] docker (temp): /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/addons-521995/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0910 17:48:13.715784 71609 cli_runner.go:164] Run: docker container inspect addons-521995 --format={{.State.Status}}
I0910 17:48:13.782056 71609 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0910 17:48:13.782085 71609 kic_runner.go:114] Args: [docker exec --privileged addons-521995 chown docker:docker /home/docker/.ssh/authorized_keys]
I0910 17:48:13.957438 71609 cli_runner.go:164] Run: docker container inspect addons-521995 --format={{.State.Status}}
I0910 17:48:14.012898 71609 machine.go:93] provisionDockerMachine start ...
I0910 17:48:14.013107 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:14.079350 71609 main.go:141] libmachine: Using SSH client type: native
I0910 17:48:14.079740 71609 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8375c0] 0x83a320 <nil> [] 0s} 127.0.0.1 32788 <nil> <nil>}
I0910 17:48:14.079759 71609 main.go:141] libmachine: About to run SSH command:
hostname
I0910 17:48:14.258972 71609 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-521995
I0910 17:48:14.259114 71609 ubuntu.go:169] provisioning hostname "addons-521995"
I0910 17:48:14.259355 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:14.317943 71609 main.go:141] libmachine: Using SSH client type: native
I0910 17:48:14.318471 71609 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8375c0] 0x83a320 <nil> [] 0s} 127.0.0.1 32788 <nil> <nil>}
I0910 17:48:14.318520 71609 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-521995 && echo "addons-521995" | sudo tee /etc/hostname
I0910 17:48:14.524273 71609 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-521995
I0910 17:48:14.524517 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:14.564156 71609 main.go:141] libmachine: Using SSH client type: native
I0910 17:48:14.564578 71609 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8375c0] 0x83a320 <nil> [] 0s} 127.0.0.1 32788 <nil> <nil>}
I0910 17:48:14.564625 71609 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-521995' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-521995/g' /etc/hosts;
else
echo '127.0.1.1 addons-521995' | sudo tee -a /etc/hosts;
fi
fi
I0910 17:48:14.729888 71609 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0910 17:48:14.729927 71609 ubuntu.go:175] set auth options {CertDir:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube CaCertPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/certs/ca.pem CaPrivateKeyPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/server.pem ServerKeyPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/server-key.pem ClientKeyPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube}
I0910 17:48:14.729978 71609 ubuntu.go:177] setting up certificates
I0910 17:48:14.729995 71609 provision.go:84] configureAuth start
I0910 17:48:14.730130 71609 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-521995
I0910 17:48:14.757745 71609 provision.go:143] copyHostCerts
I0910 17:48:14.757873 71609 exec_runner.go:151] cp: /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/certs/key.pem --> /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/key.pem (1675 bytes)
I0910 17:48:14.758122 71609 exec_runner.go:151] cp: /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/certs/ca.pem --> /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/ca.pem (1119 bytes)
I0910 17:48:14.758306 71609 exec_runner.go:151] cp: /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/certs/cert.pem --> /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/cert.pem (1164 bytes)
I0910 17:48:14.758430 71609 provision.go:117] generating server cert: /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/server.pem ca-key=/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/certs/ca.pem private-key=/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/certs/ca-key.pem org=g528047478195_compute.addons-521995 san=[127.0.0.1 192.168.49.2 addons-521995 localhost minikube]
I0910 17:48:14.965592 71609 provision.go:177] copyRemoteCerts
I0910 17:48:14.965789 71609 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0910 17:48:14.965881 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:14.993578 71609 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/addons-521995/id_rsa Username:docker}
I0910 17:48:15.098386 71609 ssh_runner.go:362] scp /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1119 bytes)
I0910 17:48:15.140616 71609 ssh_runner.go:362] scp /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/server.pem --> /etc/docker/server.pem (1249 bytes)
I0910 17:48:15.182051 71609 ssh_runner.go:362] scp /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0910 17:48:15.223412 71609 provision.go:87] duration metric: took 493.396798ms to configureAuth
I0910 17:48:15.223454 71609 ubuntu.go:193] setting minikube options for container-runtime
I0910 17:48:15.223778 71609 config.go:182] Loaded profile config "addons-521995": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.31.0
I0910 17:48:15.223900 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:15.250636 71609 main.go:141] libmachine: Using SSH client type: native
I0910 17:48:15.251004 71609 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8375c0] 0x83a320 <nil> [] 0s} 127.0.0.1 32788 <nil> <nil>}
I0910 17:48:15.251033 71609 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0910 17:48:15.396736 71609 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0910 17:48:15.396769 71609 ubuntu.go:71] root file system type: overlay
I0910 17:48:15.396956 71609 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
I0910 17:48:15.397091 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:15.425222 71609 main.go:141] libmachine: Using SSH client type: native
I0910 17:48:15.425567 71609 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8375c0] 0x83a320 <nil> [] 0s} 127.0.0.1 32788 <nil> <nil>}
I0910 17:48:15.425696 71609 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0910 17:48:15.591428 71609 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0910 17:48:15.591586 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:15.620426 71609 main.go:141] libmachine: Using SSH client type: native
I0910 17:48:15.620716 71609 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8375c0] 0x83a320 <nil> [] 0s} 127.0.0.1 32788 <nil> <nil>}
I0910 17:48:15.620758 71609 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0910 17:48:16.775694 71609 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2024-09-06 12:06:41.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2024-09-10 17:48:15.587362156 +0000
@@ -1,46 +1,49 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service time-set.target
-Wants=network-online.target containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
+Wants=network-online.target
Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutStartSec=0
-RestartSec=2
-Restart=always
+Restart=on-failure
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
+LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0910 17:48:16.775830 71609 machine.go:96] duration metric: took 2.762902269s to provisionDockerMachine
I0910 17:48:16.775903 71609 client.go:171] duration metric: took 16.936793355s to LocalClient.Create
I0910 17:48:16.776013 71609 start.go:167] duration metric: took 16.936930878s to libmachine.API.Create "addons-521995"
I0910 17:48:16.776055 71609 start.go:293] postStartSetup for "addons-521995" (driver="docker")
I0910 17:48:16.776108 71609 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0910 17:48:16.776329 71609 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0910 17:48:16.776496 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:16.807595 71609 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/addons-521995/id_rsa Username:docker}
I0910 17:48:16.913216 71609 ssh_runner.go:195] Run: cat /etc/os-release
I0910 17:48:16.918960 71609 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0910 17:48:16.919009 71609 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0910 17:48:16.919030 71609 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0910 17:48:16.919043 71609 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0910 17:48:16.919061 71609 filesync.go:126] Scanning /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/addons for local assets ...
I0910 17:48:16.919173 71609 filesync.go:126] Scanning /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/files for local assets ...
I0910 17:48:16.919227 71609 start.go:296] duration metric: took 143.126523ms for postStartSetup
I0910 17:48:16.919780 71609 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-521995
I0910 17:48:16.947848 71609 profile.go:143] Saving config to /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/config.json ...
I0910 17:48:16.948367 71609 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0910 17:48:16.948461 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:16.976070 71609 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/addons-521995/id_rsa Username:docker}
I0910 17:48:17.074526 71609 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0910 17:48:17.082301 71609 start.go:128] duration metric: took 17.247580003s to createHost
I0910 17:48:17.082351 71609 start.go:83] releasing machines lock for "addons-521995", held for 17.247839515s
I0910 17:48:17.082494 71609 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-521995
I0910 17:48:17.117821 71609 ssh_runner.go:195] Run: cat /version.json
I0910 17:48:17.117911 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:17.118375 71609 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0910 17:48:17.118522 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:17.156302 71609 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/addons-521995/id_rsa Username:docker}
I0910 17:48:17.163326 71609 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/addons-521995/id_rsa Username:docker}
I0910 17:48:17.362174 71609 ssh_runner.go:195] Run: systemctl --version
I0910 17:48:17.369948 71609 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0910 17:48:17.377862 71609 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0910 17:48:17.429553 71609 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0910 17:48:17.429680 71609 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0910 17:48:17.483026 71609 cni.go:262] disabled [/etc/cni/net.d/100-crio-bridge.conf, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0910 17:48:17.483062 71609 start.go:495] detecting cgroup driver to use...
I0910 17:48:17.483108 71609 detect.go:190] detected "systemd" cgroup driver on host os
I0910 17:48:17.483305 71609 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0910 17:48:17.511434 71609 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0910 17:48:17.528165 71609 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0910 17:48:17.545138 71609 containerd.go:146] configuring containerd to use "systemd" as cgroup driver...
I0910 17:48:17.545312 71609 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = true|g' /etc/containerd/config.toml"
I0910 17:48:17.562476 71609 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0910 17:48:17.579432 71609 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0910 17:48:17.596196 71609 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0910 17:48:17.613177 71609 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0910 17:48:17.629177 71609 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0910 17:48:17.645859 71609 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0910 17:48:17.662549 71609 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0910 17:48:17.679175 71609 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0910 17:48:17.694517 71609 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0910 17:48:17.709117 71609 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0910 17:48:17.843142 71609 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0910 17:48:17.969138 71609 start.go:495] detecting cgroup driver to use...
I0910 17:48:17.969196 71609 detect.go:190] detected "systemd" cgroup driver on host os
I0910 17:48:17.969306 71609 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0910 17:48:18.009580 71609 cruntime.go:279] skipping containerd shutdown because we are bound to it
I0910 17:48:18.009696 71609 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0910 17:48:18.037445 71609 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I0910 17:48:18.080083 71609 ssh_runner.go:195] Run: which cri-dockerd
I0910 17:48:18.088089 71609 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0910 17:48:18.112508 71609 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (190 bytes)
I0910 17:48:18.155314 71609 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0910 17:48:18.383625 71609 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0910 17:48:18.618754 71609 docker.go:574] configuring docker to use "systemd" as cgroup driver...
I0910 17:48:18.618924 71609 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (129 bytes)
I0910 17:48:18.648980 71609 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0910 17:48:18.850032 71609 ssh_runner.go:195] Run: sudo systemctl restart docker
I0910 17:48:19.361138 71609 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket
I0910 17:48:19.381418 71609 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I0910 17:48:19.401183 71609 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
I0910 17:48:19.546358 71609 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I0910 17:48:19.685534 71609 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0910 17:48:19.821543 71609 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
I0910 17:48:19.852638 71609 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I0910 17:48:19.871659 71609 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0910 17:48:20.009863 71609 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service
I0910 17:48:20.127105 71609 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock
I0910 17:48:20.127243 71609 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
I0910 17:48:20.135752 71609 start.go:563] Will wait 60s for crictl version
I0910 17:48:20.135899 71609 ssh_runner.go:195] Run: which crictl
I0910 17:48:20.144645 71609 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0910 17:48:20.198748 71609 start.go:579] Version: 0.1.0
RuntimeName: docker
RuntimeVersion: 27.2.1
RuntimeApiVersion: v1
I0910 17:48:20.198892 71609 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0910 17:48:20.241165 71609 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0910 17:48:20.290593 71609 out.go:235] * Preparing Kubernetes v1.31.0 on Docker 27.2.1 ...
I0910 17:48:20.290774 71609 cli_runner.go:164] Run: docker network inspect addons-521995 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0910 17:48:20.317533 71609 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I0910 17:48:20.323808 71609 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0910 17:48:20.346529 71609 out.go:177] - kubelet.cgroups-per-qos=false
I0910 17:48:20.349686 71609 out.go:177] - kubelet.enforce-node-allocatable=""
I0910 17:48:20.353777 71609 kubeadm.go:883] updating cluster {Name:addons-521995 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-521995 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cgroups-per-qos Value:false} {Component:kubelet Key:enforce-node-allocatable Value:""}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/g528047478195_compute:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOp
tions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0910 17:48:20.353995 71609 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
I0910 17:48:20.354151 71609 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0910 17:48:20.390364 71609 docker.go:685] Got preloaded images: -- stdout --
registry.k8s.io/kube-controller-manager:v1.31.0
registry.k8s.io/kube-scheduler:v1.31.0
registry.k8s.io/kube-apiserver:v1.31.0
registry.k8s.io/kube-proxy:v1.31.0
registry.k8s.io/etcd:3.5.15-0
registry.k8s.io/pause:3.10
registry.k8s.io/coredns/coredns:v1.11.1
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I0910 17:48:20.390467 71609 docker.go:615] Images already preloaded, skipping extraction
I0910 17:48:20.390674 71609 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0910 17:48:20.421013 71609 docker.go:685] Got preloaded images: -- stdout --
registry.k8s.io/kube-controller-manager:v1.31.0
registry.k8s.io/kube-scheduler:v1.31.0
registry.k8s.io/kube-apiserver:v1.31.0
registry.k8s.io/kube-proxy:v1.31.0
registry.k8s.io/etcd:3.5.15-0
registry.k8s.io/pause:3.10
registry.k8s.io/coredns/coredns:v1.11.1
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I0910 17:48:20.421045 71609 cache_images.go:84] Images are preloaded, skipping loading
I0910 17:48:20.421066 71609 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.0 docker true true} ...
I0910 17:48:20.421263 71609 kubeadm.go:946] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable="" --hostname-override=addons-521995 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.31.0 ClusterName:addons-521995 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cgroups-per-qos Value:false} {Component:kubelet Key:enforce-node-allocatable Value:""}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0910 17:48:20.421412 71609 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0910 17:48:20.497723 71609 cni.go:84] Creating CNI manager for ""
I0910 17:48:20.497774 71609 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0910 17:48:20.497818 71609 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0910 17:48:20.497869 71609 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-521995 NodeName:addons-521995 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubern
etes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0910 17:48:20.498145 71609 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/cri-dockerd.sock
name: "addons-521995"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0910 17:48:20.498286 71609 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.0
I0910 17:48:20.513799 71609 binaries.go:44] Found k8s binaries, skipping transfer
I0910 17:48:20.513930 71609 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0910 17:48:20.528510 71609 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (366 bytes)
I0910 17:48:20.558706 71609 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0910 17:48:20.589101 71609 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2154 bytes)
I0910 17:48:20.619787 71609 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0910 17:48:20.625584 71609 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0910 17:48:20.644148 71609 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0910 17:48:20.784755 71609 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0910 17:48:20.814488 71609 certs.go:68] Setting up /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995 for IP: 192.168.49.2
I0910 17:48:20.814525 71609 certs.go:194] generating shared ca certs ...
I0910 17:48:20.814551 71609 certs.go:226] acquiring lock for ca certs: {Name:mk6849ef843cab28f64c966c12af24cda6eb3b00 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 17:48:20.814897 71609 certs.go:240] generating "minikubeCA" ca cert: /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/ca.key
I0910 17:48:20.998221 71609 crypto.go:156] Writing cert to /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/ca.crt ...
I0910 17:48:20.998272 71609 lock.go:35] WriteFile acquiring /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/ca.crt: {Name:mk48c83261f0b6f613cdcc7d2d8ed9a9fd818397 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 17:48:20.998692 71609 crypto.go:164] Writing key to /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/ca.key ...
I0910 17:48:20.998733 71609 lock.go:35] WriteFile acquiring /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/ca.key: {Name:mk3f7fb9745820c3cfd4cbc4012a5dc962d5ad80 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 17:48:20.999077 71609 certs.go:240] generating "proxyClientCA" ca cert: /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/proxy-client-ca.key
I0910 17:48:21.128100 71609 crypto.go:156] Writing cert to /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/proxy-client-ca.crt ...
I0910 17:48:21.128140 71609 lock.go:35] WriteFile acquiring /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/proxy-client-ca.crt: {Name:mk6439dac513e2967882795db25aa6f61cbd2d5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 17:48:21.128592 71609 crypto.go:164] Writing key to /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/proxy-client-ca.key ...
I0910 17:48:21.128617 71609 lock.go:35] WriteFile acquiring /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/proxy-client-ca.key: {Name:mk6a7d72b144d202b00959e263ff762086766209 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 17:48:21.128953 71609 certs.go:256] generating profile certs ...
I0910 17:48:21.129070 71609 certs.go:363] generating signed profile cert for "minikube-user": /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/client.key
I0910 17:48:21.129116 71609 crypto.go:68] Generating cert /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/client.crt with IP's: []
I0910 17:48:21.230616 71609 crypto.go:156] Writing cert to /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/client.crt ...
I0910 17:48:21.230656 71609 lock.go:35] WriteFile acquiring /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/client.crt: {Name:mkee3dc1a27aa54b76dd6d7ccd0eb8fbe09d1bc9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 17:48:21.231106 71609 crypto.go:164] Writing key to /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/client.key ...
I0910 17:48:21.231134 71609 lock.go:35] WriteFile acquiring /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/client.key: {Name:mkc58324cad51313e7e3bda7c5d6a10d2bbae41c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 17:48:21.231462 71609 certs.go:363] generating signed profile cert for "minikube": /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/apiserver.key.4e06cfca
I0910 17:48:21.231501 71609 crypto.go:68] Generating cert /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/apiserver.crt.4e06cfca with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I0910 17:48:21.467845 71609 crypto.go:156] Writing cert to /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/apiserver.crt.4e06cfca ...
I0910 17:48:21.467895 71609 lock.go:35] WriteFile acquiring /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/apiserver.crt.4e06cfca: {Name:mk6ba2be54c8321970769857273473d41fc149af Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 17:48:21.468432 71609 crypto.go:164] Writing key to /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/apiserver.key.4e06cfca ...
I0910 17:48:21.468465 71609 lock.go:35] WriteFile acquiring /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/apiserver.key.4e06cfca: {Name:mk7ec652f03e02e891bd9e5b0f1762630065fabe Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 17:48:21.468815 71609 certs.go:381] copying /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/apiserver.crt.4e06cfca -> /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/apiserver.crt
I0910 17:48:21.468987 71609 certs.go:385] copying /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/apiserver.key.4e06cfca -> /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/apiserver.key
I0910 17:48:21.469101 71609 certs.go:363] generating signed profile cert for "aggregator": /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/proxy-client.key
I0910 17:48:21.469155 71609 crypto.go:68] Generating cert /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/proxy-client.crt with IP's: []
I0910 17:48:21.630967 71609 crypto.go:156] Writing cert to /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/proxy-client.crt ...
I0910 17:48:21.631006 71609 lock.go:35] WriteFile acquiring /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/proxy-client.crt: {Name:mkf7a8a16bf3d47c795255ff9ba9feebb29ecdba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 17:48:21.631500 71609 crypto.go:164] Writing key to /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/proxy-client.key ...
I0910 17:48:21.631527 71609 lock.go:35] WriteFile acquiring /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/proxy-client.key: {Name:mk965002524b60bc9249849b6338593e23ef8933 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 17:48:21.632032 71609 certs.go:484] found cert: /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/certs/ca-key.pem (1675 bytes)
I0910 17:48:21.632104 71609 certs.go:484] found cert: /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/certs/ca.pem (1119 bytes)
I0910 17:48:21.632159 71609 certs.go:484] found cert: /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/certs/cert.pem (1164 bytes)
I0910 17:48:21.632224 71609 certs.go:484] found cert: /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/certs/key.pem (1675 bytes)
I0910 17:48:21.633085 71609 ssh_runner.go:362] scp /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0910 17:48:21.672702 71609 ssh_runner.go:362] scp /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0910 17:48:21.732225 71609 ssh_runner.go:362] scp /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0910 17:48:21.791689 71609 ssh_runner.go:362] scp /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0910 17:48:21.835352 71609 ssh_runner.go:362] scp /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0910 17:48:21.875761 71609 ssh_runner.go:362] scp /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0910 17:48:21.916648 71609 ssh_runner.go:362] scp /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0910 17:48:21.957476 71609 ssh_runner.go:362] scp /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/profiles/addons-521995/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0910 17:48:21.999092 71609 ssh_runner.go:362] scp /home/g528047478195_compute/minikube-integration/19598-61662/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0910 17:48:22.040004 71609 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0910 17:48:22.070039 71609 ssh_runner.go:195] Run: openssl version
I0910 17:48:22.078963 71609 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0910 17:48:22.095656 71609 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0910 17:48:22.101988 71609 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 10 17:48 /usr/share/ca-certificates/minikubeCA.pem
I0910 17:48:22.102148 71609 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0910 17:48:22.112889 71609 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0910 17:48:22.131767 71609 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0910 17:48:22.137636 71609 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0910 17:48:22.137727 71609 kubeadm.go:392] StartCluster: {Name:addons-521995 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-521995 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cgroups-per-qos Value:false} {Component:kubelet Key:enforce-node-allocatable Value:""}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/g528047478195_compute:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptio
ns:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0910 17:48:22.137957 71609 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0910 17:48:22.166380 71609 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0910 17:48:22.182458 71609 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0910 17:48:22.198287 71609 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0910 17:48:22.198495 71609 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0910 17:48:22.214298 71609 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0910 17:48:22.214329 71609 kubeadm.go:157] found existing configuration files:
I0910 17:48:22.214521 71609 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0910 17:48:22.230304 71609 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0910 17:48:22.230472 71609 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0910 17:48:22.245568 71609 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0910 17:48:22.260719 71609 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0910 17:48:22.260916 71609 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0910 17:48:22.276393 71609 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0910 17:48:22.292164 71609 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0910 17:48:22.292288 71609 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0910 17:48:22.307635 71609 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0910 17:48:22.322805 71609 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0910 17:48:22.323040 71609 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0910 17:48:22.337890 71609 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0910 17:48:22.394451 71609 kubeadm.go:310] W0910 17:48:22.393142 1680 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0910 17:48:22.395595 71609 kubeadm.go:310] W0910 17:48:22.394802 1680 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0910 17:48:22.580307 71609 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0910 17:48:35.731819 71609 kubeadm.go:310] [init] Using Kubernetes version: v1.31.0
I0910 17:48:35.731916 71609 kubeadm.go:310] [preflight] Running pre-flight checks
I0910 17:48:35.732049 71609 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0910 17:48:35.732217 71609 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0910 17:48:35.732448 71609 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0910 17:48:35.732592 71609 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0910 17:48:35.736513 71609 out.go:235] - Generating certificates and keys ...
I0910 17:48:35.736694 71609 kubeadm.go:310] [certs] Using existing ca certificate authority
I0910 17:48:35.736816 71609 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0910 17:48:35.736942 71609 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0910 17:48:35.737054 71609 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0910 17:48:35.737166 71609 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0910 17:48:35.737274 71609 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0910 17:48:35.737377 71609 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0910 17:48:35.737587 71609 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-521995 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0910 17:48:35.737687 71609 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0910 17:48:35.737884 71609 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-521995 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0910 17:48:35.738004 71609 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0910 17:48:35.738130 71609 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0910 17:48:35.738218 71609 kubeadm.go:310] [certs] Generating "sa" key and public key
I0910 17:48:35.738464 71609 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0910 17:48:35.738623 71609 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0910 17:48:35.738844 71609 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0910 17:48:35.739168 71609 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0910 17:48:35.739634 71609 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0910 17:48:35.739757 71609 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0910 17:48:35.739978 71609 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0910 17:48:35.740114 71609 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0910 17:48:35.743789 71609 out.go:235] - Booting up control plane ...
I0910 17:48:35.743969 71609 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0910 17:48:35.744116 71609 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0910 17:48:35.744243 71609 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0910 17:48:35.744457 71609 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0910 17:48:35.744632 71609 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0910 17:48:35.744705 71609 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0910 17:48:35.745040 71609 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0910 17:48:35.745290 71609 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0910 17:48:35.745402 71609 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 502.132695ms
I0910 17:48:35.745540 71609 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0910 17:48:35.745703 71609 kubeadm.go:310] [api-check] The API server is healthy after 7.501388823s
I0910 17:48:35.745935 71609 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0910 17:48:35.746182 71609 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0910 17:48:35.746425 71609 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0910 17:48:35.746735 71609 kubeadm.go:310] [mark-control-plane] Marking the node addons-521995 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0910 17:48:35.746839 71609 kubeadm.go:310] [bootstrap-token] Using token: 1he68i.s5h5qr5vihjz5faz
I0910 17:48:35.750884 71609 out.go:235] - Configuring RBAC rules ...
I0910 17:48:35.751113 71609 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0910 17:48:35.751286 71609 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0910 17:48:35.751556 71609 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0910 17:48:35.751831 71609 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0910 17:48:35.752037 71609 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0910 17:48:35.752203 71609 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0910 17:48:35.752427 71609 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0910 17:48:35.752514 71609 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0910 17:48:35.752605 71609 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0910 17:48:35.752624 71609 kubeadm.go:310]
I0910 17:48:35.752732 71609 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0910 17:48:35.752746 71609 kubeadm.go:310]
I0910 17:48:35.752915 71609 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0910 17:48:35.752933 71609 kubeadm.go:310]
I0910 17:48:35.752988 71609 kubeadm.go:310] mkdir -p $HOME/.kube
I0910 17:48:35.753099 71609 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0910 17:48:35.753195 71609 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0910 17:48:35.753209 71609 kubeadm.go:310]
I0910 17:48:35.753319 71609 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0910 17:48:35.753331 71609 kubeadm.go:310]
I0910 17:48:35.753417 71609 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0910 17:48:35.753432 71609 kubeadm.go:310]
I0910 17:48:35.753535 71609 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0910 17:48:35.753675 71609 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0910 17:48:35.753825 71609 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0910 17:48:35.753841 71609 kubeadm.go:310]
I0910 17:48:35.753991 71609 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0910 17:48:35.754133 71609 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0910 17:48:35.754147 71609 kubeadm.go:310]
I0910 17:48:35.754311 71609 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token 1he68i.s5h5qr5vihjz5faz \
I0910 17:48:35.754501 71609 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:b90531c477e1815db09a4f0a9010a40b558061298ce0c25d3a69e87ea663e2aa \
I0910 17:48:35.754549 71609 kubeadm.go:310] --control-plane
I0910 17:48:35.754563 71609 kubeadm.go:310]
I0910 17:48:35.754711 71609 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0910 17:48:35.754727 71609 kubeadm.go:310]
I0910 17:48:35.754882 71609 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token 1he68i.s5h5qr5vihjz5faz \
I0910 17:48:35.755081 71609 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:b90531c477e1815db09a4f0a9010a40b558061298ce0c25d3a69e87ea663e2aa
I0910 17:48:35.755126 71609 cni.go:84] Creating CNI manager for ""
I0910 17:48:35.755156 71609 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0910 17:48:35.758849 71609 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0910 17:48:35.761709 71609 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0910 17:48:35.779191 71609 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)
I0910 17:48:35.813862 71609 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0910 17:48:35.813987 71609 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0910 17:48:35.814055 71609 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-521995 minikube.k8s.io/updated_at=2024_09_10T17_48_35_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=37b4bace07cd53444288cad630e4db4b688b8c18 minikube.k8s.io/name=addons-521995 minikube.k8s.io/primary=true
I0910 17:48:36.053351 71609 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0910 17:48:36.053351 71609 ops.go:34] apiserver oom_adj: -16
I0910 17:48:36.553408 71609 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0910 17:48:37.053936 71609 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0910 17:48:37.553434 71609 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0910 17:48:38.054205 71609 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0910 17:48:38.553854 71609 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0910 17:48:39.053977 71609 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0910 17:48:39.553849 71609 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0910 17:48:39.690066 71609 kubeadm.go:1113] duration metric: took 3.876177965s to wait for elevateKubeSystemPrivileges
I0910 17:48:39.690120 71609 kubeadm.go:394] duration metric: took 17.5524051s to StartCluster
I0910 17:48:39.690150 71609 settings.go:142] acquiring lock: {Name:mkbd43709bf358649c87a38934b29a10e630acaa Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 17:48:39.690550 71609 settings.go:150] Updating kubeconfig: /home/g528047478195_compute/minikube-integration/19598-61662/kubeconfig
I0910 17:48:39.691513 71609 lock.go:35] WriteFile acquiring /home/g528047478195_compute/minikube-integration/19598-61662/kubeconfig: {Name:mkee7b104dcc5077f0fe8e454a8ebcb9b1fcfda3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 17:48:39.692018 71609 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0910 17:48:39.692143 71609 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0910 17:48:39.692448 71609 config.go:182] Loaded profile config "addons-521995": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.31.0
I0910 17:48:39.692499 71609 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:true inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I0910 17:48:39.692655 71609 addons.go:69] Setting yakd=true in profile "addons-521995"
I0910 17:48:39.692709 71609 addons.go:234] Setting addon yakd=true in "addons-521995"
I0910 17:48:39.692754 71609 host.go:66] Checking if "addons-521995" exists ...
I0910 17:48:39.693535 71609 cli_runner.go:164] Run: docker container inspect addons-521995 --format={{.State.Status}}
I0910 17:48:39.694792 71609 addons.go:69] Setting inspektor-gadget=true in profile "addons-521995"
I0910 17:48:39.694816 71609 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-521995"
I0910 17:48:39.694845 71609 addons.go:234] Setting addon inspektor-gadget=true in "addons-521995"
I0910 17:48:39.694863 71609 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-521995"
I0910 17:48:39.694902 71609 host.go:66] Checking if "addons-521995" exists ...
I0910 17:48:39.694915 71609 host.go:66] Checking if "addons-521995" exists ...
I0910 17:48:39.695873 71609 cli_runner.go:164] Run: docker container inspect addons-521995 --format={{.State.Status}}
I0910 17:48:39.694803 71609 addons.go:69] Setting metrics-server=true in profile "addons-521995"
I0910 17:48:39.698633 71609 addons.go:234] Setting addon metrics-server=true in "addons-521995"
I0910 17:48:39.698679 71609 host.go:66] Checking if "addons-521995" exists ...
I0910 17:48:39.699617 71609 cli_runner.go:164] Run: docker container inspect addons-521995 --format={{.State.Status}}
I0910 17:48:39.700080 71609 addons.go:69] Setting registry=true in profile "addons-521995"
I0910 17:48:39.700145 71609 addons.go:234] Setting addon registry=true in "addons-521995"
I0910 17:48:39.700186 71609 host.go:66] Checking if "addons-521995" exists ...
I0910 17:48:39.701017 71609 cli_runner.go:164] Run: docker container inspect addons-521995 --format={{.State.Status}}
I0910 17:48:39.703909 71609 addons.go:69] Setting storage-provisioner=true in profile "addons-521995"
I0910 17:48:39.703969 71609 addons.go:234] Setting addon storage-provisioner=true in "addons-521995"
I0910 17:48:39.704022 71609 host.go:66] Checking if "addons-521995" exists ...
I0910 17:48:39.704974 71609 cli_runner.go:164] Run: docker container inspect addons-521995 --format={{.State.Status}}
I0910 17:48:39.708517 71609 addons.go:69] Setting cloud-spanner=true in profile "addons-521995"
I0910 17:48:39.708595 71609 addons.go:234] Setting addon cloud-spanner=true in "addons-521995"
I0910 17:48:39.708658 71609 host.go:66] Checking if "addons-521995" exists ...
I0910 17:48:39.711113 71609 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-521995"
I0910 17:48:39.711177 71609 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-521995"
I0910 17:48:39.711744 71609 cli_runner.go:164] Run: docker container inspect addons-521995 --format={{.State.Status}}
I0910 17:48:39.712644 71609 cli_runner.go:164] Run: docker container inspect addons-521995 --format={{.State.Status}}
I0910 17:48:39.725373 71609 addons.go:69] Setting volcano=true in profile "addons-521995"
I0910 17:48:39.725455 71609 addons.go:234] Setting addon volcano=true in "addons-521995"
I0910 17:48:39.725515 71609 host.go:66] Checking if "addons-521995" exists ...
I0910 17:48:39.726600 71609 cli_runner.go:164] Run: docker container inspect addons-521995 --format={{.State.Status}}
I0910 17:48:39.728687 71609 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-521995"
I0910 17:48:39.729171 71609 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-521995"
I0910 17:48:39.729279 71609 host.go:66] Checking if "addons-521995" exists ...
I0910 17:48:39.730435 71609 cli_runner.go:164] Run: docker container inspect addons-521995 --format={{.State.Status}}
I0910 17:48:39.745708 71609 addons.go:69] Setting volumesnapshots=true in profile "addons-521995"
I0910 17:48:39.745796 71609 addons.go:234] Setting addon volumesnapshots=true in "addons-521995"
I0910 17:48:39.745865 71609 host.go:66] Checking if "addons-521995" exists ...
I0910 17:48:39.746836 71609 cli_runner.go:164] Run: docker container inspect addons-521995 --format={{.State.Status}}
I0910 17:48:39.762577 71609 addons.go:69] Setting default-storageclass=true in profile "addons-521995"
I0910 17:48:39.762669 71609 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-521995"
I0910 17:48:39.763364 71609 cli_runner.go:164] Run: docker container inspect addons-521995 --format={{.State.Status}}
I0910 17:48:39.764571 71609 cli_runner.go:164] Run: docker container inspect addons-521995 --format={{.State.Status}}
I0910 17:48:39.777895 71609 addons.go:69] Setting gcp-auth=true in profile "addons-521995"
I0910 17:48:39.777958 71609 mustload.go:65] Loading cluster: addons-521995
I0910 17:48:39.778338 71609 config.go:182] Loaded profile config "addons-521995": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.31.0
I0910 17:48:39.778859 71609 cli_runner.go:164] Run: docker container inspect addons-521995 --format={{.State.Status}}
I0910 17:48:39.780567 71609 out.go:177] * Verifying Kubernetes components...
I0910 17:48:39.798541 71609 addons.go:69] Setting helm-tiller=true in profile "addons-521995"
I0910 17:48:39.798624 71609 addons.go:234] Setting addon helm-tiller=true in "addons-521995"
I0910 17:48:39.798697 71609 host.go:66] Checking if "addons-521995" exists ...
I0910 17:48:39.799718 71609 cli_runner.go:164] Run: docker container inspect addons-521995 --format={{.State.Status}}
I0910 17:48:39.822690 71609 addons.go:69] Setting ingress=true in profile "addons-521995"
I0910 17:48:39.822786 71609 addons.go:234] Setting addon ingress=true in "addons-521995"
I0910 17:48:39.822860 71609 host.go:66] Checking if "addons-521995" exists ...
I0910 17:48:39.824261 71609 cli_runner.go:164] Run: docker container inspect addons-521995 --format={{.State.Status}}
I0910 17:48:39.844810 71609 addons.go:69] Setting ingress-dns=true in profile "addons-521995"
I0910 17:48:39.844907 71609 addons.go:234] Setting addon ingress-dns=true in "addons-521995"
I0910 17:48:39.844986 71609 host.go:66] Checking if "addons-521995" exists ...
I0910 17:48:39.846015 71609 cli_runner.go:164] Run: docker container inspect addons-521995 --format={{.State.Status}}
I0910 17:48:39.987905 71609 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0910 17:48:40.223283 71609 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0910 17:48:40.343412 71609 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I0910 17:48:40.343599 71609 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2
I0910 17:48:40.350790 71609 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
I0910 17:48:40.350836 71609 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0910 17:48:40.350999 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:40.351432 71609 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0910 17:48:40.351600 71609 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0910 17:48:40.351891 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:40.394326 71609 out.go:177] - Using image docker.io/registry:2.8.3
I0910 17:48:40.397453 71609 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
I0910 17:48:40.400493 71609 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
I0910 17:48:40.400522 71609 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I0910 17:48:40.400622 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:40.459306 71609 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0910 17:48:40.464459 71609 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0910 17:48:40.464494 71609 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0910 17:48:40.464605 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:40.493389 71609 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-521995"
I0910 17:48:40.493461 71609 host.go:66] Checking if "addons-521995" exists ...
I0910 17:48:40.494294 71609 cli_runner.go:164] Run: docker container inspect addons-521995 --format={{.State.Status}}
I0910 17:48:40.666622 71609 out.go:177] - Using image docker.io/volcanosh/vc-controller-manager:v1.9.0
I0910 17:48:40.680689 71609 out.go:177] - Using image docker.io/volcanosh/vc-scheduler:v1.9.0
I0910 17:48:40.683937 71609 out.go:177] - Using image ghcr.io/helm/tiller:v2.17.0
I0910 17:48:40.684065 71609 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0910 17:48:40.686668 71609 addons.go:431] installing /etc/kubernetes/addons/helm-tiller-dp.yaml
I0910 17:48:40.686697 71609 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-dp.yaml (2422 bytes)
I0910 17:48:40.686808 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:40.738285 71609 out.go:177] - Using image docker.io/volcanosh/vc-webhook-manager:v1.9.0
I0910 17:48:40.745708 71609 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml
I0910 17:48:40.745801 71609 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (434001 bytes)
I0910 17:48:40.745946 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:40.752215 71609 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0910 17:48:40.759932 71609 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0910 17:48:40.760068 71609 cli_runner.go:217] Completed: docker container inspect addons-521995 --format={{.State.Status}}: (1.04738553s)
I0910 17:48:40.760855 71609 cli_runner.go:217] Completed: docker container inspect addons-521995 --format={{.State.Status}}: (1.0649094s)
I0910 17:48:40.764316 71609 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
I0910 17:48:40.764538 71609 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0910 17:48:40.764624 71609 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2
I0910 17:48:40.764795 71609 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.23
I0910 17:48:40.770393 71609 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0910 17:48:40.770472 71609 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0910 17:48:40.770630 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:40.770762 71609 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
I0910 17:48:40.774486 71609 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0910 17:48:40.774673 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:40.782308 71609 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0910 17:48:40.789821 71609 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0910 17:48:40.790510 71609 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0910 17:48:40.798679 71609 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0910 17:48:40.798712 71609 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I0910 17:48:40.798832 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:40.809101 71609 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0910 17:48:40.815555 71609 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0910 17:48:40.818906 71609 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0910 17:48:40.824283 71609 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0910 17:48:40.827422 71609 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0910 17:48:40.827547 71609 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0910 17:48:40.827743 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:40.875156 71609 cli_runner.go:217] Completed: docker container inspect addons-521995 --format={{.State.Status}}: (1.029077718s)
I0910 17:48:40.879671 71609 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I0910 17:48:40.882948 71609 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0910 17:48:40.882976 71609 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0910 17:48:40.883084 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:40.883404 71609 cli_runner.go:217] Completed: docker container inspect addons-521995 --format={{.State.Status}}: (1.120004589s)
I0910 17:48:40.884913 71609 addons.go:234] Setting addon default-storageclass=true in "addons-521995"
I0910 17:48:40.884958 71609 host.go:66] Checking if "addons-521995" exists ...
I0910 17:48:40.888710 71609 cli_runner.go:164] Run: docker container inspect addons-521995 --format={{.State.Status}}
I0910 17:48:40.898076 71609 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/addons-521995/id_rsa Username:docker}
I0910 17:48:40.915389 71609 cli_runner.go:217] Completed: docker container inspect addons-521995 --format={{.State.Status}}: (1.168501767s)
I0910 17:48:40.919755 71609 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0910 17:48:40.924915 71609 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0910 17:48:40.924966 71609 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0910 17:48:40.925090 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:41.001716 71609 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/addons-521995/id_rsa Username:docker}
I0910 17:48:41.013772 71609 cli_runner.go:217] Completed: docker container inspect addons-521995 --format={{.State.Status}}: (1.23483838s)
I0910 17:48:41.013820 71609 host.go:66] Checking if "addons-521995" exists ...
I0910 17:48:41.016449 71609 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0910 17:48:41.016529 71609 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0910 17:48:41.016700 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:41.107944 71609 cli_runner.go:217] Completed: docker container inspect addons-521995 --format={{.State.Status}}: (1.343302941s)
I0910 17:48:41.112309 71609 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0
I0910 17:48:41.115564 71609 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
I0910 17:48:41.115603 71609 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I0910 17:48:41.115725 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:41.167312 71609 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0910 17:48:41.173516 71609 out.go:177] - Using image docker.io/busybox:stable
I0910 17:48:41.177351 71609 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0910 17:48:41.177381 71609 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0910 17:48:41.177499 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:41.258023 71609 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/addons-521995/id_rsa Username:docker}
I0910 17:48:41.258554 71609 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/addons-521995/id_rsa Username:docker}
I0910 17:48:41.268589 71609 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/addons-521995/id_rsa Username:docker}
I0910 17:48:41.360787 71609 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/addons-521995/id_rsa Username:docker}
I0910 17:48:41.405372 71609 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/addons-521995/id_rsa Username:docker}
I0910 17:48:41.417515 71609 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/addons-521995/id_rsa Username:docker}
I0910 17:48:41.453970 71609 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/addons-521995/id_rsa Username:docker}
I0910 17:48:41.494081 71609 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/addons-521995/id_rsa Username:docker}
I0910 17:48:41.527068 71609 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/addons-521995/id_rsa Username:docker}
I0910 17:48:41.560997 71609 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/addons-521995/id_rsa Username:docker}
I0910 17:48:41.589723 71609 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/addons-521995/id_rsa Username:docker}
I0910 17:48:41.594761 71609 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/addons-521995/id_rsa Username:docker}
I0910 17:48:41.598887 71609 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/addons-521995/id_rsa Username:docker}
W0910 17:48:41.600723 71609 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0910 17:48:41.600834 71609 retry.go:31] will retry after 344.58889ms: ssh: handshake failed: EOF
I0910 17:48:41.982678 71609 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0910 17:48:41.982709 71609 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0910 17:48:42.027832 71609 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
I0910 17:48:42.027950 71609 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0910 17:48:42.067488 71609 addons.go:431] installing /etc/kubernetes/addons/helm-tiller-rbac.yaml
I0910 17:48:42.067611 71609 ssh_runner.go:362] scp helm-tiller/helm-tiller-rbac.yaml --> /etc/kubernetes/addons/helm-tiller-rbac.yaml (1188 bytes)
I0910 17:48:42.105385 71609 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0910 17:48:42.123281 71609 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
I0910 17:48:42.123408 71609 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0910 17:48:42.273911 71609 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0910 17:48:42.336491 71609 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0910 17:48:42.336621 71609 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0910 17:48:42.379683 71609 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0910 17:48:42.379715 71609 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0910 17:48:42.523858 71609 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
I0910 17:48:42.523893 71609 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0910 17:48:42.566917 71609 addons.go:431] installing /etc/kubernetes/addons/helm-tiller-svc.yaml
I0910 17:48:42.566950 71609 ssh_runner.go:362] scp helm-tiller/helm-tiller-svc.yaml --> /etc/kubernetes/addons/helm-tiller-svc.yaml (951 bytes)
I0910 17:48:42.613106 71609 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0910 17:48:42.620193 71609 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
I0910 17:48:42.620226 71609 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0910 17:48:42.627937 71609 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
I0910 17:48:42.641075 71609 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0910 17:48:42.660558 71609 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0910 17:48:42.715877 71609 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0910 17:48:42.736791 71609 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0910 17:48:42.736826 71609 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0910 17:48:42.829366 71609 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0910 17:48:42.829397 71609 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0910 17:48:42.860372 71609 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0910 17:48:42.860407 71609 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0910 17:48:42.863944 71609 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I0910 17:48:42.863977 71609 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I0910 17:48:42.970324 71609 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0910 17:48:43.077205 71609 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml
I0910 17:48:43.137863 71609 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
I0910 17:48:43.137897 71609 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0910 17:48:43.209645 71609 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0910 17:48:43.329774 71609 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0910 17:48:43.329812 71609 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0910 17:48:43.408300 71609 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (3.184894794s)
I0910 17:48:43.408347 71609 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I0910 17:48:43.410102 71609 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (2.65013652s)
I0910 17:48:43.411423 71609 node_ready.go:35] waiting up to 6m0s for node "addons-521995" to be "Ready" ...
I0910 17:48:43.485427 71609 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
I0910 17:48:43.485491 71609 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I0910 17:48:43.490844 71609 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0910 17:48:43.490879 71609 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0910 17:48:43.527038 71609 node_ready.go:49] node "addons-521995" has status "Ready":"True"
I0910 17:48:43.527077 71609 node_ready.go:38] duration metric: took 115.623976ms for node "addons-521995" to be "Ready" ...
I0910 17:48:43.527093 71609 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0910 17:48:43.568109 71609 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0910 17:48:43.714207 71609 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
I0910 17:48:43.714238 71609 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0910 17:48:43.788877 71609 pod_ready.go:79] waiting up to 6m0s for pod "coredns-6f6b679f8f-cll96" in "kube-system" namespace to be "Ready" ...
I0910 17:48:44.058029 71609 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0910 17:48:44.058071 71609 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0910 17:48:44.090788 71609 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-521995" context rescaled to 1 replicas
I0910 17:48:44.237694 71609 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0910 17:48:44.237728 71609 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0910 17:48:44.243476 71609 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I0910 17:48:44.243507 71609 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I0910 17:48:44.310594 71609 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0910 17:48:44.310627 71609 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0910 17:48:44.410660 71609 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0910 17:48:44.410712 71609 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0910 17:48:44.421084 71609 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0910 17:48:44.454375 71609 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I0910 17:48:44.454411 71609 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I0910 17:48:44.641175 71609 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0910 17:48:44.641206 71609 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0910 17:48:44.691479 71609 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I0910 17:48:44.691511 71609 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I0910 17:48:44.741609 71609 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0910 17:48:44.741640 71609 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0910 17:48:45.114736 71609 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0910 17:48:45.114772 71609 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0910 17:48:45.197264 71609 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0910 17:48:45.298644 71609 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
I0910 17:48:45.298699 71609 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I0910 17:48:45.859876 71609 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0910 17:48:45.859909 71609 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0910 17:48:46.002960 71609 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
I0910 17:48:46.002991 71609 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
I0910 17:48:46.283786 71609 pod_ready.go:103] pod "coredns-6f6b679f8f-cll96" in "kube-system" namespace has status "Ready":"False"
I0910 17:48:46.502494 71609 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0910 17:48:46.502526 71609 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0910 17:48:46.569562 71609 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I0910 17:48:47.069927 71609 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0910 17:48:47.069966 71609 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0910 17:48:48.102215 71609 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0910 17:48:49.104737 71609 pod_ready.go:103] pod "coredns-6f6b679f8f-cll96" in "kube-system" namespace has status "Ready":"False"
I0910 17:48:53.300498 71609 pod_ready.go:103] pod "coredns-6f6b679f8f-cll96" in "kube-system" namespace has status "Ready":"False"
I0910 17:48:54.654308 71609 pod_ready.go:98] pod "coredns-6f6b679f8f-cll96" in "kube-system" namespace has status phase "Failed" (skipping!): {Phase:Failed Conditions:[{Type:PodReadyToStartContainers Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-10 17:48:49 +0000 UTC Reason: Message:} {Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-10 17:48:42 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-10 17:48:42 +0000 UTC Reason:PodFailed Message:} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-10 17:48:42 +0000 UTC Reason:PodFailed Message:} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-10 17:48:41 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:192.168.49.2 HostIPs:[{IP:192.168.49.2}] PodIP:10.244.0.2 PodI
Ps:[{IP:10.244.0.2}] StartTime:2024-09-10 17:48:42 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:coredns State:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:2,Signal:0,Reason:Error,Message:,StartedAt:2024-09-10 17:48:47 +0000 UTC,FinishedAt:2024-09-10 17:48:49 +0000 UTC,ContainerID:docker://3991301c495ecae581885af9175a82a23a581709b9795c497fc994676d6c8d00,}} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:0 Image:registry.k8s.io/coredns/coredns:v1.11.1 ImageID:docker-pullable://registry.k8s.io/coredns/coredns@sha256:1eeb4c7316bacb1d4c8ead65571cd92dd21e27359f0d4917f1a5822a73b75db1 ContainerID:docker://3991301c495ecae581885af9175a82a23a581709b9795c497fc994676d6c8d00 Started:0xc0192bb83c AllocatedResources:map[] Resources:nil VolumeMounts:[{Name:config-volume MountPath:/etc/coredns ReadOnly:true RecursiveReadOnly:0xc0192ad5a0} {Name:kube-api-access-thmzj MountPath:/var/run/secrets/kubernetes.io/serviceaccount ReadOnly:true RecursiveRead
Only:0xc0192ad5b0}] User:nil AllocatedResourcesStatus:[]}] QOSClass:Burstable EphemeralContainerStatuses:[] Resize: ResourceClaimStatuses:[]}
I0910 17:48:54.654438 71609 pod_ready.go:82] duration metric: took 10.865432878s for pod "coredns-6f6b679f8f-cll96" in "kube-system" namespace to be "Ready" ...
E0910 17:48:54.654513 71609 pod_ready.go:67] WaitExtra: waitPodCondition: pod "coredns-6f6b679f8f-cll96" in "kube-system" namespace has status phase "Failed" (skipping!): {Phase:Failed Conditions:[{Type:PodReadyToStartContainers Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-10 17:48:49 +0000 UTC Reason: Message:} {Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-10 17:48:42 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-10 17:48:42 +0000 UTC Reason:PodFailed Message:} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-10 17:48:42 +0000 UTC Reason:PodFailed Message:} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-10 17:48:41 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:192.168.49.2 HostIPs:[{IP:192.168
.49.2}] PodIP:10.244.0.2 PodIPs:[{IP:10.244.0.2}] StartTime:2024-09-10 17:48:42 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:coredns State:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:2,Signal:0,Reason:Error,Message:,StartedAt:2024-09-10 17:48:47 +0000 UTC,FinishedAt:2024-09-10 17:48:49 +0000 UTC,ContainerID:docker://3991301c495ecae581885af9175a82a23a581709b9795c497fc994676d6c8d00,}} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:0 Image:registry.k8s.io/coredns/coredns:v1.11.1 ImageID:docker-pullable://registry.k8s.io/coredns/coredns@sha256:1eeb4c7316bacb1d4c8ead65571cd92dd21e27359f0d4917f1a5822a73b75db1 ContainerID:docker://3991301c495ecae581885af9175a82a23a581709b9795c497fc994676d6c8d00 Started:0xc0192bb83c AllocatedResources:map[] Resources:nil VolumeMounts:[{Name:config-volume MountPath:/etc/coredns ReadOnly:true RecursiveReadOnly:0xc0192ad5a0} {Name:kube-api-access-thmzj MountPath:/var/run/secrets/kubernetes.io/serviceaccoun
t ReadOnly:true RecursiveReadOnly:0xc0192ad5b0}] User:nil AllocatedResourcesStatus:[]}] QOSClass:Burstable EphemeralContainerStatuses:[] Resize: ResourceClaimStatuses:[]}
I0910 17:48:54.654564 71609 pod_ready.go:79] waiting up to 6m0s for pod "coredns-6f6b679f8f-ngrsx" in "kube-system" namespace to be "Ready" ...
I0910 17:48:56.411413 71609 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (14.305888022s)
I0910 17:48:56.411615 71609 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (14.137428406s)
I0910 17:48:56.412064 71609 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (13.798925406s)
I0910 17:48:57.088109 71609 pod_ready.go:103] pod "coredns-6f6b679f8f-ngrsx" in "kube-system" namespace has status "Ready":"False"
I0910 17:48:57.982656 71609 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0910 17:48:57.982829 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:58.045312 71609 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/addons-521995/id_rsa Username:docker}
I0910 17:48:58.272693 71609 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0910 17:48:58.364752 71609 addons.go:234] Setting addon gcp-auth=true in "addons-521995"
I0910 17:48:58.364844 71609 host.go:66] Checking if "addons-521995" exists ...
I0910 17:48:58.365671 71609 cli_runner.go:164] Run: docker container inspect addons-521995 --format={{.State.Status}}
I0910 17:48:58.420266 71609 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0910 17:48:58.420376 71609 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-521995
I0910 17:48:58.472652 71609 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/g528047478195_compute/minikube-integration/19598-61662/.minikube/machines/addons-521995/id_rsa Username:docker}
I0910 17:48:59.209387 71609 pod_ready.go:103] pod "coredns-6f6b679f8f-ngrsx" in "kube-system" namespace has status "Ready":"False"
I0910 17:49:01.319411 71609 pod_ready.go:103] pod "coredns-6f6b679f8f-ngrsx" in "kube-system" namespace has status "Ready":"False"
I0910 17:49:03.569050 71609 pod_ready.go:103] pod "coredns-6f6b679f8f-ngrsx" in "kube-system" namespace has status "Ready":"False"
I0910 17:49:05.690987 71609 pod_ready.go:103] pod "coredns-6f6b679f8f-ngrsx" in "kube-system" namespace has status "Ready":"False"
I0910 17:49:07.886468 71609 pod_ready.go:103] pod "coredns-6f6b679f8f-ngrsx" in "kube-system" namespace has status "Ready":"False"
I0910 17:49:10.649466 71609 pod_ready.go:103] pod "coredns-6f6b679f8f-ngrsx" in "kube-system" namespace has status "Ready":"False"
I0910 17:49:10.693320 71609 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (28.065328533s)
I0910 17:49:10.693665 71609 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (28.052553847s)
I0910 17:49:10.694166 71609 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (28.033565154s)
I0910 17:49:10.694423 71609 addons.go:475] Verifying addon ingress=true in "addons-521995"
I0910 17:49:10.694519 71609 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (27.978605862s)
I0910 17:49:10.694713 71609 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (27.72435468s)
I0910 17:49:10.694742 71609 addons.go:475] Verifying addon registry=true in "addons-521995"
I0910 17:49:10.695406 71609 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml: (27.618007094s)
I0910 17:49:10.695602 71609 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (27.485927095s)
I0910 17:49:10.695718 71609 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (27.12756659s)
I0910 17:49:10.695744 71609 addons.go:475] Verifying addon metrics-server=true in "addons-521995"
I0910 17:49:10.695859 71609 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (26.274734484s)
I0910 17:49:10.696216 71609 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (25.498910869s)
W0910 17:49:10.696322 71609 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0910 17:49:10.696333 71609 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (24.126723786s)
I0910 17:49:10.696351 71609 retry.go:31] will retry after 230.197336ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0910 17:49:10.699531 71609 out.go:177] * Verifying registry addon...
I0910 17:49:10.699531 71609 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-521995 service yakd-dashboard -n yakd-dashboard
I0910 17:49:10.699792 71609 out.go:177] * Verifying ingress addon...
I0910 17:49:10.703629 71609 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0910 17:49:10.707244 71609 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0910 17:49:10.927206 71609 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0910 17:49:10.955831 71609 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0910 17:49:10.955863 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:10.957067 71609 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0910 17:49:10.957149 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:11.439557 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:11.441536 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:11.827408 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:12.038590 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:12.660613 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:12.670978 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:12.785864 71609 pod_ready.go:103] pod "coredns-6f6b679f8f-ngrsx" in "kube-system" namespace has status "Ready":"False"
I0910 17:49:12.900785 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:12.909874 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:13.528002 71609 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (25.425687793s)
I0910 17:49:13.528156 71609 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-521995"
I0910 17:49:13.528799 71609 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (15.108494451s)
I0910 17:49:13.532148 71609 out.go:177] * Verifying csi-hostpath-driver addon...
I0910 17:49:13.532474 71609 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0910 17:49:13.535897 71609 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
I0910 17:49:13.537896 71609 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0910 17:49:13.539200 71609 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0910 17:49:13.539301 71609 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0910 17:49:13.601968 71609 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0910 17:49:13.602006 71609 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0910 17:49:13.613073 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:13.619001 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:13.652108 71609 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0910 17:49:13.652198 71609 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I0910 17:49:13.701063 71609 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0910 17:49:13.860120 71609 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0910 17:49:13.860224 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:14.010477 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:14.012823 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:14.515358 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:14.517708 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:14.520571 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:14.635625 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:14.720579 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:14.723732 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:15.170560 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:15.299792 71609 pod_ready.go:103] pod "coredns-6f6b679f8f-ngrsx" in "kube-system" namespace has status "Ready":"False"
I0910 17:49:15.300579 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:15.365893 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:15.883308 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:15.888388 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:15.908201 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:16.064367 71609 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (5.136928482s)
I0910 17:49:16.124468 71609 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (2.423283115s)
I0910 17:49:16.130152 71609 addons.go:475] Verifying addon gcp-auth=true in "addons-521995"
I0910 17:49:16.134164 71609 out.go:177] * Verifying gcp-auth addon...
I0910 17:49:16.139623 71609 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0910 17:49:16.143632 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:16.208465 71609 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0910 17:49:16.312338 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:16.314143 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:16.556765 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:16.730529 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:16.733104 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:17.067812 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:17.222514 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:17.233844 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:17.622639 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:17.663951 71609 pod_ready.go:103] pod "coredns-6f6b679f8f-ngrsx" in "kube-system" namespace has status "Ready":"False"
I0910 17:49:17.709156 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:17.713302 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:18.062617 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:18.211117 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:18.214534 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:18.560236 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:18.725792 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:18.744975 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:19.073102 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:19.354352 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:19.397198 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:19.562668 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:19.675114 71609 pod_ready.go:103] pod "coredns-6f6b679f8f-ngrsx" in "kube-system" namespace has status "Ready":"False"
I0910 17:49:19.770514 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:19.772136 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:20.068298 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:20.255067 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:20.256467 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:20.618717 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:20.769016 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:20.786176 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:21.065893 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:21.262716 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:21.270717 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:21.555609 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:21.683308 71609 pod_ready.go:103] pod "coredns-6f6b679f8f-ngrsx" in "kube-system" namespace has status "Ready":"False"
I0910 17:49:21.738443 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:21.740205 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:22.052952 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:22.231012 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:22.353859 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:22.549845 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:22.719295 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:22.721842 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:23.055242 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:23.223787 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:23.273281 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:23.547909 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:23.679500 71609 pod_ready.go:93] pod "coredns-6f6b679f8f-ngrsx" in "kube-system" namespace has status "Ready":"True"
I0910 17:49:23.679606 71609 pod_ready.go:82] duration metric: took 29.024987686s for pod "coredns-6f6b679f8f-ngrsx" in "kube-system" namespace to be "Ready" ...
I0910 17:49:23.679646 71609 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-521995" in "kube-system" namespace to be "Ready" ...
I0910 17:49:23.705393 71609 pod_ready.go:93] pod "etcd-addons-521995" in "kube-system" namespace has status "Ready":"True"
I0910 17:49:23.705502 71609 pod_ready.go:82] duration metric: took 25.784663ms for pod "etcd-addons-521995" in "kube-system" namespace to be "Ready" ...
I0910 17:49:23.705570 71609 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-521995" in "kube-system" namespace to be "Ready" ...
I0910 17:49:23.719458 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:23.721939 71609 pod_ready.go:93] pod "kube-apiserver-addons-521995" in "kube-system" namespace has status "Ready":"True"
I0910 17:49:23.722044 71609 pod_ready.go:82] duration metric: took 16.419206ms for pod "kube-apiserver-addons-521995" in "kube-system" namespace to be "Ready" ...
I0910 17:49:23.722084 71609 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-521995" in "kube-system" namespace to be "Ready" ...
I0910 17:49:23.723051 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:23.732870 71609 pod_ready.go:93] pod "kube-controller-manager-addons-521995" in "kube-system" namespace has status "Ready":"True"
I0910 17:49:23.732929 71609 pod_ready.go:82] duration metric: took 10.796958ms for pod "kube-controller-manager-addons-521995" in "kube-system" namespace to be "Ready" ...
I0910 17:49:23.732950 71609 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-zhwb9" in "kube-system" namespace to be "Ready" ...
I0910 17:49:23.743342 71609 pod_ready.go:93] pod "kube-proxy-zhwb9" in "kube-system" namespace has status "Ready":"True"
I0910 17:49:23.743397 71609 pod_ready.go:82] duration metric: took 10.434068ms for pod "kube-proxy-zhwb9" in "kube-system" namespace to be "Ready" ...
I0910 17:49:23.743414 71609 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-521995" in "kube-system" namespace to be "Ready" ...
I0910 17:49:24.051912 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:24.062030 71609 pod_ready.go:93] pod "kube-scheduler-addons-521995" in "kube-system" namespace has status "Ready":"True"
I0910 17:49:24.062144 71609 pod_ready.go:82] duration metric: took 318.715292ms for pod "kube-scheduler-addons-521995" in "kube-system" namespace to be "Ready" ...
I0910 17:49:24.062218 71609 pod_ready.go:39] duration metric: took 40.535072294s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0910 17:49:24.062336 71609 api_server.go:52] waiting for apiserver process to appear ...
I0910 17:49:24.062539 71609 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0910 17:49:24.094226 71609 api_server.go:72] duration metric: took 44.402012816s to wait for apiserver process to appear ...
I0910 17:49:24.094342 71609 api_server.go:88] waiting for apiserver healthz status ...
I0910 17:49:24.094386 71609 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I0910 17:49:24.112549 71609 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I0910 17:49:24.114758 71609 api_server.go:141] control plane version: v1.31.0
I0910 17:49:24.114862 71609 api_server.go:131] duration metric: took 20.488703ms to wait for apiserver health ...
I0910 17:49:24.114901 71609 system_pods.go:43] waiting for kube-system pods to appear ...
I0910 17:49:24.213057 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:24.219428 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:24.275060 71609 system_pods.go:59] 18 kube-system pods found
I0910 17:49:24.275108 71609 system_pods.go:61] "coredns-6f6b679f8f-ngrsx" [5d742ea4-053c-4b81-86dd-6167a9d803c5] Running
I0910 17:49:24.275126 71609 system_pods.go:61] "csi-hostpath-attacher-0" [06b29c97-ec02-43aa-9a9e-e66cf6cceb97] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0910 17:49:24.275139 71609 system_pods.go:61] "csi-hostpath-resizer-0" [cc52299c-489d-449a-b6c6-c0803f7d97ea] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0910 17:49:24.275160 71609 system_pods.go:61] "csi-hostpathplugin-46c6c" [81647ee0-b069-4cf1-9be3-3b7298177801] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0910 17:49:24.275172 71609 system_pods.go:61] "etcd-addons-521995" [0b6d8f58-1d75-49e9-b05c-3c1f7ca7f2c0] Running
I0910 17:49:24.275189 71609 system_pods.go:61] "kube-apiserver-addons-521995" [50dbe839-c197-4e24-a04d-d1a694fc2b29] Running
I0910 17:49:24.275197 71609 system_pods.go:61] "kube-controller-manager-addons-521995" [8d3fb3ac-bef0-4fd4-8064-3b88dd61466b] Running
I0910 17:49:24.275208 71609 system_pods.go:61] "kube-ingress-dns-minikube" [14e9d8ef-89d6-4d09-8466-cdb8ca2e55cc] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
I0910 17:49:24.275224 71609 system_pods.go:61] "kube-proxy-zhwb9" [476538d8-84a2-4c0f-b0ca-1f61a3f0544a] Running
I0910 17:49:24.275232 71609 system_pods.go:61] "kube-scheduler-addons-521995" [13ad9663-f352-4485-abd4-515cba823985] Running
I0910 17:49:24.275325 71609 system_pods.go:61] "metrics-server-84c5f94fbc-fb9nq" [6b74f6a0-0605-403c-88b5-a0026b395720] Running / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0910 17:49:24.275348 71609 system_pods.go:61] "nvidia-device-plugin-daemonset-49rbk" [630ddd18-dc9c-40e3-9055-382936a92450] Running
I0910 17:49:24.275359 71609 system_pods.go:61] "registry-66c9cd494c-bl6xf" [afcec85d-6c6f-4a38-9678-3749bc69d2a3] Running
I0910 17:49:24.275372 71609 system_pods.go:61] "registry-proxy-g4vdc" [4153d723-3ce2-48ca-929d-b85b94b0b7ff] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0910 17:49:24.275390 71609 system_pods.go:61] "snapshot-controller-56fcc65765-9844r" [6ea20390-6672-42ad-9858-21b0fe47d0ac] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0910 17:49:24.275403 71609 system_pods.go:61] "snapshot-controller-56fcc65765-vmfn4" [e6b2a198-237a-4bbe-be59-752e1d15873b] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0910 17:49:24.275413 71609 system_pods.go:61] "storage-provisioner" [f45aa517-c4cb-4888-99cb-eec62ec8293e] Running
I0910 17:49:24.275422 71609 system_pods.go:61] "tiller-deploy-b48cc5f79-qbrmp" [853eb711-7f02-446e-ae55-dd70836bd910] Running
I0910 17:49:24.275435 71609 system_pods.go:74] duration metric: took 160.470185ms to wait for pod list to return data ...
I0910 17:49:24.275455 71609 default_sa.go:34] waiting for default service account to be created ...
I0910 17:49:24.466158 71609 default_sa.go:45] found service account: "default"
I0910 17:49:24.466201 71609 default_sa.go:55] duration metric: took 190.734361ms for default service account to be created ...
I0910 17:49:24.466218 71609 system_pods.go:116] waiting for k8s-apps to be running ...
I0910 17:49:24.546296 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:24.697988 71609 system_pods.go:86] 18 kube-system pods found
I0910 17:49:24.698132 71609 system_pods.go:89] "coredns-6f6b679f8f-ngrsx" [5d742ea4-053c-4b81-86dd-6167a9d803c5] Running
I0910 17:49:24.698202 71609 system_pods.go:89] "csi-hostpath-attacher-0" [06b29c97-ec02-43aa-9a9e-e66cf6cceb97] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0910 17:49:24.698240 71609 system_pods.go:89] "csi-hostpath-resizer-0" [cc52299c-489d-449a-b6c6-c0803f7d97ea] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0910 17:49:24.698305 71609 system_pods.go:89] "csi-hostpathplugin-46c6c" [81647ee0-b069-4cf1-9be3-3b7298177801] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0910 17:49:24.698330 71609 system_pods.go:89] "etcd-addons-521995" [0b6d8f58-1d75-49e9-b05c-3c1f7ca7f2c0] Running
I0910 17:49:24.698377 71609 system_pods.go:89] "kube-apiserver-addons-521995" [50dbe839-c197-4e24-a04d-d1a694fc2b29] Running
I0910 17:49:24.698413 71609 system_pods.go:89] "kube-controller-manager-addons-521995" [8d3fb3ac-bef0-4fd4-8064-3b88dd61466b] Running
I0910 17:49:24.698444 71609 system_pods.go:89] "kube-ingress-dns-minikube" [14e9d8ef-89d6-4d09-8466-cdb8ca2e55cc] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
I0910 17:49:24.698490 71609 system_pods.go:89] "kube-proxy-zhwb9" [476538d8-84a2-4c0f-b0ca-1f61a3f0544a] Running
I0910 17:49:24.698538 71609 system_pods.go:89] "kube-scheduler-addons-521995" [13ad9663-f352-4485-abd4-515cba823985] Running
I0910 17:49:24.698574 71609 system_pods.go:89] "metrics-server-84c5f94fbc-fb9nq" [6b74f6a0-0605-403c-88b5-a0026b395720] Running / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0910 17:49:24.698612 71609 system_pods.go:89] "nvidia-device-plugin-daemonset-49rbk" [630ddd18-dc9c-40e3-9055-382936a92450] Running
I0910 17:49:24.698648 71609 system_pods.go:89] "registry-66c9cd494c-bl6xf" [afcec85d-6c6f-4a38-9678-3749bc69d2a3] Running
I0910 17:49:24.698674 71609 system_pods.go:89] "registry-proxy-g4vdc" [4153d723-3ce2-48ca-929d-b85b94b0b7ff] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0910 17:49:24.698703 71609 system_pods.go:89] "snapshot-controller-56fcc65765-9844r" [6ea20390-6672-42ad-9858-21b0fe47d0ac] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0910 17:49:24.698770 71609 system_pods.go:89] "snapshot-controller-56fcc65765-vmfn4" [e6b2a198-237a-4bbe-be59-752e1d15873b] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0910 17:49:24.698803 71609 system_pods.go:89] "storage-provisioner" [f45aa517-c4cb-4888-99cb-eec62ec8293e] Running
I0910 17:49:24.698844 71609 system_pods.go:89] "tiller-deploy-b48cc5f79-qbrmp" [853eb711-7f02-446e-ae55-dd70836bd910] Running
I0910 17:49:24.698889 71609 system_pods.go:126] duration metric: took 232.658603ms to wait for k8s-apps to be running ...
I0910 17:49:24.698922 71609 system_svc.go:44] waiting for kubelet service to be running ....
I0910 17:49:24.699075 71609 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0910 17:49:24.731793 71609 system_svc.go:56] duration metric: took 32.823234ms WaitForService to wait for kubelet
I0910 17:49:24.731920 71609 kubeadm.go:582] duration metric: took 45.039734843s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0910 17:49:24.732004 71609 node_conditions.go:102] verifying NodePressure condition ...
I0910 17:49:24.741212 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:24.743186 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:24.861853 71609 node_conditions.go:122] node storage ephemeral capacity is 119475748Ki
I0910 17:49:24.861977 71609 node_conditions.go:123] node cpu capacity is 2
I0910 17:49:24.862051 71609 node_conditions.go:105] duration metric: took 129.982761ms to run NodePressure ...
I0910 17:49:24.862098 71609 start.go:241] waiting for startup goroutines ...
I0910 17:49:25.057869 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:25.217232 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:25.241506 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:25.549682 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:25.712715 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:25.721449 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:26.052310 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:26.216561 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:26.219766 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:26.551601 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:26.827441 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:27.303700 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:27.304267 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:27.305416 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:27.311904 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:27.685669 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:27.731234 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:27.734294 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:28.046333 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:28.211106 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 17:49:28.220123 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:28.579100 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:28.725273 71609 kapi.go:107] duration metric: took 18.021624573s to wait for kubernetes.io/minikube-addons=registry ...
I0910 17:49:28.730356 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:29.083987 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:29.217689 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:29.560967 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:29.722801 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:30.049488 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:30.216713 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:30.548296 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:30.718732 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:31.062310 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:31.215221 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:31.545701 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:31.714606 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:32.047046 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:32.240999 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:32.562866 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:32.726097 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:33.056327 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:33.217726 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:33.545590 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:33.718973 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:34.051317 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:34.215560 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:34.544717 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:34.717033 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:35.046137 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:35.225744 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:35.546514 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:35.719243 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:36.052954 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:36.216324 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:36.545980 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:36.752397 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:37.048138 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:37.218406 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:37.548777 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:37.725769 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:38.052333 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:38.213920 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:38.547668 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:38.925286 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:39.048982 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:39.232898 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:39.565336 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:39.722790 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:40.048063 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:40.217653 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:40.558367 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:40.727748 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:41.053070 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:41.238393 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:41.567677 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:41.737530 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:42.115893 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:42.220360 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:42.545405 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:42.727136 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:43.048880 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:43.225297 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:43.546375 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:43.723643 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:44.063656 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:44.224547 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:44.555980 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:44.718536 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:45.054948 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:45.216655 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:45.544861 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:45.713744 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:46.052654 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:46.219192 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:46.546028 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:46.716143 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:47.052839 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:47.221359 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:47.568098 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:47.718912 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:48.051608 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:48.215039 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:48.554422 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:48.754163 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:49.071169 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:49.216894 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:49.551745 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:49.715622 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:50.047581 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:50.214106 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:50.544751 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:50.715461 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:51.046889 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:51.230852 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:51.570242 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:51.719131 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:52.073847 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:52.228954 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:52.561919 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:52.730780 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:53.081706 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:53.226305 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:53.561275 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:53.726335 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:54.081118 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:54.229838 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:54.545430 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:54.713586 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:55.045001 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:55.246819 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:55.547270 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:55.715385 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:56.056013 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:56.237060 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:56.550305 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:56.722900 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:57.058466 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:57.255840 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:57.563224 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:57.719984 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:58.053655 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:58.226299 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:58.609083 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:58.868379 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:59.113558 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:59.378982 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:49:59.568326 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:49:59.763325 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:00.105648 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:00.227335 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:00.569888 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:00.720100 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:01.056659 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:01.219098 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:01.653844 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:01.801207 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:02.123980 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:02.227072 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:02.547476 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:02.721189 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:03.084958 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:03.263609 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:03.563940 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:03.724335 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:04.121565 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:04.214385 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:04.547672 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:04.715892 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:05.069081 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:05.248086 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:05.547790 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:05.714522 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:06.057132 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:06.223516 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:06.546928 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:06.716930 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:07.045221 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:07.224947 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:07.599374 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:07.716470 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:08.065158 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:08.222777 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:08.558892 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:08.748108 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:09.096327 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:09.216363 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:09.562311 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:09.720454 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:10.071141 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:10.320040 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:10.596161 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:10.734173 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:11.092950 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:11.219540 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:11.558954 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:11.719632 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:12.118903 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:12.258000 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:12.574239 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:12.742587 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:13.074120 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:13.221613 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:13.553618 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:13.747572 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:14.052347 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:14.221131 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:14.578934 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:14.759737 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:15.086407 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:15.257449 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:15.578588 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:15.762458 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:16.062562 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:16.244984 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:16.559597 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:16.717039 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:17.240657 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:17.243614 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:17.554774 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:17.719366 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:18.050546 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:18.215851 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:18.580653 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:18.756237 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:19.068434 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:19.216124 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:19.594856 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:19.855789 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:20.197358 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:20.273997 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:20.712924 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:20.760768 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:21.277920 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:21.516471 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:21.679352 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:21.972070 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:22.062968 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:22.218063 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:22.562340 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:22.804422 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:23.082077 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:23.230184 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:23.545548 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:23.745059 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:24.101516 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:24.598765 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:24.601111 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:24.934624 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:25.061567 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:25.217232 71609 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 17:50:25.561000 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:25.748985 71609 kapi.go:107] duration metric: took 1m15.041737283s to wait for app.kubernetes.io/name=ingress-nginx ...
I0910 17:50:26.076523 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:26.552430 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:27.052777 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:27.561239 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:28.056410 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:28.612084 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:29.108214 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:29.546502 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:30.044388 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:30.544814 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:31.056115 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:31.552632 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:32.091811 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:32.545043 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 17:50:33.045194 71609 kapi.go:107] duration metric: took 1m19.50729655s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0910 17:50:38.645608 71609 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0910 17:50:38.645638 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:39.145460 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:39.646156 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:40.144726 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:40.644607 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:41.146831 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:41.644554 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:42.144618 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:42.644717 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:43.144930 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:43.645175 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:44.144630 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:44.644593 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:45.145023 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:45.645051 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:46.145476 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:46.644621 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:47.144828 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:47.645423 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:48.144860 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:48.645355 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:49.145315 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:49.645907 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:50.144326 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:50.645188 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:51.144729 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:51.644800 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:52.144988 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:52.644877 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:53.147427 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:53.645116 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:54.144833 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:54.644521 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:55.145448 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:55.644295 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:56.144089 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:56.644506 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:57.145234 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:57.644435 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:58.150177 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:58.643887 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:59.145011 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:50:59.646146 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:00.144210 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:00.645701 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:01.144757 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:01.644408 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:02.144332 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:02.645747 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:03.145485 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:03.644801 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:04.144950 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:04.644191 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:05.144419 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:05.647405 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:06.144467 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:06.645000 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:07.148413 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:07.646460 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:08.144895 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:08.644334 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:09.144024 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:09.644972 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:10.144963 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:10.644580 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:11.145061 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:11.645109 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:12.143945 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:12.645425 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:13.144542 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:13.644675 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:14.145785 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:14.644659 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:15.145222 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:15.689754 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:16.152613 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:16.644235 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:17.144758 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:17.644725 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:18.145492 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:18.644938 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:19.194394 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:19.678499 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:20.151997 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:20.644471 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:21.144888 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:21.646628 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:22.144499 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:22.655708 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:23.145369 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:23.644208 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:24.144532 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:24.644642 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:25.145349 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:25.647781 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:26.145388 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:26.644552 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:27.145406 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:27.645080 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:28.144593 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:28.644991 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:29.145582 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:29.644464 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:30.144847 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:30.647369 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:31.144635 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:31.644723 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:32.144734 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:32.645142 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:33.144828 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:33.644681 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:34.145846 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:34.644507 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:35.145481 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:35.647535 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:36.145314 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:36.644863 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:37.147347 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:37.645016 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:38.144734 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:38.645235 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:39.145937 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:39.645097 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:40.144296 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:40.644819 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:41.145815 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:41.644971 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:42.145084 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:42.646807 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:43.145688 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:43.645282 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:44.148381 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:44.656198 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:45.148115 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:45.649568 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:46.151876 71609 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 17:51:46.645141 71609 kapi.go:107] duration metric: took 2m30.505513676s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0910 17:51:46.649008 71609 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-521995 cluster.
I0910 17:51:46.652022 71609 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0910 17:51:46.655820 71609 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0910 17:51:46.658938 71609 out.go:177] * Enabled addons: storage-provisioner, nvidia-device-plugin, default-storageclass, volcano, cloud-spanner, helm-tiller, ingress-dns, metrics-server, inspektor-gadget, yakd, storage-provisioner-rancher, volumesnapshots, registry, ingress, csi-hostpath-driver, gcp-auth
I0910 17:51:46.661680 71609 addons.go:510] duration metric: took 3m6.969183174s for enable addons: enabled=[storage-provisioner nvidia-device-plugin default-storageclass volcano cloud-spanner helm-tiller ingress-dns metrics-server inspektor-gadget yakd storage-provisioner-rancher volumesnapshots registry ingress csi-hostpath-driver gcp-auth]
I0910 17:51:46.661750 71609 start.go:246] waiting for cluster config update ...
I0910 17:51:46.661810 71609 start.go:255] writing updated cluster config ...
I0910 17:51:46.662389 71609 ssh_runner.go:195] Run: rm -f paused
I0910 17:51:47.154078 71609 start.go:600] kubectl: 1.31.0, cluster: 1.31.0 (minor skew: 0)
I0910 17:51:47.161049 71609 out.go:177] * Done! kubectl is now configured to use "addons-521995" cluster and "default" namespace by default
==> Docker <==
Sep 10 18:01:30 addons-521995 dockerd[1160]: time="2024-09-10T18:01:30.315500439Z" level=info msg="ignoring event" container=3ae1c43049efd9b187f8ba357c7c5687d41f14d90c889ce91791b1e03e8f40d0 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 10 18:01:30 addons-521995 dockerd[1160]: time="2024-09-10T18:01:30.387237469Z" level=info msg="ignoring event" container=f39cae700a827b1591c5b0670591e077be9a6b5d5db7f713a2f5988b538f07e7 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 10 18:01:30 addons-521995 dockerd[1160]: time="2024-09-10T18:01:30.653478063Z" level=info msg="ignoring event" container=c5ffe3a7fd1ffcf8eda91f8617cb9f25fa7bdefcbd9300c37166346507d17ac4 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 10 18:01:30 addons-521995 dockerd[1160]: time="2024-09-10T18:01:30.745195347Z" level=info msg="ignoring event" container=0b99ed86ab904e37d390a9f56477a135b5b0f06409a3bcabbf49b49d834ee69a module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 10 18:01:37 addons-521995 cri-dockerd[1418]: time="2024-09-10T18:01:37Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/9b899bbc9c6bcb0af63201b35863cd1dbc8ad548197ca954c754a8490981f8f8/resolv.conf as [nameserver 10.96.0.10 search kube-system.svc.cluster.local svc.cluster.local cluster.local us-east1-c.c.p79a29526b6c1e63c-tp.internal c.p79a29526b6c1e63c-tp.internal google.internal options ndots:5]"
Sep 10 18:01:39 addons-521995 cri-dockerd[1418]: time="2024-09-10T18:01:39Z" level=info msg="Stop pulling image docker.io/alpine/helm:2.16.3: Status: Downloaded newer image for alpine/helm:2.16.3"
Sep 10 18:01:39 addons-521995 dockerd[1160]: time="2024-09-10T18:01:39.323914303Z" level=info msg="Attempting next endpoint for pull after error: Head \"https://gcr.io/v2/k8s-minikube/busybox/manifests/latest\": unauthorized: authentication failed"
Sep 10 18:01:39 addons-521995 dockerd[1160]: time="2024-09-10T18:01:39.435203892Z" level=error msg="Handler for POST /v1.43/images/create returned error: Head \"https://gcr.io/v2/k8s-minikube/busybox/manifests/latest\": unauthorized: authentication failed"
Sep 10 18:01:39 addons-521995 dockerd[1160]: time="2024-09-10T18:01:39.886211231Z" level=info msg="ignoring event" container=54565baa749f5fb79df8eeec9f213ed9e739db195258ad33f84354b073217033 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 10 18:01:39 addons-521995 dockerd[1160]: time="2024-09-10T18:01:39.915046551Z" level=warning msg="failed to close stdin: NotFound: task 54565baa749f5fb79df8eeec9f213ed9e739db195258ad33f84354b073217033 not found: not found"
Sep 10 18:01:41 addons-521995 dockerd[1160]: time="2024-09-10T18:01:41.840485336Z" level=info msg="ignoring event" container=9b899bbc9c6bcb0af63201b35863cd1dbc8ad548197ca954c754a8490981f8f8 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 10 18:01:43 addons-521995 cri-dockerd[1418]: time="2024-09-10T18:01:43Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/c7c98cd54e250bd58a152bc9b67c5f46745a9e9899c9a8dd3aa19e9377d60255/resolv.conf as [nameserver 10.96.0.10 search kube-system.svc.cluster.local svc.cluster.local cluster.local us-east1-c.c.p79a29526b6c1e63c-tp.internal c.p79a29526b6c1e63c-tp.internal google.internal options ndots:5]"
Sep 10 18:01:43 addons-521995 dockerd[1160]: time="2024-09-10T18:01:43.804325735Z" level=info msg="ignoring event" container=02729daee0152c389a940b54db409bfe2e1a54ae56a1e2d3d4db66d2746fc720 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 10 18:01:43 addons-521995 dockerd[1160]: time="2024-09-10T18:01:43.839540237Z" level=warning msg="failed to close stdin: NotFound: task 02729daee0152c389a940b54db409bfe2e1a54ae56a1e2d3d4db66d2746fc720 not found: not found"
Sep 10 18:01:45 addons-521995 dockerd[1160]: time="2024-09-10T18:01:45.008932075Z" level=info msg="ignoring event" container=c7c98cd54e250bd58a152bc9b67c5f46745a9e9899c9a8dd3aa19e9377d60255 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 10 18:01:45 addons-521995 dockerd[1160]: time="2024-09-10T18:01:45.842367927Z" level=info msg="ignoring event" container=b179042fbb3272780c34cbc49295813dddb51783520cc3e95a711f8e8e6000eb module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 10 18:01:46 addons-521995 dockerd[1160]: time="2024-09-10T18:01:46.136823333Z" level=info msg="ignoring event" container=24b840634b475ee79ca73319b8f062a321fe48569071527c40ac2d7f97f56937 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 10 18:01:53 addons-521995 dockerd[1160]: time="2024-09-10T18:01:53.441127984Z" level=info msg="ignoring event" container=d392cc3f522271b08eee7146c95fcebc4086a85d33658d88c6dfa5f614ad70af module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 10 18:01:54 addons-521995 dockerd[1160]: time="2024-09-10T18:01:54.058014040Z" level=info msg="ignoring event" container=28967a34f5b8339bcd1eeadc2d0b684d36d43193ea7179479280a367ffd848dc module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 10 18:01:54 addons-521995 cri-dockerd[1418]: time="2024-09-10T18:01:54Z" level=info msg="Failed to read pod IP from plugin/docker: networkPlugin cni failed on the status hook for pod \"metrics-server-84c5f94fbc-fb9nq_kube-system\": unexpected command output nsenter: cannot open /proc/3725/ns/net: No such file or directory\n with error: exit status 1"
Sep 10 18:01:54 addons-521995 dockerd[1160]: time="2024-09-10T18:01:54.321769385Z" level=info msg="ignoring event" container=8223e2a25615774203c43ecb5aa41525251692d466e2376b019699ecdcd6eb18 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 10 18:01:54 addons-521995 dockerd[1160]: time="2024-09-10T18:01:54.627989206Z" level=info msg="ignoring event" container=19da7412b678c28a14c0faa372206e0978f910493195344d1d5d73596d0ee3cc module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 10 18:01:54 addons-521995 dockerd[1160]: time="2024-09-10T18:01:54.813780147Z" level=info msg="ignoring event" container=9d806248fcac09156d1f09574ade8e523d7f409a5af215a66204ebb8de60884e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 10 18:01:54 addons-521995 dockerd[1160]: time="2024-09-10T18:01:54.923747271Z" level=info msg="ignoring event" container=232688509ffaa15d2df30eb40dbfdaab6a2ace442f783558941621377daa6a0c module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 10 18:01:55 addons-521995 dockerd[1160]: time="2024-09-10T18:01:55.229296315Z" level=info msg="ignoring event" container=83ddee74d53b023ecfd8e018d6b0732fd54bf60f4ec1b463fe7eb50407353d5f module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
54565baa749f5 alpine/helm@sha256:9d9fab00e0680f1328924429925595dfe96a68531c8a9c1518d05ee2ad45c36f 17 seconds ago Exited helm-test 0 9b899bbc9c6bc helm-test
ee51b6640a70e ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec 30 seconds ago Exited gadget 7 b08d42caa82ad gadget-9zmzb
da9ba839c6142 gcr.io/k8s-minikube/gcp-auth-webhook@sha256:e6c5b3bc32072ea370d34c27836efd11b3519d25bd444c2a8efc339cff0e20fb 10 minutes ago Running gcp-auth 0 b523ceaafe15d gcp-auth-89d5ffd79-htlvz
2aa389f7b1c00 registry.k8s.io/ingress-nginx/controller@sha256:d5f8217feeac4887cb1ed21f27c2674e58be06bd8f5184cacea2a69abaf78dce 11 minutes ago Running controller 0 2683b127372bf ingress-nginx-controller-bc57996ff-k6kr9
6daeae40245c8 registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a320a50cc91bd15fd2d6fa6de58bd98c1bd64b9a6f926ce23a600d87043455a3 11 minutes ago Exited patch 0 8ac87bbf512fa ingress-nginx-admission-patch-klb4b
7b35056f3da81 registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a320a50cc91bd15fd2d6fa6de58bd98c1bd64b9a6f926ce23a600d87043455a3 11 minutes ago Exited create 0 08a066ed004e2 ingress-nginx-admission-create-4q7lz
b2b7098628e6a marcnuri/yakd@sha256:c5414196116a2266ad097b0468833b73ef1d6c7922241115fe203fb826381624 12 minutes ago Running yakd 0 e305a3b7ecc79 yakd-dashboard-67d98fc6b-5h9ks
0ac1bd22e2a96 rancher/local-path-provisioner@sha256:e34c88ae0affb1cdefbb874140d6339d4a27ec4ee420ae8199cd839997b05246 12 minutes ago Running local-path-provisioner 0 45dfe05f057e8 local-path-provisioner-86d989889c-48ktm
0a3c4d26805bd gcr.io/k8s-minikube/minikube-ingress-dns@sha256:4211a1de532376c881851542238121b26792225faa36a7b02dccad88fd05797c 12 minutes ago Running minikube-ingress-dns 0 44a5884f94f33 kube-ingress-dns-minikube
20794d5320be6 gcr.io/cloud-spanner-emulator/emulator@sha256:636fdfc528824bae5f0ea2eca6ae307fe81092f05ec21038008bc0d6100e52fc 12 minutes ago Running cloud-spanner-emulator 0 a3a38f6a92fd3 cloud-spanner-emulator-769b77f747-nwmrz
a438f3ddc859a nvcr.io/nvidia/k8s-device-plugin@sha256:ed39e22c8b71343fb996737741a99da88ce6c75dd83b5c520e0b3d8e8a884c47 12 minutes ago Running nvidia-device-plugin-ctr 0 f4368a217d187 nvidia-device-plugin-daemonset-49rbk
ff89d888bf3bb 6e38f40d628db 12 minutes ago Running storage-provisioner 0 bc10e0dafeab2 storage-provisioner
4eba00d7dc161 cbb01a7bd410d 13 minutes ago Running coredns 0 586a00228b95b coredns-6f6b679f8f-ngrsx
d7c362463a568 ad83b2ca7b09e 13 minutes ago Running kube-proxy 0 590084a8ddaf8 kube-proxy-zhwb9
1f76112d37553 045733566833c 13 minutes ago Running kube-controller-manager 0 a6b9caf5314b8 kube-controller-manager-addons-521995
7a271c072fdb3 2e96e5913fc06 13 minutes ago Running etcd 0 7eb678ccdb049 etcd-addons-521995
6afe6ef5460ed 1766f54c897f0 13 minutes ago Running kube-scheduler 0 91d6de49964e9 kube-scheduler-addons-521995
97f9ef523fa93 604f5db92eaa8 13 minutes ago Running kube-apiserver 0 2805e8f11fac6 kube-apiserver-addons-521995
==> controller_ingress [2aa389f7b1c0] <==
Build: 46e76e5916813cfca2a9b0bfdc34b69a0000f6b9
Repository: https://github.com/kubernetes/ingress-nginx
nginx version: nginx/1.25.5
-------------------------------------------------------------------------------
W0910 17:50:25.280121 7 client_config.go:659] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
I0910 17:50:25.283805 7 main.go:205] "Creating API client" host="https://10.96.0.1:443"
I0910 17:50:25.330689 7 main.go:248] "Running in Kubernetes cluster" major="1" minor="31" git="v1.31.0" state="clean" commit="9edcffcde5595e8a5b1a35f88c421764e575afce" platform="linux/amd64"
I0910 17:50:26.545777 7 main.go:101] "SSL fake certificate created" file="/etc/ingress-controller/ssl/default-fake-certificate.pem"
I0910 17:50:26.624050 7 ssl.go:535] "loading tls certificate" path="/usr/local/certificates/cert" key="/usr/local/certificates/key"
I0910 17:50:26.694339 7 nginx.go:271] "Starting NGINX Ingress controller"
I0910 17:50:26.749304 7 event.go:377] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"ingress-nginx", Name:"ingress-nginx-controller", UID:"6d0aadc0-76e4-4c69-8360-ee0d7c6e5d94", APIVersion:"v1", ResourceVersion:"665", FieldPath:""}): type: 'Normal' reason: 'CREATE' ConfigMap ingress-nginx/ingress-nginx-controller
I0910 17:50:26.751966 7 event.go:377] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"ingress-nginx", Name:"tcp-services", UID:"2e356a4f-2b4a-4a46-acb9-6cd3c3df1b88", APIVersion:"v1", ResourceVersion:"675", FieldPath:""}): type: 'Normal' reason: 'CREATE' ConfigMap ingress-nginx/tcp-services
I0910 17:50:26.753476 7 event.go:377] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"ingress-nginx", Name:"udp-services", UID:"e76db6e3-f3a6-4877-aa76-50de58bbc99e", APIVersion:"v1", ResourceVersion:"681", FieldPath:""}): type: 'Normal' reason: 'CREATE' ConfigMap ingress-nginx/udp-services
I0910 17:50:27.901502 7 nginx.go:317] "Starting NGINX process"
I0910 17:50:27.902675 7 leaderelection.go:250] attempting to acquire leader lease ingress-nginx/ingress-nginx-leader...
I0910 17:50:27.903926 7 nginx.go:337] "Starting validation webhook" address=":8443" certPath="/usr/local/certificates/cert" keyPath="/usr/local/certificates/key"
I0910 17:50:27.904632 7 controller.go:193] "Configuration changes detected, backend reload required"
I0910 17:50:27.919195 7 leaderelection.go:260] successfully acquired lease ingress-nginx/ingress-nginx-leader
I0910 17:50:27.919781 7 status.go:85] "New leader elected" identity="ingress-nginx-controller-bc57996ff-k6kr9"
I0910 17:50:27.954508 7 status.go:219] "POD is not ready" pod="ingress-nginx/ingress-nginx-controller-bc57996ff-k6kr9" node="addons-521995"
I0910 17:50:28.116508 7 controller.go:213] "Backend successfully reloaded"
I0910 17:50:28.116759 7 controller.go:224] "Initial sync, sleeping for 1 second"
I0910 17:50:28.116924 7 event.go:377] Event(v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-bc57996ff-k6kr9", UID:"76236a70-02c3-4467-99e6-07f4fdf4038b", APIVersion:"v1", ResourceVersion:"1256", FieldPath:""}): type: 'Normal' reason: 'RELOAD' NGINX reload triggered due to a change in configuration
==> coredns [4eba00d7dc16] <==
[INFO] 10.244.0.8:56342 - 53497 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000037792s
[INFO] 10.244.0.8:56439 - 37619 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000056042s
[INFO] 10.244.0.8:56439 - 7151 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000052807s
[INFO] 10.244.0.8:48404 - 5150 "A IN registry.kube-system.svc.cluster.local.us-east1-c.c.p79a29526b6c1e63c-tp.internal. udp 99 false 512" NXDOMAIN qr,aa,rd,ra 206 0.000074253s
[INFO] 10.244.0.8:48404 - 60955 "AAAA IN registry.kube-system.svc.cluster.local.us-east1-c.c.p79a29526b6c1e63c-tp.internal. udp 99 false 512" NXDOMAIN qr,aa,rd,ra 206 0.000063897s
[INFO] 10.244.0.8:50377 - 43499 "A IN registry.kube-system.svc.cluster.local.c.p79a29526b6c1e63c-tp.internal. udp 88 false 512" NXDOMAIN qr,aa,rd,ra 193 0.000066737s
[INFO] 10.244.0.8:50377 - 3311 "AAAA IN registry.kube-system.svc.cluster.local.c.p79a29526b6c1e63c-tp.internal. udp 88 false 512" NXDOMAIN qr,aa,rd,ra 193 0.000055934s
[INFO] 10.244.0.8:48539 - 62691 "AAAA IN registry.kube-system.svc.cluster.local.google.internal. udp 72 false 512" NXDOMAIN qr,aa,rd,ra 177 0.000063034s
[INFO] 10.244.0.8:48539 - 52974 "A IN registry.kube-system.svc.cluster.local.google.internal. udp 72 false 512" NXDOMAIN qr,aa,rd,ra 177 0.000034061s
[INFO] 10.244.0.8:60953 - 65398 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.00007925s
[INFO] 10.244.0.8:60953 - 28020 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000470943s
[INFO] 10.244.0.26:50979 - 653 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000479067s
[INFO] 10.244.0.26:58898 - 26955 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.00081221s
[INFO] 10.244.0.26:44662 - 21332 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000341841s
[INFO] 10.244.0.26:43293 - 44502 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000578226s
[INFO] 10.244.0.26:47633 - 1712 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000137192s
[INFO] 10.244.0.26:53776 - 55633 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000160382s
[INFO] 10.244.0.26:52244 - 55319 "AAAA IN storage.googleapis.com.us-east1-c.c.p79a29526b6c1e63c-tp.internal. udp 94 false 1232" NXDOMAIN qr,rd,ra 190 0.004113987s
[INFO] 10.244.0.26:39483 - 47704 "A IN storage.googleapis.com.us-east1-c.c.p79a29526b6c1e63c-tp.internal. udp 94 false 1232" NXDOMAIN qr,rd,ra 190 0.004577864s
[INFO] 10.244.0.26:52752 - 14516 "AAAA IN storage.googleapis.com.c.p79a29526b6c1e63c-tp.internal. udp 83 false 1232" NXDOMAIN qr,rd,ra 177 0.003549981s
[INFO] 10.244.0.26:60567 - 52803 "A IN storage.googleapis.com.c.p79a29526b6c1e63c-tp.internal. udp 83 false 1232" NXDOMAIN qr,rd,ra 177 0.004836428s
[INFO] 10.244.0.26:40820 - 26268 "A IN storage.googleapis.com.google.internal. udp 67 false 1232" NXDOMAIN qr,rd,ra 161 0.004178779s
[INFO] 10.244.0.26:32815 - 17528 "AAAA IN storage.googleapis.com.google.internal. udp 67 false 1232" NXDOMAIN qr,rd,ra 161 0.004147175s
[INFO] 10.244.0.26:35234 - 6070 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 648 0.003243896s
[INFO] 10.244.0.26:46352 - 63303 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.003380139s
==> describe nodes <==
Name: addons-521995
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=addons-521995
kubernetes.io/os=linux
minikube.k8s.io/commit=37b4bace07cd53444288cad630e4db4b688b8c18
minikube.k8s.io/name=addons-521995
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_09_10T17_48_35_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-521995
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Tue, 10 Sep 2024 17:48:32 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-521995
AcquireTime: <unset>
RenewTime: Tue, 10 Sep 2024 18:01:51 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Tue, 10 Sep 2024 17:57:44 +0000 Tue, 10 Sep 2024 17:48:29 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Tue, 10 Sep 2024 17:57:44 +0000 Tue, 10 Sep 2024 17:48:29 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Tue, 10 Sep 2024 17:57:44 +0000 Tue, 10 Sep 2024 17:48:29 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Tue, 10 Sep 2024 17:57:44 +0000 Tue, 10 Sep 2024 17:48:32 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-521995
Capacity:
cpu: 2
ephemeral-storage: 119475748Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 8141772Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 119475748Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 8141772Ki
pods: 110
System Info:
Machine ID: a9686b739c13439e8cde87ca31378cd9
System UUID: 63485c03-162c-4c6d-b357-b8a54af033ee
Boot ID: e30a8a3b-e409-4351-b9ea-efa1f869e37c
Kernel Version: 6.1.100+
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: amd64
Container Runtime Version: docker://27.2.1
Kubelet Version: v1.31.0
Kube-Proxy Version:
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (16 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 9m20s
default cloud-spanner-emulator-769b77f747-nwmrz 0 (0%) 0 (0%) 0 (0%) 0 (0%) 13m
gadget gadget-9zmzb 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
gcp-auth gcp-auth-89d5ffd79-htlvz 0 (0%) 0 (0%) 0 (0%) 0 (0%) 11m
ingress-nginx ingress-nginx-controller-bc57996ff-k6kr9 100m (5%) 0 (0%) 90Mi (1%) 0 (0%) 12m
kube-system coredns-6f6b679f8f-ngrsx 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 13m
kube-system etcd-addons-521995 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 13m
kube-system kube-apiserver-addons-521995 250m (12%) 0 (0%) 0 (0%) 0 (0%) 13m
kube-system kube-controller-manager-addons-521995 200m (10%) 0 (0%) 0 (0%) 0 (0%) 13m
kube-system kube-ingress-dns-minikube 0 (0%) 0 (0%) 0 (0%) 0 (0%) 13m
kube-system kube-proxy-zhwb9 0 (0%) 0 (0%) 0 (0%) 0 (0%) 13m
kube-system kube-scheduler-addons-521995 100m (5%) 0 (0%) 0 (0%) 0 (0%) 13m
kube-system nvidia-device-plugin-daemonset-49rbk 0 (0%) 0 (0%) 0 (0%) 0 (0%) 13m
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 13m
local-path-storage local-path-provisioner-86d989889c-48ktm 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
yakd-dashboard yakd-dashboard-67d98fc6b-5h9ks 0 (0%) 0 (0%) 128Mi (1%) 256Mi (3%) 12m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (42%) 0 (0%)
memory 388Mi (4%) 426Mi (5%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 13m kube-proxy
Normal Starting 13m kubelet Starting kubelet.
Normal NodeHasSufficientMemory 13m kubelet Node addons-521995 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 13m kubelet Node addons-521995 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 13m kubelet Node addons-521995 status is now: NodeHasSufficientPID
Normal RegisteredNode 13m node-controller Node addons-521995 event: Registered Node addons-521995 in Controller
==> dmesg <==
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff f6 1a 4f dc 94 03 08 06
[ +2.206511] IPv4: martian source 10.244.0.1 from 10.244.0.18, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff ae 41 7d 6b 15 54 08 06
[ +8.040261] IPv4: martian source 10.244.0.1 from 10.244.0.22, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff ce 0b 33 6d 16 f6 08 06
[ +12.807443] IPv4: martian source 10.244.0.1 from 10.244.0.23, on dev eth0
[ +0.000012] ll header: 00000000: ff ff ff ff ff ff 22 34 60 90 73 56 08 06
[ +1.764640] IPv4: martian source 10.244.0.1 from 10.244.0.20, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff a6 c5 a2 f6 6a e6 08 06
[ +0.148165] IPv4: martian source 10.244.0.1 from 10.244.0.21, on dev eth0
[ +0.000011] ll header: 00000000: ff ff ff ff ff ff 92 f1 9a bc 38 72 08 06
[ +0.329250] IPv4: martian source 10.244.0.1 from 10.244.0.19, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff 4a 3d 01 18 2e b4 08 06
[Sep10 17:51] IPv4: martian source 10.244.0.1 from 10.244.0.24, on dev eth0
[ +0.000011] ll header: 00000000: ff ff ff ff ff ff 16 2a a2 67 f5 ed 08 06
[ +0.499880] IPv4: martian source 10.244.0.1 from 10.244.0.25, on dev eth0
[ +0.000010] ll header: 00000000: ff ff ff ff ff ff 06 1c f5 b0 75 56 08 06
[ +25.469141] IPv4: martian source 10.244.0.1 from 10.244.0.26, on dev eth0
[ +0.000010] ll header: 00000000: ff ff ff ff ff ff 06 52 19 90 fe 5d 08 06
[ +0.000899] IPv4: martian source 10.244.0.26 from 10.244.0.3, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 86 e4 b8 28 5e b5 08 06
[Sep10 18:01] IPv4: martian source 10.244.0.1 from 10.244.0.32, on dev eth0
[ +0.000010] ll header: 00000000: ff ff ff ff ff ff ce 0c c6 7f c3 f4 08 06
[ +3.885307] IPv4: martian source 10.244.0.1 from 10.244.0.33, on dev eth0
[ +0.000010] ll header: 00000000: ff ff ff ff ff ff be fc ae 01 5d 51 08 06
==> etcd [7a271c072fdb] <==
{"level":"warn","ts":"2024-09-10T17:50:24.577567Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"470.01188ms","expected-duration":"100ms","prefix":"read-only range ","request":"limit:1 keys_only:true ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2024-09-10T17:50:24.577666Z","caller":"traceutil/trace.go:171","msg":"trace[1268026863] range","detail":"{range_begin:; range_end:; response_count:0; response_revision:1253; }","duration":"470.128894ms","start":"2024-09-10T17:50:24.107526Z","end":"2024-09-10T17:50:24.577655Z","steps":["trace[1268026863] 'agreement among raft nodes before linearized reading' (duration: 469.996998ms)"],"step_count":1}
{"level":"warn","ts":"2024-09-10T17:50:24.577873Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"434.743658ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods\" limit:1 ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2024-09-10T17:50:24.577918Z","caller":"traceutil/trace.go:171","msg":"trace[2000299001] range","detail":"{range_begin:/registry/pods; range_end:; response_count:0; response_revision:1253; }","duration":"434.793421ms","start":"2024-09-10T17:50:24.143116Z","end":"2024-09-10T17:50:24.577909Z","steps":["trace[2000299001] 'agreement among raft nodes before linearized reading' (duration: 434.724398ms)"],"step_count":1}
{"level":"warn","ts":"2024-09-10T17:50:24.577957Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2024-09-10T17:50:24.143068Z","time spent":"434.877734ms","remote":"127.0.0.1:51830","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/pods\" limit:1 "}
{"level":"warn","ts":"2024-09-10T17:50:24.585933Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"375.209036ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods\" limit:1 ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2024-09-10T17:50:24.587960Z","caller":"traceutil/trace.go:171","msg":"trace[355742086] range","detail":"{range_begin:/registry/pods; range_end:; response_count:0; response_revision:1253; }","duration":"376.191851ms","start":"2024-09-10T17:50:24.210487Z","end":"2024-09-10T17:50:24.586679Z","steps":["trace[355742086] 'agreement among raft nodes before linearized reading' (duration: 372.049567ms)"],"step_count":1}
{"level":"warn","ts":"2024-09-10T17:50:24.588062Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2024-09-10T17:50:24.210439Z","time spent":"377.595571ms","remote":"127.0.0.1:51830","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/pods\" limit:1 "}
{"level":"warn","ts":"2024-09-10T17:50:24.588210Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"129.543795ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/validatingwebhookconfigurations/\" range_end:\"/registry/validatingwebhookconfigurations0\" count_only:true ","response":"range_response_count:0 size:7"}
{"level":"info","ts":"2024-09-10T17:50:24.588244Z","caller":"traceutil/trace.go:171","msg":"trace[749318366] range","detail":"{range_begin:/registry/validatingwebhookconfigurations/; range_end:/registry/validatingwebhookconfigurations0; response_count:0; response_revision:1253; }","duration":"129.578496ms","start":"2024-09-10T17:50:24.458653Z","end":"2024-09-10T17:50:24.588231Z","steps":["trace[749318366] 'agreement among raft nodes before linearized reading' (duration: 129.512771ms)"],"step_count":1}
{"level":"warn","ts":"2024-09-10T17:50:24.930999Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"220.249704ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods\" limit:1 ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2024-09-10T17:50:24.931073Z","caller":"traceutil/trace.go:171","msg":"trace[176454987] range","detail":"{range_begin:/registry/pods; range_end:; response_count:0; response_revision:1253; }","duration":"220.338845ms","start":"2024-09-10T17:50:24.710718Z","end":"2024-09-10T17:50:24.931057Z","steps":["trace[176454987] 'range keys from in-memory index tree' (duration: 220.110474ms)"],"step_count":1}
{"level":"info","ts":"2024-09-10T17:50:25.482755Z","caller":"traceutil/trace.go:171","msg":"trace[445787121] transaction","detail":"{read_only:false; response_revision:1259; number_of_response:1; }","duration":"150.795336ms","start":"2024-09-10T17:50:25.331924Z","end":"2024-09-10T17:50:25.482719Z","steps":["trace[445787121] 'process raft request' (duration: 150.534926ms)"],"step_count":1}
{"level":"info","ts":"2024-09-10T17:52:17.295915Z","caller":"traceutil/trace.go:171","msg":"trace[1889502678] linearizableReadLoop","detail":"{readStateIndex:1636; appliedIndex:1635; }","duration":"255.551627ms","start":"2024-09-10T17:52:17.040340Z","end":"2024-09-10T17:52:17.295892Z","steps":["trace[1889502678] 'read index received' (duration: 255.338012ms)","trace[1889502678] 'applied index is now lower than readState.Index' (duration: 212.886µs)"],"step_count":2}
{"level":"info","ts":"2024-09-10T17:52:17.296345Z","caller":"traceutil/trace.go:171","msg":"trace[1738385911] transaction","detail":"{read_only:false; response_revision:1571; number_of_response:1; }","duration":"407.974855ms","start":"2024-09-10T17:52:16.888343Z","end":"2024-09-10T17:52:17.296318Z","steps":["trace[1738385911] 'process raft request' (duration: 407.398798ms)"],"step_count":1}
{"level":"warn","ts":"2024-09-10T17:52:17.296483Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2024-09-10T17:52:16.888207Z","time spent":"408.17822ms","remote":"127.0.0.1:51806","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1098,"response count":0,"response size":40,"request content":"compare:<target:MOD key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" mod_revision:1569 > success:<request_put:<key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" value_size:1025 >> failure:<request_range:<key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" > >"}
{"level":"warn","ts":"2024-09-10T17:52:17.296701Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"256.354874ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2024-09-10T17:52:17.296743Z","caller":"traceutil/trace.go:171","msg":"trace[880807066] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1571; }","duration":"256.405806ms","start":"2024-09-10T17:52:17.040326Z","end":"2024-09-10T17:52:17.296732Z","steps":["trace[880807066] 'agreement among raft nodes before linearized reading' (duration: 256.328424ms)"],"step_count":1}
{"level":"warn","ts":"2024-09-10T17:52:17.298404Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"227.149601ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/\" range_end:\"/registry/serviceaccounts0\" count_only:true ","response":"range_response_count:0 size:7"}
{"level":"info","ts":"2024-09-10T17:52:17.298779Z","caller":"traceutil/trace.go:171","msg":"trace[1774644669] range","detail":"{range_begin:/registry/serviceaccounts/; range_end:/registry/serviceaccounts0; response_count:0; response_revision:1571; }","duration":"227.536832ms","start":"2024-09-10T17:52:17.071224Z","end":"2024-09-10T17:52:17.298761Z","steps":["trace[1774644669] 'agreement among raft nodes before linearized reading' (duration: 227.060446ms)"],"step_count":1}
{"level":"warn","ts":"2024-09-10T17:52:17.298461Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"191.056551ms","expected-duration":"100ms","prefix":"read-only range ","request":"limit:1 keys_only:true ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2024-09-10T17:52:17.298954Z","caller":"traceutil/trace.go:171","msg":"trace[256425197] range","detail":"{range_begin:; range_end:; response_count:0; response_revision:1571; }","duration":"191.546067ms","start":"2024-09-10T17:52:17.107398Z","end":"2024-09-10T17:52:17.298944Z","steps":["trace[256425197] 'agreement among raft nodes before linearized reading' (duration: 191.047107ms)"],"step_count":1}
{"level":"info","ts":"2024-09-10T17:58:30.268813Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1837}
{"level":"info","ts":"2024-09-10T17:58:30.482789Z","caller":"mvcc/kvstore_compaction.go:69","msg":"finished scheduled compaction","compact-revision":1837,"took":"213.145975ms","hash":3326184582,"current-db-size-bytes":9359360,"current-db-size":"9.4 MB","current-db-size-in-use-bytes":4923392,"current-db-size-in-use":"4.9 MB"}
{"level":"info","ts":"2024-09-10T17:58:30.482864Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":3326184582,"revision":1837,"compact-revision":-1}
==> gcp-auth [da9ba839c614] <==
2024/09/10 17:51:45 GCP Auth Webhook started!
2024/09/10 17:52:07 Ready to marshal response ...
2024/09/10 17:52:07 Ready to write response ...
2024/09/10 17:52:08 Ready to marshal response ...
2024/09/10 17:52:08 Ready to write response ...
2024/09/10 17:52:36 Ready to marshal response ...
2024/09/10 17:52:36 Ready to write response ...
2024/09/10 17:52:36 Ready to marshal response ...
2024/09/10 17:52:36 Ready to write response ...
2024/09/10 17:52:36 Ready to marshal response ...
2024/09/10 17:52:36 Ready to write response ...
2024/09/10 18:00:53 Ready to marshal response ...
2024/09/10 18:00:53 Ready to write response ...
2024/09/10 18:00:58 Ready to marshal response ...
2024/09/10 18:00:58 Ready to write response ...
2024/09/10 18:01:12 Ready to marshal response ...
2024/09/10 18:01:12 Ready to write response ...
2024/09/10 18:01:36 Ready to marshal response ...
2024/09/10 18:01:36 Ready to write response ...
2024/09/10 18:01:42 Ready to marshal response ...
2024/09/10 18:01:42 Ready to write response ...
==> kernel <==
18:01:56 up 1:11, 0 users, load average: 1.47, 1.48, 2.11
Linux addons-521995 6.1.100+ #1 SMP PREEMPT_DYNAMIC Sat Aug 17 14:12:26 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kube-apiserver [97f9ef523fa9] <==
I0910 17:52:28.869884 1 handler.go:286] Adding GroupVersion flow.volcano.sh v1alpha1 to ResourceManager
W0910 17:52:29.017747 1 cacher.go:171] Terminating all watchers from cacher podgroups.scheduling.volcano.sh
W0910 17:52:29.328598 1 cacher.go:171] Terminating all watchers from cacher numatopologies.nodeinfo.volcano.sh
W0910 17:52:29.329969 1 cacher.go:171] Terminating all watchers from cacher jobs.batch.volcano.sh
W0910 17:52:29.413516 1 cacher.go:171] Terminating all watchers from cacher queues.scheduling.volcano.sh
W0910 17:52:29.870043 1 cacher.go:171] Terminating all watchers from cacher jobflows.flow.volcano.sh
W0910 17:52:30.575617 1 cacher.go:171] Terminating all watchers from cacher jobtemplates.flow.volcano.sh
I0910 18:01:06.779325 1 controller.go:615] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io
I0910 18:01:30.041664 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0910 18:01:30.042193 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0910 18:01:30.078423 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0910 18:01:30.078697 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0910 18:01:30.124641 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0910 18:01:30.124900 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0910 18:01:30.168458 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0910 18:01:30.168699 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0910 18:01:30.183561 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0910 18:01:30.184537 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
E0910 18:01:30.342035 1 watch.go:250] "Unhandled Error" err="http2: stream closed" logger="UnhandledError"
W0910 18:01:31.169233 1 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io
W0910 18:01:31.183728 1 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io
W0910 18:01:31.327530 1 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io
E0910 18:01:39.747514 1 conn.go:339] Error on socket receive: read tcp 192.168.49.2:8443->192.168.49.1:45600: use of closed network connection
E0910 18:01:39.863144 1 upgradeaware.go:427] Error proxying data from client to backend: read tcp 192.168.49.2:8443->10.244.0.32:42698: read: connection reset by peer
E0910 18:01:43.753146 1 upgradeaware.go:427] Error proxying data from client to backend: read tcp 192.168.49.2:8443->10.244.0.33:58406: read: connection reset by peer
==> kube-controller-manager [1f76112d3755] <==
W0910 18:01:35.817362 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0910 18:01:35.817417 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0910 18:01:39.640717 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0910 18:01:39.640794 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0910 18:01:40.503389 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0910 18:01:40.503446 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
I0910 18:01:41.351229 1 shared_informer.go:313] Waiting for caches to sync for resource quota
I0910 18:01:41.351290 1 shared_informer.go:320] Caches are synced for resource quota
W0910 18:01:41.622288 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0910 18:01:41.622352 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
I0910 18:01:42.932036 1 shared_informer.go:313] Waiting for caches to sync for garbage collector
I0910 18:01:42.932131 1 shared_informer.go:320] Caches are synced for garbage collector
I0910 18:01:45.744325 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/tiller-deploy-b48cc5f79" duration="8.918µs"
W0910 18:01:47.526190 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0910 18:01:47.526288 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0910 18:01:48.111383 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0910 18:01:48.111442 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0910 18:01:48.276100 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0910 18:01:48.276169 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
I0910 18:01:52.855203 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/metrics-server-84c5f94fbc" duration="11.965µs"
W0910 18:01:53.230958 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0910 18:01:53.231015 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
I0910 18:01:54.529207 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/registry-66c9cd494c" duration="7.703µs"
W0910 18:01:56.681632 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0910 18:01:56.681688 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
==> kube-proxy [d7c362463a56] <==
I0910 17:48:49.535204 1 server_linux.go:66] "Using iptables proxy"
I0910 17:48:53.314047 1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
E0910 17:48:53.314372 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I0910 17:48:54.364030 1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I0910 17:48:54.364223 1 server_linux.go:169] "Using iptables Proxier"
I0910 17:48:54.472513 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I0910 17:48:54.476656 1 server.go:483] "Version info" version="v1.31.0"
I0910 17:48:54.476810 1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0910 17:48:54.495645 1 config.go:197] "Starting service config controller"
I0910 17:48:54.497319 1 shared_informer.go:313] Waiting for caches to sync for service config
I0910 17:48:54.495957 1 config.go:326] "Starting node config controller"
I0910 17:48:54.497359 1 shared_informer.go:313] Waiting for caches to sync for node config
I0910 17:48:54.496812 1 config.go:104] "Starting endpoint slice config controller"
I0910 17:48:54.497390 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0910 17:48:54.800485 1 shared_informer.go:320] Caches are synced for endpoint slice config
I0910 17:48:54.903504 1 shared_informer.go:320] Caches are synced for service config
I0910 17:48:54.916120 1 shared_informer.go:320] Caches are synced for node config
==> kube-scheduler [6afe6ef5460e] <==
E0910 17:48:32.258393 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0910 17:48:32.255921 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0910 17:48:32.258500 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0910 17:48:32.255926 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0910 17:48:32.258854 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError"
E0910 17:48:32.258140 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0910 17:48:33.118998 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0910 17:48:33.119054 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0910 17:48:33.145026 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0910 17:48:33.145432 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0910 17:48:33.156635 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0910 17:48:33.156990 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0910 17:48:33.202041 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0910 17:48:33.202324 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0910 17:48:33.260867 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0910 17:48:33.261763 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0910 17:48:33.351462 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
E0910 17:48:33.351793 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0910 17:48:33.485465 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0910 17:48:33.485983 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0910 17:48:33.534561 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0910 17:48:33.534907 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError"
W0910 17:48:33.564364 1 reflector.go:561] runtime/asm_amd64.s:1695: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0910 17:48:33.564418 1 reflector.go:158] "Unhandled Error" err="runtime/asm_amd64.s:1695: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"
I0910 17:48:35.541543 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Sep 10 18:01:54 addons-521995 kubelet[2177]: I0910 18:01:54.515116 2177 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b74f6a0-0605-403c-88b5-a0026b395720-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6b74f6a0-0605-403c-88b5-a0026b395720" (UID: "6b74f6a0-0605-403c-88b5-a0026b395720"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGidValue ""
Sep 10 18:01:54 addons-521995 kubelet[2177]: I0910 18:01:54.524731 2177 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b74f6a0-0605-403c-88b5-a0026b395720-kube-api-access-k6wvr" (OuterVolumeSpecName: "kube-api-access-k6wvr") pod "6b74f6a0-0605-403c-88b5-a0026b395720" (UID: "6b74f6a0-0605-403c-88b5-a0026b395720"). InnerVolumeSpecName "kube-api-access-k6wvr". PluginName "kubernetes.io/projected", VolumeGidValue ""
Sep 10 18:01:54 addons-521995 kubelet[2177]: I0910 18:01:54.614363 2177 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-k6wvr\" (UniqueName: \"kubernetes.io/projected/6b74f6a0-0605-403c-88b5-a0026b395720-kube-api-access-k6wvr\") on node \"addons-521995\" DevicePath \"\""
Sep 10 18:01:54 addons-521995 kubelet[2177]: I0910 18:01:54.614426 2177 reconciler_common.go:288] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b74f6a0-0605-403c-88b5-a0026b395720-tmp-dir\") on node \"addons-521995\" DevicePath \"\""
Sep 10 18:01:55 addons-521995 kubelet[2177]: I0910 18:01:55.124074 2177 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmjw9\" (UniqueName: \"kubernetes.io/projected/afcec85d-6c6f-4a38-9678-3749bc69d2a3-kube-api-access-jmjw9\") pod \"afcec85d-6c6f-4a38-9678-3749bc69d2a3\" (UID: \"afcec85d-6c6f-4a38-9678-3749bc69d2a3\") "
Sep 10 18:01:55 addons-521995 kubelet[2177]: I0910 18:01:55.128749 2177 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afcec85d-6c6f-4a38-9678-3749bc69d2a3-kube-api-access-jmjw9" (OuterVolumeSpecName: "kube-api-access-jmjw9") pod "afcec85d-6c6f-4a38-9678-3749bc69d2a3" (UID: "afcec85d-6c6f-4a38-9678-3749bc69d2a3"). InnerVolumeSpecName "kube-api-access-jmjw9". PluginName "kubernetes.io/projected", VolumeGidValue ""
Sep 10 18:01:55 addons-521995 kubelet[2177]: I0910 18:01:55.180549 2177 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9f9b0cb-08d3-4aba-9edb-4e8368501a89" path="/var/lib/kubelet/pods/b9f9b0cb-08d3-4aba-9edb-4e8368501a89/volumes"
Sep 10 18:01:55 addons-521995 kubelet[2177]: I0910 18:01:55.224790 2177 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-jmjw9\" (UniqueName: \"kubernetes.io/projected/afcec85d-6c6f-4a38-9678-3749bc69d2a3-kube-api-access-jmjw9\") on node \"addons-521995\" DevicePath \"\""
Sep 10 18:01:55 addons-521995 kubelet[2177]: I0910 18:01:55.335941 2177 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zht4m\" (UniqueName: \"kubernetes.io/projected/4153d723-3ce2-48ca-929d-b85b94b0b7ff-kube-api-access-zht4m\") pod \"4153d723-3ce2-48ca-929d-b85b94b0b7ff\" (UID: \"4153d723-3ce2-48ca-929d-b85b94b0b7ff\") "
Sep 10 18:01:55 addons-521995 kubelet[2177]: I0910 18:01:55.376771 2177 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4153d723-3ce2-48ca-929d-b85b94b0b7ff-kube-api-access-zht4m" (OuterVolumeSpecName: "kube-api-access-zht4m") pod "4153d723-3ce2-48ca-929d-b85b94b0b7ff" (UID: "4153d723-3ce2-48ca-929d-b85b94b0b7ff"). InnerVolumeSpecName "kube-api-access-zht4m". PluginName "kubernetes.io/projected", VolumeGidValue ""
Sep 10 18:01:55 addons-521995 kubelet[2177]: I0910 18:01:55.387313 2177 scope.go:117] "RemoveContainer" containerID="9d806248fcac09156d1f09574ade8e523d7f409a5af215a66204ebb8de60884e"
Sep 10 18:01:55 addons-521995 kubelet[2177]: I0910 18:01:55.445860 2177 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-zht4m\" (UniqueName: \"kubernetes.io/projected/4153d723-3ce2-48ca-929d-b85b94b0b7ff-kube-api-access-zht4m\") on node \"addons-521995\" DevicePath \"\""
Sep 10 18:01:55 addons-521995 kubelet[2177]: I0910 18:01:55.480770 2177 scope.go:117] "RemoveContainer" containerID="9d806248fcac09156d1f09574ade8e523d7f409a5af215a66204ebb8de60884e"
Sep 10 18:01:55 addons-521995 kubelet[2177]: E0910 18:01:55.482505 2177 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = Unknown desc = Error response from daemon: No such container: 9d806248fcac09156d1f09574ade8e523d7f409a5af215a66204ebb8de60884e" containerID="9d806248fcac09156d1f09574ade8e523d7f409a5af215a66204ebb8de60884e"
Sep 10 18:01:55 addons-521995 kubelet[2177]: I0910 18:01:55.482576 2177 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"docker","ID":"9d806248fcac09156d1f09574ade8e523d7f409a5af215a66204ebb8de60884e"} err="failed to get container status \"9d806248fcac09156d1f09574ade8e523d7f409a5af215a66204ebb8de60884e\": rpc error: code = Unknown desc = Error response from daemon: No such container: 9d806248fcac09156d1f09574ade8e523d7f409a5af215a66204ebb8de60884e"
Sep 10 18:01:55 addons-521995 kubelet[2177]: I0910 18:01:55.482627 2177 scope.go:117] "RemoveContainer" containerID="19da7412b678c28a14c0faa372206e0978f910493195344d1d5d73596d0ee3cc"
Sep 10 18:01:55 addons-521995 kubelet[2177]: I0910 18:01:55.522721 2177 scope.go:117] "RemoveContainer" containerID="19da7412b678c28a14c0faa372206e0978f910493195344d1d5d73596d0ee3cc"
Sep 10 18:01:55 addons-521995 kubelet[2177]: E0910 18:01:55.524471 2177 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = Unknown desc = Error response from daemon: No such container: 19da7412b678c28a14c0faa372206e0978f910493195344d1d5d73596d0ee3cc" containerID="19da7412b678c28a14c0faa372206e0978f910493195344d1d5d73596d0ee3cc"
Sep 10 18:01:55 addons-521995 kubelet[2177]: I0910 18:01:55.524517 2177 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"docker","ID":"19da7412b678c28a14c0faa372206e0978f910493195344d1d5d73596d0ee3cc"} err="failed to get container status \"19da7412b678c28a14c0faa372206e0978f910493195344d1d5d73596d0ee3cc\": rpc error: code = Unknown desc = Error response from daemon: No such container: 19da7412b678c28a14c0faa372206e0978f910493195344d1d5d73596d0ee3cc"
Sep 10 18:01:55 addons-521995 kubelet[2177]: I0910 18:01:55.524554 2177 scope.go:117] "RemoveContainer" containerID="28967a34f5b8339bcd1eeadc2d0b684d36d43193ea7179479280a367ffd848dc"
Sep 10 18:01:56 addons-521995 kubelet[2177]: I0910 18:01:56.148466 2177 scope.go:117] "RemoveContainer" containerID="ee51b6640a70e0909e8c15bb0afc75739178d20bbe081b580c5db924637b0d85"
Sep 10 18:01:56 addons-521995 kubelet[2177]: E0910 18:01:56.148786 2177 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=gadget pod=gadget-9zmzb_gadget(1b55f309-fa38-4600-8bfa-f791901f1772)\"" pod="gadget/gadget-9zmzb" podUID="1b55f309-fa38-4600-8bfa-f791901f1772"
Sep 10 18:01:57 addons-521995 kubelet[2177]: I0910 18:01:57.165645 2177 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4153d723-3ce2-48ca-929d-b85b94b0b7ff" path="/var/lib/kubelet/pods/4153d723-3ce2-48ca-929d-b85b94b0b7ff/volumes"
Sep 10 18:01:57 addons-521995 kubelet[2177]: I0910 18:01:57.166711 2177 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b74f6a0-0605-403c-88b5-a0026b395720" path="/var/lib/kubelet/pods/6b74f6a0-0605-403c-88b5-a0026b395720/volumes"
Sep 10 18:01:57 addons-521995 kubelet[2177]: I0910 18:01:57.167567 2177 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afcec85d-6c6f-4a38-9678-3749bc69d2a3" path="/var/lib/kubelet/pods/afcec85d-6c6f-4a38-9678-3749bc69d2a3/volumes"
==> storage-provisioner [ff89d888bf3b] <==
I0910 17:49:00.273582 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0910 17:49:00.708228 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0910 17:49:00.708523 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0910 17:49:01.316828 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0910 17:49:01.322664 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-521995_349965be-606a-4379-8b44-f0e930cce8f0!
I0910 17:49:01.346842 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"3696dea2-7300-447b-986c-1d087ba60d13", APIVersion:"v1", ResourceVersion:"658", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-521995_349965be-606a-4379-8b44-f0e930cce8f0 became leader
I0910 17:49:01.624998 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-521995_349965be-606a-4379-8b44-f0e930cce8f0!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p addons-521995 -n addons-521995
helpers_test.go:261: (dbg) Run: kubectl --context addons-521995 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: busybox ingress-nginx-admission-create-4q7lz ingress-nginx-admission-patch-klb4b
helpers_test.go:274: ======> post-mortem[TestAddons/parallel/Registry]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-521995 describe pod busybox ingress-nginx-admission-create-4q7lz ingress-nginx-admission-patch-klb4b
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-521995 describe pod busybox ingress-nginx-admission-create-4q7lz ingress-nginx-admission-patch-klb4b: exit status 1 (121.179809ms)
-- stdout --
Name: busybox
Namespace: default
Priority: 0
Service Account: default
Node: addons-521995/192.168.49.2
Start Time: Tue, 10 Sep 2024 17:52:36 +0000
Labels: integration-test=busybox
Annotations: <none>
Status: Pending
IP: 10.244.0.28
IPs:
IP: 10.244.0.28
Containers:
busybox:
Container ID:
Image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
Image ID:
Port: <none>
Host Port: <none>
Command:
sleep
3600
State: Waiting
Reason: ImagePullBackOff
Ready: False
Restart Count: 0
Environment:
GOOGLE_APPLICATION_CREDENTIALS: /google-app-creds.json
PROJECT_ID: this_is_fake
GCP_PROJECT: this_is_fake
GCLOUD_PROJECT: this_is_fake
GOOGLE_CLOUD_PROJECT: this_is_fake
CLOUDSDK_CORE_PROJECT: this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-42xm7 (ro)
Conditions:
Type Status
PodReadyToStartContainers True
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
kube-api-access-42xm7:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
gcp-creds:
Type: HostPath (bare host directory volume)
Path: /var/lib/minikube/google_application_credentials.json
HostPathType: File
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 9m22s default-scheduler Successfully assigned default/busybox to addons-521995
Normal Pulling 7m49s (x4 over 9m21s) kubelet Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"
Warning Failed 7m49s (x4 over 9m21s) kubelet Failed to pull image "gcr.io/k8s-minikube/busybox:1.28.4-glibc": Error response from daemon: Head "https://gcr.io/v2/k8s-minikube/busybox/manifests/1.28.4-glibc": unauthorized: authentication failed
Warning Failed 7m49s (x4 over 9m21s) kubelet Error: ErrImagePull
Warning Failed 7m38s (x6 over 9m21s) kubelet Error: ImagePullBackOff
Normal BackOff 4m14s (x21 over 9m21s) kubelet Back-off pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"
-- /stdout --
** stderr **
Error from server (NotFound): pods "ingress-nginx-admission-create-4q7lz" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-klb4b" not found
** /stderr **
helpers_test.go:279: kubectl --context addons-521995 describe pod busybox ingress-nginx-admission-create-4q7lz ingress-nginx-admission-patch-klb4b: exit status 1
--- FAIL: TestAddons/parallel/Registry (76.39s)