=== RUN TestAddons/serial/Volcano
addons_test.go:851: volcano-controller stabilized in 53.599844ms
addons_test.go:843: volcano-admission stabilized in 54.432038ms
addons_test.go:835: volcano-scheduler stabilized in 54.941681ms
addons_test.go:857: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-scheduler-576bc46687-knktf" [624c2582-42f8-491a-ae9d-781edffdc337] Running
addons_test.go:857: (dbg) TestAddons/serial/Volcano: app=volcano-scheduler healthy within 6.004445518s
addons_test.go:861: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-admission-77d7d48b68-gs99c" [1c9bb9fc-6628-407f-be87-19f90cf5be12] Running
addons_test.go:861: (dbg) TestAddons/serial/Volcano: app=volcano-admission healthy within 5.0037733s
addons_test.go:865: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-controllers-56675bb4d5-724bn" [f043b7ae-031a-4ced-afbb-e64a2599c107] Running
addons_test.go:865: (dbg) TestAddons/serial/Volcano: app=volcano-controller healthy within 5.003347181s
addons_test.go:870: (dbg) Run: kubectl --context addons-895903 delete -n volcano-system job volcano-admission-init
addons_test.go:876: (dbg) Run: kubectl --context addons-895903 create -f testdata/vcjob.yaml
addons_test.go:884: (dbg) Run: kubectl --context addons-895903 get vcjob -n my-volcano
addons_test.go:902: (dbg) TestAddons/serial/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...
helpers_test.go:344: "test-job-nginx-0" [fc66b5df-a403-4ee1-bec1-11c1c45ff82c] Pending
helpers_test.go:344: "test-job-nginx-0" [fc66b5df-a403-4ee1-bec1-11c1c45ff82c] Pending: PodScheduled:Unschedulable (0/1 nodes are unavailable: 1 Insufficient cpu.)
addons_test.go:902: ***** TestAddons/serial/Volcano: pod "volcano.sh/job-name=test-job" failed to start within 3m0s: context deadline exceeded ****
addons_test.go:902: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-895903 -n addons-895903
addons_test.go:902: TestAddons/serial/Volcano: showing logs for failed pods as of 2024-09-23 10:32:45.559032754 +0000 UTC m=+473.817918333
addons_test.go:902: (dbg) Run: kubectl --context addons-895903 describe po test-job-nginx-0 -n my-volcano
addons_test.go:902: (dbg) kubectl --context addons-895903 describe po test-job-nginx-0 -n my-volcano:
Name: test-job-nginx-0
Namespace: my-volcano
Priority: 0
Service Account: default
Node: <none>
Labels: volcano.sh/job-name=test-job
volcano.sh/job-namespace=my-volcano
volcano.sh/queue-name=test
volcano.sh/task-index=0
volcano.sh/task-spec=nginx
Annotations: scheduling.k8s.io/group-name: test-job-a5b3cc79-ac3d-475f-bb39-d2229227cdbd
volcano.sh/job-name: test-job
volcano.sh/job-version: 0
volcano.sh/queue-name: test
volcano.sh/task-index: 0
volcano.sh/task-spec: nginx
volcano.sh/template-uid: test-job-nginx
Status: Pending
IP:
IPs: <none>
Controlled By: Job/test-job
Containers:
nginx:
Image: nginx:latest
Port: <none>
Host Port: <none>
Command:
sleep
10m
Limits:
cpu: 1
Requests:
cpu: 1
Environment:
GOOGLE_APPLICATION_CREDENTIALS: /google-app-creds.json
PROJECT_ID: this_is_fake
GCP_PROJECT: this_is_fake
GCLOUD_PROJECT: this_is_fake
GOOGLE_CLOUD_PROJECT: this_is_fake
CLOUDSDK_CORE_PROJECT: this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-z2dkf (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
kube-api-access-z2dkf:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
gcp-creds:
Type: HostPath (bare host directory volume)
Path: /var/lib/minikube/google_application_credentials.json
HostPathType: File
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling 2m59s volcano 0/1 nodes are unavailable: 1 Insufficient cpu.
addons_test.go:902: (dbg) Run: kubectl --context addons-895903 logs test-job-nginx-0 -n my-volcano
addons_test.go:902: (dbg) kubectl --context addons-895903 logs test-job-nginx-0 -n my-volcano:
addons_test.go:903: failed waiting for test-local-path pod: volcano.sh/job-name=test-job within 3m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestAddons/serial/Volcano]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect addons-895903
helpers_test.go:235: (dbg) docker inspect addons-895903:
-- stdout --
[
{
"Id": "4d7c6b023610b09dcdd899a5e72c5b691f34eb04ad3c80a82e9b18ab772437c7",
"Created": "2024-09-23T10:25:31.536953277Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 2614295,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-09-23T10:25:31.678814399Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:c94982da1293baee77c00993711af197ed62d6b1a4ee12c0caa4f57c70de4fdc",
"ResolvConfPath": "/var/lib/docker/containers/4d7c6b023610b09dcdd899a5e72c5b691f34eb04ad3c80a82e9b18ab772437c7/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/4d7c6b023610b09dcdd899a5e72c5b691f34eb04ad3c80a82e9b18ab772437c7/hostname",
"HostsPath": "/var/lib/docker/containers/4d7c6b023610b09dcdd899a5e72c5b691f34eb04ad3c80a82e9b18ab772437c7/hosts",
"LogPath": "/var/lib/docker/containers/4d7c6b023610b09dcdd899a5e72c5b691f34eb04ad3c80a82e9b18ab772437c7/4d7c6b023610b09dcdd899a5e72c5b691f34eb04ad3c80a82e9b18ab772437c7-json.log",
"Name": "/addons-895903",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"addons-895903:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "addons-895903",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4194304000,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8388608000,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/08fba6eaa099cf49c775b34319663b148eb86df6e084507181455dbd7c699a7d-init/diff:/var/lib/docker/overlay2/3f48eb309b414f1318a2f8c59316f40e6520b9d7d492e0795786c9b63367452d/diff",
"MergedDir": "/var/lib/docker/overlay2/08fba6eaa099cf49c775b34319663b148eb86df6e084507181455dbd7c699a7d/merged",
"UpperDir": "/var/lib/docker/overlay2/08fba6eaa099cf49c775b34319663b148eb86df6e084507181455dbd7c699a7d/diff",
"WorkDir": "/var/lib/docker/overlay2/08fba6eaa099cf49c775b34319663b148eb86df6e084507181455dbd7c699a7d/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "addons-895903",
"Source": "/var/lib/docker/volumes/addons-895903/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "addons-895903",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-895903",
"name.minikube.sigs.k8s.io": "addons-895903",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "7855619e49bff79b2c9bf4ba40ca6602c3337ccae8c5e425338f7d45e968b379",
"SandboxKey": "/var/run/docker/netns/7855619e49bf",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "41421"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "41422"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "41425"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "41423"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "41424"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"addons-895903": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:31:02",
"DriverOpts": null,
"NetworkID": "0b49d225d0f0f97400a97c62672b238e2d4ebfd01f050c880dacf5466c522167",
"EndpointID": "ad8d62fb49c697e2bbf3a723e08fa40412599e4af81293aadbd689c78fd698b0",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-895903",
"4d7c6b023610"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p addons-895903 -n addons-895903
helpers_test.go:244: <<< TestAddons/serial/Volcano FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/serial/Volcano]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p addons-895903 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-895903 logs -n 25: (1.599742925s)
helpers_test.go:252: TestAddons/serial/Volcano logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| start | -o=json --download-only | download-only-179078 | jenkins | v1.34.0 | 23 Sep 24 10:24 UTC | |
| | -p download-only-179078 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 23 Sep 24 10:24 UTC | 23 Sep 24 10:24 UTC |
| delete | -p download-only-179078 | download-only-179078 | jenkins | v1.34.0 | 23 Sep 24 10:24 UTC | 23 Sep 24 10:24 UTC |
| start | -o=json --download-only | download-only-676157 | jenkins | v1.34.0 | 23 Sep 24 10:24 UTC | |
| | -p download-only-676157 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 23 Sep 24 10:25 UTC | 23 Sep 24 10:25 UTC |
| delete | -p download-only-676157 | download-only-676157 | jenkins | v1.34.0 | 23 Sep 24 10:25 UTC | 23 Sep 24 10:25 UTC |
| delete | -p download-only-179078 | download-only-179078 | jenkins | v1.34.0 | 23 Sep 24 10:25 UTC | 23 Sep 24 10:25 UTC |
| delete | -p download-only-676157 | download-only-676157 | jenkins | v1.34.0 | 23 Sep 24 10:25 UTC | 23 Sep 24 10:25 UTC |
| start | --download-only -p | download-docker-775785 | jenkins | v1.34.0 | 23 Sep 24 10:25 UTC | |
| | download-docker-775785 | | | | | |
| | --alsologtostderr | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p download-docker-775785 | download-docker-775785 | jenkins | v1.34.0 | 23 Sep 24 10:25 UTC | 23 Sep 24 10:25 UTC |
| start | --download-only -p | binary-mirror-598077 | jenkins | v1.34.0 | 23 Sep 24 10:25 UTC | |
| | binary-mirror-598077 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:45953 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p binary-mirror-598077 | binary-mirror-598077 | jenkins | v1.34.0 | 23 Sep 24 10:25 UTC | 23 Sep 24 10:25 UTC |
| addons | enable dashboard -p | addons-895903 | jenkins | v1.34.0 | 23 Sep 24 10:25 UTC | |
| | addons-895903 | | | | | |
| addons | disable dashboard -p | addons-895903 | jenkins | v1.34.0 | 23 Sep 24 10:25 UTC | |
| | addons-895903 | | | | | |
| start | -p addons-895903 --wait=true | addons-895903 | jenkins | v1.34.0 | 23 Sep 24 10:25 UTC | 23 Sep 24 10:29 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/09/23 10:25:07
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.23.0 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0923 10:25:07.641380 2613811 out.go:345] Setting OutFile to fd 1 ...
I0923 10:25:07.641528 2613811 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0923 10:25:07.641553 2613811 out.go:358] Setting ErrFile to fd 2...
I0923 10:25:07.641571 2613811 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0923 10:25:07.641842 2613811 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19689-2607666/.minikube/bin
I0923 10:25:07.642348 2613811 out.go:352] Setting JSON to false
I0923 10:25:07.643335 2613811 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":151655,"bootTime":1726935453,"procs":177,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0923 10:25:07.643409 2613811 start.go:139] virtualization:
I0923 10:25:07.646249 2613811 out.go:177] * [addons-895903] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I0923 10:25:07.648110 2613811 out.go:177] - MINIKUBE_LOCATION=19689
I0923 10:25:07.648139 2613811 notify.go:220] Checking for updates...
I0923 10:25:07.652182 2613811 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0923 10:25:07.653981 2613811 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19689-2607666/kubeconfig
I0923 10:25:07.656435 2613811 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19689-2607666/.minikube
I0923 10:25:07.658248 2613811 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0923 10:25:07.659939 2613811 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0923 10:25:07.661985 2613811 driver.go:394] Setting default libvirt URI to qemu:///system
I0923 10:25:07.687965 2613811 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
I0923 10:25:07.688102 2613811 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0923 10:25:07.744937 2613811 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-23 10:25:07.735240578 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214839296 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I0923 10:25:07.745052 2613811 docker.go:318] overlay module found
I0923 10:25:07.747057 2613811 out.go:177] * Using the docker driver based on user configuration
I0923 10:25:07.748929 2613811 start.go:297] selected driver: docker
I0923 10:25:07.748946 2613811 start.go:901] validating driver "docker" against <nil>
I0923 10:25:07.748960 2613811 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0923 10:25:07.749600 2613811 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0923 10:25:07.799161 2613811 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-23 10:25:07.790422927 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214839296 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I0923 10:25:07.799385 2613811 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0923 10:25:07.799621 2613811 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0923 10:25:07.801741 2613811 out.go:177] * Using Docker driver with root privileges
I0923 10:25:07.803860 2613811 cni.go:84] Creating CNI manager for ""
I0923 10:25:07.803913 2613811 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0923 10:25:07.803928 2613811 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0923 10:25:07.804009 2613811 start.go:340] cluster config:
{Name:addons-895903 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-895903 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHA
uthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0923 10:25:07.805931 2613811 out.go:177] * Starting "addons-895903" primary control-plane node in "addons-895903" cluster
I0923 10:25:07.807666 2613811 cache.go:121] Beginning downloading kic base image for docker with containerd
I0923 10:25:07.809562 2613811 out.go:177] * Pulling base image v0.0.45-1726784731-19672 ...
I0923 10:25:07.811335 2613811 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I0923 10:25:07.811390 2613811 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19689-2607666/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4
I0923 10:25:07.811402 2613811 cache.go:56] Caching tarball of preloaded images
I0923 10:25:07.811426 2613811 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed in local docker daemon
I0923 10:25:07.811514 2613811 preload.go:172] Found /home/jenkins/minikube-integration/19689-2607666/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0923 10:25:07.811525 2613811 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on containerd
I0923 10:25:07.811871 2613811 profile.go:143] Saving config to /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/config.json ...
I0923 10:25:07.811900 2613811 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/config.json: {Name:mkbac1b4d1bedb57f9296b37e514f282d3b7bdfd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 10:25:07.826150 2613811 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed to local cache
I0923 10:25:07.826253 2613811 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed in local cache directory
I0923 10:25:07.826272 2613811 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed in local cache directory, skipping pull
I0923 10:25:07.826276 2613811 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed exists in cache, skipping pull
I0923 10:25:07.826283 2613811 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed as a tarball
I0923 10:25:07.826289 2613811 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed from local cache
I0923 10:25:24.989285 2613811 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed from cached tarball
I0923 10:25:24.989325 2613811 cache.go:194] Successfully downloaded all kic artifacts
I0923 10:25:24.989356 2613811 start.go:360] acquireMachinesLock for addons-895903: {Name:mk4b9ad88333f6a0cec9f2ddaa794eedc9f368e7 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0923 10:25:24.990018 2613811 start.go:364] duration metric: took 641.088µs to acquireMachinesLock for "addons-895903"
I0923 10:25:24.990072 2613811 start.go:93] Provisioning new machine with config: &{Name:addons-895903 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-895903 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fa
lse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0923 10:25:24.990166 2613811 start.go:125] createHost starting for "" (driver="docker")
I0923 10:25:24.993641 2613811 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
I0923 10:25:24.993964 2613811 start.go:159] libmachine.API.Create for "addons-895903" (driver="docker")
I0923 10:25:24.994002 2613811 client.go:168] LocalClient.Create starting
I0923 10:25:24.994154 2613811 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19689-2607666/.minikube/certs/ca.pem
I0923 10:25:25.917807 2613811 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19689-2607666/.minikube/certs/cert.pem
I0923 10:25:26.212645 2613811 cli_runner.go:164] Run: docker network inspect addons-895903 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0923 10:25:26.229433 2613811 cli_runner.go:211] docker network inspect addons-895903 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0923 10:25:26.229526 2613811 network_create.go:284] running [docker network inspect addons-895903] to gather additional debugging logs...
I0923 10:25:26.229550 2613811 cli_runner.go:164] Run: docker network inspect addons-895903
W0923 10:25:26.245112 2613811 cli_runner.go:211] docker network inspect addons-895903 returned with exit code 1
I0923 10:25:26.245150 2613811 network_create.go:287] error running [docker network inspect addons-895903]: docker network inspect addons-895903: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-895903 not found
I0923 10:25:26.245165 2613811 network_create.go:289] output of [docker network inspect addons-895903]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-895903 not found
** /stderr **
I0923 10:25:26.245271 2613811 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0923 10:25:26.260458 2613811 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x400063b920}
I0923 10:25:26.260498 2613811 network_create.go:124] attempt to create docker network addons-895903 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0923 10:25:26.260560 2613811 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-895903 addons-895903
I0923 10:25:26.332617 2613811 network_create.go:108] docker network addons-895903 192.168.49.0/24 created
I0923 10:25:26.332649 2613811 kic.go:121] calculated static IP "192.168.49.2" for the "addons-895903" container
I0923 10:25:26.332724 2613811 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0923 10:25:26.346286 2613811 cli_runner.go:164] Run: docker volume create addons-895903 --label name.minikube.sigs.k8s.io=addons-895903 --label created_by.minikube.sigs.k8s.io=true
I0923 10:25:26.363592 2613811 oci.go:103] Successfully created a docker volume addons-895903
I0923 10:25:26.363695 2613811 cli_runner.go:164] Run: docker run --rm --name addons-895903-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-895903 --entrypoint /usr/bin/test -v addons-895903:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed -d /var/lib
I0923 10:25:27.530609 2613811 cli_runner.go:217] Completed: docker run --rm --name addons-895903-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-895903 --entrypoint /usr/bin/test -v addons-895903:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed -d /var/lib: (1.166872958s)
I0923 10:25:27.530650 2613811 oci.go:107] Successfully prepared a docker volume addons-895903
I0923 10:25:27.530675 2613811 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I0923 10:25:27.530695 2613811 kic.go:194] Starting extracting preloaded images to volume ...
I0923 10:25:27.530768 2613811 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19689-2607666/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-895903:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed -I lz4 -xf /preloaded.tar -C /extractDir
I0923 10:25:31.466242 2613811 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19689-2607666/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-895903:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed -I lz4 -xf /preloaded.tar -C /extractDir: (3.935426243s)
I0923 10:25:31.466275 2613811 kic.go:203] duration metric: took 3.935576962s to extract preloaded images to volume ...
W0923 10:25:31.466410 2613811 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0923 10:25:31.466515 2613811 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0923 10:25:31.522771 2613811 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-895903 --name addons-895903 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-895903 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-895903 --network addons-895903 --ip 192.168.49.2 --volume addons-895903:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed
I0923 10:25:31.838228 2613811 cli_runner.go:164] Run: docker container inspect addons-895903 --format={{.State.Running}}
I0923 10:25:31.864048 2613811 cli_runner.go:164] Run: docker container inspect addons-895903 --format={{.State.Status}}
I0923 10:25:31.890389 2613811 cli_runner.go:164] Run: docker exec addons-895903 stat /var/lib/dpkg/alternatives/iptables
I0923 10:25:31.951053 2613811 oci.go:144] the created container "addons-895903" has a running status.
I0923 10:25:31.951083 2613811 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19689-2607666/.minikube/machines/addons-895903/id_rsa...
I0923 10:25:32.347386 2613811 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19689-2607666/.minikube/machines/addons-895903/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0923 10:25:32.371492 2613811 cli_runner.go:164] Run: docker container inspect addons-895903 --format={{.State.Status}}
I0923 10:25:32.402892 2613811 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0923 10:25:32.402916 2613811 kic_runner.go:114] Args: [docker exec --privileged addons-895903 chown docker:docker /home/docker/.ssh/authorized_keys]
I0923 10:25:32.499526 2613811 cli_runner.go:164] Run: docker container inspect addons-895903 --format={{.State.Status}}
I0923 10:25:32.519717 2613811 machine.go:93] provisionDockerMachine start ...
I0923 10:25:32.519822 2613811 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-895903
I0923 10:25:32.539739 2613811 main.go:141] libmachine: Using SSH client type: native
I0923 10:25:32.540003 2613811 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 41421 <nil> <nil>}
I0923 10:25:32.540020 2613811 main.go:141] libmachine: About to run SSH command:
hostname
I0923 10:25:32.719039 2613811 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-895903
I0923 10:25:32.719065 2613811 ubuntu.go:169] provisioning hostname "addons-895903"
I0923 10:25:32.719144 2613811 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-895903
I0923 10:25:32.740947 2613811 main.go:141] libmachine: Using SSH client type: native
I0923 10:25:32.741194 2613811 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 41421 <nil> <nil>}
I0923 10:25:32.741211 2613811 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-895903 && echo "addons-895903" | sudo tee /etc/hostname
I0923 10:25:32.897700 2613811 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-895903
I0923 10:25:32.897819 2613811 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-895903
I0923 10:25:32.915447 2613811 main.go:141] libmachine: Using SSH client type: native
I0923 10:25:32.915694 2613811 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 41421 <nil> <nil>}
I0923 10:25:32.915716 2613811 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-895903' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-895903/g' /etc/hosts;
else
echo '127.0.1.1 addons-895903' | sudo tee -a /etc/hosts;
fi
fi
I0923 10:25:33.055651 2613811 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0923 10:25:33.055680 2613811 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19689-2607666/.minikube CaCertPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19689-2607666/.minikube}
I0923 10:25:33.055703 2613811 ubuntu.go:177] setting up certificates
I0923 10:25:33.055713 2613811 provision.go:84] configureAuth start
I0923 10:25:33.055782 2613811 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-895903
I0923 10:25:33.074585 2613811 provision.go:143] copyHostCerts
I0923 10:25:33.074671 2613811 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19689-2607666/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19689-2607666/.minikube/ca.pem (1078 bytes)
I0923 10:25:33.074807 2613811 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19689-2607666/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19689-2607666/.minikube/cert.pem (1123 bytes)
I0923 10:25:33.074881 2613811 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19689-2607666/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19689-2607666/.minikube/key.pem (1675 bytes)
I0923 10:25:33.075000 2613811 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19689-2607666/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19689-2607666/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19689-2607666/.minikube/certs/ca-key.pem org=jenkins.addons-895903 san=[127.0.0.1 192.168.49.2 addons-895903 localhost minikube]
I0923 10:25:33.418516 2613811 provision.go:177] copyRemoteCerts
I0923 10:25:33.418594 2613811 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0923 10:25:33.418647 2613811 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-895903
I0923 10:25:33.438490 2613811 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41421 SSHKeyPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/machines/addons-895903/id_rsa Username:docker}
I0923 10:25:33.532063 2613811 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19689-2607666/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0923 10:25:33.556795 2613811 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19689-2607666/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0923 10:25:33.581785 2613811 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19689-2607666/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0923 10:25:33.606426 2613811 provision.go:87] duration metric: took 550.698501ms to configureAuth
I0923 10:25:33.606462 2613811 ubuntu.go:193] setting minikube options for container-runtime
I0923 10:25:33.606659 2613811 config.go:182] Loaded profile config "addons-895903": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I0923 10:25:33.606672 2613811 machine.go:96] duration metric: took 1.086930996s to provisionDockerMachine
I0923 10:25:33.606684 2613811 client.go:171] duration metric: took 8.612665703s to LocalClient.Create
I0923 10:25:33.606707 2613811 start.go:167] duration metric: took 8.612745185s to libmachine.API.Create "addons-895903"
I0923 10:25:33.606720 2613811 start.go:293] postStartSetup for "addons-895903" (driver="docker")
I0923 10:25:33.606730 2613811 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0923 10:25:33.606795 2613811 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0923 10:25:33.606841 2613811 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-895903
I0923 10:25:33.623504 2613811 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41421 SSHKeyPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/machines/addons-895903/id_rsa Username:docker}
I0923 10:25:33.720808 2613811 ssh_runner.go:195] Run: cat /etc/os-release
I0923 10:25:33.724086 2613811 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0923 10:25:33.724121 2613811 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0923 10:25:33.724132 2613811 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0923 10:25:33.724139 2613811 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I0923 10:25:33.724149 2613811 filesync.go:126] Scanning /home/jenkins/minikube-integration/19689-2607666/.minikube/addons for local assets ...
I0923 10:25:33.724218 2613811 filesync.go:126] Scanning /home/jenkins/minikube-integration/19689-2607666/.minikube/files for local assets ...
I0923 10:25:33.724242 2613811 start.go:296] duration metric: took 117.515561ms for postStartSetup
I0923 10:25:33.724562 2613811 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-895903
I0923 10:25:33.740614 2613811 profile.go:143] Saving config to /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/config.json ...
I0923 10:25:33.740909 2613811 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0923 10:25:33.740960 2613811 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-895903
I0923 10:25:33.758935 2613811 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41421 SSHKeyPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/machines/addons-895903/id_rsa Username:docker}
I0923 10:25:33.852270 2613811 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0923 10:25:33.856701 2613811 start.go:128] duration metric: took 8.866517068s to createHost
I0923 10:25:33.856727 2613811 start.go:83] releasing machines lock for "addons-895903", held for 8.866690787s
I0923 10:25:33.856796 2613811 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-895903
I0923 10:25:33.872710 2613811 ssh_runner.go:195] Run: cat /version.json
I0923 10:25:33.872764 2613811 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-895903
I0923 10:25:33.872769 2613811 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0923 10:25:33.872859 2613811 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-895903
I0923 10:25:33.892568 2613811 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41421 SSHKeyPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/machines/addons-895903/id_rsa Username:docker}
I0923 10:25:33.893093 2613811 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41421 SSHKeyPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/machines/addons-895903/id_rsa Username:docker}
I0923 10:25:34.110401 2613811 ssh_runner.go:195] Run: systemctl --version
I0923 10:25:34.114812 2613811 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0923 10:25:34.119249 2613811 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0923 10:25:34.144017 2613811 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0923 10:25:34.144104 2613811 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0923 10:25:34.173126 2613811 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0923 10:25:34.173197 2613811 start.go:495] detecting cgroup driver to use...
I0923 10:25:34.173271 2613811 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0923 10:25:34.173344 2613811 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0923 10:25:34.186458 2613811 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0923 10:25:34.198487 2613811 docker.go:217] disabling cri-docker service (if available) ...
I0923 10:25:34.198555 2613811 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0923 10:25:34.212494 2613811 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0923 10:25:34.227685 2613811 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0923 10:25:34.319379 2613811 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0923 10:25:34.411854 2613811 docker.go:233] disabling docker service ...
I0923 10:25:34.411945 2613811 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0923 10:25:34.431496 2613811 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0923 10:25:34.443484 2613811 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0923 10:25:34.536190 2613811 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0923 10:25:34.622813 2613811 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0923 10:25:34.634104 2613811 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0923 10:25:34.650772 2613811 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0923 10:25:34.660746 2613811 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0923 10:25:34.670287 2613811 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0923 10:25:34.670382 2613811 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0923 10:25:34.680259 2613811 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0923 10:25:34.691646 2613811 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0923 10:25:34.701535 2613811 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0923 10:25:34.711514 2613811 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0923 10:25:34.721080 2613811 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0923 10:25:34.731003 2613811 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0923 10:25:34.741157 2613811 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0923 10:25:34.751427 2613811 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0923 10:25:34.760297 2613811 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0923 10:25:34.773031 2613811 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0923 10:25:34.852738 2613811 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0923 10:25:34.988702 2613811 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0923 10:25:34.988817 2613811 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0923 10:25:34.992837 2613811 start.go:563] Will wait 60s for crictl version
I0923 10:25:34.992999 2613811 ssh_runner.go:195] Run: which crictl
I0923 10:25:34.996983 2613811 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0923 10:25:35.038852 2613811 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.22
RuntimeApiVersion: v1
I0923 10:25:35.039014 2613811 ssh_runner.go:195] Run: containerd --version
I0923 10:25:35.061854 2613811 ssh_runner.go:195] Run: containerd --version
I0923 10:25:35.089980 2613811 out.go:177] * Preparing Kubernetes v1.31.1 on containerd 1.7.22 ...
I0923 10:25:35.092270 2613811 cli_runner.go:164] Run: docker network inspect addons-895903 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0923 10:25:35.108013 2613811 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I0923 10:25:35.112027 2613811 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0923 10:25:35.124280 2613811 kubeadm.go:883] updating cluster {Name:addons-895903 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-895903 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cus
tomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0923 10:25:35.124412 2613811 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I0923 10:25:35.124475 2613811 ssh_runner.go:195] Run: sudo crictl images --output json
I0923 10:25:35.162474 2613811 containerd.go:627] all images are preloaded for containerd runtime.
I0923 10:25:35.162501 2613811 containerd.go:534] Images already preloaded, skipping extraction
I0923 10:25:35.162568 2613811 ssh_runner.go:195] Run: sudo crictl images --output json
I0923 10:25:35.198861 2613811 containerd.go:627] all images are preloaded for containerd runtime.
I0923 10:25:35.198885 2613811 cache_images.go:84] Images are preloaded, skipping loading
I0923 10:25:35.198894 2613811 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.1 containerd true true} ...
I0923 10:25:35.199048 2613811 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-895903 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.31.1 ClusterName:addons-895903 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0923 10:25:35.199136 2613811 ssh_runner.go:195] Run: sudo crictl info
I0923 10:25:35.236480 2613811 cni.go:84] Creating CNI manager for ""
I0923 10:25:35.236506 2613811 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0923 10:25:35.236517 2613811 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0923 10:25:35.236541 2613811 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-895903 NodeName:addons-895903 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc
/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0923 10:25:35.236677 2613811 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "addons-895903"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0923 10:25:35.236753 2613811 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1
I0923 10:25:35.245618 2613811 binaries.go:44] Found k8s binaries, skipping transfer
I0923 10:25:35.245695 2613811 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0923 10:25:35.254499 2613811 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (317 bytes)
I0923 10:25:35.273431 2613811 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0923 10:25:35.292891 2613811 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2167 bytes)
I0923 10:25:35.311057 2613811 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0923 10:25:35.314627 2613811 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0923 10:25:35.325509 2613811 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0923 10:25:35.404412 2613811 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0923 10:25:35.423842 2613811 certs.go:68] Setting up /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903 for IP: 192.168.49.2
I0923 10:25:35.423865 2613811 certs.go:194] generating shared ca certs ...
I0923 10:25:35.423882 2613811 certs.go:226] acquiring lock for ca certs: {Name:mkc2661b18cd20ef76bea48b3ea09fb1e1611036 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 10:25:35.424070 2613811 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19689-2607666/.minikube/ca.key
I0923 10:25:35.664657 2613811 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19689-2607666/.minikube/ca.crt ...
I0923 10:25:35.664690 2613811 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19689-2607666/.minikube/ca.crt: {Name:mk2acbf498be7eb9fd1e609e34971b58d80166f3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 10:25:35.664885 2613811 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19689-2607666/.minikube/ca.key ...
I0923 10:25:35.664898 2613811 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19689-2607666/.minikube/ca.key: {Name:mkc1870c5bffa1df2e3213758813cdea7eb8bc40 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 10:25:35.665564 2613811 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19689-2607666/.minikube/proxy-client-ca.key
I0923 10:25:35.995171 2613811 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19689-2607666/.minikube/proxy-client-ca.crt ...
I0923 10:25:35.995204 2613811 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19689-2607666/.minikube/proxy-client-ca.crt: {Name:mk191d04dcb1c323d55eabd7e3e9677c7c6b6bdd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 10:25:35.995384 2613811 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19689-2607666/.minikube/proxy-client-ca.key ...
I0923 10:25:35.995400 2613811 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19689-2607666/.minikube/proxy-client-ca.key: {Name:mk392e746be6cf3ba3a56f779014273f417f1804 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 10:25:35.995488 2613811 certs.go:256] generating profile certs ...
I0923 10:25:35.995548 2613811 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/client.key
I0923 10:25:35.995574 2613811 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/client.crt with IP's: []
I0923 10:25:36.550698 2613811 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/client.crt ...
I0923 10:25:36.550730 2613811 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/client.crt: {Name:mk52c061011b0f3aa24257ac1188a8de3a8bf524 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 10:25:36.551473 2613811 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/client.key ...
I0923 10:25:36.551489 2613811 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/client.key: {Name:mk3799d794cd5493d7e5501e630f6433f2791b62 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 10:25:36.552113 2613811 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/apiserver.key.bd897abb
I0923 10:25:36.552136 2613811 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/apiserver.crt.bd897abb with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I0923 10:25:36.802373 2613811 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/apiserver.crt.bd897abb ...
I0923 10:25:36.802406 2613811 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/apiserver.crt.bd897abb: {Name:mk7734653c52dbd2068e79485fc03fd9216a459b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 10:25:36.803090 2613811 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/apiserver.key.bd897abb ...
I0923 10:25:36.803108 2613811 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/apiserver.key.bd897abb: {Name:mk34d87f9db1092f46c9fc08e3987627392ea56e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 10:25:36.803719 2613811 certs.go:381] copying /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/apiserver.crt.bd897abb -> /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/apiserver.crt
I0923 10:25:36.803805 2613811 certs.go:385] copying /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/apiserver.key.bd897abb -> /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/apiserver.key
I0923 10:25:36.803864 2613811 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/proxy-client.key
I0923 10:25:36.803886 2613811 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/proxy-client.crt with IP's: []
I0923 10:25:37.283113 2613811 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/proxy-client.crt ...
I0923 10:25:37.283144 2613811 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/proxy-client.crt: {Name:mk013b16236a46e80a5f1c0420e9b88ba7e38434 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 10:25:37.283869 2613811 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/proxy-client.key ...
I0923 10:25:37.283897 2613811 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/proxy-client.key: {Name:mke6d167f82f0a627b86b3ecea1890ba1a4034b1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 10:25:37.284096 2613811 certs.go:484] found cert: /home/jenkins/minikube-integration/19689-2607666/.minikube/certs/ca-key.pem (1675 bytes)
I0923 10:25:37.284137 2613811 certs.go:484] found cert: /home/jenkins/minikube-integration/19689-2607666/.minikube/certs/ca.pem (1078 bytes)
I0923 10:25:37.284167 2613811 certs.go:484] found cert: /home/jenkins/minikube-integration/19689-2607666/.minikube/certs/cert.pem (1123 bytes)
I0923 10:25:37.284200 2613811 certs.go:484] found cert: /home/jenkins/minikube-integration/19689-2607666/.minikube/certs/key.pem (1675 bytes)
I0923 10:25:37.284799 2613811 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19689-2607666/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0923 10:25:37.309859 2613811 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19689-2607666/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0923 10:25:37.335235 2613811 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19689-2607666/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0923 10:25:37.359458 2613811 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19689-2607666/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0923 10:25:37.383419 2613811 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0923 10:25:37.407692 2613811 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0923 10:25:37.432347 2613811 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0923 10:25:37.456880 2613811 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19689-2607666/.minikube/profiles/addons-895903/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0923 10:25:37.481472 2613811 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19689-2607666/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0923 10:25:37.505748 2613811 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0923 10:25:37.523216 2613811 ssh_runner.go:195] Run: openssl version
I0923 10:25:37.528881 2613811 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0923 10:25:37.538595 2613811 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0923 10:25:37.542091 2613811 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 23 10:25 /usr/share/ca-certificates/minikubeCA.pem
I0923 10:25:37.542182 2613811 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0923 10:25:37.549210 2613811 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0923 10:25:37.558564 2613811 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0923 10:25:37.561752 2613811 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0923 10:25:37.561801 2613811 kubeadm.go:392] StartCluster: {Name:addons-895903 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-895903 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom
QemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0923 10:25:37.561878 2613811 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0923 10:25:37.561937 2613811 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0923 10:25:37.603113 2613811 cri.go:89] found id: ""
I0923 10:25:37.603198 2613811 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0923 10:25:37.615140 2613811 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0923 10:25:37.624648 2613811 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0923 10:25:37.624716 2613811 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0923 10:25:37.635647 2613811 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0923 10:25:37.635669 2613811 kubeadm.go:157] found existing configuration files:
I0923 10:25:37.635725 2613811 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0923 10:25:37.645813 2613811 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0923 10:25:37.645880 2613811 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0923 10:25:37.655461 2613811 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0923 10:25:37.665037 2613811 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0923 10:25:37.665104 2613811 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0923 10:25:37.675230 2613811 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0923 10:25:37.684396 2613811 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0923 10:25:37.684487 2613811 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0923 10:25:37.695963 2613811 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0923 10:25:37.705038 2613811 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0923 10:25:37.705107 2613811 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0923 10:25:37.713929 2613811 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0923 10:25:37.751931 2613811 kubeadm.go:310] W0923 10:25:37.751208 1024 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0923 10:25:37.753123 2613811 kubeadm.go:310] W0923 10:25:37.752622 1024 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0923 10:25:37.775254 2613811 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1070-aws\n", err: exit status 1
I0923 10:25:37.841707 2613811 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0923 10:25:52.504769 2613811 kubeadm.go:310] [init] Using Kubernetes version: v1.31.1
I0923 10:25:52.504825 2613811 kubeadm.go:310] [preflight] Running pre-flight checks
I0923 10:25:52.504912 2613811 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0923 10:25:52.504967 2613811 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1070-aws[0m
I0923 10:25:52.505005 2613811 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0923 10:25:52.505050 2613811 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0923 10:25:52.505106 2613811 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0923 10:25:52.505153 2613811 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0923 10:25:52.505201 2613811 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0923 10:25:52.505249 2613811 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0923 10:25:52.505298 2613811 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0923 10:25:52.505343 2613811 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0923 10:25:52.505391 2613811 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0923 10:25:52.505437 2613811 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0923 10:25:52.505508 2613811 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0923 10:25:52.505600 2613811 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0923 10:25:52.505689 2613811 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0923 10:25:52.505750 2613811 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0923 10:25:52.508224 2613811 out.go:235] - Generating certificates and keys ...
I0923 10:25:52.508332 2613811 kubeadm.go:310] [certs] Using existing ca certificate authority
I0923 10:25:52.508404 2613811 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0923 10:25:52.508477 2613811 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0923 10:25:52.508550 2613811 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0923 10:25:52.508614 2613811 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0923 10:25:52.508669 2613811 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0923 10:25:52.508728 2613811 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0923 10:25:52.508857 2613811 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-895903 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0923 10:25:52.508925 2613811 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0923 10:25:52.509053 2613811 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-895903 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0923 10:25:52.509122 2613811 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0923 10:25:52.509195 2613811 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0923 10:25:52.509244 2613811 kubeadm.go:310] [certs] Generating "sa" key and public key
I0923 10:25:52.509304 2613811 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0923 10:25:52.509359 2613811 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0923 10:25:52.509430 2613811 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0923 10:25:52.509491 2613811 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0923 10:25:52.509558 2613811 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0923 10:25:52.509620 2613811 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0923 10:25:52.509707 2613811 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0923 10:25:52.509777 2613811 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0923 10:25:52.512097 2613811 out.go:235] - Booting up control plane ...
I0923 10:25:52.512246 2613811 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0923 10:25:52.512344 2613811 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0923 10:25:52.512420 2613811 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0923 10:25:52.512536 2613811 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0923 10:25:52.512631 2613811 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0923 10:25:52.512678 2613811 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0923 10:25:52.512826 2613811 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0923 10:25:52.512942 2613811 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0923 10:25:52.513011 2613811 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.508131221s
I0923 10:25:52.513090 2613811 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0923 10:25:52.513155 2613811 kubeadm.go:310] [api-check] The API server is healthy after 6.002077012s
I0923 10:25:52.513303 2613811 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0923 10:25:52.513449 2613811 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0923 10:25:52.513520 2613811 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0923 10:25:52.513716 2613811 kubeadm.go:310] [mark-control-plane] Marking the node addons-895903 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0923 10:25:52.513780 2613811 kubeadm.go:310] [bootstrap-token] Using token: 4zg0rz.2ebwvuelhji42w71
I0923 10:25:52.516244 2613811 out.go:235] - Configuring RBAC rules ...
I0923 10:25:52.516430 2613811 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0923 10:25:52.516553 2613811 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0923 10:25:52.516744 2613811 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0923 10:25:52.516931 2613811 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0923 10:25:52.517083 2613811 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0923 10:25:52.517205 2613811 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0923 10:25:52.517365 2613811 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0923 10:25:52.517436 2613811 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0923 10:25:52.517514 2613811 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0923 10:25:52.517526 2613811 kubeadm.go:310]
I0923 10:25:52.517631 2613811 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0923 10:25:52.517642 2613811 kubeadm.go:310]
I0923 10:25:52.517760 2613811 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0923 10:25:52.517770 2613811 kubeadm.go:310]
I0923 10:25:52.517810 2613811 kubeadm.go:310] mkdir -p $HOME/.kube
I0923 10:25:52.517891 2613811 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0923 10:25:52.517956 2613811 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0923 10:25:52.517969 2613811 kubeadm.go:310]
I0923 10:25:52.518042 2613811 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0923 10:25:52.518056 2613811 kubeadm.go:310]
I0923 10:25:52.518128 2613811 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0923 10:25:52.518137 2613811 kubeadm.go:310]
I0923 10:25:52.518215 2613811 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0923 10:25:52.518324 2613811 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0923 10:25:52.518424 2613811 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0923 10:25:52.518432 2613811 kubeadm.go:310]
I0923 10:25:52.518576 2613811 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0923 10:25:52.518683 2613811 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0923 10:25:52.518693 2613811 kubeadm.go:310]
I0923 10:25:52.518811 2613811 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token 4zg0rz.2ebwvuelhji42w71 \
I0923 10:25:52.518972 2613811 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:deeeddfc0a4999368721e63570c2dde69fb165cf439b6cc1b8195d35c4b9585a \
I0923 10:25:52.519001 2613811 kubeadm.go:310] --control-plane
I0923 10:25:52.519009 2613811 kubeadm.go:310]
I0923 10:25:52.519125 2613811 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0923 10:25:52.519136 2613811 kubeadm.go:310]
I0923 10:25:52.519254 2613811 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token 4zg0rz.2ebwvuelhji42w71 \
I0923 10:25:52.519647 2613811 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:deeeddfc0a4999368721e63570c2dde69fb165cf439b6cc1b8195d35c4b9585a
I0923 10:25:52.519672 2613811 cni.go:84] Creating CNI manager for ""
I0923 10:25:52.519682 2613811 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0923 10:25:52.522161 2613811 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0923 10:25:52.524182 2613811 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0923 10:25:52.528636 2613811 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.1/kubectl ...
I0923 10:25:52.528665 2613811 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I0923 10:25:52.552625 2613811 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0923 10:25:52.841728 2613811 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0923 10:25:52.841860 2613811 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0923 10:25:52.841946 2613811 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-895903 minikube.k8s.io/updated_at=2024_09_23T10_25_52_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=f69bf2f8ed9442c9c01edbe27466c5398c68b986 minikube.k8s.io/name=addons-895903 minikube.k8s.io/primary=true
I0923 10:25:53.055771 2613811 ops.go:34] apiserver oom_adj: -16
I0923 10:25:53.055920 2613811 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0923 10:25:53.556732 2613811 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0923 10:25:54.055988 2613811 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0923 10:25:54.556662 2613811 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0923 10:25:55.057047 2613811 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0923 10:25:55.556051 2613811 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0923 10:25:56.056463 2613811 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0923 10:25:56.160907 2613811 kubeadm.go:1113] duration metric: took 3.319094577s to wait for elevateKubeSystemPrivileges
I0923 10:25:56.160953 2613811 kubeadm.go:394] duration metric: took 18.599155453s to StartCluster
I0923 10:25:56.160973 2613811 settings.go:142] acquiring lock: {Name:mk1c6f0c92ddda690ace497add83b1e7b2d81202 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 10:25:56.161105 2613811 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19689-2607666/kubeconfig
I0923 10:25:56.161506 2613811 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19689-2607666/kubeconfig: {Name:mkc42fb93f23df2d68ce1d16de1a9365e31d0501 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 10:25:56.161719 2613811 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0923 10:25:56.161862 2613811 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0923 10:25:56.162133 2613811 config.go:182] Loaded profile config "addons-895903": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I0923 10:25:56.162181 2613811 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I0923 10:25:56.162260 2613811 addons.go:69] Setting yakd=true in profile "addons-895903"
I0923 10:25:56.162277 2613811 addons.go:234] Setting addon yakd=true in "addons-895903"
I0923 10:25:56.162301 2613811 host.go:66] Checking if "addons-895903" exists ...
I0923 10:25:56.162809 2613811 cli_runner.go:164] Run: docker container inspect addons-895903 --format={{.State.Status}}
I0923 10:25:56.163363 2613811 addons.go:69] Setting inspektor-gadget=true in profile "addons-895903"
I0923 10:25:56.163389 2613811 addons.go:234] Setting addon inspektor-gadget=true in "addons-895903"
I0923 10:25:56.163425 2613811 host.go:66] Checking if "addons-895903" exists ...
I0923 10:25:56.163855 2613811 cli_runner.go:164] Run: docker container inspect addons-895903 --format={{.State.Status}}
I0923 10:25:56.164325 2613811 addons.go:69] Setting cloud-spanner=true in profile "addons-895903"
I0923 10:25:56.164349 2613811 addons.go:234] Setting addon cloud-spanner=true in "addons-895903"
I0923 10:25:56.164379 2613811 host.go:66] Checking if "addons-895903" exists ...
I0923 10:25:56.164794 2613811 cli_runner.go:164] Run: docker container inspect addons-895903 --format={{.State.Status}}
I0923 10:25:56.166348 2613811 addons.go:69] Setting metrics-server=true in profile "addons-895903"
I0923 10:25:56.166612 2613811 addons.go:234] Setting addon metrics-server=true in "addons-895903"
I0923 10:25:56.166666 2613811 host.go:66] Checking if "addons-895903" exists ...
I0923 10:25:56.167043 2613811 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-895903"
I0923 10:25:56.167097 2613811 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-895903"
I0923 10:25:56.167125 2613811 host.go:66] Checking if "addons-895903" exists ...
I0923 10:25:56.169094 2613811 cli_runner.go:164] Run: docker container inspect addons-895903 --format={{.State.Status}}
I0923 10:25:56.166516 2613811 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-895903"
I0923 10:25:56.169852 2613811 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-895903"
I0923 10:25:56.169919 2613811 host.go:66] Checking if "addons-895903" exists ...
I0923 10:25:56.166529 2613811 addons.go:69] Setting registry=true in profile "addons-895903"
I0923 10:25:56.170546 2613811 addons.go:234] Setting addon registry=true in "addons-895903"
I0923 10:25:56.170599 2613811 host.go:66] Checking if "addons-895903" exists ...
I0923 10:25:56.171127 2613811 cli_runner.go:164] Run: docker container inspect addons-895903 --format={{.State.Status}}
I0923 10:25:56.179437 2613811 addons.go:69] Setting default-storageclass=true in profile "addons-895903"
I0923 10:25:56.179518 2613811 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-895903"
I0923 10:25:56.179867 2613811 cli_runner.go:164] Run: docker container inspect addons-895903 --format={{.State.Status}}
I0923 10:25:56.166536 2613811 addons.go:69] Setting storage-provisioner=true in profile "addons-895903"
I0923 10:25:56.180182 2613811 addons.go:234] Setting addon storage-provisioner=true in "addons-895903"
I0923 10:25:56.180220 2613811 host.go:66] Checking if "addons-895903" exists ...
I0923 10:25:56.180628 2613811 cli_runner.go:164] Run: docker container inspect addons-895903 --format={{.State.Status}}
I0923 10:25:56.166542 2613811 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-895903"
I0923 10:25:56.186186 2613811 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-895903"
I0923 10:25:56.186516 2613811 cli_runner.go:164] Run: docker container inspect addons-895903 --format={{.State.Status}}
I0923 10:25:56.196030 2613811 addons.go:69] Setting gcp-auth=true in profile "addons-895903"
I0923 10:25:56.196117 2613811 mustload.go:65] Loading cluster: addons-895903
I0923 10:25:56.196363 2613811 config.go:182] Loaded profile config "addons-895903": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I0923 10:25:56.196687 2613811 cli_runner.go:164] Run: docker container inspect addons-895903 --format={{.State.Status}}
I0923 10:25:56.166548 2613811 addons.go:69] Setting volcano=true in profile "addons-895903"
I0923 10:25:56.199478 2613811 addons.go:234] Setting addon volcano=true in "addons-895903"
I0923 10:25:56.199526 2613811 host.go:66] Checking if "addons-895903" exists ...
I0923 10:25:56.166556 2613811 addons.go:69] Setting volumesnapshots=true in profile "addons-895903"
I0923 10:25:56.200399 2613811 out.go:177] * Verifying Kubernetes components...
I0923 10:25:56.200651 2613811 cli_runner.go:164] Run: docker container inspect addons-895903 --format={{.State.Status}}
I0923 10:25:56.213221 2613811 cli_runner.go:164] Run: docker container inspect addons-895903 --format={{.State.Status}}
I0923 10:25:56.217897 2613811 addons.go:69] Setting ingress=true in profile "addons-895903"
I0923 10:25:56.217971 2613811 addons.go:234] Setting addon ingress=true in "addons-895903"
I0923 10:25:56.219832 2613811 host.go:66] Checking if "addons-895903" exists ...
I0923 10:25:56.220389 2613811 cli_runner.go:164] Run: docker container inspect addons-895903 --format={{.State.Status}}
I0923 10:25:56.228740 2613811 cli_runner.go:164] Run: docker container inspect addons-895903 --format={{.State.Status}}
I0923 10:25:56.230707 2613811 addons.go:69] Setting ingress-dns=true in profile "addons-895903"
I0923 10:25:56.230764 2613811 addons.go:234] Setting addon ingress-dns=true in "addons-895903"
I0923 10:25:56.230832 2613811 host.go:66] Checking if "addons-895903" exists ...
I0923 10:25:56.231505 2613811 cli_runner.go:164] Run: docker container inspect addons-895903 --format={{.State.Status}}
I0923 10:25:56.233035 2613811 addons.go:234] Setting addon volumesnapshots=true in "addons-895903"
I0923 10:25:56.233101 2613811 host.go:66] Checking if "addons-895903" exists ...
I0923 10:25:56.235148 2613811 cli_runner.go:164] Run: docker container inspect addons-895903 --format={{.State.Status}}
I0923 10:25:56.266669 2613811 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0923 10:25:56.280702 2613811 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I0923 10:25:56.282546 2613811 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
I0923 10:25:56.282575 2613811 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0923 10:25:56.282647 2613811 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-895903
I0923 10:25:56.322003 2613811 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0923 10:25:56.326863 2613811 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.24
I0923 10:25:56.330229 2613811 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
I0923 10:25:56.330256 2613811 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0923 10:25:56.330322 2613811 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-895903
I0923 10:25:56.341798 2613811 out.go:177] - Using image docker.io/registry:2.8.3
I0923 10:25:56.344063 2613811 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
I0923 10:25:56.348743 2613811 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
I0923 10:25:56.348768 2613811 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I0923 10:25:56.348842 2613811 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-895903
I0923 10:25:56.362847 2613811 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0
I0923 10:25:56.367165 2613811 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
I0923 10:25:56.367196 2613811 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I0923 10:25:56.367324 2613811 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-895903
I0923 10:25:56.412993 2613811 addons.go:234] Setting addon default-storageclass=true in "addons-895903"
I0923 10:25:56.413037 2613811 host.go:66] Checking if "addons-895903" exists ...
I0923 10:25:56.413464 2613811 cli_runner.go:164] Run: docker container inspect addons-895903 --format={{.State.Status}}
I0923 10:25:56.418198 2613811 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-895903"
I0923 10:25:56.418235 2613811 host.go:66] Checking if "addons-895903" exists ...
I0923 10:25:56.418672 2613811 cli_runner.go:164] Run: docker container inspect addons-895903 --format={{.State.Status}}
I0923 10:25:56.431034 2613811 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0923 10:25:56.435438 2613811 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0923 10:25:56.436680 2613811 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0923 10:25:56.442345 2613811 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0923 10:25:56.442481 2613811 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2
I0923 10:25:56.445419 2613811 host.go:66] Checking if "addons-895903" exists ...
I0923 10:25:56.454866 2613811 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0923 10:25:56.454998 2613811 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0923 10:25:56.455016 2613811 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0923 10:25:56.455103 2613811 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-895903
I0923 10:25:56.465664 2613811 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0923 10:25:56.465817 2613811 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
I0923 10:25:56.471364 2613811 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0923 10:25:56.471682 2613811 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0923 10:25:56.471711 2613811 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0923 10:25:56.471797 2613811 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-895903
I0923 10:25:56.475496 2613811 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0923 10:25:56.475520 2613811 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0923 10:25:56.475587 2613811 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-895903
I0923 10:25:56.499362 2613811 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0923 10:25:56.501602 2613811 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0923 10:25:56.501629 2613811 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0923 10:25:56.501700 2613811 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-895903
I0923 10:25:56.506492 2613811 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0923 10:25:56.514962 2613811 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I0923 10:25:56.519764 2613811 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0923 10:25:56.520020 2613811 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41421 SSHKeyPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/machines/addons-895903/id_rsa Username:docker}
I0923 10:25:56.522163 2613811 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2
I0923 10:25:56.522460 2613811 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0923 10:25:56.522475 2613811 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0923 10:25:56.522538 2613811 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-895903
I0923 10:25:56.529297 2613811 out.go:177] - Using image docker.io/volcanosh/vc-webhook-manager:v1.9.0
I0923 10:25:56.529735 2613811 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0923 10:25:56.529751 2613811 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I0923 10:25:56.529813 2613811 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-895903
I0923 10:25:56.545935 2613811 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0923 10:25:56.551388 2613811 out.go:177] - Using image docker.io/volcanosh/vc-controller-manager:v1.9.0
I0923 10:25:56.556230 2613811 out.go:177] - Using image docker.io/volcanosh/vc-scheduler:v1.9.0
I0923 10:25:56.559248 2613811 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml
I0923 10:25:56.559274 2613811 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (434001 bytes)
I0923 10:25:56.562409 2613811 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-895903
I0923 10:25:56.573551 2613811 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41421 SSHKeyPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/machines/addons-895903/id_rsa Username:docker}
I0923 10:25:56.573910 2613811 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41421 SSHKeyPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/machines/addons-895903/id_rsa Username:docker}
I0923 10:25:56.576823 2613811 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41421 SSHKeyPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/machines/addons-895903/id_rsa Username:docker}
I0923 10:25:56.578177 2613811 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0923 10:25:56.583026 2613811 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0923 10:25:56.583059 2613811 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0923 10:25:56.583122 2613811 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-895903
I0923 10:25:56.583543 2613811 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0923 10:25:56.589557 2613811 out.go:177] - Using image docker.io/busybox:stable
I0923 10:25:56.591512 2613811 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0923 10:25:56.591534 2613811 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0923 10:25:56.591604 2613811 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-895903
I0923 10:25:56.646924 2613811 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41421 SSHKeyPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/machines/addons-895903/id_rsa Username:docker}
I0923 10:25:56.677886 2613811 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0923 10:25:56.677908 2613811 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0923 10:25:56.678112 2613811 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-895903
I0923 10:25:56.678515 2613811 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0923 10:25:56.695447 2613811 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41421 SSHKeyPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/machines/addons-895903/id_rsa Username:docker}
I0923 10:25:56.702469 2613811 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41421 SSHKeyPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/machines/addons-895903/id_rsa Username:docker}
I0923 10:25:56.705169 2613811 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41421 SSHKeyPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/machines/addons-895903/id_rsa Username:docker}
I0923 10:25:56.717200 2613811 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41421 SSHKeyPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/machines/addons-895903/id_rsa Username:docker}
I0923 10:25:56.724924 2613811 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41421 SSHKeyPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/machines/addons-895903/id_rsa Username:docker}
I0923 10:25:56.761050 2613811 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41421 SSHKeyPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/machines/addons-895903/id_rsa Username:docker}
I0923 10:25:56.766594 2613811 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41421 SSHKeyPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/machines/addons-895903/id_rsa Username:docker}
W0923 10:25:56.768690 2613811 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0923 10:25:56.768716 2613811 retry.go:31] will retry after 339.286565ms: ssh: handshake failed: EOF
I0923 10:25:56.772325 2613811 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41421 SSHKeyPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/machines/addons-895903/id_rsa Username:docker}
I0923 10:25:56.793444 2613811 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41421 SSHKeyPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/machines/addons-895903/id_rsa Username:docker}
I0923 10:25:57.206129 2613811 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0923 10:25:57.231628 2613811 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0923 10:25:57.231700 2613811 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0923 10:25:57.235340 2613811 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0923 10:25:57.282384 2613811 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0923 10:25:57.385416 2613811 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0923 10:25:57.385496 2613811 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0923 10:25:57.400083 2613811 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0923 10:25:57.400147 2613811 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0923 10:25:57.451487 2613811 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0923 10:25:57.451510 2613811 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0923 10:25:57.602008 2613811 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
I0923 10:25:57.602088 2613811 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0923 10:25:57.741771 2613811 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0923 10:25:57.741850 2613811 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0923 10:25:57.758051 2613811 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0923 10:25:57.758081 2613811 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0923 10:25:57.806090 2613811 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I0923 10:25:57.806115 2613811 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I0923 10:25:57.856728 2613811 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0923 10:25:57.873402 2613811 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
I0923 10:25:57.873428 2613811 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0923 10:25:57.875781 2613811 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0923 10:25:57.875803 2613811 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0923 10:25:57.912042 2613811 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0923 10:25:57.936303 2613811 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0923 10:25:57.960885 2613811 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0923 10:25:57.995320 2613811 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
I0923 10:25:57.999779 2613811 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
I0923 10:25:57.999804 2613811 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0923 10:25:58.092014 2613811 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0923 10:25:58.092039 2613811 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0923 10:25:58.104282 2613811 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
I0923 10:25:58.104308 2613811 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I0923 10:25:58.118896 2613811 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0923 10:25:58.118924 2613811 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0923 10:25:58.180700 2613811 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0923 10:25:58.298352 2613811 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0923 10:25:58.301350 2613811 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
I0923 10:25:58.301381 2613811 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0923 10:25:58.482488 2613811 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I0923 10:25:58.482514 2613811 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I0923 10:25:58.491676 2613811 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0923 10:25:58.491703 2613811 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0923 10:25:58.587946 2613811 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0923 10:25:58.587973 2613811 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0923 10:25:58.632344 2613811 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.195626135s)
I0923 10:25:58.632374 2613811 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I0923 10:25:58.633395 2613811 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (1.954856606s)
I0923 10:25:58.634085 2613811 node_ready.go:35] waiting up to 6m0s for node "addons-895903" to be "Ready" ...
I0923 10:25:58.637637 2613811 node_ready.go:49] node "addons-895903" has status "Ready":"True"
I0923 10:25:58.637698 2613811 node_ready.go:38] duration metric: took 3.584182ms for node "addons-895903" to be "Ready" ...
I0923 10:25:58.637724 2613811 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0923 10:25:58.653283 2613811 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-j4q7p" in "kube-system" namespace to be "Ready" ...
I0923 10:25:58.759300 2613811 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
I0923 10:25:58.759377 2613811 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0923 10:25:58.770491 2613811 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0923 10:25:58.770562 2613811 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0923 10:25:58.773719 2613811 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I0923 10:25:58.773789 2613811 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I0923 10:25:58.955727 2613811 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0923 10:25:58.955801 2613811 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0923 10:25:59.007992 2613811 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0923 10:25:59.018121 2613811 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (1.811917434s)
I0923 10:25:59.047422 2613811 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I0923 10:25:59.047499 2613811 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I0923 10:25:59.089439 2613811 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
I0923 10:25:59.089512 2613811 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0923 10:25:59.137033 2613811 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-895903" context rescaled to 1 replicas
I0923 10:25:59.211435 2613811 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0923 10:25:59.211509 2613811 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0923 10:25:59.364792 2613811 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
I0923 10:25:59.364872 2613811 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I0923 10:25:59.417450 2613811 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0923 10:25:59.515369 2613811 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0923 10:25:59.515451 2613811 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0923 10:25:59.538207 2613811 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
I0923 10:25:59.538279 2613811 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
I0923 10:25:59.786760 2613811 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I0923 10:25:59.906870 2613811 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0923 10:25:59.906945 2613811 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0923 10:26:00.569623 2613811 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0923 10:26:00.569698 2613811 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0923 10:26:00.661782 2613811 pod_ready.go:103] pod "coredns-7c65d6cfc9-j4q7p" in "kube-system" namespace has status "Ready":"False"
I0923 10:26:00.795905 2613811 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0923 10:26:00.795982 2613811 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0923 10:26:00.995911 2613811 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0923 10:26:03.191608 2613811 pod_ready.go:103] pod "coredns-7c65d6cfc9-j4q7p" in "kube-system" namespace has status "Ready":"False"
I0923 10:26:03.655428 2613811 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0923 10:26:03.655625 2613811 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-895903
I0923 10:26:03.703413 2613811 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41421 SSHKeyPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/machines/addons-895903/id_rsa Username:docker}
I0923 10:26:03.963884 2613811 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0923 10:26:04.056152 2613811 addons.go:234] Setting addon gcp-auth=true in "addons-895903"
I0923 10:26:04.056212 2613811 host.go:66] Checking if "addons-895903" exists ...
I0923 10:26:04.056728 2613811 cli_runner.go:164] Run: docker container inspect addons-895903 --format={{.State.Status}}
I0923 10:26:04.091467 2613811 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0923 10:26:04.091526 2613811 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-895903
I0923 10:26:04.129679 2613811 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41421 SSHKeyPath:/home/jenkins/minikube-integration/19689-2607666/.minikube/machines/addons-895903/id_rsa Username:docker}
I0923 10:26:04.618667 2613811 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (7.336244667s)
I0923 10:26:04.618813 2613811 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (6.761994872s)
I0923 10:26:04.618899 2613811 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (6.706835365s)
I0923 10:26:04.619150 2613811 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (6.682826337s)
I0923 10:26:04.619226 2613811 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (6.658317732s)
I0923 10:26:04.619792 2613811 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (7.384374018s)
I0923 10:26:04.619839 2613811 addons.go:475] Verifying addon ingress=true in "addons-895903"
I0923 10:26:04.621975 2613811 out.go:177] * Verifying ingress addon...
I0923 10:26:04.625048 2613811 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0923 10:26:04.634289 2613811 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0923 10:26:04.634310 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W0923 10:26:04.638210 2613811 out.go:270] ! Enabling 'storage-provisioner-rancher' returned an error: running callbacks: [Error making local-path the default storage class: Error while marking storage class local-path as default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]
I0923 10:26:05.178969 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:05.235510 2613811 pod_ready.go:103] pod "coredns-7c65d6cfc9-j4q7p" in "kube-system" namespace has status "Ready":"False"
I0923 10:26:05.718296 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:06.129991 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:06.244674 2613811 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (8.063937477s)
I0923 10:26:06.245015 2613811 addons.go:475] Verifying addon registry=true in "addons-895903"
I0923 10:26:06.244800 2613811 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (7.946416812s)
I0923 10:26:06.245073 2613811 addons.go:475] Verifying addon metrics-server=true in "addons-895903"
I0923 10:26:06.244874 2613811 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (7.236802014s)
W0923 10:26:06.245097 2613811 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0923 10:26:06.245112 2613811 retry.go:31] will retry after 245.145851ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0923 10:26:06.244905 2613811 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (6.827377937s)
I0923 10:26:06.244966 2613811 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (6.45813048s)
I0923 10:26:06.245498 2613811 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (8.250151443s)
I0923 10:26:06.247359 2613811 out.go:177] * Verifying registry addon...
I0923 10:26:06.247368 2613811 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-895903 service yakd-dashboard -n yakd-dashboard
I0923 10:26:06.250188 2613811 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0923 10:26:06.282464 2613811 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0923 10:26:06.282487 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:06.491024 2613811 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0923 10:26:06.660915 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:06.753880 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:07.157215 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:07.251659 2613811 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (6.255702983s)
I0923 10:26:07.251687 2613811 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-895903"
I0923 10:26:07.251820 2613811 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (3.16032709s)
I0923 10:26:07.254573 2613811 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
I0923 10:26:07.254673 2613811 out.go:177] * Verifying csi-hostpath-driver addon...
I0923 10:26:07.256964 2613811 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0923 10:26:07.257895 2613811 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0923 10:26:07.260326 2613811 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0923 10:26:07.260380 2613811 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0923 10:26:07.263591 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:07.272175 2613811 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0923 10:26:07.272319 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:07.313625 2613811 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0923 10:26:07.313691 2613811 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0923 10:26:07.390497 2613811 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0923 10:26:07.390581 2613811 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I0923 10:26:07.435515 2613811 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0923 10:26:07.629422 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:07.658905 2613811 pod_ready.go:103] pod "coredns-7c65d6cfc9-j4q7p" in "kube-system" namespace has status "Ready":"False"
I0923 10:26:07.754581 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:07.762877 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:07.950427 2613811 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.459358869s)
I0923 10:26:08.129802 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:08.254410 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:08.262930 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:08.460410 2613811 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.024850845s)
I0923 10:26:08.464814 2613811 addons.go:475] Verifying addon gcp-auth=true in "addons-895903"
I0923 10:26:08.467208 2613811 out.go:177] * Verifying gcp-auth addon...
I0923 10:26:08.470163 2613811 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0923 10:26:08.480806 2613811 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0923 10:26:08.630753 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:08.753503 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:08.763260 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:09.130229 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:09.254386 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:09.263544 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:09.630352 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:09.660039 2613811 pod_ready.go:103] pod "coredns-7c65d6cfc9-j4q7p" in "kube-system" namespace has status "Ready":"False"
I0923 10:26:09.754429 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:09.763139 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:10.132090 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:10.255380 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:10.263224 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:10.630418 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:10.754715 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:10.764156 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:11.131115 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:11.255079 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:11.265861 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:11.631624 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:11.664074 2613811 pod_ready.go:103] pod "coredns-7c65d6cfc9-j4q7p" in "kube-system" namespace has status "Ready":"False"
I0923 10:26:11.757498 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:11.765117 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:12.131567 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:12.254127 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:12.262829 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:12.628877 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:12.754627 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:12.763439 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:13.129564 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:13.254382 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:13.263147 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:13.629834 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:13.667363 2613811 pod_ready.go:103] pod "coredns-7c65d6cfc9-j4q7p" in "kube-system" namespace has status "Ready":"False"
I0923 10:26:13.754870 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:13.763479 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:14.129256 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:14.254275 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:14.262721 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:14.629292 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:14.754667 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:14.762190 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:15.130377 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:15.254237 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:15.263552 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:15.629651 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:15.754828 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:15.764127 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:16.141233 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:16.160922 2613811 pod_ready.go:103] pod "coredns-7c65d6cfc9-j4q7p" in "kube-system" namespace has status "Ready":"False"
I0923 10:26:16.256752 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:16.263701 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:16.629735 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:16.754944 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:16.762687 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:17.129813 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:17.253853 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:17.262512 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:17.629275 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:17.754651 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:17.763047 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:18.129467 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:18.254456 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:18.262608 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:18.629213 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:18.660533 2613811 pod_ready.go:103] pod "coredns-7c65d6cfc9-j4q7p" in "kube-system" namespace has status "Ready":"False"
I0923 10:26:18.754174 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:18.762967 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:19.131471 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:19.254540 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:19.263218 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:19.630409 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:19.753618 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:19.762459 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:20.130037 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:20.254779 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:20.262694 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:20.629127 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:20.753747 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:20.762456 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:21.129187 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:21.160542 2613811 pod_ready.go:103] pod "coredns-7c65d6cfc9-j4q7p" in "kube-system" namespace has status "Ready":"False"
I0923 10:26:21.254345 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:21.262737 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:21.631138 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:21.754530 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:21.762591 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:22.129924 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:22.254596 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:22.262807 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:22.629980 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:22.757786 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:22.762801 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:23.129220 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:23.254521 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:23.262350 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:23.630381 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:23.660797 2613811 pod_ready.go:103] pod "coredns-7c65d6cfc9-j4q7p" in "kube-system" namespace has status "Ready":"False"
I0923 10:26:23.753829 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:23.762765 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:24.130332 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:24.254688 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:24.263180 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:24.629585 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:24.754393 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:24.762882 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:25.130579 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:25.254219 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:25.263171 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:25.629692 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:25.754874 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:25.762572 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:26.130090 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:26.160302 2613811 pod_ready.go:103] pod "coredns-7c65d6cfc9-j4q7p" in "kube-system" namespace has status "Ready":"False"
I0923 10:26:26.260154 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:26.265330 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:26.631033 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:26.754386 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:26.763083 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:27.129110 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:27.254123 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:27.262639 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:27.629670 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:27.754478 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:27.764052 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:28.129915 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:28.254253 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:28.262888 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:28.629344 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:28.659357 2613811 pod_ready.go:103] pod "coredns-7c65d6cfc9-j4q7p" in "kube-system" namespace has status "Ready":"False"
I0923 10:26:28.754284 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:28.762718 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:29.130177 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:29.254628 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:29.263460 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:29.629621 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:29.753983 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:29.762718 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:30.131418 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:30.254578 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:30.263661 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:30.629213 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:30.660413 2613811 pod_ready.go:103] pod "coredns-7c65d6cfc9-j4q7p" in "kube-system" namespace has status "Ready":"False"
I0923 10:26:30.754541 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:30.762878 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:31.129184 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:31.254795 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:31.263188 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:31.629275 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:31.754229 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:31.763522 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:32.130876 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:32.255212 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:32.262837 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:32.629501 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:32.754612 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:32.762324 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:33.130545 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:33.163364 2613811 pod_ready.go:103] pod "coredns-7c65d6cfc9-j4q7p" in "kube-system" namespace has status "Ready":"False"
I0923 10:26:33.266064 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:33.280739 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:33.629572 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:33.754610 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:33.762913 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:34.129568 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:34.253831 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:34.263224 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:34.629901 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:34.754890 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:34.762329 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:35.129904 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:35.254065 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:35.263137 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:35.629089 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:35.660275 2613811 pod_ready.go:103] pod "coredns-7c65d6cfc9-j4q7p" in "kube-system" namespace has status "Ready":"False"
I0923 10:26:35.754030 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:35.762581 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:36.130167 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:36.254092 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:36.262710 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:36.630213 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:36.754297 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:36.762991 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:37.130391 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:37.253951 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:37.262193 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:37.630168 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:37.754218 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:37.762682 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:38.129691 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:38.160687 2613811 pod_ready.go:103] pod "coredns-7c65d6cfc9-j4q7p" in "kube-system" namespace has status "Ready":"False"
I0923 10:26:38.254339 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:38.263058 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:38.630141 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:38.754156 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:38.762917 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:39.129806 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:39.254340 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:39.262797 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:39.630213 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:39.754538 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:39.762936 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:40.130585 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:40.160767 2613811 pod_ready.go:103] pod "coredns-7c65d6cfc9-j4q7p" in "kube-system" namespace has status "Ready":"False"
I0923 10:26:40.254787 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:40.263394 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:40.629901 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:40.753837 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:40.762846 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:41.132544 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:41.255797 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:41.265682 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:41.630251 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:41.754780 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:41.763363 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:42.132276 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:42.171180 2613811 pod_ready.go:103] pod "coredns-7c65d6cfc9-j4q7p" in "kube-system" namespace has status "Ready":"False"
I0923 10:26:42.261631 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:42.272119 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:42.630092 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:42.659049 2613811 pod_ready.go:93] pod "coredns-7c65d6cfc9-j4q7p" in "kube-system" namespace has status "Ready":"True"
I0923 10:26:42.659076 2613811 pod_ready.go:82] duration metric: took 44.005713606s for pod "coredns-7c65d6cfc9-j4q7p" in "kube-system" namespace to be "Ready" ...
I0923 10:26:42.659088 2613811 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-md4fh" in "kube-system" namespace to be "Ready" ...
I0923 10:26:42.660931 2613811 pod_ready.go:98] error getting pod "coredns-7c65d6cfc9-md4fh" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-md4fh" not found
I0923 10:26:42.660995 2613811 pod_ready.go:82] duration metric: took 1.899553ms for pod "coredns-7c65d6cfc9-md4fh" in "kube-system" namespace to be "Ready" ...
E0923 10:26:42.661014 2613811 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-7c65d6cfc9-md4fh" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-md4fh" not found
I0923 10:26:42.661021 2613811 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-895903" in "kube-system" namespace to be "Ready" ...
I0923 10:26:42.666203 2613811 pod_ready.go:93] pod "etcd-addons-895903" in "kube-system" namespace has status "Ready":"True"
I0923 10:26:42.666226 2613811 pod_ready.go:82] duration metric: took 5.19759ms for pod "etcd-addons-895903" in "kube-system" namespace to be "Ready" ...
I0923 10:26:42.666242 2613811 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-895903" in "kube-system" namespace to be "Ready" ...
I0923 10:26:42.671375 2613811 pod_ready.go:93] pod "kube-apiserver-addons-895903" in "kube-system" namespace has status "Ready":"True"
I0923 10:26:42.671399 2613811 pod_ready.go:82] duration metric: took 5.147227ms for pod "kube-apiserver-addons-895903" in "kube-system" namespace to be "Ready" ...
I0923 10:26:42.671411 2613811 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-895903" in "kube-system" namespace to be "Ready" ...
I0923 10:26:42.676355 2613811 pod_ready.go:93] pod "kube-controller-manager-addons-895903" in "kube-system" namespace has status "Ready":"True"
I0923 10:26:42.676379 2613811 pod_ready.go:82] duration metric: took 4.960692ms for pod "kube-controller-manager-addons-895903" in "kube-system" namespace to be "Ready" ...
I0923 10:26:42.676392 2613811 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-mckj4" in "kube-system" namespace to be "Ready" ...
I0923 10:26:42.753675 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:42.762426 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:42.856542 2613811 pod_ready.go:93] pod "kube-proxy-mckj4" in "kube-system" namespace has status "Ready":"True"
I0923 10:26:42.856568 2613811 pod_ready.go:82] duration metric: took 180.16857ms for pod "kube-proxy-mckj4" in "kube-system" namespace to be "Ready" ...
I0923 10:26:42.856579 2613811 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-895903" in "kube-system" namespace to be "Ready" ...
I0923 10:26:43.130578 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:43.254455 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:43.257188 2613811 pod_ready.go:93] pod "kube-scheduler-addons-895903" in "kube-system" namespace has status "Ready":"True"
I0923 10:26:43.257216 2613811 pod_ready.go:82] duration metric: took 400.625966ms for pod "kube-scheduler-addons-895903" in "kube-system" namespace to be "Ready" ...
I0923 10:26:43.257227 2613811 pod_ready.go:39] duration metric: took 44.619478156s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0923 10:26:43.257242 2613811 api_server.go:52] waiting for apiserver process to appear ...
I0923 10:26:43.257308 2613811 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0923 10:26:43.271122 2613811 api_server.go:72] duration metric: took 47.109366553s to wait for apiserver process to appear ...
I0923 10:26:43.271146 2613811 api_server.go:88] waiting for apiserver healthz status ...
I0923 10:26:43.271167 2613811 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I0923 10:26:43.280169 2613811 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I0923 10:26:43.281163 2613811 api_server.go:141] control plane version: v1.31.1
I0923 10:26:43.281190 2613811 api_server.go:131] duration metric: took 10.035944ms to wait for apiserver health ...
I0923 10:26:43.281199 2613811 system_pods.go:43] waiting for kube-system pods to appear ...
I0923 10:26:43.356144 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:43.463788 2613811 system_pods.go:59] 18 kube-system pods found
I0923 10:26:43.463828 2613811 system_pods.go:61] "coredns-7c65d6cfc9-j4q7p" [798cfb79-7676-4cad-b9fb-1af6a1c8291c] Running
I0923 10:26:43.463837 2613811 system_pods.go:61] "csi-hostpath-attacher-0" [dece228a-f5d6-44a9-86f6-4b0934d95786] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0923 10:26:43.463845 2613811 system_pods.go:61] "csi-hostpath-resizer-0" [0b290bf6-b803-4f36-9404-5110fdaed196] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0923 10:26:43.463855 2613811 system_pods.go:61] "csi-hostpathplugin-4n4q7" [eca301e7-fca3-486b-8cb3-c08e370c253a] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0923 10:26:43.463860 2613811 system_pods.go:61] "etcd-addons-895903" [d0fa203b-30c6-467d-966f-e432eade70ab] Running
I0923 10:26:43.463864 2613811 system_pods.go:61] "kindnet-vj6hj" [247b200b-16cd-4790-afc8-4f1ae7f8a569] Running
I0923 10:26:43.463868 2613811 system_pods.go:61] "kube-apiserver-addons-895903" [a09526d5-215c-451f-b395-342ea2ada4df] Running
I0923 10:26:43.463872 2613811 system_pods.go:61] "kube-controller-manager-addons-895903" [f4531424-e4e2-4b14-a36f-140c87b1f59c] Running
I0923 10:26:43.463877 2613811 system_pods.go:61] "kube-ingress-dns-minikube" [5cd5ffcb-7820-43fa-b964-0b987c301620] Running
I0923 10:26:43.463881 2613811 system_pods.go:61] "kube-proxy-mckj4" [20b8dd4c-d9fe-4395-acf6-d0db1dfb38e5] Running
I0923 10:26:43.463885 2613811 system_pods.go:61] "kube-scheduler-addons-895903" [09e493cd-0e0b-441c-94c1-84a4b8584c50] Running
I0923 10:26:43.463893 2613811 system_pods.go:61] "metrics-server-84c5f94fbc-jw4gj" [ce212bd3-d200-4f28-ad95-8a82fcaa0703] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0923 10:26:43.463934 2613811 system_pods.go:61] "nvidia-device-plugin-daemonset-r7wk4" [139101f4-490e-4130-90f0-4341fcfd1afb] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I0923 10:26:43.463941 2613811 system_pods.go:61] "registry-66c9cd494c-jwrzn" [b939f687-74b6-4a54-9a56-07aa57ae0752] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0923 10:26:43.463951 2613811 system_pods.go:61] "registry-proxy-skfcc" [7874c975-6ab8-4813-bd94-94c3ecf85327] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0923 10:26:43.463958 2613811 system_pods.go:61] "snapshot-controller-56fcc65765-57fj2" [9aae62e1-0a42-406c-a542-2162595178b8] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0923 10:26:43.463967 2613811 system_pods.go:61] "snapshot-controller-56fcc65765-jt2fx" [049df3ed-990e-4945-8bf9-9b93dc68dad2] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0923 10:26:43.463972 2613811 system_pods.go:61] "storage-provisioner" [b358446f-3d09-4444-ac88-c5483b59d295] Running
I0923 10:26:43.463977 2613811 system_pods.go:74] duration metric: took 182.735664ms to wait for pod list to return data ...
I0923 10:26:43.463985 2613811 default_sa.go:34] waiting for default service account to be created ...
I0923 10:26:43.630287 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:43.657370 2613811 default_sa.go:45] found service account: "default"
I0923 10:26:43.657396 2613811 default_sa.go:55] duration metric: took 193.399905ms for default service account to be created ...
I0923 10:26:43.657406 2613811 system_pods.go:116] waiting for k8s-apps to be running ...
I0923 10:26:43.753730 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:43.763061 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:43.868449 2613811 system_pods.go:86] 18 kube-system pods found
I0923 10:26:43.868538 2613811 system_pods.go:89] "coredns-7c65d6cfc9-j4q7p" [798cfb79-7676-4cad-b9fb-1af6a1c8291c] Running
I0923 10:26:43.868568 2613811 system_pods.go:89] "csi-hostpath-attacher-0" [dece228a-f5d6-44a9-86f6-4b0934d95786] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0923 10:26:43.868604 2613811 system_pods.go:89] "csi-hostpath-resizer-0" [0b290bf6-b803-4f36-9404-5110fdaed196] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0923 10:26:43.868633 2613811 system_pods.go:89] "csi-hostpathplugin-4n4q7" [eca301e7-fca3-486b-8cb3-c08e370c253a] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0923 10:26:43.868654 2613811 system_pods.go:89] "etcd-addons-895903" [d0fa203b-30c6-467d-966f-e432eade70ab] Running
I0923 10:26:43.868671 2613811 system_pods.go:89] "kindnet-vj6hj" [247b200b-16cd-4790-afc8-4f1ae7f8a569] Running
I0923 10:26:43.868676 2613811 system_pods.go:89] "kube-apiserver-addons-895903" [a09526d5-215c-451f-b395-342ea2ada4df] Running
I0923 10:26:43.868681 2613811 system_pods.go:89] "kube-controller-manager-addons-895903" [f4531424-e4e2-4b14-a36f-140c87b1f59c] Running
I0923 10:26:43.868685 2613811 system_pods.go:89] "kube-ingress-dns-minikube" [5cd5ffcb-7820-43fa-b964-0b987c301620] Running
I0923 10:26:43.868689 2613811 system_pods.go:89] "kube-proxy-mckj4" [20b8dd4c-d9fe-4395-acf6-d0db1dfb38e5] Running
I0923 10:26:43.868693 2613811 system_pods.go:89] "kube-scheduler-addons-895903" [09e493cd-0e0b-441c-94c1-84a4b8584c50] Running
I0923 10:26:43.868713 2613811 system_pods.go:89] "metrics-server-84c5f94fbc-jw4gj" [ce212bd3-d200-4f28-ad95-8a82fcaa0703] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0923 10:26:43.868721 2613811 system_pods.go:89] "nvidia-device-plugin-daemonset-r7wk4" [139101f4-490e-4130-90f0-4341fcfd1afb] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I0923 10:26:43.868728 2613811 system_pods.go:89] "registry-66c9cd494c-jwrzn" [b939f687-74b6-4a54-9a56-07aa57ae0752] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0923 10:26:43.868735 2613811 system_pods.go:89] "registry-proxy-skfcc" [7874c975-6ab8-4813-bd94-94c3ecf85327] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0923 10:26:43.868741 2613811 system_pods.go:89] "snapshot-controller-56fcc65765-57fj2" [9aae62e1-0a42-406c-a542-2162595178b8] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0923 10:26:43.868747 2613811 system_pods.go:89] "snapshot-controller-56fcc65765-jt2fx" [049df3ed-990e-4945-8bf9-9b93dc68dad2] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0923 10:26:43.868751 2613811 system_pods.go:89] "storage-provisioner" [b358446f-3d09-4444-ac88-c5483b59d295] Running
I0923 10:26:43.868759 2613811 system_pods.go:126] duration metric: took 211.34738ms to wait for k8s-apps to be running ...
I0923 10:26:43.868767 2613811 system_svc.go:44] waiting for kubelet service to be running ....
I0923 10:26:43.868826 2613811 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0923 10:26:43.886247 2613811 system_svc.go:56] duration metric: took 17.469734ms WaitForService to wait for kubelet
I0923 10:26:43.886327 2613811 kubeadm.go:582] duration metric: took 47.724576505s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0923 10:26:43.886361 2613811 node_conditions.go:102] verifying NodePressure condition ...
I0923 10:26:44.059524 2613811 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0923 10:26:44.059559 2613811 node_conditions.go:123] node cpu capacity is 2
I0923 10:26:44.059572 2613811 node_conditions.go:105] duration metric: took 173.174146ms to run NodePressure ...
I0923 10:26:44.059586 2613811 start.go:241] waiting for startup goroutines ...
I0923 10:26:44.129792 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:44.254862 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:44.262502 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:44.629808 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:44.754891 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:44.764260 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:45.238315 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:45.259505 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:45.265245 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:45.631176 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:45.754370 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:45.763465 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:46.129150 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:46.254243 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:46.263055 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:46.629662 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:46.754729 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:46.762428 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:47.130723 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:47.254234 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:47.262838 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:47.630557 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:47.754367 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:47.762410 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:48.130421 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:48.256424 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:48.263273 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:48.629656 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:48.754389 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:48.763202 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:49.129597 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:49.258385 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:49.263057 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:49.629405 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:49.754752 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:49.763489 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:50.130365 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:50.253686 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:50.262438 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:50.637444 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:50.754898 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:50.763200 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:51.130619 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:51.254476 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:51.263407 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:51.630500 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:51.754821 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:51.763207 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:52.130148 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:52.253765 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:52.262762 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:52.630536 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:52.754539 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:52.763596 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:53.129257 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:53.255061 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:53.263778 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:53.630040 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:53.753538 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:53.763110 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:54.130705 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:54.255407 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:54.264478 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:54.630595 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:54.754461 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:54.763182 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:55.130164 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:55.253548 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:55.262878 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:55.632385 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:55.754518 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:55.762994 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:56.132422 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:56.254591 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:56.262993 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:56.630110 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:56.754868 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:56.764137 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:57.129038 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:57.253886 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:57.262513 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:57.629553 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:57.754268 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:57.762790 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:58.129213 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:58.253997 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:58.262928 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:58.629390 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:58.754239 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:58.765318 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:59.130031 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:59.254927 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:59.262924 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:26:59.630275 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:26:59.754281 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:26:59.762510 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:00.177392 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:00.279387 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:00.280065 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:27:00.629497 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:00.754383 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:27:00.763186 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:01.130889 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:01.255764 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:27:01.263786 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:01.629500 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:01.754419 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:27:01.763140 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:02.130590 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:02.254458 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:27:02.263675 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:02.629712 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:02.757096 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:27:02.766157 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:03.129745 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:03.254665 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:27:03.263940 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:03.630508 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:03.755569 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:27:03.763376 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:04.129584 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:04.253932 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0923 10:27:04.262116 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:04.629789 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:04.755970 2613811 kapi.go:107] duration metric: took 58.505778932s to wait for kubernetes.io/minikube-addons=registry ...
I0923 10:27:04.762399 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:05.130858 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:05.263960 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:05.632313 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:05.766639 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:06.131465 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:06.271245 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:06.630399 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:06.771244 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:07.131316 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:07.263944 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:07.631016 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:07.767925 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:08.129795 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:08.264098 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:08.629817 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:08.764356 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:09.130366 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:09.263203 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:09.629582 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:09.763171 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:10.130714 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:10.263498 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:10.630305 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:10.762687 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:11.131496 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:11.265340 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:11.630423 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:11.764088 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:12.129824 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:12.264965 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:12.631076 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:12.762930 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:13.130490 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:13.263971 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:13.630166 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:13.763582 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:14.129857 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:14.262960 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:14.630434 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:14.762814 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:15.130277 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:15.262765 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:15.630257 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:15.763026 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:16.130924 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:16.264173 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:16.632198 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:16.763221 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:17.131558 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:17.263571 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:17.631024 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:17.763471 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:18.130284 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:18.263558 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:18.630696 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:18.765310 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:19.131012 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:19.262396 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:19.630126 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:19.766506 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:20.139913 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:20.262763 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:20.629614 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:20.763356 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:21.129500 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:21.263580 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:21.633562 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:21.762711 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:22.129464 2613811 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0923 10:27:22.264976 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:22.633733 2613811 kapi.go:107] duration metric: took 1m18.008678344s to wait for app.kubernetes.io/name=ingress-nginx ...
I0923 10:27:22.768316 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:23.263872 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:23.763788 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:24.262330 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:24.763509 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:25.264056 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:25.762820 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:26.263562 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:26.762987 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:27.263482 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:27.764338 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:28.263321 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:28.763622 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:29.262898 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0923 10:27:29.763019 2613811 kapi.go:107] duration metric: took 1m22.50512239s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0923 10:28:52.474069 2613811 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0923 10:28:52.474092 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:28:52.974235 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:28:53.474876 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:28:53.973907 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:28:54.473873 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:28:54.973502 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:28:55.475037 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:28:55.973452 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:28:56.474267 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:28:56.974006 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:28:57.473831 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:28:57.973855 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:28:58.473523 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:28:58.975054 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:28:59.473744 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:28:59.973434 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:00.475024 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:00.974427 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:01.475245 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:01.974397 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:02.474005 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:02.973329 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:03.474310 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:03.974463 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:04.474068 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:04.973296 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:05.474462 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:05.974345 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:06.473533 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:06.974277 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:07.474223 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:07.974520 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:08.475134 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:08.974605 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:09.474519 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:09.974367 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:10.474567 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:10.974587 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:11.476547 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:11.976413 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:12.474375 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:12.974033 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:13.473784 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:13.974352 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:14.474122 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:14.973488 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:15.474166 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:15.974712 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:16.473896 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:16.974171 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:17.474441 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:17.974552 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:18.474437 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:18.973907 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:19.474667 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:19.973880 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:20.474600 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:20.974647 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:21.473747 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:21.973462 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:22.474409 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:22.974628 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:23.475207 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:23.974279 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:24.474619 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:24.975242 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:25.474365 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:25.974694 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:26.473618 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:26.974192 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:27.474452 2613811 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0923 10:29:27.980932 2613811 kapi.go:107] duration metric: took 3m19.510767062s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0923 10:29:27.983108 2613811 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-895903 cluster.
I0923 10:29:27.985420 2613811 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0923 10:29:27.988002 2613811 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0923 10:29:27.989952 2613811 out.go:177] * Enabled addons: nvidia-device-plugin, storage-provisioner, cloud-spanner, ingress-dns, default-storageclass, metrics-server, inspektor-gadget, volcano, yakd, volumesnapshots, registry, ingress, csi-hostpath-driver, gcp-auth
I0923 10:29:27.991718 2613811 addons.go:510] duration metric: took 3m31.829532617s for enable addons: enabled=[nvidia-device-plugin storage-provisioner cloud-spanner ingress-dns default-storageclass metrics-server inspektor-gadget volcano yakd volumesnapshots registry ingress csi-hostpath-driver gcp-auth]
I0923 10:29:27.991772 2613811 start.go:246] waiting for cluster config update ...
I0923 10:29:27.991794 2613811 start.go:255] writing updated cluster config ...
I0923 10:29:27.993157 2613811 ssh_runner.go:195] Run: rm -f paused
I0923 10:29:28.353215 2613811 start.go:600] kubectl: 1.31.1, cluster: 1.31.1 (minor skew: 0)
I0923 10:29:28.356276 2613811 out.go:177] * Done! kubectl is now configured to use "addons-895903" cluster and "default" namespace by default
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
612a75b16eaa6 4f725bf50aaa5 20 seconds ago Exited gadget 6 b36c01d93c225 gadget-wbbdg
d64e1092b174b 6ef582f3ec844 3 minutes ago Running gcp-auth 0 2c7151562401b gcp-auth-89d5ffd79-pbtsl
19fe0f8a2dbea 8b46b1cd48760 4 minutes ago Running admission 0 68e8f731f0fbe volcano-admission-77d7d48b68-gs99c
a131c9e17bbe0 d9c7ad4c226bf 4 minutes ago Running volcano-scheduler 1 111067311d9a1 volcano-scheduler-576bc46687-knktf
1bcf5965ba7a4 ee6d597e62dc8 5 minutes ago Running csi-snapshotter 0 131a911860624 csi-hostpathplugin-4n4q7
61d90f5072131 642ded511e141 5 minutes ago Running csi-provisioner 0 131a911860624 csi-hostpathplugin-4n4q7
e07884af092cf 922312104da8a 5 minutes ago Running liveness-probe 0 131a911860624 csi-hostpathplugin-4n4q7
4c9c6f02628d2 08f6b2990811a 5 minutes ago Running hostpath 0 131a911860624 csi-hostpathplugin-4n4q7
3d1f1b0a2aeb9 0107d56dbc0be 5 minutes ago Running node-driver-registrar 0 131a911860624 csi-hostpathplugin-4n4q7
75bb7400b98ed 289a818c8d9c5 5 minutes ago Running controller 0 9bf1ad1aed165 ingress-nginx-controller-bc57996ff-5nsw5
b0db1ee518ec6 9a80d518f102c 5 minutes ago Running csi-attacher 0 eba7cd278b314 csi-hostpath-attacher-0
6a84ffbec5111 1461903ec4fe9 5 minutes ago Running csi-external-health-monitor-controller 0 131a911860624 csi-hostpathplugin-4n4q7
fc532f382df3e be9cac3585579 5 minutes ago Running cloud-spanner-emulator 0 b28ef9d7882c9 cloud-spanner-emulator-5b584cc74-gmnrx
c7bcc56a614d9 420193b27261a 5 minutes ago Exited patch 2 0120424b37102 ingress-nginx-admission-patch-2trv2
b5d0935a141fc 487fa743e1e22 5 minutes ago Running csi-resizer 0 d1b56ec47f61c csi-hostpath-resizer-0
ee516ac731cff 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 9331c98f21379 snapshot-controller-56fcc65765-jt2fx
3b86988e9cf3c 420193b27261a 5 minutes ago Exited create 0 3895921c532eb ingress-nginx-admission-create-b8hdz
cf227c2de58f6 5548a49bb60ba 5 minutes ago Running metrics-server 0 844a794e5b942 metrics-server-84c5f94fbc-jw4gj
2902a0355b5f4 3410e1561990a 5 minutes ago Running registry-proxy 0 f8e1da6952484 registry-proxy-skfcc
108a0ef115107 d9c7ad4c226bf 5 minutes ago Exited volcano-scheduler 0 111067311d9a1 volcano-scheduler-576bc46687-knktf
d41f0984aac27 c9cf76bb104e1 5 minutes ago Running registry 0 837be611557c2 registry-66c9cd494c-jwrzn
509caddf748c5 1505f556b3a7b 5 minutes ago Running volcano-controllers 0 d624b0a9b41e6 volcano-controllers-56675bb4d5-724bn
0b10cafbd33b0 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 93e843d7f5f3a snapshot-controller-56fcc65765-57fj2
a87b32efcf3b1 77bdba588b953 5 minutes ago Running yakd 0 62102cc3a33bb yakd-dashboard-67d98fc6b-5wqrb
9e45b0eeea0f3 a9bac31a5be8d 5 minutes ago Running nvidia-device-plugin-ctr 0 d9d4daea0c5c8 nvidia-device-plugin-daemonset-r7wk4
ddf731fcc9c15 7ce2150c8929b 6 minutes ago Running local-path-provisioner 0 28d07c1bf80fc local-path-provisioner-86d989889c-q6rc8
86182a62ab42c 2f6c962e7b831 6 minutes ago Running coredns 0 54183a39d0309 coredns-7c65d6cfc9-j4q7p
b8c756c0cb163 35508c2f890c4 6 minutes ago Running minikube-ingress-dns 0 ee964fd464813 kube-ingress-dns-minikube
48f66ea8bb65e ba04bb24b9575 6 minutes ago Running storage-provisioner 0 b02dcb7d63557 storage-provisioner
39ee3c472b520 6a23fa8fd2b78 6 minutes ago Running kindnet-cni 0 6be4e59c7de3d kindnet-vj6hj
05c518285c3c1 24a140c548c07 6 minutes ago Running kube-proxy 0 369971865bac9 kube-proxy-mckj4
74de3e6b43598 279f381cb3736 7 minutes ago Running kube-controller-manager 0 2867182cccf7a kube-controller-manager-addons-895903
22ca1983779c4 d3f53a98c0a9d 7 minutes ago Running kube-apiserver 0 57a3be5181e6d kube-apiserver-addons-895903
20eeff7220c81 7f8aa378bb47d 7 minutes ago Running kube-scheduler 0 279842e216d5c kube-scheduler-addons-895903
6bdf993a2a01b 27e3830e14027 7 minutes ago Running etcd 0 14642ca01a85f etcd-addons-895903
==> containerd <==
Sep 23 10:29:51 addons-895903 containerd[816]: time="2024-09-23T10:29:51.970785687Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"645fe9652862ba06d1df620c6d024160106c085bedacae20caf1d59db57dfdcd\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus."
Sep 23 10:29:51 addons-895903 containerd[816]: time="2024-09-23T10:29:51.970904727Z" level=info msg="RemovePodSandbox \"645fe9652862ba06d1df620c6d024160106c085bedacae20caf1d59db57dfdcd\" returns successfully"
Sep 23 10:32:26 addons-895903 containerd[816]: time="2024-09-23T10:32:26.851770118Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\""
Sep 23 10:32:26 addons-895903 containerd[816]: time="2024-09-23T10:32:26.970101700Z" level=info msg="ImageUpdate event name:\"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}"
Sep 23 10:32:26 addons-895903 containerd[816]: time="2024-09-23T10:32:26.971729000Z" level=info msg="stop pulling image ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec: active requests=0, bytes read=89"
Sep 23 10:32:26 addons-895903 containerd[816]: time="2024-09-23T10:32:26.979747009Z" level=info msg="Pulled image \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\" with image id \"sha256:4f725bf50aaa5c697fbb84c107e9c7a3766f0f85f514ffce712d03ee5f62e8dd\", repo tag \"\", repo digest \"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\", size \"72524105\" in 127.924371ms"
Sep 23 10:32:26 addons-895903 containerd[816]: time="2024-09-23T10:32:26.979799554Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\" returns image reference \"sha256:4f725bf50aaa5c697fbb84c107e9c7a3766f0f85f514ffce712d03ee5f62e8dd\""
Sep 23 10:32:26 addons-895903 containerd[816]: time="2024-09-23T10:32:26.981937514Z" level=info msg="CreateContainer within sandbox \"b36c01d93c2251fc2dab2eeac856796549bfd8df74b1033529c70c60cdf2deb8\" for container &ContainerMetadata{Name:gadget,Attempt:6,}"
Sep 23 10:32:27 addons-895903 containerd[816]: time="2024-09-23T10:32:27.002714336Z" level=info msg="CreateContainer within sandbox \"b36c01d93c2251fc2dab2eeac856796549bfd8df74b1033529c70c60cdf2deb8\" for &ContainerMetadata{Name:gadget,Attempt:6,} returns container id \"612a75b16eaa6621cce0021d0e532b8b85d6d3f64846c7e9090af38b638f4e8a\""
Sep 23 10:32:27 addons-895903 containerd[816]: time="2024-09-23T10:32:27.004469299Z" level=info msg="StartContainer for \"612a75b16eaa6621cce0021d0e532b8b85d6d3f64846c7e9090af38b638f4e8a\""
Sep 23 10:32:27 addons-895903 containerd[816]: time="2024-09-23T10:32:27.078446830Z" level=info msg="StartContainer for \"612a75b16eaa6621cce0021d0e532b8b85d6d3f64846c7e9090af38b638f4e8a\" returns successfully"
Sep 23 10:32:28 addons-895903 containerd[816]: time="2024-09-23T10:32:28.475152513Z" level=error msg="ExecSync for \"612a75b16eaa6621cce0021d0e532b8b85d6d3f64846c7e9090af38b638f4e8a\" failed" error="failed to exec in container: failed to start exec \"c80a7c3ea0263b3416e539d3cdac21c07c6aec6f3a400a10dc8f987b235d799e\": OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown"
Sep 23 10:32:28 addons-895903 containerd[816]: time="2024-09-23T10:32:28.497443930Z" level=error msg="ExecSync for \"612a75b16eaa6621cce0021d0e532b8b85d6d3f64846c7e9090af38b638f4e8a\" failed" error="failed to exec in container: failed to start exec \"43ccd234594dc0896703f6fb4172453942e4523f182db0847c54005a5738e903\": OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown"
Sep 23 10:32:28 addons-895903 containerd[816]: time="2024-09-23T10:32:28.513837993Z" level=error msg="ExecSync for \"612a75b16eaa6621cce0021d0e532b8b85d6d3f64846c7e9090af38b638f4e8a\" failed" error="failed to exec in container: failed to start exec \"6fa8736af13b02c58bb50de73d5c5096157a874325886631043f90104fe2f4d5\": OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown"
Sep 23 10:32:28 addons-895903 containerd[816]: time="2024-09-23T10:32:28.622591712Z" level=info msg="shim disconnected" id=612a75b16eaa6621cce0021d0e532b8b85d6d3f64846c7e9090af38b638f4e8a namespace=k8s.io
Sep 23 10:32:28 addons-895903 containerd[816]: time="2024-09-23T10:32:28.622659199Z" level=warning msg="cleaning up after shim disconnected" id=612a75b16eaa6621cce0021d0e532b8b85d6d3f64846c7e9090af38b638f4e8a namespace=k8s.io
Sep 23 10:32:28 addons-895903 containerd[816]: time="2024-09-23T10:32:28.622670686Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Sep 23 10:32:28 addons-895903 containerd[816]: time="2024-09-23T10:32:28.772272650Z" level=error msg="ExecSync for \"612a75b16eaa6621cce0021d0e532b8b85d6d3f64846c7e9090af38b638f4e8a\" failed" error="failed to exec in container: container is in CONTAINER_EXITED state"
Sep 23 10:32:28 addons-895903 containerd[816]: time="2024-09-23T10:32:28.772283120Z" level=error msg="ExecSync for \"612a75b16eaa6621cce0021d0e532b8b85d6d3f64846c7e9090af38b638f4e8a\" failed" error="failed to exec in container: container is in CONTAINER_EXITED state"
Sep 23 10:32:28 addons-895903 containerd[816]: time="2024-09-23T10:32:28.773009312Z" level=error msg="ExecSync for \"612a75b16eaa6621cce0021d0e532b8b85d6d3f64846c7e9090af38b638f4e8a\" failed" error="failed to exec in container: container is in CONTAINER_EXITED state"
Sep 23 10:32:28 addons-895903 containerd[816]: time="2024-09-23T10:32:28.773169040Z" level=error msg="ExecSync for \"612a75b16eaa6621cce0021d0e532b8b85d6d3f64846c7e9090af38b638f4e8a\" failed" error="failed to exec in container: container is in CONTAINER_EXITED state"
Sep 23 10:32:28 addons-895903 containerd[816]: time="2024-09-23T10:32:28.773665325Z" level=error msg="ExecSync for \"612a75b16eaa6621cce0021d0e532b8b85d6d3f64846c7e9090af38b638f4e8a\" failed" error="failed to exec in container: container is in CONTAINER_EXITED state"
Sep 23 10:32:28 addons-895903 containerd[816]: time="2024-09-23T10:32:28.773827630Z" level=error msg="ExecSync for \"612a75b16eaa6621cce0021d0e532b8b85d6d3f64846c7e9090af38b638f4e8a\" failed" error="failed to exec in container: container is in CONTAINER_EXITED state"
Sep 23 10:32:29 addons-895903 containerd[816]: time="2024-09-23T10:32:29.464846874Z" level=info msg="RemoveContainer for \"6280fad4a0f78fa1524533f83c2e2459fdbf39aba281ccdc406877f217ca79e0\""
Sep 23 10:32:29 addons-895903 containerd[816]: time="2024-09-23T10:32:29.472001921Z" level=info msg="RemoveContainer for \"6280fad4a0f78fa1524533f83c2e2459fdbf39aba281ccdc406877f217ca79e0\" returns successfully"
==> coredns [86182a62ab42cab4656a47799401eedd37f3a84c28eef105d167be5212f33291] <==
[INFO] 10.244.0.8:58722 - 53129 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000105846s
[INFO] 10.244.0.8:53700 - 45770 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.003238969s
[INFO] 10.244.0.8:53700 - 20436 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002600826s
[INFO] 10.244.0.8:35138 - 36930 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000154419s
[INFO] 10.244.0.8:35138 - 51276 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000112131s
[INFO] 10.244.0.8:56982 - 48456 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000146247s
[INFO] 10.244.0.8:56982 - 15183 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000222719s
[INFO] 10.244.0.8:35084 - 2037 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000077957s
[INFO] 10.244.0.8:35084 - 21751 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000093054s
[INFO] 10.244.0.8:54347 - 41389 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000077391s
[INFO] 10.244.0.8:54347 - 17576 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000080327s
[INFO] 10.244.0.8:33234 - 65497 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.011172252s
[INFO] 10.244.0.8:33234 - 6886 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.015495375s
[INFO] 10.244.0.8:39269 - 12238 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000083848s
[INFO] 10.244.0.8:39269 - 16845 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000049189s
[INFO] 10.244.0.24:47228 - 49608 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000184729s
[INFO] 10.244.0.24:51930 - 51213 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000383654s
[INFO] 10.244.0.24:34754 - 25619 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.00013696s
[INFO] 10.244.0.24:59634 - 2973 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000354049s
[INFO] 10.244.0.24:46673 - 37287 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000166359s
[INFO] 10.244.0.24:56562 - 42301 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000112189s
[INFO] 10.244.0.24:43030 - 59880 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002345663s
[INFO] 10.244.0.24:35327 - 21806 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.001811266s
[INFO] 10.244.0.24:56902 - 56902 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.001948381s
[INFO] 10.244.0.24:38096 - 60288 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 610 0.001819373s
==> describe nodes <==
Name: addons-895903
Roles: control-plane
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=addons-895903
kubernetes.io/os=linux
minikube.k8s.io/commit=f69bf2f8ed9442c9c01edbe27466c5398c68b986
minikube.k8s.io/name=addons-895903
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_09_23T10_25_52_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-895903
Annotations: csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-895903"}
kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Mon, 23 Sep 2024 10:25:49 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-895903
AcquireTime: <unset>
RenewTime: Mon, 23 Sep 2024 10:32:39 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Mon, 23 Sep 2024 10:29:56 +0000 Mon, 23 Sep 2024 10:25:46 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Mon, 23 Sep 2024 10:29:56 +0000 Mon, 23 Sep 2024 10:25:46 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Mon, 23 Sep 2024 10:29:56 +0000 Mon, 23 Sep 2024 10:25:46 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Mon, 23 Sep 2024 10:29:56 +0000 Mon, 23 Sep 2024 10:25:49 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-895903
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022304Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022304Ki
pods: 110
System Info:
Machine ID: f6624dc2cfbb4e6f9ec51a72c242076a
System UUID: bfb89664-39e7-4869-9292-c0198371ac0f
Boot ID: d8899273-2c3a-49f7-8c9a-66d2209373ba
Kernel Version: 5.15.0-1070-aws
OS Image: Ubuntu 22.04.5 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.22
Kubelet Version: v1.31.1
Kube-Proxy Version: v1.31.1
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (27 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default cloud-spanner-emulator-5b584cc74-gmnrx 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m48s
gadget gadget-wbbdg 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m44s
gcp-auth gcp-auth-89d5ffd79-pbtsl 0 (0%) 0 (0%) 0 (0%) 0 (0%) 3m55s
ingress-nginx ingress-nginx-controller-bc57996ff-5nsw5 100m (5%) 0 (0%) 90Mi (1%) 0 (0%) 6m43s
kube-system coredns-7c65d6cfc9-j4q7p 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 6m50s
kube-system csi-hostpath-attacher-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m40s
kube-system csi-hostpath-resizer-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m40s
kube-system csi-hostpathplugin-4n4q7 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m40s
kube-system etcd-addons-895903 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 6m55s
kube-system kindnet-vj6hj 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 6m51s
kube-system kube-apiserver-addons-895903 250m (12%) 0 (0%) 0 (0%) 0 (0%) 6m55s
kube-system kube-controller-manager-addons-895903 200m (10%) 0 (0%) 0 (0%) 0 (0%) 6m55s
kube-system kube-ingress-dns-minikube 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m46s
kube-system kube-proxy-mckj4 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m51s
kube-system kube-scheduler-addons-895903 100m (5%) 0 (0%) 0 (0%) 0 (0%) 6m55s
kube-system metrics-server-84c5f94fbc-jw4gj 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 6m45s
kube-system nvidia-device-plugin-daemonset-r7wk4 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m49s
kube-system registry-66c9cd494c-jwrzn 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m46s
kube-system registry-proxy-skfcc 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m46s
kube-system snapshot-controller-56fcc65765-57fj2 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m44s
kube-system snapshot-controller-56fcc65765-jt2fx 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m44s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m46s
local-path-storage local-path-provisioner-86d989889c-q6rc8 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m44s
volcano-system volcano-admission-77d7d48b68-gs99c 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m43s
volcano-system volcano-controllers-56675bb4d5-724bn 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m42s
volcano-system volcano-scheduler-576bc46687-knktf 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m42s
yakd-dashboard yakd-dashboard-67d98fc6b-5wqrb 0 (0%) 0 (0%) 128Mi (1%) 256Mi (3%) 6m45s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 1050m (52%) 100m (5%)
memory 638Mi (8%) 476Mi (6%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 6m49s kube-proxy
Normal NodeHasSufficientMemory 7m3s (x8 over 7m3s) kubelet Node addons-895903 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 7m3s (x7 over 7m3s) kubelet Node addons-895903 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 7m3s (x7 over 7m3s) kubelet Node addons-895903 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 7m3s kubelet Updated Node Allocatable limit across pods
Normal Starting 6m56s kubelet Starting kubelet.
Warning CgroupV1 6m56s kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeAllocatableEnforced 6m55s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 6m55s kubelet Node addons-895903 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m55s kubelet Node addons-895903 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m55s kubelet Node addons-895903 status is now: NodeHasSufficientPID
Normal RegisteredNode 6m52s node-controller Node addons-895903 event: Registered Node addons-895903 in Controller
==> dmesg <==
[Sep23 08:17] systemd-journald[222]: Failed to send WATCHDOG=1 notification message: Connection refused
==> etcd [6bdf993a2a01b8852ec382a7cc4b78988ba13dbd216a009cb59b93fa78da01cc] <==
{"level":"info","ts":"2024-09-23T10:25:45.516062Z","caller":"embed/etcd.go:599","msg":"serving peer traffic","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-09-23T10:25:45.516087Z","caller":"embed/etcd.go:571","msg":"cmux::serve","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-09-23T10:25:45.517141Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc switched to configuration voters=(12593026477526642892)"}
{"level":"info","ts":"2024-09-23T10:25:45.517222Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","added-peer-id":"aec36adc501070cc","added-peer-peer-urls":["https://192.168.49.2:2380"]}
{"level":"info","ts":"2024-09-23T10:25:45.515270Z","caller":"fileutil/purge.go:50","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/wal","suffix":"wal","max":5,"interval":"30s"}
{"level":"info","ts":"2024-09-23T10:25:45.883309Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
{"level":"info","ts":"2024-09-23T10:25:45.883524Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
{"level":"info","ts":"2024-09-23T10:25:45.883622Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
{"level":"info","ts":"2024-09-23T10:25:45.883732Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
{"level":"info","ts":"2024-09-23T10:25:45.883822Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-23T10:25:45.883906Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
{"level":"info","ts":"2024-09-23T10:25:45.883996Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-23T10:25:45.891408Z","caller":"etcdserver/server.go:2629","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-23T10:25:45.895498Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-895903 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
{"level":"info","ts":"2024-09-23T10:25:45.899356Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-23T10:25:45.899867Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-23T10:25:45.900141Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-09-23T10:25:45.900248Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-09-23T10:25:45.900992Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-23T10:25:45.901586Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-23T10:25:45.901675Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-23T10:25:45.901705Z","caller":"etcdserver/server.go:2653","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-23T10:25:45.923302Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
{"level":"info","ts":"2024-09-23T10:25:45.949917Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-23T10:25:45.968048Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
==> gcp-auth [d64e1092b174b0340ee1b99592a30c89cc36c0f60856509a345b7f8de22c4dba] <==
2024/09/23 10:29:27 GCP Auth Webhook started!
2024/09/23 10:29:44 Ready to marshal response ...
2024/09/23 10:29:44 Ready to write response ...
2024/09/23 10:29:45 Ready to marshal response ...
2024/09/23 10:29:45 Ready to write response ...
==> kernel <==
10:32:47 up 1 day, 18:15, 0 users, load average: 0.24, 1.19, 1.99
Linux addons-895903 5.15.0-1070-aws #76~20.04.1-Ubuntu SMP Mon Sep 2 12:20:48 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.5 LTS"
==> kindnet [39ee3c472b5203440f2df1e97a66266d071ac3ee846e391cddd51fefc540df02] <==
I0923 10:30:38.115875 1 main.go:299] handling current node
I0923 10:30:48.124737 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0923 10:30:48.124776 1 main.go:299] handling current node
I0923 10:30:58.115224 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0923 10:30:58.115260 1 main.go:299] handling current node
I0923 10:31:08.119412 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0923 10:31:08.119446 1 main.go:299] handling current node
I0923 10:31:18.115269 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0923 10:31:18.115508 1 main.go:299] handling current node
I0923 10:31:28.115086 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0923 10:31:28.115215 1 main.go:299] handling current node
I0923 10:31:38.119432 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0923 10:31:38.119493 1 main.go:299] handling current node
I0923 10:31:48.123429 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0923 10:31:48.123472 1 main.go:299] handling current node
I0923 10:31:58.115564 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0923 10:31:58.115595 1 main.go:299] handling current node
I0923 10:32:08.115645 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0923 10:32:08.115683 1 main.go:299] handling current node
I0923 10:32:18.115049 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0923 10:32:18.115089 1 main.go:299] handling current node
I0923 10:32:28.116287 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0923 10:32:28.116326 1 main.go:299] handling current node
I0923 10:32:38.118445 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0923 10:32:38.118481 1 main.go:299] handling current node
==> kube-apiserver [22ca1983779c47b817279a341b9cd9e116968ffbb124cd7faf35dd235c858eec] <==
W0923 10:28:11.507809 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.106.13.255:443: connect: connection refused
W0923 10:28:12.492935 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.13.255:443: connect: connection refused
W0923 10:28:13.507606 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.13.255:443: connect: connection refused
W0923 10:28:14.601165 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.13.255:443: connect: connection refused
W0923 10:28:15.689787 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.13.255:443: connect: connection refused
W0923 10:28:16.770637 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.13.255:443: connect: connection refused
W0923 10:28:17.853788 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.13.255:443: connect: connection refused
W0923 10:28:18.888383 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.13.255:443: connect: connection refused
W0923 10:28:19.944223 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.13.255:443: connect: connection refused
W0923 10:28:20.975458 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.13.255:443: connect: connection refused
W0923 10:28:21.990927 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.13.255:443: connect: connection refused
W0923 10:28:23.078749 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.13.255:443: connect: connection refused
W0923 10:28:24.166603 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.13.255:443: connect: connection refused
W0923 10:28:25.197576 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.13.255:443: connect: connection refused
W0923 10:28:26.230489 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.13.255:443: connect: connection refused
W0923 10:28:27.298326 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.13.255:443: connect: connection refused
W0923 10:28:28.383426 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.13.255:443: connect: connection refused
W0923 10:28:52.349542 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.111.159.173:443: connect: connection refused
E0923 10:28:52.349589 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.111.159.173:443: connect: connection refused" logger="UnhandledError"
W0923 10:29:11.474390 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.111.159.173:443: connect: connection refused
E0923 10:29:11.474432 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.111.159.173:443: connect: connection refused" logger="UnhandledError"
W0923 10:29:11.515013 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.111.159.173:443: connect: connection refused
E0923 10:29:11.515224 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.111.159.173:443: connect: connection refused" logger="UnhandledError"
I0923 10:29:44.868849 1 controller.go:615] quota admission added evaluator for: jobs.batch.volcano.sh
I0923 10:29:44.903934 1 controller.go:615] quota admission added evaluator for: podgroups.scheduling.volcano.sh
==> kube-controller-manager [74de3e6b43598eb398a73e476abb3b74df7078c623fb5eaaab2f36b209edd89d] <==
I0923 10:29:11.499517 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0923 10:29:11.500316 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0923 10:29:11.511073 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0923 10:29:11.523064 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0923 10:29:11.530477 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0923 10:29:11.534519 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0923 10:29:11.549067 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0923 10:29:12.912443 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0923 10:29:12.926372 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0923 10:29:14.031736 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0923 10:29:14.051957 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0923 10:29:15.039852 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0923 10:29:15.050830 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0923 10:29:15.060900 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0923 10:29:15.062543 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0923 10:29:15.075442 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0923 10:29:15.086137 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0923 10:29:27.992533 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="15.549078ms"
I0923 10:29:27.992709 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="107.076µs"
I0923 10:29:44.614085 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="volcano-system/volcano-admission-init" delay="0s"
I0923 10:29:45.050592 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0923 10:29:45.057803 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0923 10:29:45.135043 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0923 10:29:45.137476 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0923 10:29:56.101392 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-895903"
==> kube-proxy [05c518285c3c1fd4d62e8ddf3baeddeb21ec8678340753bce2c13ffd08f99f3c] <==
I0923 10:25:57.784541 1 server_linux.go:66] "Using iptables proxy"
I0923 10:25:57.880569 1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
E0923 10:25:57.880642 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I0923 10:25:57.933379 1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I0923 10:25:57.933727 1 server_linux.go:169] "Using iptables Proxier"
I0923 10:25:57.949526 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I0923 10:25:57.950265 1 server.go:483] "Version info" version="v1.31.1"
I0923 10:25:57.950291 1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0923 10:25:57.956932 1 config.go:199] "Starting service config controller"
I0923 10:25:57.956968 1 shared_informer.go:313] Waiting for caches to sync for service config
I0923 10:25:57.957007 1 config.go:105] "Starting endpoint slice config controller"
I0923 10:25:57.957012 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0923 10:25:57.968016 1 config.go:328] "Starting node config controller"
I0923 10:25:57.968057 1 shared_informer.go:313] Waiting for caches to sync for node config
I0923 10:25:58.057811 1 shared_informer.go:320] Caches are synced for endpoint slice config
I0923 10:25:58.057876 1 shared_informer.go:320] Caches are synced for service config
I0923 10:25:58.068351 1 shared_informer.go:320] Caches are synced for node config
==> kube-scheduler [20eeff7220c81f507d6a104120551da6efb5343427ce72308d50f0e571eed1c5] <==
W0923 10:25:49.279989 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0923 10:25:49.280009 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0923 10:25:49.280098 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0923 10:25:49.280121 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0923 10:25:49.278786 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0923 10:25:49.280156 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0923 10:25:49.279067 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
E0923 10:25:49.280194 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0923 10:25:49.280358 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0923 10:25:49.280505 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0923 10:25:50.093178 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0923 10:25:50.093757 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0923 10:25:50.128661 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0923 10:25:50.128915 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0923 10:25:50.278608 1 reflector.go:561] runtime/asm_arm64.s:1222: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0923 10:25:50.278655 1 reflector.go:158] "Unhandled Error" err="runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"
W0923 10:25:50.283303 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0923 10:25:50.283355 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0923 10:25:50.315575 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0923 10:25:50.315620 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0923 10:25:50.331435 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0923 10:25:50.331673 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0923 10:25:50.413909 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0923 10:25:50.414032 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError"
I0923 10:25:52.973710 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Sep 23 10:31:49 addons-895903 kubelet[1477]: I0923 10:31:49.850235 1477 scope.go:117] "RemoveContainer" containerID="6280fad4a0f78fa1524533f83c2e2459fdbf39aba281ccdc406877f217ca79e0"
Sep 23 10:31:49 addons-895903 kubelet[1477]: E0923 10:31:49.850428 1477 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-wbbdg_gadget(da6e2bf1-1c63-4e4f-93e1-244f156ae28b)\"" pod="gadget/gadget-wbbdg" podUID="da6e2bf1-1c63-4e4f-93e1-244f156ae28b"
Sep 23 10:31:51 addons-895903 kubelet[1477]: I0923 10:31:51.851059 1477 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-skfcc" secret="" err="secret \"gcp-auth\" not found"
Sep 23 10:32:00 addons-895903 kubelet[1477]: I0923 10:32:00.849798 1477 scope.go:117] "RemoveContainer" containerID="6280fad4a0f78fa1524533f83c2e2459fdbf39aba281ccdc406877f217ca79e0"
Sep 23 10:32:00 addons-895903 kubelet[1477]: E0923 10:32:00.850001 1477 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-wbbdg_gadget(da6e2bf1-1c63-4e4f-93e1-244f156ae28b)\"" pod="gadget/gadget-wbbdg" podUID="da6e2bf1-1c63-4e4f-93e1-244f156ae28b"
Sep 23 10:32:02 addons-895903 kubelet[1477]: I0923 10:32:02.849454 1477 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-66c9cd494c-jwrzn" secret="" err="secret \"gcp-auth\" not found"
Sep 23 10:32:03 addons-895903 kubelet[1477]: I0923 10:32:03.849558 1477 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-r7wk4" secret="" err="secret \"gcp-auth\" not found"
Sep 23 10:32:13 addons-895903 kubelet[1477]: I0923 10:32:13.849884 1477 scope.go:117] "RemoveContainer" containerID="6280fad4a0f78fa1524533f83c2e2459fdbf39aba281ccdc406877f217ca79e0"
Sep 23 10:32:13 addons-895903 kubelet[1477]: E0923 10:32:13.850582 1477 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-wbbdg_gadget(da6e2bf1-1c63-4e4f-93e1-244f156ae28b)\"" pod="gadget/gadget-wbbdg" podUID="da6e2bf1-1c63-4e4f-93e1-244f156ae28b"
Sep 23 10:32:26 addons-895903 kubelet[1477]: I0923 10:32:26.850294 1477 scope.go:117] "RemoveContainer" containerID="6280fad4a0f78fa1524533f83c2e2459fdbf39aba281ccdc406877f217ca79e0"
Sep 23 10:32:28 addons-895903 kubelet[1477]: E0923 10:32:28.475501 1477 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = failed to exec in container: failed to start exec \"c80a7c3ea0263b3416e539d3cdac21c07c6aec6f3a400a10dc8f987b235d799e\": OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown" containerID="612a75b16eaa6621cce0021d0e532b8b85d6d3f64846c7e9090af38b638f4e8a" cmd=["/bin/gadgettracermanager","-liveness"]
Sep 23 10:32:28 addons-895903 kubelet[1477]: E0923 10:32:28.497871 1477 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = failed to exec in container: failed to start exec \"43ccd234594dc0896703f6fb4172453942e4523f182db0847c54005a5738e903\": OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown" containerID="612a75b16eaa6621cce0021d0e532b8b85d6d3f64846c7e9090af38b638f4e8a" cmd=["/bin/gadgettracermanager","-liveness"]
Sep 23 10:32:28 addons-895903 kubelet[1477]: E0923 10:32:28.514135 1477 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = failed to exec in container: failed to start exec \"6fa8736af13b02c58bb50de73d5c5096157a874325886631043f90104fe2f4d5\": OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown" containerID="612a75b16eaa6621cce0021d0e532b8b85d6d3f64846c7e9090af38b638f4e8a" cmd=["/bin/gadgettracermanager","-liveness"]
Sep 23 10:32:28 addons-895903 kubelet[1477]: E0923 10:32:28.772496 1477 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = failed to exec in container: container is in CONTAINER_EXITED state" containerID="612a75b16eaa6621cce0021d0e532b8b85d6d3f64846c7e9090af38b638f4e8a" cmd=["/bin/gadgettracermanager","-liveness"]
Sep 23 10:32:28 addons-895903 kubelet[1477]: E0923 10:32:28.772630 1477 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = failed to exec in container: container is in CONTAINER_EXITED state" containerID="612a75b16eaa6621cce0021d0e532b8b85d6d3f64846c7e9090af38b638f4e8a" cmd=["/bin/gadgettracermanager","-liveness"]
Sep 23 10:32:28 addons-895903 kubelet[1477]: E0923 10:32:28.773160 1477 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = failed to exec in container: container is in CONTAINER_EXITED state" containerID="612a75b16eaa6621cce0021d0e532b8b85d6d3f64846c7e9090af38b638f4e8a" cmd=["/bin/gadgettracermanager","-liveness"]
Sep 23 10:32:28 addons-895903 kubelet[1477]: E0923 10:32:28.773459 1477 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = failed to exec in container: container is in CONTAINER_EXITED state" containerID="612a75b16eaa6621cce0021d0e532b8b85d6d3f64846c7e9090af38b638f4e8a" cmd=["/bin/gadgettracermanager","-liveness"]
Sep 23 10:32:28 addons-895903 kubelet[1477]: E0923 10:32:28.773843 1477 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = failed to exec in container: container is in CONTAINER_EXITED state" containerID="612a75b16eaa6621cce0021d0e532b8b85d6d3f64846c7e9090af38b638f4e8a" cmd=["/bin/gadgettracermanager","-liveness"]
Sep 23 10:32:28 addons-895903 kubelet[1477]: E0923 10:32:28.774261 1477 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = failed to exec in container: container is in CONTAINER_EXITED state" containerID="612a75b16eaa6621cce0021d0e532b8b85d6d3f64846c7e9090af38b638f4e8a" cmd=["/bin/gadgettracermanager","-liveness"]
Sep 23 10:32:29 addons-895903 kubelet[1477]: I0923 10:32:29.463148 1477 scope.go:117] "RemoveContainer" containerID="6280fad4a0f78fa1524533f83c2e2459fdbf39aba281ccdc406877f217ca79e0"
Sep 23 10:32:29 addons-895903 kubelet[1477]: I0923 10:32:29.463741 1477 scope.go:117] "RemoveContainer" containerID="612a75b16eaa6621cce0021d0e532b8b85d6d3f64846c7e9090af38b638f4e8a"
Sep 23 10:32:29 addons-895903 kubelet[1477]: E0923 10:32:29.463924 1477 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=gadget pod=gadget-wbbdg_gadget(da6e2bf1-1c63-4e4f-93e1-244f156ae28b)\"" pod="gadget/gadget-wbbdg" podUID="da6e2bf1-1c63-4e4f-93e1-244f156ae28b"
Sep 23 10:32:33 addons-895903 kubelet[1477]: I0923 10:32:33.772343 1477 scope.go:117] "RemoveContainer" containerID="612a75b16eaa6621cce0021d0e532b8b85d6d3f64846c7e9090af38b638f4e8a"
Sep 23 10:32:33 addons-895903 kubelet[1477]: E0923 10:32:33.773007 1477 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=gadget pod=gadget-wbbdg_gadget(da6e2bf1-1c63-4e4f-93e1-244f156ae28b)\"" pod="gadget/gadget-wbbdg" podUID="da6e2bf1-1c63-4e4f-93e1-244f156ae28b"
Sep 23 10:32:46 addons-895903 kubelet[1477]: I0923 10:32:46.849951 1477 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/coredns-7c65d6cfc9-j4q7p" secret="" err="secret \"gcp-auth\" not found"
==> storage-provisioner [48f66ea8bb65e78e4bdacefce8027301bcca563203c0539a572141675ab9cc9d] <==
I0923 10:26:01.860414 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0923 10:26:01.872035 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0923 10:26:01.872123 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0923 10:26:01.885264 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0923 10:26:01.885433 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-895903_08ed9cf5-4a03-4805-9a01-3039ef1cf3c9!
I0923 10:26:01.885501 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"21b594b8-25eb-4902-bf82-fa304e2a6479", APIVersion:"v1", ResourceVersion:"530", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-895903_08ed9cf5-4a03-4805-9a01-3039ef1cf3c9 became leader
I0923 10:26:01.985713 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-895903_08ed9cf5-4a03-4805-9a01-3039ef1cf3c9!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-895903 -n addons-895903
helpers_test.go:261: (dbg) Run: kubectl --context addons-895903 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: ingress-nginx-admission-create-b8hdz ingress-nginx-admission-patch-2trv2 test-job-nginx-0
helpers_test.go:274: ======> post-mortem[TestAddons/serial/Volcano]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-895903 describe pod ingress-nginx-admission-create-b8hdz ingress-nginx-admission-patch-2trv2 test-job-nginx-0
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-895903 describe pod ingress-nginx-admission-create-b8hdz ingress-nginx-admission-patch-2trv2 test-job-nginx-0: exit status 1 (96.465255ms)
** stderr **
Error from server (NotFound): pods "ingress-nginx-admission-create-b8hdz" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-2trv2" not found
Error from server (NotFound): pods "test-job-nginx-0" not found
** /stderr **
helpers_test.go:279: kubectl --context addons-895903 describe pod ingress-nginx-admission-create-b8hdz ingress-nginx-admission-patch-2trv2 test-job-nginx-0: exit status 1
--- FAIL: TestAddons/serial/Volcano (200.11s)