=== RUN TestAddons/serial/Volcano
addons_test.go:843: volcano-admission stabilized in 51.866056ms
addons_test.go:851: volcano-controller stabilized in 52.40467ms
addons_test.go:835: volcano-scheduler stabilized in 52.525391ms
addons_test.go:857: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-scheduler-6c9778cbdf-97rkk" [96966f75-5651-47aa-9fc5-d4bb6aa841e7] Running
addons_test.go:857: (dbg) TestAddons/serial/Volcano: app=volcano-scheduler healthy within 6.003147544s
addons_test.go:861: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-admission-5874dfdd79-8t7dh" [e0aae584-7a8a-4bb0-ac30-ba3b3e6ca1bf] Running
addons_test.go:861: (dbg) TestAddons/serial/Volcano: app=volcano-admission healthy within 5.004307014s
addons_test.go:865: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-controllers-789ffc5785-pn52r" [88652b45-4c2b-462c-af32-2d8b915d21f2] Running
addons_test.go:865: (dbg) TestAddons/serial/Volcano: app=volcano-controller healthy within 5.003050985s
addons_test.go:870: (dbg) Run: kubectl --context addons-783184 delete -n volcano-system job volcano-admission-init
addons_test.go:876: (dbg) Run: kubectl --context addons-783184 create -f testdata/vcjob.yaml
addons_test.go:884: (dbg) Run: kubectl --context addons-783184 get vcjob -n my-volcano
addons_test.go:902: (dbg) TestAddons/serial/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...
helpers_test.go:344: "test-job-nginx-0" [4c89eabf-2c9f-4830-9afd-83c40711e3bd] Pending
helpers_test.go:344: "test-job-nginx-0" [4c89eabf-2c9f-4830-9afd-83c40711e3bd] Pending: PodScheduled:Unschedulable (0/1 nodes are unavailable: 1 Insufficient cpu.)
helpers_test.go:329: TestAddons/serial/Volcano: WARNING: pod list for "my-volcano" "volcano.sh/job-name=test-job" returned: client rate limiter Wait returned an error: context deadline exceeded
addons_test.go:902: ***** TestAddons/serial/Volcano: pod "volcano.sh/job-name=test-job" failed to start within 3m0s: context deadline exceeded ****
addons_test.go:902: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-783184 -n addons-783184
addons_test.go:902: TestAddons/serial/Volcano: showing logs for failed pods as of 2024-09-24 18:44:19.374567651 +0000 UTC m=+433.126042153
addons_test.go:902: (dbg) Run: kubectl --context addons-783184 describe po test-job-nginx-0 -n my-volcano
addons_test.go:902: (dbg) kubectl --context addons-783184 describe po test-job-nginx-0 -n my-volcano:
Name: test-job-nginx-0
Namespace: my-volcano
Priority: 0
Service Account: default
Node: <none>
Labels: volcano.sh/job-name=test-job
volcano.sh/job-namespace=my-volcano
volcano.sh/queue-name=test
volcano.sh/task-index=0
volcano.sh/task-spec=nginx
Annotations: scheduling.k8s.io/group-name: test-job-7fe1d191-e2e6-42c6-ba17-b9bc550d33ba
volcano.sh/job-name: test-job
volcano.sh/job-retry-count: 0
volcano.sh/job-version: 0
volcano.sh/queue-name: test
volcano.sh/task-index: 0
volcano.sh/task-spec: nginx
volcano.sh/template-uid: test-job-nginx
Status: Pending
IP:
IPs: <none>
Controlled By: Job/test-job
Containers:
nginx:
Image: nginx:latest
Port: <none>
Host Port: <none>
Command:
sleep
10m
Limits:
cpu: 1
Requests:
cpu: 1
Environment:
GOOGLE_APPLICATION_CREDENTIALS: /google-app-creds.json
PROJECT_ID: this_is_fake
GCP_PROJECT: this_is_fake
GCLOUD_PROJECT: this_is_fake
GOOGLE_CLOUD_PROJECT: this_is_fake
CLOUDSDK_CORE_PROJECT: this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-86hww (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
kube-api-access-86hww:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
gcp-creds:
Type: HostPath (bare host directory volume)
Path: /var/lib/minikube/google_application_credentials.json
HostPathType: File
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling 2m59s volcano 0/1 nodes are unavailable: 1 Insufficient cpu.
addons_test.go:902: (dbg) Run: kubectl --context addons-783184 logs test-job-nginx-0 -n my-volcano
addons_test.go:902: (dbg) kubectl --context addons-783184 logs test-job-nginx-0 -n my-volcano:
addons_test.go:903: failed waiting for test-local-path pod: volcano.sh/job-name=test-job within 3m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestAddons/serial/Volcano]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect addons-783184
helpers_test.go:235: (dbg) docker inspect addons-783184:
-- stdout --
[
{
"Id": "93cfb52902bae015f7fb092c45ebfbb70f894edeb0e6d6a19458867275c5e98d",
"Created": "2024-09-24T18:37:50.001329723Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 446685,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-09-24T18:37:50.165089597Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:62002f6a97ad1f6cd4117c29b1c488a6bf3b6255c8231f0d600b1bc7ba1bcfd6",
"ResolvConfPath": "/var/lib/docker/containers/93cfb52902bae015f7fb092c45ebfbb70f894edeb0e6d6a19458867275c5e98d/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/93cfb52902bae015f7fb092c45ebfbb70f894edeb0e6d6a19458867275c5e98d/hostname",
"HostsPath": "/var/lib/docker/containers/93cfb52902bae015f7fb092c45ebfbb70f894edeb0e6d6a19458867275c5e98d/hosts",
"LogPath": "/var/lib/docker/containers/93cfb52902bae015f7fb092c45ebfbb70f894edeb0e6d6a19458867275c5e98d/93cfb52902bae015f7fb092c45ebfbb70f894edeb0e6d6a19458867275c5e98d-json.log",
"Name": "/addons-783184",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"addons-783184:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "addons-783184",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4194304000,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8388608000,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/19db1dc4f3167e5ab74099e75eb4382ce47bd1c0f36ae31b6c65302bf8a75474-init/diff:/var/lib/docker/overlay2/2e74424088d657fa7b20c4e08819e2c12796efa2ff7323c17fa30eba84a8b965/diff",
"MergedDir": "/var/lib/docker/overlay2/19db1dc4f3167e5ab74099e75eb4382ce47bd1c0f36ae31b6c65302bf8a75474/merged",
"UpperDir": "/var/lib/docker/overlay2/19db1dc4f3167e5ab74099e75eb4382ce47bd1c0f36ae31b6c65302bf8a75474/diff",
"WorkDir": "/var/lib/docker/overlay2/19db1dc4f3167e5ab74099e75eb4382ce47bd1c0f36ae31b6c65302bf8a75474/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "volume",
"Name": "addons-783184",
"Source": "/var/lib/docker/volumes/addons-783184/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
},
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
}
],
"Config": {
"Hostname": "addons-783184",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-783184",
"name.minikube.sigs.k8s.io": "addons-783184",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "e5c6e3696754ecd48aaa465af175202ef6b1955dd259cada0d71338af09fdf98",
"SandboxKey": "/var/run/docker/netns/e5c6e3696754",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33164"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33165"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33168"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33166"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33167"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"addons-783184": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:31:02",
"DriverOpts": null,
"NetworkID": "69ac39ed713fa3e3a619f182622e519bf10b6f9ab774854bca00a598a2227e89",
"EndpointID": "42c1bf0896b2692ebc4e1018ab0dcdfa8f89cf374b3955996d25bd43b1f53ce5",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-783184",
"93cfb52902ba"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p addons-783184 -n addons-783184
helpers_test.go:244: <<< TestAddons/serial/Volcano FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/serial/Volcano]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p addons-783184 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-783184 logs -n 25: (1.5975606s)
helpers_test.go:252: TestAddons/serial/Volcano logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| start | -o=json --download-only | download-only-168781 | jenkins | v1.34.0 | 24 Sep 24 18:37 UTC | |
| | -p download-only-168781 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 24 Sep 24 18:37 UTC | 24 Sep 24 18:37 UTC |
| delete | -p download-only-168781 | download-only-168781 | jenkins | v1.34.0 | 24 Sep 24 18:37 UTC | 24 Sep 24 18:37 UTC |
| start | -o=json --download-only | download-only-679007 | jenkins | v1.34.0 | 24 Sep 24 18:37 UTC | |
| | -p download-only-679007 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 24 Sep 24 18:37 UTC | 24 Sep 24 18:37 UTC |
| delete | -p download-only-679007 | download-only-679007 | jenkins | v1.34.0 | 24 Sep 24 18:37 UTC | 24 Sep 24 18:37 UTC |
| delete | -p download-only-168781 | download-only-168781 | jenkins | v1.34.0 | 24 Sep 24 18:37 UTC | 24 Sep 24 18:37 UTC |
| delete | -p download-only-679007 | download-only-679007 | jenkins | v1.34.0 | 24 Sep 24 18:37 UTC | 24 Sep 24 18:37 UTC |
| start | --download-only -p | download-docker-263463 | jenkins | v1.34.0 | 24 Sep 24 18:37 UTC | |
| | download-docker-263463 | | | | | |
| | --alsologtostderr | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p download-docker-263463 | download-docker-263463 | jenkins | v1.34.0 | 24 Sep 24 18:37 UTC | 24 Sep 24 18:37 UTC |
| start | --download-only -p | binary-mirror-636468 | jenkins | v1.34.0 | 24 Sep 24 18:37 UTC | |
| | binary-mirror-636468 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:43135 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p binary-mirror-636468 | binary-mirror-636468 | jenkins | v1.34.0 | 24 Sep 24 18:37 UTC | 24 Sep 24 18:37 UTC |
| addons | disable dashboard -p | addons-783184 | jenkins | v1.34.0 | 24 Sep 24 18:37 UTC | |
| | addons-783184 | | | | | |
| addons | enable dashboard -p | addons-783184 | jenkins | v1.34.0 | 24 Sep 24 18:37 UTC | |
| | addons-783184 | | | | | |
| start | -p addons-783184 --wait=true | addons-783184 | jenkins | v1.34.0 | 24 Sep 24 18:37 UTC | 24 Sep 24 18:41 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/09/24 18:37:25
Running on machine: ip-172-31-30-239
Binary: Built with gc go1.23.0 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0924 18:37:25.242580 446193 out.go:345] Setting OutFile to fd 1 ...
I0924 18:37:25.242794 446193 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0924 18:37:25.242821 446193 out.go:358] Setting ErrFile to fd 2...
I0924 18:37:25.242839 446193 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0924 18:37:25.243144 446193 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19700-440051/.minikube/bin
I0924 18:37:25.243740 446193 out.go:352] Setting JSON to false
I0924 18:37:25.244766 446193 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":8395,"bootTime":1727194651,"procs":178,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
I0924 18:37:25.244879 446193 start.go:139] virtualization:
I0924 18:37:25.249002 446193 out.go:177] * [addons-783184] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I0924 18:37:25.251411 446193 out.go:177] - MINIKUBE_LOCATION=19700
I0924 18:37:25.251632 446193 notify.go:220] Checking for updates...
I0924 18:37:25.255992 446193 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0924 18:37:25.258348 446193 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19700-440051/kubeconfig
I0924 18:37:25.260650 446193 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19700-440051/.minikube
I0924 18:37:25.262930 446193 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0924 18:37:25.265282 446193 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0924 18:37:25.267961 446193 driver.go:394] Setting default libvirt URI to qemu:///system
I0924 18:37:25.299028 446193 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
I0924 18:37:25.299147 446193 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0924 18:37:25.350593 446193 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-24 18:37:25.341109881 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I0924 18:37:25.350715 446193 docker.go:318] overlay module found
I0924 18:37:25.353351 446193 out.go:177] * Using the docker driver based on user configuration
I0924 18:37:25.355266 446193 start.go:297] selected driver: docker
I0924 18:37:25.355290 446193 start.go:901] validating driver "docker" against <nil>
I0924 18:37:25.355305 446193 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0924 18:37:25.355965 446193 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0924 18:37:25.402414 446193 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-24 18:37:25.392821538 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I0924 18:37:25.402618 446193 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0924 18:37:25.402852 446193 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0924 18:37:25.405165 446193 out.go:177] * Using Docker driver with root privileges
I0924 18:37:25.407544 446193 cni.go:84] Creating CNI manager for ""
I0924 18:37:25.407612 446193 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0924 18:37:25.407626 446193 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0924 18:37:25.407714 446193 start.go:340] cluster config:
{Name:addons-783184 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-783184 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHA
uthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0924 18:37:25.413965 446193 out.go:177] * Starting "addons-783184" primary control-plane node in "addons-783184" cluster
I0924 18:37:25.416582 446193 cache.go:121] Beginning downloading kic base image for docker with containerd
I0924 18:37:25.418844 446193 out.go:177] * Pulling base image v0.0.45-1727108449-19696 ...
I0924 18:37:25.421069 446193 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I0924 18:37:25.421106 446193 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local docker daemon
I0924 18:37:25.421131 446193 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19700-440051/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4
I0924 18:37:25.421141 446193 cache.go:56] Caching tarball of preloaded images
I0924 18:37:25.421241 446193 preload.go:172] Found /home/jenkins/minikube-integration/19700-440051/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0924 18:37:25.421252 446193 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on containerd
I0924 18:37:25.421700 446193 profile.go:143] Saving config to /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/config.json ...
I0924 18:37:25.421779 446193 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/config.json: {Name:mkd89b82417b0d16afbe94d658bac1df91e49057 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 18:37:25.436574 446193 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 to local cache
I0924 18:37:25.436728 446193 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local cache directory
I0924 18:37:25.436753 446193 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local cache directory, skipping pull
I0924 18:37:25.436762 446193 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 exists in cache, skipping pull
I0924 18:37:25.436770 446193 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 as a tarball
I0924 18:37:25.436775 446193 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 from local cache
I0924 18:37:42.782639 446193 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 from cached tarball
I0924 18:37:42.782680 446193 cache.go:194] Successfully downloaded all kic artifacts
I0924 18:37:42.782711 446193 start.go:360] acquireMachinesLock for addons-783184: {Name:mkcb2d7912881a5ed1f67f7099182a6679c22d7a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0924 18:37:42.782831 446193 start.go:364] duration metric: took 92.126µs to acquireMachinesLock for "addons-783184"
I0924 18:37:42.782861 446193 start.go:93] Provisioning new machine with config: &{Name:addons-783184 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-783184 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fa
lse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0924 18:37:42.782958 446193 start.go:125] createHost starting for "" (driver="docker")
I0924 18:37:42.786518 446193 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
I0924 18:37:42.786771 446193 start.go:159] libmachine.API.Create for "addons-783184" (driver="docker")
I0924 18:37:42.786810 446193 client.go:168] LocalClient.Create starting
I0924 18:37:42.786936 446193 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19700-440051/.minikube/certs/ca.pem
I0924 18:37:43.227988 446193 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19700-440051/.minikube/certs/cert.pem
I0924 18:37:43.694790 446193 cli_runner.go:164] Run: docker network inspect addons-783184 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0924 18:37:43.708763 446193 cli_runner.go:211] docker network inspect addons-783184 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0924 18:37:43.708867 446193 network_create.go:284] running [docker network inspect addons-783184] to gather additional debugging logs...
I0924 18:37:43.708893 446193 cli_runner.go:164] Run: docker network inspect addons-783184
W0924 18:37:43.722575 446193 cli_runner.go:211] docker network inspect addons-783184 returned with exit code 1
I0924 18:37:43.722613 446193 network_create.go:287] error running [docker network inspect addons-783184]: docker network inspect addons-783184: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-783184 not found
I0924 18:37:43.722627 446193 network_create.go:289] output of [docker network inspect addons-783184]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-783184 not found
** /stderr **
I0924 18:37:43.722725 446193 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0924 18:37:43.739216 446193 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4001867d60}
I0924 18:37:43.739263 446193 network_create.go:124] attempt to create docker network addons-783184 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0924 18:37:43.739322 446193 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-783184 addons-783184
I0924 18:37:43.812785 446193 network_create.go:108] docker network addons-783184 192.168.49.0/24 created
I0924 18:37:43.812818 446193 kic.go:121] calculated static IP "192.168.49.2" for the "addons-783184" container
I0924 18:37:43.812901 446193 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0924 18:37:43.827813 446193 cli_runner.go:164] Run: docker volume create addons-783184 --label name.minikube.sigs.k8s.io=addons-783184 --label created_by.minikube.sigs.k8s.io=true
I0924 18:37:43.844517 446193 oci.go:103] Successfully created a docker volume addons-783184
I0924 18:37:43.844617 446193 cli_runner.go:164] Run: docker run --rm --name addons-783184-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-783184 --entrypoint /usr/bin/test -v addons-783184:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 -d /var/lib
I0924 18:37:45.895321 446193 cli_runner.go:217] Completed: docker run --rm --name addons-783184-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-783184 --entrypoint /usr/bin/test -v addons-783184:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 -d /var/lib: (2.050658761s)
I0924 18:37:45.895353 446193 oci.go:107] Successfully prepared a docker volume addons-783184
I0924 18:37:45.895385 446193 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I0924 18:37:45.895410 446193 kic.go:194] Starting extracting preloaded images to volume ...
I0924 18:37:45.895482 446193 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19700-440051/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-783184:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 -I lz4 -xf /preloaded.tar -C /extractDir
I0924 18:37:49.934293 446193 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19700-440051/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-783184:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 -I lz4 -xf /preloaded.tar -C /extractDir: (4.038770488s)
I0924 18:37:49.934327 446193 kic.go:203] duration metric: took 4.038914019s to extract preloaded images to volume ...
W0924 18:37:49.934480 446193 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0924 18:37:49.934665 446193 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0924 18:37:49.987127 446193 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-783184 --name addons-783184 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-783184 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-783184 --network addons-783184 --ip 192.168.49.2 --volume addons-783184:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21
I0924 18:37:50.322309 446193 cli_runner.go:164] Run: docker container inspect addons-783184 --format={{.State.Running}}
I0924 18:37:50.342777 446193 cli_runner.go:164] Run: docker container inspect addons-783184 --format={{.State.Status}}
I0924 18:37:50.370750 446193 cli_runner.go:164] Run: docker exec addons-783184 stat /var/lib/dpkg/alternatives/iptables
I0924 18:37:50.433771 446193 oci.go:144] the created container "addons-783184" has a running status.
I0924 18:37:50.433816 446193 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19700-440051/.minikube/machines/addons-783184/id_rsa...
I0924 18:37:50.982238 446193 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19700-440051/.minikube/machines/addons-783184/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0924 18:37:51.010604 446193 cli_runner.go:164] Run: docker container inspect addons-783184 --format={{.State.Status}}
I0924 18:37:51.036651 446193 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0924 18:37:51.036674 446193 kic_runner.go:114] Args: [docker exec --privileged addons-783184 chown docker:docker /home/docker/.ssh/authorized_keys]
I0924 18:37:51.116641 446193 cli_runner.go:164] Run: docker container inspect addons-783184 --format={{.State.Status}}
I0924 18:37:51.155609 446193 machine.go:93] provisionDockerMachine start ...
I0924 18:37:51.155720 446193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-783184
I0924 18:37:51.176620 446193 main.go:141] libmachine: Using SSH client type: native
I0924 18:37:51.176885 446193 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33164 <nil> <nil>}
I0924 18:37:51.176896 446193 main.go:141] libmachine: About to run SSH command:
hostname
I0924 18:37:51.329117 446193 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-783184
I0924 18:37:51.329162 446193 ubuntu.go:169] provisioning hostname "addons-783184"
I0924 18:37:51.329232 446193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-783184
I0924 18:37:51.350487 446193 main.go:141] libmachine: Using SSH client type: native
I0924 18:37:51.350736 446193 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33164 <nil> <nil>}
I0924 18:37:51.350749 446193 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-783184 && echo "addons-783184" | sudo tee /etc/hostname
I0924 18:37:51.498547 446193 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-783184
I0924 18:37:51.498708 446193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-783184
I0924 18:37:51.519251 446193 main.go:141] libmachine: Using SSH client type: native
I0924 18:37:51.519492 446193 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33164 <nil> <nil>}
I0924 18:37:51.519510 446193 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-783184' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-783184/g' /etc/hosts;
else
echo '127.0.1.1 addons-783184' | sudo tee -a /etc/hosts;
fi
fi
I0924 18:37:51.657502 446193 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0924 18:37:51.657531 446193 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19700-440051/.minikube CaCertPath:/home/jenkins/minikube-integration/19700-440051/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19700-440051/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19700-440051/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19700-440051/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19700-440051/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19700-440051/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19700-440051/.minikube}
I0924 18:37:51.657566 446193 ubuntu.go:177] setting up certificates
I0924 18:37:51.657582 446193 provision.go:84] configureAuth start
I0924 18:37:51.657648 446193 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-783184
I0924 18:37:51.676734 446193 provision.go:143] copyHostCerts
I0924 18:37:51.676823 446193 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19700-440051/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19700-440051/.minikube/ca.pem (1078 bytes)
I0924 18:37:51.676941 446193 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19700-440051/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19700-440051/.minikube/cert.pem (1123 bytes)
I0924 18:37:51.677005 446193 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19700-440051/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19700-440051/.minikube/key.pem (1675 bytes)
I0924 18:37:51.677057 446193 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19700-440051/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19700-440051/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19700-440051/.minikube/certs/ca-key.pem org=jenkins.addons-783184 san=[127.0.0.1 192.168.49.2 addons-783184 localhost minikube]
I0924 18:37:51.873532 446193 provision.go:177] copyRemoteCerts
I0924 18:37:51.873601 446193 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0924 18:37:51.873672 446193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-783184
I0924 18:37:51.892487 446193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33164 SSHKeyPath:/home/jenkins/minikube-integration/19700-440051/.minikube/machines/addons-783184/id_rsa Username:docker}
I0924 18:37:51.986140 446193 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-440051/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0924 18:37:52.017118 446193 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-440051/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0924 18:37:52.042101 446193 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-440051/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0924 18:37:52.068410 446193 provision.go:87] duration metric: took 410.808754ms to configureAuth
I0924 18:37:52.068484 446193 ubuntu.go:193] setting minikube options for container-runtime
I0924 18:37:52.068708 446193 config.go:182] Loaded profile config "addons-783184": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I0924 18:37:52.068745 446193 machine.go:96] duration metric: took 913.111682ms to provisionDockerMachine
I0924 18:37:52.068760 446193 client.go:171] duration metric: took 9.281940802s to LocalClient.Create
I0924 18:37:52.068781 446193 start.go:167] duration metric: took 9.282011061s to libmachine.API.Create "addons-783184"
I0924 18:37:52.068793 446193 start.go:293] postStartSetup for "addons-783184" (driver="docker")
I0924 18:37:52.068806 446193 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0924 18:37:52.068864 446193 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0924 18:37:52.068917 446193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-783184
I0924 18:37:52.085831 446193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33164 SSHKeyPath:/home/jenkins/minikube-integration/19700-440051/.minikube/machines/addons-783184/id_rsa Username:docker}
I0924 18:37:52.178713 446193 ssh_runner.go:195] Run: cat /etc/os-release
I0924 18:37:52.181923 446193 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0924 18:37:52.181962 446193 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0924 18:37:52.181974 446193 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0924 18:37:52.181981 446193 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I0924 18:37:52.181991 446193 filesync.go:126] Scanning /home/jenkins/minikube-integration/19700-440051/.minikube/addons for local assets ...
I0924 18:37:52.182062 446193 filesync.go:126] Scanning /home/jenkins/minikube-integration/19700-440051/.minikube/files for local assets ...
I0924 18:37:52.182089 446193 start.go:296] duration metric: took 113.290123ms for postStartSetup
I0924 18:37:52.182394 446193 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-783184
I0924 18:37:52.198230 446193 profile.go:143] Saving config to /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/config.json ...
I0924 18:37:52.198520 446193 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0924 18:37:52.198572 446193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-783184
I0924 18:37:52.214395 446193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33164 SSHKeyPath:/home/jenkins/minikube-integration/19700-440051/.minikube/machines/addons-783184/id_rsa Username:docker}
I0924 18:37:52.302271 446193 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0924 18:37:52.306482 446193 start.go:128] duration metric: took 9.523509703s to createHost
I0924 18:37:52.306550 446193 start.go:83] releasing machines lock for "addons-783184", held for 9.523704655s
I0924 18:37:52.306656 446193 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-783184
I0924 18:37:52.328247 446193 ssh_runner.go:195] Run: cat /version.json
I0924 18:37:52.328268 446193 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0924 18:37:52.328297 446193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-783184
I0924 18:37:52.328327 446193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-783184
I0924 18:37:52.347795 446193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33164 SSHKeyPath:/home/jenkins/minikube-integration/19700-440051/.minikube/machines/addons-783184/id_rsa Username:docker}
I0924 18:37:52.357642 446193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33164 SSHKeyPath:/home/jenkins/minikube-integration/19700-440051/.minikube/machines/addons-783184/id_rsa Username:docker}
I0924 18:37:52.578263 446193 ssh_runner.go:195] Run: systemctl --version
I0924 18:37:52.582781 446193 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0924 18:37:52.586953 446193 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0924 18:37:52.612369 446193 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0924 18:37:52.612462 446193 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0924 18:37:52.643806 446193 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0924 18:37:52.643835 446193 start.go:495] detecting cgroup driver to use...
I0924 18:37:52.643869 446193 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0924 18:37:52.643956 446193 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0924 18:37:52.656531 446193 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0924 18:37:52.668253 446193 docker.go:217] disabling cri-docker service (if available) ...
I0924 18:37:52.668342 446193 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0924 18:37:52.682892 446193 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0924 18:37:52.698074 446193 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0924 18:37:52.786866 446193 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0924 18:37:52.881507 446193 docker.go:233] disabling docker service ...
I0924 18:37:52.881625 446193 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0924 18:37:52.902779 446193 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0924 18:37:52.915128 446193 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0924 18:37:53.026430 446193 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0924 18:37:53.120360 446193 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0924 18:37:53.131731 446193 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0924 18:37:53.150560 446193 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0924 18:37:53.160743 446193 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0924 18:37:53.171180 446193 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0924 18:37:53.171353 446193 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0924 18:37:53.181490 446193 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0924 18:37:53.191619 446193 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0924 18:37:53.201461 446193 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0924 18:37:53.211468 446193 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0924 18:37:53.220883 446193 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0924 18:37:53.230944 446193 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0924 18:37:53.240724 446193 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0924 18:37:53.250751 446193 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0924 18:37:53.259284 446193 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0924 18:37:53.267854 446193 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0924 18:37:53.348929 446193 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0924 18:37:53.468106 446193 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0924 18:37:53.468262 446193 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0924 18:37:53.471736 446193 start.go:563] Will wait 60s for crictl version
I0924 18:37:53.471836 446193 ssh_runner.go:195] Run: which crictl
I0924 18:37:53.475113 446193 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0924 18:37:53.509454 446193 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.22
RuntimeApiVersion: v1
I0924 18:37:53.509542 446193 ssh_runner.go:195] Run: containerd --version
I0924 18:37:53.532930 446193 ssh_runner.go:195] Run: containerd --version
I0924 18:37:53.559581 446193 out.go:177] * Preparing Kubernetes v1.31.1 on containerd 1.7.22 ...
I0924 18:37:53.561768 446193 cli_runner.go:164] Run: docker network inspect addons-783184 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0924 18:37:53.577388 446193 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I0924 18:37:53.580995 446193 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0924 18:37:53.591893 446193 kubeadm.go:883] updating cluster {Name:addons-783184 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-783184 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cus
tomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0924 18:37:53.592028 446193 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I0924 18:37:53.592093 446193 ssh_runner.go:195] Run: sudo crictl images --output json
I0924 18:37:53.629823 446193 containerd.go:627] all images are preloaded for containerd runtime.
I0924 18:37:53.629848 446193 containerd.go:534] Images already preloaded, skipping extraction
I0924 18:37:53.629908 446193 ssh_runner.go:195] Run: sudo crictl images --output json
I0924 18:37:53.665692 446193 containerd.go:627] all images are preloaded for containerd runtime.
I0924 18:37:53.665718 446193 cache_images.go:84] Images are preloaded, skipping loading
I0924 18:37:53.665726 446193 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.1 containerd true true} ...
I0924 18:37:53.665832 446193 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-783184 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.31.1 ClusterName:addons-783184 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0924 18:37:53.665907 446193 ssh_runner.go:195] Run: sudo crictl info
I0924 18:37:53.705817 446193 cni.go:84] Creating CNI manager for ""
I0924 18:37:53.705841 446193 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0924 18:37:53.705852 446193 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0924 18:37:53.705897 446193 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-783184 NodeName:addons-783184 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc
/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0924 18:37:53.706064 446193 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "addons-783184"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0924 18:37:53.706136 446193 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1
I0924 18:37:53.714903 446193 binaries.go:44] Found k8s binaries, skipping transfer
I0924 18:37:53.714974 446193 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0924 18:37:53.723671 446193 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (317 bytes)
I0924 18:37:53.741692 446193 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0924 18:37:53.759777 446193 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2167 bytes)
I0924 18:37:53.777981 446193 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0924 18:37:53.781585 446193 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0924 18:37:53.792964 446193 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0924 18:37:53.881423 446193 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0924 18:37:53.897886 446193 certs.go:68] Setting up /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184 for IP: 192.168.49.2
I0924 18:37:53.897952 446193 certs.go:194] generating shared ca certs ...
I0924 18:37:53.897983 446193 certs.go:226] acquiring lock for ca certs: {Name:mkc62fc2ccc794a5cedf26dce205cca22588d47c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 18:37:53.898141 446193 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19700-440051/.minikube/ca.key
I0924 18:37:54.335338 446193 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19700-440051/.minikube/ca.crt ...
I0924 18:37:54.335375 446193 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19700-440051/.minikube/ca.crt: {Name:mk41de5a40c957082b07c5e5522192ac32df909d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 18:37:54.335586 446193 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19700-440051/.minikube/ca.key ...
I0924 18:37:54.335599 446193 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19700-440051/.minikube/ca.key: {Name:mkb588b997c3c9a57e7cc494e0ad159c75d24af0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 18:37:54.335692 446193 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19700-440051/.minikube/proxy-client-ca.key
I0924 18:37:54.796880 446193 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19700-440051/.minikube/proxy-client-ca.crt ...
I0924 18:37:54.796911 446193 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19700-440051/.minikube/proxy-client-ca.crt: {Name:mk1db8c85b7ac3320f9b9b4fcd1f8947f353e327 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 18:37:54.797088 446193 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19700-440051/.minikube/proxy-client-ca.key ...
I0924 18:37:54.797103 446193 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19700-440051/.minikube/proxy-client-ca.key: {Name:mk1a6ad1d2f5bce860bc93f13140c07a4f3de5eb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 18:37:54.797173 446193 certs.go:256] generating profile certs ...
I0924 18:37:54.797244 446193 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/client.key
I0924 18:37:54.797261 446193 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/client.crt with IP's: []
I0924 18:37:56.367549 446193 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/client.crt ...
I0924 18:37:56.367586 446193 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/client.crt: {Name:mkdcc7de2e953da8c89df3c2033a9066da166201 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 18:37:56.367786 446193 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/client.key ...
I0924 18:37:56.367801 446193 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/client.key: {Name:mk5d7f71748d3a45be05619139eebe49642a451a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 18:37:56.367878 446193 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/apiserver.key.5eecb0aa
I0924 18:37:56.367902 446193 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/apiserver.crt.5eecb0aa with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I0924 18:37:56.915365 446193 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/apiserver.crt.5eecb0aa ...
I0924 18:37:56.915400 446193 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/apiserver.crt.5eecb0aa: {Name:mk0669b5bf070621dc3af0dc8327722c9fd3c744 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 18:37:56.915594 446193 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/apiserver.key.5eecb0aa ...
I0924 18:37:56.915610 446193 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/apiserver.key.5eecb0aa: {Name:mk5d8f1af1915128105ededb4d982600cd8a963c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 18:37:56.916207 446193 certs.go:381] copying /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/apiserver.crt.5eecb0aa -> /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/apiserver.crt
I0924 18:37:56.916304 446193 certs.go:385] copying /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/apiserver.key.5eecb0aa -> /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/apiserver.key
I0924 18:37:56.916377 446193 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/proxy-client.key
I0924 18:37:56.916398 446193 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/proxy-client.crt with IP's: []
I0924 18:37:57.205286 446193 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/proxy-client.crt ...
I0924 18:37:57.205322 446193 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/proxy-client.crt: {Name:mkdc508fabb98207c0a60b399f671ec05dbacdc6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 18:37:57.205950 446193 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/proxy-client.key ...
I0924 18:37:57.205970 446193 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/proxy-client.key: {Name:mk164ff26e3b33c126e6445d21c7e59a6f40a51d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 18:37:57.206726 446193 certs.go:484] found cert: /home/jenkins/minikube-integration/19700-440051/.minikube/certs/ca-key.pem (1679 bytes)
I0924 18:37:57.206773 446193 certs.go:484] found cert: /home/jenkins/minikube-integration/19700-440051/.minikube/certs/ca.pem (1078 bytes)
I0924 18:37:57.206804 446193 certs.go:484] found cert: /home/jenkins/minikube-integration/19700-440051/.minikube/certs/cert.pem (1123 bytes)
I0924 18:37:57.206833 446193 certs.go:484] found cert: /home/jenkins/minikube-integration/19700-440051/.minikube/certs/key.pem (1675 bytes)
I0924 18:37:57.207440 446193 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-440051/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0924 18:37:57.233000 446193 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-440051/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0924 18:37:57.258470 446193 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-440051/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0924 18:37:57.283092 446193 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-440051/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0924 18:37:57.307670 446193 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0924 18:37:57.331734 446193 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0924 18:37:57.356034 446193 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0924 18:37:57.380252 446193 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-440051/.minikube/profiles/addons-783184/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0924 18:37:57.404512 446193 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19700-440051/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0924 18:37:57.429271 446193 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0924 18:37:57.448221 446193 ssh_runner.go:195] Run: openssl version
I0924 18:37:57.454040 446193 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0924 18:37:57.464064 446193 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0924 18:37:57.467742 446193 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 24 18:37 /usr/share/ca-certificates/minikubeCA.pem
I0924 18:37:57.467819 446193 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0924 18:37:57.474675 446193 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0924 18:37:57.484130 446193 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0924 18:37:57.487715 446193 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0924 18:37:57.487762 446193 kubeadm.go:392] StartCluster: {Name:addons-783184 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-783184 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom
QemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0924 18:37:57.487843 446193 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0924 18:37:57.487905 446193 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0924 18:37:57.523585 446193 cri.go:89] found id: ""
I0924 18:37:57.523666 446193 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0924 18:37:57.532507 446193 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0924 18:37:57.541457 446193 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0924 18:37:57.541566 446193 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0924 18:37:57.550523 446193 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0924 18:37:57.550586 446193 kubeadm.go:157] found existing configuration files:
I0924 18:37:57.550649 446193 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0924 18:37:57.559219 446193 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0924 18:37:57.559291 446193 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0924 18:37:57.567897 446193 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0924 18:37:57.576551 446193 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0924 18:37:57.576633 446193 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0924 18:37:57.584907 446193 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0924 18:37:57.593456 446193 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0924 18:37:57.593546 446193 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0924 18:37:57.602011 446193 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0924 18:37:57.611316 446193 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0924 18:37:57.611448 446193 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0924 18:37:57.621306 446193 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0924 18:37:57.657513 446193 kubeadm.go:310] W0924 18:37:57.656747 1036 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0924 18:37:57.658465 446193 kubeadm.go:310] W0924 18:37:57.657938 1036 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0924 18:37:57.687685 446193 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1070-aws\n", err: exit status 1
I0924 18:37:57.759027 446193 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0924 18:38:13.481260 446193 kubeadm.go:310] [init] Using Kubernetes version: v1.31.1
I0924 18:38:13.481321 446193 kubeadm.go:310] [preflight] Running pre-flight checks
I0924 18:38:13.481433 446193 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0924 18:38:13.481502 446193 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1070-aws[0m
I0924 18:38:13.481542 446193 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0924 18:38:13.481614 446193 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0924 18:38:13.481674 446193 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0924 18:38:13.481732 446193 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0924 18:38:13.481794 446193 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0924 18:38:13.481851 446193 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0924 18:38:13.481902 446193 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0924 18:38:13.481953 446193 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0924 18:38:13.482007 446193 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0924 18:38:13.482058 446193 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0924 18:38:13.482131 446193 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0924 18:38:13.482227 446193 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0924 18:38:13.482318 446193 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0924 18:38:13.482383 446193 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0924 18:38:13.484786 446193 out.go:235] - Generating certificates and keys ...
I0924 18:38:13.484878 446193 kubeadm.go:310] [certs] Using existing ca certificate authority
I0924 18:38:13.484945 446193 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0924 18:38:13.485014 446193 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0924 18:38:13.485078 446193 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0924 18:38:13.485144 446193 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0924 18:38:13.485197 446193 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0924 18:38:13.485253 446193 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0924 18:38:13.485371 446193 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-783184 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0924 18:38:13.485454 446193 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0924 18:38:13.485572 446193 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-783184 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0924 18:38:13.485640 446193 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0924 18:38:13.485706 446193 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0924 18:38:13.485753 446193 kubeadm.go:310] [certs] Generating "sa" key and public key
I0924 18:38:13.485818 446193 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0924 18:38:13.485872 446193 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0924 18:38:13.485931 446193 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0924 18:38:13.485995 446193 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0924 18:38:13.486064 446193 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0924 18:38:13.486120 446193 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0924 18:38:13.486204 446193 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0924 18:38:13.486273 446193 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0924 18:38:13.488125 446193 out.go:235] - Booting up control plane ...
I0924 18:38:13.488272 446193 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0924 18:38:13.488390 446193 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0924 18:38:13.488489 446193 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0924 18:38:13.488606 446193 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0924 18:38:13.488705 446193 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0924 18:38:13.488770 446193 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0924 18:38:13.488925 446193 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0924 18:38:13.489085 446193 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0924 18:38:13.489172 446193 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.001854504s
I0924 18:38:13.489293 446193 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0924 18:38:13.489375 446193 kubeadm.go:310] [api-check] The API server is healthy after 6.001679926s
I0924 18:38:13.489549 446193 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0924 18:38:13.489720 446193 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0924 18:38:13.489802 446193 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0924 18:38:13.490027 446193 kubeadm.go:310] [mark-control-plane] Marking the node addons-783184 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0924 18:38:13.490097 446193 kubeadm.go:310] [bootstrap-token] Using token: 4sc01p.7p933z1vnxse3mtp
I0924 18:38:13.492358 446193 out.go:235] - Configuring RBAC rules ...
I0924 18:38:13.492507 446193 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0924 18:38:13.492603 446193 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0924 18:38:13.492755 446193 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0924 18:38:13.492918 446193 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0924 18:38:13.493045 446193 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0924 18:38:13.493138 446193 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0924 18:38:13.493267 446193 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0924 18:38:13.493318 446193 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0924 18:38:13.493389 446193 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0924 18:38:13.493419 446193 kubeadm.go:310]
I0924 18:38:13.493574 446193 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0924 18:38:13.493590 446193 kubeadm.go:310]
I0924 18:38:13.493733 446193 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0924 18:38:13.493745 446193 kubeadm.go:310]
I0924 18:38:13.493775 446193 kubeadm.go:310] mkdir -p $HOME/.kube
I0924 18:38:13.493843 446193 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0924 18:38:13.493922 446193 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0924 18:38:13.493933 446193 kubeadm.go:310]
I0924 18:38:13.494005 446193 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0924 18:38:13.494017 446193 kubeadm.go:310]
I0924 18:38:13.494078 446193 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0924 18:38:13.494086 446193 kubeadm.go:310]
I0924 18:38:13.494162 446193 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0924 18:38:13.494257 446193 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0924 18:38:13.494326 446193 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0924 18:38:13.494331 446193 kubeadm.go:310]
I0924 18:38:13.494414 446193 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0924 18:38:13.494489 446193 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0924 18:38:13.494498 446193 kubeadm.go:310]
I0924 18:38:13.494582 446193 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token 4sc01p.7p933z1vnxse3mtp \
I0924 18:38:13.494682 446193 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:2a38b3e34527ef5dc2482a099948c7069d28274afedb4ce8d0d61d9acee11985 \
I0924 18:38:13.494705 446193 kubeadm.go:310] --control-plane
I0924 18:38:13.494709 446193 kubeadm.go:310]
I0924 18:38:13.494792 446193 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0924 18:38:13.494797 446193 kubeadm.go:310]
I0924 18:38:13.494879 446193 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token 4sc01p.7p933z1vnxse3mtp \
I0924 18:38:13.494995 446193 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:2a38b3e34527ef5dc2482a099948c7069d28274afedb4ce8d0d61d9acee11985
I0924 18:38:13.495003 446193 cni.go:84] Creating CNI manager for ""
I0924 18:38:13.495011 446193 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0924 18:38:13.497203 446193 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0924 18:38:13.499681 446193 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0924 18:38:13.504032 446193 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.1/kubectl ...
I0924 18:38:13.504054 446193 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I0924 18:38:13.526947 446193 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0924 18:38:13.799682 446193 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0924 18:38:13.799828 446193 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0924 18:38:13.799915 446193 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-783184 minikube.k8s.io/updated_at=2024_09_24T18_38_13_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=ab8e06d5efb8aef1f7ea9881c3e41593ddc7876e minikube.k8s.io/name=addons-783184 minikube.k8s.io/primary=true
I0924 18:38:13.930773 446193 ops.go:34] apiserver oom_adj: -16
I0924 18:38:13.930915 446193 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0924 18:38:14.431513 446193 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0924 18:38:14.931750 446193 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0924 18:38:15.431385 446193 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0924 18:38:15.931003 446193 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0924 18:38:16.431782 446193 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0924 18:38:16.931345 446193 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0924 18:38:17.431242 446193 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0924 18:38:17.931104 446193 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0924 18:38:18.050963 446193 kubeadm.go:1113] duration metric: took 4.251182117s to wait for elevateKubeSystemPrivileges
I0924 18:38:18.050999 446193 kubeadm.go:394] duration metric: took 20.563240059s to StartCluster
I0924 18:38:18.051018 446193 settings.go:142] acquiring lock: {Name:mk3474ab2e32bda4466d93100746590bcb646da8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 18:38:18.051155 446193 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19700-440051/kubeconfig
I0924 18:38:18.051569 446193 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19700-440051/kubeconfig: {Name:mkbcffc23d82b4297a6a95e203a67e556e7df2cf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 18:38:18.051812 446193 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0924 18:38:18.051829 446193 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0924 18:38:18.052125 446193 config.go:182] Loaded profile config "addons-783184": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I0924 18:38:18.052170 446193 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I0924 18:38:18.052248 446193 addons.go:69] Setting yakd=true in profile "addons-783184"
I0924 18:38:18.052263 446193 addons.go:234] Setting addon yakd=true in "addons-783184"
I0924 18:38:18.052295 446193 host.go:66] Checking if "addons-783184" exists ...
I0924 18:38:18.052787 446193 cli_runner.go:164] Run: docker container inspect addons-783184 --format={{.State.Status}}
I0924 18:38:18.053377 446193 addons.go:69] Setting metrics-server=true in profile "addons-783184"
I0924 18:38:18.053436 446193 addons.go:234] Setting addon metrics-server=true in "addons-783184"
I0924 18:38:18.053470 446193 host.go:66] Checking if "addons-783184" exists ...
I0924 18:38:18.053943 446193 cli_runner.go:164] Run: docker container inspect addons-783184 --format={{.State.Status}}
I0924 18:38:18.054213 446193 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-783184"
I0924 18:38:18.054236 446193 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-783184"
I0924 18:38:18.054263 446193 host.go:66] Checking if "addons-783184" exists ...
I0924 18:38:18.054705 446193 cli_runner.go:164] Run: docker container inspect addons-783184 --format={{.State.Status}}
I0924 18:38:18.057181 446193 addons.go:69] Setting registry=true in profile "addons-783184"
I0924 18:38:18.057228 446193 addons.go:234] Setting addon registry=true in "addons-783184"
I0924 18:38:18.057300 446193 host.go:66] Checking if "addons-783184" exists ...
I0924 18:38:18.057910 446193 cli_runner.go:164] Run: docker container inspect addons-783184 --format={{.State.Status}}
I0924 18:38:18.063173 446193 addons.go:69] Setting cloud-spanner=true in profile "addons-783184"
I0924 18:38:18.063378 446193 addons.go:234] Setting addon cloud-spanner=true in "addons-783184"
I0924 18:38:18.063536 446193 host.go:66] Checking if "addons-783184" exists ...
I0924 18:38:18.064345 446193 cli_runner.go:164] Run: docker container inspect addons-783184 --format={{.State.Status}}
I0924 18:38:18.073066 446193 addons.go:69] Setting storage-provisioner=true in profile "addons-783184"
I0924 18:38:18.073122 446193 addons.go:234] Setting addon storage-provisioner=true in "addons-783184"
I0924 18:38:18.073177 446193 host.go:66] Checking if "addons-783184" exists ...
I0924 18:38:18.073540 446193 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-783184"
I0924 18:38:18.073632 446193 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-783184"
I0924 18:38:18.073679 446193 host.go:66] Checking if "addons-783184" exists ...
I0924 18:38:18.074243 446193 cli_runner.go:164] Run: docker container inspect addons-783184 --format={{.State.Status}}
I0924 18:38:18.076546 446193 cli_runner.go:164] Run: docker container inspect addons-783184 --format={{.State.Status}}
I0924 18:38:18.089736 446193 addons.go:69] Setting default-storageclass=true in profile "addons-783184"
I0924 18:38:18.089781 446193 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-783184"
I0924 18:38:18.090544 446193 cli_runner.go:164] Run: docker container inspect addons-783184 --format={{.State.Status}}
I0924 18:38:18.093322 446193 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-783184"
I0924 18:38:18.093358 446193 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-783184"
I0924 18:38:18.093912 446193 cli_runner.go:164] Run: docker container inspect addons-783184 --format={{.State.Status}}
I0924 18:38:18.112184 446193 addons.go:69] Setting gcp-auth=true in profile "addons-783184"
I0924 18:38:18.112219 446193 mustload.go:65] Loading cluster: addons-783184
I0924 18:38:18.112434 446193 config.go:182] Loaded profile config "addons-783184": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I0924 18:38:18.113743 446193 cli_runner.go:164] Run: docker container inspect addons-783184 --format={{.State.Status}}
I0924 18:38:18.129978 446193 addons.go:69] Setting ingress=true in profile "addons-783184"
I0924 18:38:18.130083 446193 addons.go:234] Setting addon ingress=true in "addons-783184"
I0924 18:38:18.130151 446193 host.go:66] Checking if "addons-783184" exists ...
I0924 18:38:18.130802 446193 cli_runner.go:164] Run: docker container inspect addons-783184 --format={{.State.Status}}
I0924 18:38:18.133462 446193 addons.go:69] Setting volcano=true in profile "addons-783184"
I0924 18:38:18.133551 446193 addons.go:234] Setting addon volcano=true in "addons-783184"
I0924 18:38:18.133633 446193 host.go:66] Checking if "addons-783184" exists ...
I0924 18:38:18.134238 446193 cli_runner.go:164] Run: docker container inspect addons-783184 --format={{.State.Status}}
I0924 18:38:18.150232 446193 addons.go:69] Setting ingress-dns=true in profile "addons-783184"
I0924 18:38:18.150266 446193 addons.go:234] Setting addon ingress-dns=true in "addons-783184"
I0924 18:38:18.150314 446193 host.go:66] Checking if "addons-783184" exists ...
I0924 18:38:18.150843 446193 cli_runner.go:164] Run: docker container inspect addons-783184 --format={{.State.Status}}
I0924 18:38:18.157479 446193 addons.go:69] Setting volumesnapshots=true in profile "addons-783184"
I0924 18:38:18.157567 446193 addons.go:234] Setting addon volumesnapshots=true in "addons-783184"
I0924 18:38:18.157646 446193 host.go:66] Checking if "addons-783184" exists ...
I0924 18:38:18.158183 446193 cli_runner.go:164] Run: docker container inspect addons-783184 --format={{.State.Status}}
I0924 18:38:18.176760 446193 addons.go:69] Setting inspektor-gadget=true in profile "addons-783184"
I0924 18:38:18.176797 446193 addons.go:234] Setting addon inspektor-gadget=true in "addons-783184"
I0924 18:38:18.176839 446193 host.go:66] Checking if "addons-783184" exists ...
I0924 18:38:18.177342 446193 cli_runner.go:164] Run: docker container inspect addons-783184 --format={{.State.Status}}
I0924 18:38:18.180724 446193 out.go:177] * Verifying Kubernetes components...
I0924 18:38:18.183097 446193 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0924 18:38:18.284017 446193 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I0924 18:38:18.294591 446193 out.go:177] - Using image docker.io/registry:2.8.3
I0924 18:38:18.295719 446193 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
I0924 18:38:18.295766 446193 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0924 18:38:18.295843 446193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-783184
I0924 18:38:18.302727 446193 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2
I0924 18:38:18.304519 446193 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0924 18:38:18.304543 446193 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0924 18:38:18.304616 446193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-783184
I0924 18:38:18.336232 446193 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.24
I0924 18:38:18.338047 446193 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
I0924 18:38:18.338072 446193 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0924 18:38:18.338141 446193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-783184
I0924 18:38:18.338715 446193 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
I0924 18:38:18.344921 446193 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
I0924 18:38:18.344955 446193 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I0924 18:38:18.345040 446193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-783184
I0924 18:38:18.353513 446193 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
I0924 18:38:18.357311 446193 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0924 18:38:18.357337 446193 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0924 18:38:18.357487 446193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-783184
I0924 18:38:18.371594 446193 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-783184"
I0924 18:38:18.371694 446193 host.go:66] Checking if "addons-783184" exists ...
I0924 18:38:18.372195 446193 cli_runner.go:164] Run: docker container inspect addons-783184 --format={{.State.Status}}
I0924 18:38:18.396903 446193 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0924 18:38:18.399083 446193 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I0924 18:38:18.399704 446193 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0924 18:38:18.399731 446193 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0924 18:38:18.399797 446193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-783184
I0924 18:38:18.422410 446193 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0924 18:38:18.422431 446193 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0924 18:38:18.422538 446193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-783184
I0924 18:38:18.424112 446193 addons.go:234] Setting addon default-storageclass=true in "addons-783184"
I0924 18:38:18.424151 446193 host.go:66] Checking if "addons-783184" exists ...
I0924 18:38:18.429847 446193 cli_runner.go:164] Run: docker container inspect addons-783184 --format={{.State.Status}}
I0924 18:38:18.434845 446193 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0924 18:38:18.440981 446193 out.go:177] - Using image docker.io/volcanosh/vc-webhook-manager:v1.10.0
I0924 18:38:18.442996 446193 out.go:177] - Using image docker.io/volcanosh/vc-controller-manager:v1.10.0
I0924 18:38:18.443156 446193 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0924 18:38:18.445518 446193 out.go:177] - Using image docker.io/volcanosh/vc-scheduler:v1.10.0
I0924 18:38:18.450878 446193 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml
I0924 18:38:18.450914 446193 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (471825 bytes)
I0924 18:38:18.451010 446193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-783184
I0924 18:38:18.451225 446193 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0924 18:38:18.453030 446193 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0924 18:38:18.458180 446193 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2
I0924 18:38:18.460206 446193 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0924 18:38:18.483663 446193 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0
I0924 18:38:18.489499 446193 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0924 18:38:18.489636 446193 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
I0924 18:38:18.489664 446193 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I0924 18:38:18.489766 446193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-783184
I0924 18:38:18.491466 446193 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0924 18:38:18.491492 446193 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0924 18:38:18.491576 446193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-783184
I0924 18:38:18.522732 446193 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0924 18:38:18.525692 446193 host.go:66] Checking if "addons-783184" exists ...
I0924 18:38:18.527325 446193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33164 SSHKeyPath:/home/jenkins/minikube-integration/19700-440051/.minikube/machines/addons-783184/id_rsa Username:docker}
I0924 18:38:18.537337 446193 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0924 18:38:18.539497 446193 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0924 18:38:18.549975 446193 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0924 18:38:18.552645 446193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33164 SSHKeyPath:/home/jenkins/minikube-integration/19700-440051/.minikube/machines/addons-783184/id_rsa Username:docker}
I0924 18:38:18.585763 446193 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0924 18:38:18.585791 446193 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I0924 18:38:18.585863 446193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-783184
I0924 18:38:18.586015 446193 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0924 18:38:18.590179 446193 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0924 18:38:18.590216 446193 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0924 18:38:18.590308 446193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-783184
I0924 18:38:18.612108 446193 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0924 18:38:18.615602 446193 out.go:177] - Using image docker.io/busybox:stable
I0924 18:38:18.622765 446193 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0924 18:38:18.622860 446193 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0924 18:38:18.622989 446193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-783184
I0924 18:38:18.655224 446193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33164 SSHKeyPath:/home/jenkins/minikube-integration/19700-440051/.minikube/machines/addons-783184/id_rsa Username:docker}
I0924 18:38:18.656482 446193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33164 SSHKeyPath:/home/jenkins/minikube-integration/19700-440051/.minikube/machines/addons-783184/id_rsa Username:docker}
I0924 18:38:18.677802 446193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33164 SSHKeyPath:/home/jenkins/minikube-integration/19700-440051/.minikube/machines/addons-783184/id_rsa Username:docker}
I0924 18:38:18.679057 446193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33164 SSHKeyPath:/home/jenkins/minikube-integration/19700-440051/.minikube/machines/addons-783184/id_rsa Username:docker}
I0924 18:38:18.679385 446193 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0924 18:38:18.679395 446193 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0924 18:38:18.679444 446193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-783184
I0924 18:38:18.701159 446193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33164 SSHKeyPath:/home/jenkins/minikube-integration/19700-440051/.minikube/machines/addons-783184/id_rsa Username:docker}
I0924 18:38:18.753759 446193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33164 SSHKeyPath:/home/jenkins/minikube-integration/19700-440051/.minikube/machines/addons-783184/id_rsa Username:docker}
I0924 18:38:18.766413 446193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33164 SSHKeyPath:/home/jenkins/minikube-integration/19700-440051/.minikube/machines/addons-783184/id_rsa Username:docker}
I0924 18:38:18.785778 446193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33164 SSHKeyPath:/home/jenkins/minikube-integration/19700-440051/.minikube/machines/addons-783184/id_rsa Username:docker}
I0924 18:38:18.790733 446193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33164 SSHKeyPath:/home/jenkins/minikube-integration/19700-440051/.minikube/machines/addons-783184/id_rsa Username:docker}
I0924 18:38:18.806397 446193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33164 SSHKeyPath:/home/jenkins/minikube-integration/19700-440051/.minikube/machines/addons-783184/id_rsa Username:docker}
I0924 18:38:18.808271 446193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33164 SSHKeyPath:/home/jenkins/minikube-integration/19700-440051/.minikube/machines/addons-783184/id_rsa Username:docker}
I0924 18:38:18.812582 446193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33164 SSHKeyPath:/home/jenkins/minikube-integration/19700-440051/.minikube/machines/addons-783184/id_rsa Username:docker}
W0924 18:38:18.812788 446193 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0924 18:38:18.812828 446193 retry.go:31] will retry after 133.271978ms: ssh: handshake failed: EOF
W0924 18:38:18.816825 446193 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0924 18:38:18.816853 446193 retry.go:31] will retry after 219.699123ms: ssh: handshake failed: EOF
I0924 18:38:19.322070 446193 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0924 18:38:19.404926 446193 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0924 18:38:19.466387 446193 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I0924 18:38:19.466469 446193 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I0924 18:38:19.488484 446193 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
I0924 18:38:19.488556 446193 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0924 18:38:19.499520 446193 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0924 18:38:19.499596 446193 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0924 18:38:19.528891 446193 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0924 18:38:19.597690 446193 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0924 18:38:19.597760 446193 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0924 18:38:19.602774 446193 ssh_runner.go:235] Completed: sudo systemctl daemon-reload: (1.419599451s)
I0924 18:38:19.602877 446193 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml": (1.551042016s)
I0924 18:38:19.603057 446193 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0924 18:38:19.603213 446193 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0924 18:38:19.603753 446193 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0924 18:38:19.641660 446193 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0924 18:38:19.660095 446193 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
I0924 18:38:19.660126 446193 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0924 18:38:19.689078 446193 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0924 18:38:19.689106 446193 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0924 18:38:19.706343 446193 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0924 18:38:19.743414 446193 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
I0924 18:38:19.792959 446193 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0924 18:38:19.836887 446193 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
I0924 18:38:19.836913 446193 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I0924 18:38:19.840649 446193 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
I0924 18:38:19.840674 446193 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0924 18:38:19.965626 446193 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0924 18:38:19.965655 446193 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0924 18:38:19.985499 446193 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
I0924 18:38:19.985528 446193 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0924 18:38:19.989273 446193 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0924 18:38:19.989298 446193 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0924 18:38:20.033337 446193 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0924 18:38:20.033367 446193 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0924 18:38:20.160613 446193 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0924 18:38:20.172305 446193 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I0924 18:38:20.172332 446193 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I0924 18:38:20.283647 446193 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0924 18:38:20.283679 446193 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0924 18:38:20.294810 446193 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0924 18:38:20.294838 446193 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0924 18:38:20.295100 446193 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
I0924 18:38:20.295113 446193 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0924 18:38:20.331019 446193 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0924 18:38:20.331051 446193 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0924 18:38:20.440281 446193 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I0924 18:38:20.440306 446193 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I0924 18:38:20.480767 446193 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I0924 18:38:20.480794 446193 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I0924 18:38:20.490382 446193 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0924 18:38:20.490406 446193 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0924 18:38:20.573636 446193 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0924 18:38:20.573662 446193 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0924 18:38:20.594892 446193 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
I0924 18:38:20.594916 446193 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0924 18:38:20.667754 446193 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0924 18:38:20.775653 446193 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
I0924 18:38:20.775684 446193 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I0924 18:38:20.783772 446193 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0924 18:38:20.783802 446193 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0924 18:38:20.874935 446193 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0924 18:38:20.887244 446193 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0924 18:38:20.887272 446193 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0924 18:38:21.150195 446193 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
I0924 18:38:21.150220 446193 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
I0924 18:38:21.240461 446193 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0924 18:38:21.294016 446193 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0924 18:38:21.294045 446193 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0924 18:38:21.314139 446193 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I0924 18:38:21.465759 446193 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0924 18:38:21.465786 446193 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0924 18:38:21.627574 446193 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0924 18:38:21.627600 446193 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0924 18:38:21.801258 446193 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (2.479143944s)
I0924 18:38:22.087401 446193 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0924 18:38:22.087426 446193 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0924 18:38:22.244999 446193 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0924 18:38:22.245025 446193 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0924 18:38:22.566226 446193 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0924 18:38:23.352212 446193 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (3.823230777s)
I0924 18:38:23.352289 446193 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (3.748515789s)
I0924 18:38:23.352325 446193 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (3.749095581s)
I0924 18:38:23.353186 446193 node_ready.go:35] waiting up to 6m0s for node "addons-783184" to be "Ready" ...
I0924 18:38:23.353451 446193 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (3.7503725s)
I0924 18:38:23.353486 446193 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I0924 18:38:23.354588 446193 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (3.949585165s)
I0924 18:38:23.361707 446193 node_ready.go:49] node "addons-783184" has status "Ready":"True"
I0924 18:38:23.361732 446193 node_ready.go:38] duration metric: took 8.517694ms for node "addons-783184" to be "Ready" ...
I0924 18:38:23.361742 446193 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0924 18:38:23.383385 446193 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-hdnmt" in "kube-system" namespace to be "Ready" ...
I0924 18:38:23.565677 446193 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (3.923977378s)
I0924 18:38:23.856893 446193 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-783184" context rescaled to 1 replicas
I0924 18:38:24.387100 446193 pod_ready.go:98] error getting pod "coredns-7c65d6cfc9-hdnmt" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-hdnmt" not found
I0924 18:38:24.387128 446193 pod_ready.go:82] duration metric: took 1.003702312s for pod "coredns-7c65d6cfc9-hdnmt" in "kube-system" namespace to be "Ready" ...
E0924 18:38:24.387139 446193 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-7c65d6cfc9-hdnmt" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-hdnmt" not found
I0924 18:38:24.387146 446193 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-l42hj" in "kube-system" namespace to be "Ready" ...
I0924 18:38:25.759194 446193 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0924 18:38:25.759322 446193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-783184
I0924 18:38:25.796643 446193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33164 SSHKeyPath:/home/jenkins/minikube-integration/19700-440051/.minikube/machines/addons-783184/id_rsa Username:docker}
I0924 18:38:26.410261 446193 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0924 18:38:26.415121 446193 pod_ready.go:103] pod "coredns-7c65d6cfc9-l42hj" in "kube-system" namespace has status "Ready":"False"
I0924 18:38:26.502817 446193 addons.go:234] Setting addon gcp-auth=true in "addons-783184"
I0924 18:38:26.502925 446193 host.go:66] Checking if "addons-783184" exists ...
I0924 18:38:26.503489 446193 cli_runner.go:164] Run: docker container inspect addons-783184 --format={{.State.Status}}
I0924 18:38:26.536384 446193 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0924 18:38:26.536454 446193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-783184
I0924 18:38:26.563561 446193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33164 SSHKeyPath:/home/jenkins/minikube-integration/19700-440051/.minikube/machines/addons-783184/id_rsa Username:docker}
I0924 18:38:26.587123 446193 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (6.880728613s)
I0924 18:38:26.587158 446193 addons.go:475] Verifying addon ingress=true in "addons-783184"
I0924 18:38:26.589028 446193 out.go:177] * Verifying ingress addon...
I0924 18:38:26.591674 446193 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0924 18:38:26.596967 446193 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0924 18:38:26.596993 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:27.096838 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:27.608884 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:28.129581 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:28.439263 446193 pod_ready.go:103] pod "coredns-7c65d6cfc9-l42hj" in "kube-system" namespace has status "Ready":"False"
I0924 18:38:28.604725 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:28.839985 446193 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (9.046967491s)
I0924 18:38:28.840084 446193 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (8.679438277s)
I0924 18:38:28.840606 446193 addons.go:475] Verifying addon registry=true in "addons-783184"
I0924 18:38:28.840159 446193 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.172376395s)
I0924 18:38:28.841044 446193 addons.go:475] Verifying addon metrics-server=true in "addons-783184"
I0924 18:38:28.840190 446193 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (7.965228404s)
I0924 18:38:28.840273 446193 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (7.599784201s)
W0924 18:38:28.841224 446193 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0924 18:38:28.841277 446193 retry.go:31] will retry after 369.079351ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0924 18:38:28.840327 446193 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (7.52616223s)
I0924 18:38:28.840436 446193 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (9.096996993s)
I0924 18:38:28.843462 446193 out.go:177] * Verifying registry addon...
I0924 18:38:28.847345 446193 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-783184 service yakd-dashboard -n yakd-dashboard
I0924 18:38:28.849988 446193 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0924 18:38:28.936096 446193 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0924 18:38:28.936120 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:29.104990 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:29.211405 446193 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0924 18:38:29.366853 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:29.588731 446193 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (3.052316907s)
I0924 18:38:29.588996 446193 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (7.022729445s)
I0924 18:38:29.589058 446193 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-783184"
I0924 18:38:29.592068 446193 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0924 18:38:29.592229 446193 out.go:177] * Verifying csi-hostpath-driver addon...
I0924 18:38:29.596293 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:29.596443 446193 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
I0924 18:38:29.597603 446193 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0924 18:38:29.598871 446193 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0924 18:38:29.598917 446193 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0924 18:38:29.602580 446193 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0924 18:38:29.602643 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:29.629186 446193 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0924 18:38:29.629263 446193 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0924 18:38:29.703519 446193 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0924 18:38:29.703543 446193 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I0924 18:38:29.744795 446193 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0924 18:38:29.854870 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:30.114824 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:30.115181 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:30.356005 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:30.597576 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:30.602601 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:30.862567 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:30.894601 446193 pod_ready.go:103] pod "coredns-7c65d6cfc9-l42hj" in "kube-system" namespace has status "Ready":"False"
I0924 18:38:30.938883 446193 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.727385459s)
I0924 18:38:30.938976 446193 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.194109591s)
I0924 18:38:30.943455 446193 addons.go:475] Verifying addon gcp-auth=true in "addons-783184"
I0924 18:38:30.948128 446193 out.go:177] * Verifying gcp-auth addon...
I0924 18:38:30.952207 446193 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0924 18:38:30.958465 446193 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0924 18:38:31.097297 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:31.103603 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:31.359490 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:31.596058 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:31.602328 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:31.854388 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:32.097059 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:32.102755 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:32.354057 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:32.596353 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:32.602801 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:32.855349 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:32.895138 446193 pod_ready.go:103] pod "coredns-7c65d6cfc9-l42hj" in "kube-system" namespace has status "Ready":"False"
I0924 18:38:33.098998 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:33.103922 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:33.353909 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:33.598219 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:33.603500 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:33.855308 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:34.097498 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:34.103430 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:34.356459 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:34.597195 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:34.602361 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:34.854834 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:35.102032 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:35.105747 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:35.361232 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:35.393117 446193 pod_ready.go:103] pod "coredns-7c65d6cfc9-l42hj" in "kube-system" namespace has status "Ready":"False"
I0924 18:38:35.596201 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:35.603450 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:35.854756 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:36.099397 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:36.105673 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:36.359230 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:36.399959 446193 pod_ready.go:93] pod "coredns-7c65d6cfc9-l42hj" in "kube-system" namespace has status "Ready":"True"
I0924 18:38:36.400063 446193 pod_ready.go:82] duration metric: took 12.012904746s for pod "coredns-7c65d6cfc9-l42hj" in "kube-system" namespace to be "Ready" ...
I0924 18:38:36.400099 446193 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-783184" in "kube-system" namespace to be "Ready" ...
I0924 18:38:36.405857 446193 pod_ready.go:93] pod "etcd-addons-783184" in "kube-system" namespace has status "Ready":"True"
I0924 18:38:36.405941 446193 pod_ready.go:82] duration metric: took 5.786948ms for pod "etcd-addons-783184" in "kube-system" namespace to be "Ready" ...
I0924 18:38:36.405972 446193 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-783184" in "kube-system" namespace to be "Ready" ...
I0924 18:38:36.412132 446193 pod_ready.go:93] pod "kube-apiserver-addons-783184" in "kube-system" namespace has status "Ready":"True"
I0924 18:38:36.412207 446193 pod_ready.go:82] duration metric: took 6.186509ms for pod "kube-apiserver-addons-783184" in "kube-system" namespace to be "Ready" ...
I0924 18:38:36.412234 446193 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-783184" in "kube-system" namespace to be "Ready" ...
I0924 18:38:36.420313 446193 pod_ready.go:93] pod "kube-controller-manager-addons-783184" in "kube-system" namespace has status "Ready":"True"
I0924 18:38:36.420389 446193 pod_ready.go:82] duration metric: took 8.133199ms for pod "kube-controller-manager-addons-783184" in "kube-system" namespace to be "Ready" ...
I0924 18:38:36.420421 446193 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-7c74q" in "kube-system" namespace to be "Ready" ...
I0924 18:38:36.427913 446193 pod_ready.go:93] pod "kube-proxy-7c74q" in "kube-system" namespace has status "Ready":"True"
I0924 18:38:36.427987 446193 pod_ready.go:82] duration metric: took 7.542772ms for pod "kube-proxy-7c74q" in "kube-system" namespace to be "Ready" ...
I0924 18:38:36.428014 446193 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-783184" in "kube-system" namespace to be "Ready" ...
I0924 18:38:36.596636 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:36.601928 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:36.792497 446193 pod_ready.go:93] pod "kube-scheduler-addons-783184" in "kube-system" namespace has status "Ready":"True"
I0924 18:38:36.792523 446193 pod_ready.go:82] duration metric: took 364.486674ms for pod "kube-scheduler-addons-783184" in "kube-system" namespace to be "Ready" ...
I0924 18:38:36.792536 446193 pod_ready.go:79] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-6tcpv" in "kube-system" namespace to be "Ready" ...
I0924 18:38:36.855157 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:37.097426 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:37.104299 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:37.355386 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:37.595988 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:37.602681 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:37.854225 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:38.096976 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:38.103238 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:38.355738 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:38.596992 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:38.602300 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:38.801775 446193 pod_ready.go:103] pod "nvidia-device-plugin-daemonset-6tcpv" in "kube-system" namespace has status "Ready":"False"
I0924 18:38:38.854096 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:39.096923 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:39.103124 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:39.354286 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:39.596839 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:39.602720 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:39.853930 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:40.097247 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:40.103352 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:40.355642 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:40.600751 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:40.604690 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:40.854645 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:41.097528 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:41.102546 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:41.301835 446193 pod_ready.go:103] pod "nvidia-device-plugin-daemonset-6tcpv" in "kube-system" namespace has status "Ready":"False"
I0924 18:38:41.355354 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:41.597203 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:41.603600 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:41.855009 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:42.101588 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:42.108006 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:42.354808 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:42.597358 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:42.602556 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:42.855079 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:43.096538 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:43.105501 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:43.357313 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:43.596163 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:43.602566 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:43.799995 446193 pod_ready.go:93] pod "nvidia-device-plugin-daemonset-6tcpv" in "kube-system" namespace has status "Ready":"True"
I0924 18:38:43.800022 446193 pod_ready.go:82] duration metric: took 7.007477608s for pod "nvidia-device-plugin-daemonset-6tcpv" in "kube-system" namespace to be "Ready" ...
I0924 18:38:43.800062 446193 pod_ready.go:39] duration metric: took 20.438308406s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0924 18:38:43.800082 446193 api_server.go:52] waiting for apiserver process to appear ...
I0924 18:38:43.800163 446193 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0924 18:38:43.817883 446193 api_server.go:72] duration metric: took 25.766019009s to wait for apiserver process to appear ...
I0924 18:38:43.817915 446193 api_server.go:88] waiting for apiserver healthz status ...
I0924 18:38:43.817941 446193 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I0924 18:38:43.826075 446193 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I0924 18:38:43.835074 446193 api_server.go:141] control plane version: v1.31.1
I0924 18:38:43.835168 446193 api_server.go:131] duration metric: took 17.244893ms to wait for apiserver health ...
I0924 18:38:43.835194 446193 system_pods.go:43] waiting for kube-system pods to appear ...
I0924 18:38:43.845077 446193 system_pods.go:59] 18 kube-system pods found
I0924 18:38:43.845119 446193 system_pods.go:61] "coredns-7c65d6cfc9-l42hj" [09ed7be8-1829-4437-9ee1-8803951fbc2c] Running
I0924 18:38:43.845132 446193 system_pods.go:61] "csi-hostpath-attacher-0" [c9d9e766-8222-4ae8-9f19-3aaf9cc28930] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0924 18:38:43.845142 446193 system_pods.go:61] "csi-hostpath-resizer-0" [4e9ee53c-9f05-4d78-a286-c4de5582a229] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0924 18:38:43.845150 446193 system_pods.go:61] "csi-hostpathplugin-qwhxj" [8ee4eb19-91c4-4897-ba2f-008371920f92] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0924 18:38:43.845155 446193 system_pods.go:61] "etcd-addons-783184" [529e0be0-53fa-4754-83e1-f0955812b01c] Running
I0924 18:38:43.845160 446193 system_pods.go:61] "kindnet-x95vn" [de1e6c42-a0cb-4df2-a122-645dd46c7609] Running
I0924 18:38:43.845165 446193 system_pods.go:61] "kube-apiserver-addons-783184" [9f99bb5b-e990-456c-a11c-15e9259c91bc] Running
I0924 18:38:43.845169 446193 system_pods.go:61] "kube-controller-manager-addons-783184" [50053294-5281-4231-8a87-9a45ccb11306] Running
I0924 18:38:43.845180 446193 system_pods.go:61] "kube-ingress-dns-minikube" [34b8e021-cf78-4b0d-9122-3394e01628f6] Running
I0924 18:38:43.845184 446193 system_pods.go:61] "kube-proxy-7c74q" [7ac78a01-1025-4052-a0db-da158174201c] Running
I0924 18:38:43.845198 446193 system_pods.go:61] "kube-scheduler-addons-783184" [4c7f3d22-6ed8-4c4c-a95e-078ef4996e36] Running
I0924 18:38:43.845204 446193 system_pods.go:61] "metrics-server-84c5f94fbc-4ckmr" [2612b668-6d6b-42bf-983a-8f4e0af581d2] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0924 18:38:43.845208 446193 system_pods.go:61] "nvidia-device-plugin-daemonset-6tcpv" [c9ba084e-6cd2-428d-82c2-c10dd5f9d5d5] Running
I0924 18:38:43.845221 446193 system_pods.go:61] "registry-66c9cd494c-r9m2n" [4a0f5031-6fb0-4e60-83fd-6ae70f4d567b] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0924 18:38:43.845227 446193 system_pods.go:61] "registry-proxy-k6vdg" [2bbc91c6-09cc-4e9b-a450-9dde1f42116b] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0924 18:38:43.845235 446193 system_pods.go:61] "snapshot-controller-56fcc65765-t5bh5" [87dca475-4a57-4913-8bd1-bb2cd203503d] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0924 18:38:43.845245 446193 system_pods.go:61] "snapshot-controller-56fcc65765-tvr46" [75a4b614-d5ee-422a-afef-2b72b451299e] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0924 18:38:43.845249 446193 system_pods.go:61] "storage-provisioner" [4cda26e0-32af-4b06-9586-11f4e9e3f7d3] Running
I0924 18:38:43.845256 446193 system_pods.go:74] duration metric: took 10.029165ms to wait for pod list to return data ...
I0924 18:38:43.845264 446193 default_sa.go:34] waiting for default service account to be created ...
I0924 18:38:43.848805 446193 default_sa.go:45] found service account: "default"
I0924 18:38:43.848841 446193 default_sa.go:55] duration metric: took 3.571257ms for default service account to be created ...
I0924 18:38:43.848851 446193 system_pods.go:116] waiting for k8s-apps to be running ...
I0924 18:38:43.855460 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:43.862299 446193 system_pods.go:86] 18 kube-system pods found
I0924 18:38:43.862345 446193 system_pods.go:89] "coredns-7c65d6cfc9-l42hj" [09ed7be8-1829-4437-9ee1-8803951fbc2c] Running
I0924 18:38:43.862361 446193 system_pods.go:89] "csi-hostpath-attacher-0" [c9d9e766-8222-4ae8-9f19-3aaf9cc28930] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0924 18:38:43.862369 446193 system_pods.go:89] "csi-hostpath-resizer-0" [4e9ee53c-9f05-4d78-a286-c4de5582a229] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0924 18:38:43.862378 446193 system_pods.go:89] "csi-hostpathplugin-qwhxj" [8ee4eb19-91c4-4897-ba2f-008371920f92] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0924 18:38:43.862423 446193 system_pods.go:89] "etcd-addons-783184" [529e0be0-53fa-4754-83e1-f0955812b01c] Running
I0924 18:38:43.862436 446193 system_pods.go:89] "kindnet-x95vn" [de1e6c42-a0cb-4df2-a122-645dd46c7609] Running
I0924 18:38:43.862442 446193 system_pods.go:89] "kube-apiserver-addons-783184" [9f99bb5b-e990-456c-a11c-15e9259c91bc] Running
I0924 18:38:43.862447 446193 system_pods.go:89] "kube-controller-manager-addons-783184" [50053294-5281-4231-8a87-9a45ccb11306] Running
I0924 18:38:43.862460 446193 system_pods.go:89] "kube-ingress-dns-minikube" [34b8e021-cf78-4b0d-9122-3394e01628f6] Running
I0924 18:38:43.862465 446193 system_pods.go:89] "kube-proxy-7c74q" [7ac78a01-1025-4052-a0db-da158174201c] Running
I0924 18:38:43.862469 446193 system_pods.go:89] "kube-scheduler-addons-783184" [4c7f3d22-6ed8-4c4c-a95e-078ef4996e36] Running
I0924 18:38:43.862475 446193 system_pods.go:89] "metrics-server-84c5f94fbc-4ckmr" [2612b668-6d6b-42bf-983a-8f4e0af581d2] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0924 18:38:43.862481 446193 system_pods.go:89] "nvidia-device-plugin-daemonset-6tcpv" [c9ba084e-6cd2-428d-82c2-c10dd5f9d5d5] Running
I0924 18:38:43.862491 446193 system_pods.go:89] "registry-66c9cd494c-r9m2n" [4a0f5031-6fb0-4e60-83fd-6ae70f4d567b] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0924 18:38:43.862499 446193 system_pods.go:89] "registry-proxy-k6vdg" [2bbc91c6-09cc-4e9b-a450-9dde1f42116b] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0924 18:38:43.862510 446193 system_pods.go:89] "snapshot-controller-56fcc65765-t5bh5" [87dca475-4a57-4913-8bd1-bb2cd203503d] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0924 18:38:43.862518 446193 system_pods.go:89] "snapshot-controller-56fcc65765-tvr46" [75a4b614-d5ee-422a-afef-2b72b451299e] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0924 18:38:43.862527 446193 system_pods.go:89] "storage-provisioner" [4cda26e0-32af-4b06-9586-11f4e9e3f7d3] Running
I0924 18:38:43.862534 446193 system_pods.go:126] duration metric: took 13.677385ms to wait for k8s-apps to be running ...
I0924 18:38:43.862546 446193 system_svc.go:44] waiting for kubelet service to be running ....
I0924 18:38:43.862601 446193 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0924 18:38:43.880895 446193 system_svc.go:56] duration metric: took 18.337961ms WaitForService to wait for kubelet
I0924 18:38:43.880928 446193 kubeadm.go:582] duration metric: took 25.82907335s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0924 18:38:43.880955 446193 node_conditions.go:102] verifying NodePressure condition ...
I0924 18:38:43.884551 446193 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0924 18:38:43.884586 446193 node_conditions.go:123] node cpu capacity is 2
I0924 18:38:43.884600 446193 node_conditions.go:105] duration metric: took 3.638054ms to run NodePressure ...
I0924 18:38:43.884622 446193 start.go:241] waiting for startup goroutines ...
I0924 18:38:44.096238 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:44.103232 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:44.354805 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:44.601688 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:44.604343 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:44.854222 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:45.105301 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:45.127998 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:45.359046 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:45.596866 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:45.602759 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:45.854242 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:46.096423 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:46.102879 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:46.354347 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:46.596621 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:46.607361 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:46.853679 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:47.097124 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:47.103289 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:47.354361 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:47.605281 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:47.642014 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:47.854396 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:48.096571 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:48.102828 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:48.355292 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:48.597650 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:48.601813 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:48.855282 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:49.096627 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:49.101782 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:49.354395 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:49.598021 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:49.605177 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:49.854527 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0924 18:38:50.097008 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:50.103585 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:50.358710 446193 kapi.go:107] duration metric: took 21.50871844s to wait for kubernetes.io/minikube-addons=registry ...
I0924 18:38:50.597163 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:50.603917 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:51.098676 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:51.104700 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:51.597228 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:51.602509 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:52.097110 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:52.102852 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:52.596636 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:52.602160 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:53.096641 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:53.102472 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:53.596483 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:53.603045 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:54.098277 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:54.110678 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:54.596806 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:54.601838 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:55.096080 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:55.102875 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:55.596632 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:55.601999 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:56.096444 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:56.102880 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:56.596801 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:56.602651 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:57.096716 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:57.101962 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:57.596467 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:57.602690 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:58.096699 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:58.102834 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:58.596237 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:58.603408 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:59.096621 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:59.102633 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:38:59.603985 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:38:59.616546 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:00.112085 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:00.122802 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:00.597064 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:00.602578 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:01.097058 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:01.102801 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:01.596921 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:01.602641 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:02.096752 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:02.102138 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:02.596133 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:02.602410 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:03.096559 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:03.102327 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:03.596673 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:03.601981 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:04.099888 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:04.105167 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:04.598290 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:04.608547 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:05.097629 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:05.108451 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:05.598895 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:05.607672 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:06.097487 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:06.103998 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:06.598715 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:06.608641 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:07.097855 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:07.103518 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:07.596946 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:07.603327 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:08.096272 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:08.102472 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:08.598013 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:08.602704 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:09.096047 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:09.102654 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:09.597851 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:09.603894 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:10.097911 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:10.103532 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:10.602313 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:10.605964 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:11.096926 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:11.102665 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:11.596968 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:11.602195 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:12.100261 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:12.104905 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:12.597842 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:12.602367 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:13.096511 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:13.103254 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:13.595920 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:13.605765 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:14.095896 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:14.102305 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:14.596578 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:14.605153 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:15.097220 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:15.103992 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:15.597086 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:15.602553 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:16.096954 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:16.102821 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:16.595841 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:16.602609 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:17.096427 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:17.102610 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:17.595743 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:17.602096 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:18.096142 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:18.102616 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:18.596246 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:18.602930 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:19.096402 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:19.102871 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:19.596616 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:19.608212 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:20.101125 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:20.106781 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:20.596618 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:20.602669 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:21.097133 446193 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0924 18:39:21.103152 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:21.617785 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:21.619143 446193 kapi.go:107] duration metric: took 55.027467759s to wait for app.kubernetes.io/name=ingress-nginx ...
I0924 18:39:22.103388 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:22.616148 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:23.107387 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:23.604351 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:24.103356 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:24.603239 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:25.105304 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:25.602578 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:26.103917 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:26.602800 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:27.102840 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:27.604541 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:28.102964 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:28.606241 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:29.102226 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:29.603033 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:30.104148 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:30.603092 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0924 18:39:31.103267 446193 kapi.go:107] duration metric: took 1m1.505663514s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0924 18:39:54.033520 446193 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0924 18:39:54.033542 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:39:54.457871 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:39:54.955923 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:39:55.458457 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:39:55.956294 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:39:56.457499 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:39:56.956241 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:39:57.458363 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:39:57.956615 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:39:58.457617 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:39:58.956374 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:39:59.458294 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:39:59.955314 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:00.513232 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:00.957328 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:01.456958 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:01.957290 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:02.457191 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:02.955920 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:03.459180 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:03.956421 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:04.458758 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:04.955979 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:05.459090 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:05.955768 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:06.457717 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:06.955704 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:07.457752 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:07.955210 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:08.458103 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:08.956501 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:09.457057 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:09.956524 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:10.457933 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:10.955786 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:11.457138 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:11.956624 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:12.458569 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:12.955936 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:13.457909 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:13.955804 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:14.456080 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:14.955563 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:15.458823 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:15.955820 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:16.456866 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:16.955532 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:17.457595 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:17.956416 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:18.455941 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:18.956166 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:19.458554 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:19.956387 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:20.459846 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:20.956096 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:21.458468 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:21.955767 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:22.458412 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:22.956126 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:23.458769 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:23.956494 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:24.457017 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:24.955431 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:25.457996 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:25.955695 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:26.459062 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:26.955740 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:27.457902 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:27.955521 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:28.459332 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:28.956305 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:29.457175 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:29.955407 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:30.457790 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:30.955268 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:31.457710 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:31.955875 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:32.457770 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:32.956378 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:33.456046 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:33.960635 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:34.461569 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:34.956839 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:35.458091 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:35.956068 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:36.459698 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:36.956199 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:37.460663 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:37.955823 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:38.458660 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:38.956070 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:39.458307 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:39.956352 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:40.458742 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:40.955462 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:41.458227 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:41.955533 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:42.458860 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:42.955712 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:43.457022 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:43.955898 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:44.457897 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:44.955306 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:45.457565 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:45.956733 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:46.457221 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:46.955717 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:47.458471 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:47.956029 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:48.456491 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:48.955880 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:49.457915 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:49.956321 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:50.459511 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:50.956515 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:51.457708 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:51.955345 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:52.458653 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:52.956379 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:53.457478 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:53.956587 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:54.457512 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:54.955870 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:55.459305 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:55.955913 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:56.458579 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:56.955834 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:57.457978 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:57.955452 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:58.457290 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:58.955667 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:59.460409 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:40:59.955611 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:41:00.456734 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:41:00.955608 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:41:01.457492 446193 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0924 18:41:01.956185 446193 kapi.go:107] duration metric: took 2m31.003976368s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0924 18:41:01.958418 446193 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-783184 cluster.
I0924 18:41:01.960332 446193 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0924 18:41:01.962355 446193 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0924 18:41:01.964139 446193 out.go:177] * Enabled addons: cloud-spanner, ingress-dns, nvidia-device-plugin, storage-provisioner-rancher, storage-provisioner, metrics-server, inspektor-gadget, volcano, yakd, default-storageclass, volumesnapshots, registry, ingress, csi-hostpath-driver, gcp-auth
I0924 18:41:01.966320 446193 addons.go:510] duration metric: took 2m43.914141393s for enable addons: enabled=[cloud-spanner ingress-dns nvidia-device-plugin storage-provisioner-rancher storage-provisioner metrics-server inspektor-gadget volcano yakd default-storageclass volumesnapshots registry ingress csi-hostpath-driver gcp-auth]
I0924 18:41:01.966386 446193 start.go:246] waiting for cluster config update ...
I0924 18:41:01.966408 446193 start.go:255] writing updated cluster config ...
I0924 18:41:01.966708 446193 ssh_runner.go:195] Run: rm -f paused
I0924 18:41:02.337758 446193 start.go:600] kubectl: 1.31.1, cluster: 1.31.1 (minor skew: 0)
I0924 18:41:02.340051 446193 out.go:177] * Done! kubectl is now configured to use "addons-783184" cluster and "default" namespace by default
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
461faadb3012b 4f725bf50aaa5 2 minutes ago Exited gadget 5 f7278c4144105 gadget-n4hxg
82bbe7e8c6233 6ef582f3ec844 3 minutes ago Running gcp-auth 0 e35cb80b799d1 gcp-auth-89d5ffd79-zwg5g
d42610c565805 1a9605c872c1d 4 minutes ago Running admission 0 9186de4ac8587 volcano-admission-5874dfdd79-8t7dh
74ee17c1596ed ee6d597e62dc8 4 minutes ago Running csi-snapshotter 0 41ff07bf3cbad csi-hostpathplugin-qwhxj
d6845875942d2 642ded511e141 4 minutes ago Running csi-provisioner 0 41ff07bf3cbad csi-hostpathplugin-qwhxj
2437ec59c8b99 922312104da8a 4 minutes ago Running liveness-probe 0 41ff07bf3cbad csi-hostpathplugin-qwhxj
21a6770853af3 08f6b2990811a 4 minutes ago Running hostpath 0 41ff07bf3cbad csi-hostpathplugin-qwhxj
14fd41cae83c2 0107d56dbc0be 4 minutes ago Running node-driver-registrar 0 41ff07bf3cbad csi-hostpathplugin-qwhxj
368d4097eb2e9 289a818c8d9c5 4 minutes ago Running controller 0 ae3236aa954fd ingress-nginx-controller-bc57996ff-n4zlp
7640e76b622f9 6aa88c604f2b4 5 minutes ago Running volcano-scheduler 0 95c030184b4ec volcano-scheduler-6c9778cbdf-97rkk
ffaa5a5fab821 1461903ec4fe9 5 minutes ago Running csi-external-health-monitor-controller 0 41ff07bf3cbad csi-hostpathplugin-qwhxj
0c3214113757d 9a80d518f102c 5 minutes ago Running csi-attacher 0 1d1c4563b824e csi-hostpath-attacher-0
96e24669fd000 487fa743e1e22 5 minutes ago Running csi-resizer 0 db2ed070cd432 csi-hostpath-resizer-0
54d3874c16644 23cbb28ae641a 5 minutes ago Running volcano-controllers 0 561075eca4c1e volcano-controllers-789ffc5785-pn52r
5a9653fc0ec74 420193b27261a 5 minutes ago Exited patch 0 028ec198ef163 ingress-nginx-admission-patch-tlf2n
e1b3941396bd9 5548a49bb60ba 5 minutes ago Running metrics-server 0 f347d06e5eb7f metrics-server-84c5f94fbc-4ckmr
be1619d396ec0 77bdba588b953 5 minutes ago Running yakd 0 3bb64e9f90ac9 yakd-dashboard-67d98fc6b-psgsz
738b7d5141141 be9cac3585579 5 minutes ago Running cloud-spanner-emulator 0 0e964c279e8b9 cloud-spanner-emulator-5b584cc74-zz9tw
1c8d4d1ab83e8 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 b025c23171e85 snapshot-controller-56fcc65765-tvr46
1aff52409cd9f 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 c6dd88e739fc5 snapshot-controller-56fcc65765-t5bh5
5aeb6bec63f52 420193b27261a 5 minutes ago Exited create 0 cf8790eaec7eb ingress-nginx-admission-create-f59th
8081626da1e30 3410e1561990a 5 minutes ago Running registry-proxy 0 1b19eaa9db1f5 registry-proxy-k6vdg
08ea43aacbb9a 7ce2150c8929b 5 minutes ago Running local-path-provisioner 0 131f177e8ae47 local-path-provisioner-86d989889c-qg9ql
73e6590eb0ef6 c9cf76bb104e1 5 minutes ago Running registry 0 9036090c33a4a registry-66c9cd494c-r9m2n
8317b49b3ea7a a9bac31a5be8d 5 minutes ago Running nvidia-device-plugin-ctr 0 70f3c20510ca1 nvidia-device-plugin-daemonset-6tcpv
cbfeebbb3b840 2f6c962e7b831 5 minutes ago Running coredns 0 571bf244b49c8 coredns-7c65d6cfc9-l42hj
ffc0135eba33e 35508c2f890c4 5 minutes ago Running minikube-ingress-dns 0 70c898bfef28f kube-ingress-dns-minikube
2bde223b96e60 ba04bb24b9575 5 minutes ago Running storage-provisioner 0 85f17198f20db storage-provisioner
2205ff1511b99 6a23fa8fd2b78 6 minutes ago Running kindnet-cni 0 c275a12cc86db kindnet-x95vn
ba4aea080842e 24a140c548c07 6 minutes ago Running kube-proxy 0 e3c5dc847e4aa kube-proxy-7c74q
ee4d2d1bda823 27e3830e14027 6 minutes ago Running etcd 0 2515b698bed9d etcd-addons-783184
bb4686f9e0857 7f8aa378bb47d 6 minutes ago Running kube-scheduler 0 8b5845c204adc kube-scheduler-addons-783184
5da91b481ae81 d3f53a98c0a9d 6 minutes ago Running kube-apiserver 0 fae79f75947e7 kube-apiserver-addons-783184
5289d6335c9b8 279f381cb3736 6 minutes ago Running kube-controller-manager 0 d500e3b77d3e3 kube-controller-manager-addons-783184
==> containerd <==
Sep 24 18:42:09 addons-783184 containerd[822]: time="2024-09-24T18:42:09.947080164Z" level=info msg="CreateContainer within sandbox \"f7278c414410534755652ed02ca8452164707d265ff1609f599e1bc45ee411fd\" for container &ContainerMetadata{Name:gadget,Attempt:5,}"
Sep 24 18:42:09 addons-783184 containerd[822]: time="2024-09-24T18:42:09.967409163Z" level=info msg="CreateContainer within sandbox \"f7278c414410534755652ed02ca8452164707d265ff1609f599e1bc45ee411fd\" for &ContainerMetadata{Name:gadget,Attempt:5,} returns container id \"461faadb3012b5090ff3df734ab3983893efa078f39713a04b3ec24d93985411\""
Sep 24 18:42:09 addons-783184 containerd[822]: time="2024-09-24T18:42:09.968145945Z" level=info msg="StartContainer for \"461faadb3012b5090ff3df734ab3983893efa078f39713a04b3ec24d93985411\""
Sep 24 18:42:10 addons-783184 containerd[822]: time="2024-09-24T18:42:10.049046337Z" level=info msg="StartContainer for \"461faadb3012b5090ff3df734ab3983893efa078f39713a04b3ec24d93985411\" returns successfully"
Sep 24 18:42:11 addons-783184 containerd[822]: time="2024-09-24T18:42:11.525274283Z" level=error msg="ExecSync for \"461faadb3012b5090ff3df734ab3983893efa078f39713a04b3ec24d93985411\" failed" error="failed to exec in container: failed to start exec \"bd929bc6225942655bdae4a27c78740ae3a975e6f7d328911109df45439014cc\": OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown"
Sep 24 18:42:11 addons-783184 containerd[822]: time="2024-09-24T18:42:11.536811475Z" level=error msg="ExecSync for \"461faadb3012b5090ff3df734ab3983893efa078f39713a04b3ec24d93985411\" failed" error="failed to exec in container: failed to start exec \"44617c49b31b95adf054beee2dc34876fdab79a121cb0093a916c29d8db31395\": OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown"
Sep 24 18:42:11 addons-783184 containerd[822]: time="2024-09-24T18:42:11.550901281Z" level=error msg="ExecSync for \"461faadb3012b5090ff3df734ab3983893efa078f39713a04b3ec24d93985411\" failed" error="failed to exec in container: failed to start exec \"363479750c9da7beb857d878e6ca4469fb6367b4aded5cba8b6a13456a67a028\": OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown"
Sep 24 18:42:11 addons-783184 containerd[822]: time="2024-09-24T18:42:11.565681797Z" level=error msg="ExecSync for \"461faadb3012b5090ff3df734ab3983893efa078f39713a04b3ec24d93985411\" failed" error="failed to exec in container: failed to start exec \"836167e868769ad0e2826848ab8b5963d9ca12f20e8fa55304167908db18373b\": OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown"
Sep 24 18:42:11 addons-783184 containerd[822]: time="2024-09-24T18:42:11.575215392Z" level=error msg="ExecSync for \"461faadb3012b5090ff3df734ab3983893efa078f39713a04b3ec24d93985411\" failed" error="failed to exec in container: failed to start exec \"4cefd5eb6e324b3d2e72f55a2534a85caf908328e8e98c69afcb9c20c1877a52\": OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown"
Sep 24 18:42:11 addons-783184 containerd[822]: time="2024-09-24T18:42:11.585488863Z" level=error msg="ExecSync for \"461faadb3012b5090ff3df734ab3983893efa078f39713a04b3ec24d93985411\" failed" error="failed to exec in container: failed to start exec \"aff7fed6e87927d28b750b8fe81500440a2818664cf03259955128cfda7c8549\": OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown"
Sep 24 18:42:11 addons-783184 containerd[822]: time="2024-09-24T18:42:11.682990823Z" level=info msg="shim disconnected" id=461faadb3012b5090ff3df734ab3983893efa078f39713a04b3ec24d93985411 namespace=k8s.io
Sep 24 18:42:11 addons-783184 containerd[822]: time="2024-09-24T18:42:11.683052648Z" level=warning msg="cleaning up after shim disconnected" id=461faadb3012b5090ff3df734ab3983893efa078f39713a04b3ec24d93985411 namespace=k8s.io
Sep 24 18:42:11 addons-783184 containerd[822]: time="2024-09-24T18:42:11.683391091Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Sep 24 18:42:12 addons-783184 containerd[822]: time="2024-09-24T18:42:12.150668702Z" level=info msg="RemoveContainer for \"fb1eea796ca2c6b75216a58df461863e9e422288299124f8da101fb7676893e7\""
Sep 24 18:42:12 addons-783184 containerd[822]: time="2024-09-24T18:42:12.160024313Z" level=info msg="RemoveContainer for \"fb1eea796ca2c6b75216a58df461863e9e422288299124f8da101fb7676893e7\" returns successfully"
Sep 24 18:42:12 addons-783184 containerd[822]: time="2024-09-24T18:42:12.963801702Z" level=info msg="RemoveContainer for \"ef6ca4dc48a13ea7d1885cb8f9244f00dc4ed41db6618ff9b3cf9921177ae291\""
Sep 24 18:42:12 addons-783184 containerd[822]: time="2024-09-24T18:42:12.970019185Z" level=info msg="RemoveContainer for \"ef6ca4dc48a13ea7d1885cb8f9244f00dc4ed41db6618ff9b3cf9921177ae291\" returns successfully"
Sep 24 18:42:12 addons-783184 containerd[822]: time="2024-09-24T18:42:12.973087356Z" level=info msg="StopPodSandbox for \"550dd51047ae1baa226c61c87a286cce3ed594e51e0c82b9693a9517378f51f3\""
Sep 24 18:42:12 addons-783184 containerd[822]: time="2024-09-24T18:42:12.981163189Z" level=info msg="TearDown network for sandbox \"550dd51047ae1baa226c61c87a286cce3ed594e51e0c82b9693a9517378f51f3\" successfully"
Sep 24 18:42:12 addons-783184 containerd[822]: time="2024-09-24T18:42:12.981202213Z" level=info msg="StopPodSandbox for \"550dd51047ae1baa226c61c87a286cce3ed594e51e0c82b9693a9517378f51f3\" returns successfully"
Sep 24 18:42:12 addons-783184 containerd[822]: time="2024-09-24T18:42:12.981771800Z" level=info msg="RemovePodSandbox for \"550dd51047ae1baa226c61c87a286cce3ed594e51e0c82b9693a9517378f51f3\""
Sep 24 18:42:12 addons-783184 containerd[822]: time="2024-09-24T18:42:12.981893408Z" level=info msg="Forcibly stopping sandbox \"550dd51047ae1baa226c61c87a286cce3ed594e51e0c82b9693a9517378f51f3\""
Sep 24 18:42:12 addons-783184 containerd[822]: time="2024-09-24T18:42:12.989335612Z" level=info msg="TearDown network for sandbox \"550dd51047ae1baa226c61c87a286cce3ed594e51e0c82b9693a9517378f51f3\" successfully"
Sep 24 18:42:12 addons-783184 containerd[822]: time="2024-09-24T18:42:12.995696856Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"550dd51047ae1baa226c61c87a286cce3ed594e51e0c82b9693a9517378f51f3\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus."
Sep 24 18:42:12 addons-783184 containerd[822]: time="2024-09-24T18:42:12.995809668Z" level=info msg="RemovePodSandbox \"550dd51047ae1baa226c61c87a286cce3ed594e51e0c82b9693a9517378f51f3\" returns successfully"
==> coredns [cbfeebbb3b84043ee8cdcd0341c633886d4b772f6f46f7f6fdd99e893f8e318a] <==
[INFO] 10.244.0.5:38318 - 48301 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000084323s
[INFO] 10.244.0.5:33857 - 35519 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002446656s
[INFO] 10.244.0.5:33857 - 9402 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002211204s
[INFO] 10.244.0.5:45486 - 24160 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000255407s
[INFO] 10.244.0.5:45486 - 37730 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000224655s
[INFO] 10.244.0.5:44968 - 46527 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000137287s
[INFO] 10.244.0.5:44968 - 42426 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000057493s
[INFO] 10.244.0.5:47069 - 52110 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000097549s
[INFO] 10.244.0.5:47069 - 42892 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000040722s
[INFO] 10.244.0.5:59277 - 43616 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000107634s
[INFO] 10.244.0.5:59277 - 22626 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000039803s
[INFO] 10.244.0.5:34886 - 13524 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001742744s
[INFO] 10.244.0.5:34886 - 32210 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001713773s
[INFO] 10.244.0.5:53575 - 1766 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000072664s
[INFO] 10.244.0.5:53575 - 15072 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000102546s
[INFO] 10.244.0.24:49226 - 11987 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000223342s
[INFO] 10.244.0.24:45443 - 53742 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000105772s
[INFO] 10.244.0.24:49940 - 58220 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000115191s
[INFO] 10.244.0.24:49842 - 52223 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000093119s
[INFO] 10.244.0.24:39077 - 36814 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000122017s
[INFO] 10.244.0.24:34950 - 55838 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000096402s
[INFO] 10.244.0.24:53464 - 8009 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002214638s
[INFO] 10.244.0.24:53955 - 26832 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.003114257s
[INFO] 10.244.0.24:47173 - 58719 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 648 0.002589461s
[INFO] 10.244.0.24:60127 - 32733 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.002532387s
==> describe nodes <==
Name: addons-783184
Roles: control-plane
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=addons-783184
kubernetes.io/os=linux
minikube.k8s.io/commit=ab8e06d5efb8aef1f7ea9881c3e41593ddc7876e
minikube.k8s.io/name=addons-783184
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_09_24T18_38_13_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-783184
Annotations: csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-783184"}
kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Tue, 24 Sep 2024 18:38:10 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-783184
AcquireTime: <unset>
RenewTime: Tue, 24 Sep 2024 18:44:20 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Tue, 24 Sep 2024 18:41:16 +0000 Tue, 24 Sep 2024 18:38:07 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Tue, 24 Sep 2024 18:41:16 +0000 Tue, 24 Sep 2024 18:38:07 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Tue, 24 Sep 2024 18:41:16 +0000 Tue, 24 Sep 2024 18:38:07 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Tue, 24 Sep 2024 18:41:16 +0000 Tue, 24 Sep 2024 18:38:10 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-783184
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022296Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022296Ki
pods: 110
System Info:
Machine ID: b342e9f398804b1b8d005ed3ab1d2e06
System UUID: cc706a0c-3443-48d9-ab9f-b237a91ce695
Boot ID: c9bfc008-5ebc-46f8-9dcc-99ff4d0a3684
Kernel Version: 5.15.0-1070-aws
OS Image: Ubuntu 22.04.5 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.22
Kubelet Version: v1.31.1
Kube-Proxy Version: v1.31.1
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (27 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default cloud-spanner-emulator-5b584cc74-zz9tw 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m
gadget gadget-n4hxg 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
gcp-auth gcp-auth-89d5ffd79-zwg5g 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m28s
ingress-nginx ingress-nginx-controller-bc57996ff-n4zlp 100m (5%) 0 (0%) 90Mi (1%) 0 (0%) 5m55s
kube-system coredns-7c65d6cfc9-l42hj 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 6m3s
kube-system csi-hostpath-attacher-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
kube-system csi-hostpath-resizer-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
kube-system csi-hostpathplugin-qwhxj 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
kube-system etcd-addons-783184 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 6m8s
kube-system kindnet-x95vn 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 6m3s
kube-system kube-apiserver-addons-783184 250m (12%) 0 (0%) 0 (0%) 0 (0%) 6m8s
kube-system kube-controller-manager-addons-783184 200m (10%) 0 (0%) 0 (0%) 0 (0%) 6m8s
kube-system kube-ingress-dns-minikube 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m59s
kube-system kube-proxy-7c74q 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m3s
kube-system kube-scheduler-addons-783184 100m (5%) 0 (0%) 0 (0%) 0 (0%) 6m8s
kube-system metrics-server-84c5f94fbc-4ckmr 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 5m57s
kube-system nvidia-device-plugin-daemonset-6tcpv 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m1s
kube-system registry-66c9cd494c-r9m2n 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
kube-system registry-proxy-k6vdg 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
kube-system snapshot-controller-56fcc65765-t5bh5 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
kube-system snapshot-controller-56fcc65765-tvr46 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
local-path-storage local-path-provisioner-86d989889c-qg9ql 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
volcano-system volcano-admission-5874dfdd79-8t7dh 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m54s
volcano-system volcano-controllers-789ffc5785-pn52r 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m54s
volcano-system volcano-scheduler-6c9778cbdf-97rkk 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m53s
yakd-dashboard yakd-dashboard-67d98fc6b-psgsz 0 (0%) 0 (0%) 128Mi (1%) 256Mi (3%) 5m56s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 1050m (52%) 100m (5%)
memory 638Mi (8%) 476Mi (6%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 6m1s kube-proxy
Normal NodeHasSufficientMemory 6m15s (x8 over 6m15s) kubelet Node addons-783184 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m15s (x7 over 6m15s) kubelet Node addons-783184 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m15s (x7 over 6m15s) kubelet Node addons-783184 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 6m15s kubelet Updated Node Allocatable limit across pods
Normal Starting 6m9s kubelet Starting kubelet.
Warning CgroupV1 6m9s kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeAllocatableEnforced 6m8s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 6m8s kubelet Node addons-783184 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m8s kubelet Node addons-783184 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m8s kubelet Node addons-783184 status is now: NodeHasSufficientPID
Normal RegisteredNode 6m4s node-controller Node addons-783184 event: Registered Node addons-783184 in Controller
==> dmesg <==
[Sep24 17:35] hrtimer: interrupt took 23501182 ns
[Sep24 18:05] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
[Sep24 18:11] overlayfs: '/var/lib/docker/overlay2/l/WCSESTVH3U25P3IZ5LAJCY2BWZ' not a directory
[ +0.000187] overlayfs: '/var/lib/docker/overlay2/l/WCSESTVH3U25P3IZ5LAJCY2BWZ' not a directory
[ +0.018249] overlayfs: '/var/lib/docker/overlay2/l/WCSESTVH3U25P3IZ5LAJCY2BWZ' not a directory
[Sep24 18:22] systemd-journald[222]: Failed to send stream file descriptor to service manager: Connection refused
==> etcd [ee4d2d1bda82362b5134d3a1575f541916de64a50e76c83edd91cac3bcdc56a1] <==
{"level":"info","ts":"2024-09-24T18:38:07.234907Z","caller":"embed/etcd.go:728","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
{"level":"info","ts":"2024-09-24T18:38:07.235039Z","caller":"embed/etcd.go:599","msg":"serving peer traffic","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-09-24T18:38:07.235060Z","caller":"embed/etcd.go:571","msg":"cmux::serve","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-09-24T18:38:07.236334Z","caller":"embed/etcd.go:279","msg":"now serving peer/client/metrics","local-member-id":"aec36adc501070cc","initial-advertise-peer-urls":["https://192.168.49.2:2380"],"listen-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.49.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
{"level":"info","ts":"2024-09-24T18:38:07.236370Z","caller":"embed/etcd.go:870","msg":"serving metrics","address":"http://127.0.0.1:2381"}
{"level":"info","ts":"2024-09-24T18:38:08.057450Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
{"level":"info","ts":"2024-09-24T18:38:08.057560Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
{"level":"info","ts":"2024-09-24T18:38:08.057607Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
{"level":"info","ts":"2024-09-24T18:38:08.057679Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
{"level":"info","ts":"2024-09-24T18:38:08.057712Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-24T18:38:08.057758Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
{"level":"info","ts":"2024-09-24T18:38:08.057803Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-24T18:38:08.061534Z","caller":"etcdserver/server.go:2629","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-24T18:38:08.065646Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-783184 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
{"level":"info","ts":"2024-09-24T18:38:08.065734Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-24T18:38:08.066052Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-24T18:38:08.066823Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-24T18:38:08.067802Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-09-24T18:38:08.068668Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-24T18:38:08.090363Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
{"level":"info","ts":"2024-09-24T18:38:08.069134Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-24T18:38:08.077953Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-09-24T18:38:08.118076Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-09-24T18:38:08.137562Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-24T18:38:08.137673Z","caller":"etcdserver/server.go:2653","msg":"cluster version is updated","cluster-version":"3.5"}
==> gcp-auth [82bbe7e8c62337dd0a7a91036200b1d880af05f73869b2e89adab475fa77acbc] <==
2024/09/24 18:41:01 GCP Auth Webhook started!
2024/09/24 18:41:18 Ready to marshal response ...
2024/09/24 18:41:18 Ready to write response ...
2024/09/24 18:41:19 Ready to marshal response ...
2024/09/24 18:41:19 Ready to write response ...
==> kernel <==
18:44:21 up 2:26, 0 users, load average: 0.15, 1.17, 2.26
Linux addons-783184 5.15.0-1070-aws #76~20.04.1-Ubuntu SMP Mon Sep 2 12:20:48 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.5 LTS"
==> kindnet [2205ff1511b99f2df9ded57048ffa142d13e8e556de5f14db54261482865494b] <==
I0924 18:42:19.910603 1 main.go:299] handling current node
I0924 18:42:29.917020 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0924 18:42:29.917055 1 main.go:299] handling current node
I0924 18:42:39.918271 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0924 18:42:39.918304 1 main.go:299] handling current node
I0924 18:42:49.913114 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0924 18:42:49.913156 1 main.go:299] handling current node
I0924 18:42:59.912672 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0924 18:42:59.912708 1 main.go:299] handling current node
I0924 18:43:09.917885 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0924 18:43:09.917924 1 main.go:299] handling current node
I0924 18:43:19.910180 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0924 18:43:19.910216 1 main.go:299] handling current node
I0924 18:43:29.910758 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0924 18:43:29.910792 1 main.go:299] handling current node
I0924 18:43:39.918749 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0924 18:43:39.918782 1 main.go:299] handling current node
I0924 18:43:49.917896 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0924 18:43:49.918128 1 main.go:299] handling current node
I0924 18:43:59.911181 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0924 18:43:59.911221 1 main.go:299] handling current node
I0924 18:44:09.912692 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0924 18:44:09.912728 1 main.go:299] handling current node
I0924 18:44:19.910604 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0924 18:44:19.910671 1 main.go:299] handling current node
==> kube-apiserver [5da91b481ae81ff0bd32731d22c5d83e3544e9421b26ab971eb94ed4406a0773] <==
W0924 18:39:28.241112 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.38.210:443: connect: connection refused
W0924 18:39:29.283532 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.38.210:443: connect: connection refused
W0924 18:39:30.331353 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.38.210:443: connect: connection refused
W0924 18:39:31.427988 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.38.210:443: connect: connection refused
W0924 18:39:32.464690 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.38.210:443: connect: connection refused
W0924 18:39:33.534768 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.38.210:443: connect: connection refused
W0924 18:39:33.831428 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.107.226.135:443: connect: connection refused
E0924 18:39:33.831484 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.107.226.135:443: connect: connection refused" logger="UnhandledError"
W0924 18:39:33.833124 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.111.38.210:443: connect: connection refused
W0924 18:39:33.922351 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.107.226.135:443: connect: connection refused
E0924 18:39:33.922394 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.107.226.135:443: connect: connection refused" logger="UnhandledError"
W0924 18:39:33.924110 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.111.38.210:443: connect: connection refused
W0924 18:39:34.548358 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.38.210:443: connect: connection refused
W0924 18:39:35.566892 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.38.210:443: connect: connection refused
W0924 18:39:36.575063 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.38.210:443: connect: connection refused
W0924 18:39:37.642185 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.38.210:443: connect: connection refused
W0924 18:39:38.725164 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.38.210:443: connect: connection refused
W0924 18:39:53.860419 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.107.226.135:443: connect: connection refused
E0924 18:39:53.860460 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.107.226.135:443: connect: connection refused" logger="UnhandledError"
W0924 18:40:33.841833 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.107.226.135:443: connect: connection refused
E0924 18:40:33.841880 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.107.226.135:443: connect: connection refused" logger="UnhandledError"
W0924 18:40:33.930229 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.107.226.135:443: connect: connection refused
E0924 18:40:33.930268 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.107.226.135:443: connect: connection refused" logger="UnhandledError"
I0924 18:41:18.883793 1 controller.go:615] quota admission added evaluator for: jobs.batch.volcano.sh
I0924 18:41:19.004054 1 controller.go:615] quota admission added evaluator for: podgroups.scheduling.volcano.sh
==> kube-controller-manager [5289d6335c9b8d12f61f68ca91107c3f876c40b82b998bcf359ceeadd7176468] <==
I0924 18:40:33.868293 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0924 18:40:33.868698 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0924 18:40:33.889126 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0924 18:40:33.938849 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0924 18:40:33.945786 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0924 18:40:33.949622 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0924 18:40:33.969565 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0924 18:40:34.822647 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0924 18:40:34.847227 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0924 18:40:35.944924 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0924 18:40:35.963972 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0924 18:40:36.951579 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0924 18:40:36.961548 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0924 18:40:36.972182 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0924 18:40:36.976987 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0924 18:40:36.986542 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0924 18:40:36.998087 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0924 18:41:01.920995 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="8.639022ms"
I0924 18:41:01.923198 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="39.031µs"
I0924 18:41:06.041279 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0924 18:41:06.043545 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0924 18:41:06.117619 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0924 18:41:06.121136 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0924 18:41:16.466724 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-783184"
I0924 18:41:18.583304 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="volcano-system/volcano-admission-init" delay="0s"
==> kube-proxy [ba4aea080842e2af5d99b2f7d92ecf3d40936d0d99bef7f04b023e4f9977f978] <==
I0924 18:38:19.344117 1 server_linux.go:66] "Using iptables proxy"
I0924 18:38:19.444889 1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
E0924 18:38:19.444965 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I0924 18:38:19.501529 1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I0924 18:38:19.501598 1 server_linux.go:169] "Using iptables Proxier"
I0924 18:38:19.505978 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I0924 18:38:19.523487 1 server.go:483] "Version info" version="v1.31.1"
I0924 18:38:19.523522 1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0924 18:38:19.531750 1 config.go:199] "Starting service config controller"
I0924 18:38:19.531802 1 shared_informer.go:313] Waiting for caches to sync for service config
I0924 18:38:19.532147 1 config.go:105] "Starting endpoint slice config controller"
I0924 18:38:19.532177 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0924 18:38:19.536100 1 config.go:328] "Starting node config controller"
I0924 18:38:19.536205 1 shared_informer.go:313] Waiting for caches to sync for node config
I0924 18:38:19.632560 1 shared_informer.go:320] Caches are synced for endpoint slice config
I0924 18:38:19.632630 1 shared_informer.go:320] Caches are synced for service config
I0924 18:38:19.637564 1 shared_informer.go:320] Caches are synced for node config
==> kube-scheduler [bb4686f9e0857ea5b5ba62067e2fd37fa63709a3aca17fef20e3288d872e5f67] <==
W0924 18:38:10.433131 1 reflector.go:561] runtime/asm_arm64.s:1222: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0924 18:38:10.433158 1 reflector.go:158] "Unhandled Error" err="runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"
W0924 18:38:10.441685 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0924 18:38:10.441965 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0924 18:38:10.445295 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0924 18:38:10.445574 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError"
W0924 18:38:10.445800 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0924 18:38:10.445904 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0924 18:38:10.446133 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0924 18:38:10.446233 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0924 18:38:10.446438 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0924 18:38:10.446531 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0924 18:38:11.265153 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0924 18:38:11.265198 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0924 18:38:11.289766 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0924 18:38:11.290064 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0924 18:38:11.450047 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0924 18:38:11.450309 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0924 18:38:11.468672 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0924 18:38:11.468888 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0924 18:38:11.474473 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0924 18:38:11.474522 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0924 18:38:11.496054 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0924 18:38:11.496320 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
I0924 18:38:12.007623 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Sep 24 18:42:15 addons-783184 kubelet[1497]: E0924 18:42:15.686185 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-n4hxg_gadget(766b85f6-6e39-42ae-a8d7-d232d3903192)\"" pod="gadget/gadget-n4hxg" podUID="766b85f6-6e39-42ae-a8d7-d232d3903192"
Sep 24 18:42:24 addons-783184 kubelet[1497]: I0924 18:42:24.807013 1497 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-66c9cd494c-r9m2n" secret="" err="secret \"gcp-auth\" not found"
Sep 24 18:42:25 addons-783184 kubelet[1497]: I0924 18:42:25.807876 1497 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-6tcpv" secret="" err="secret \"gcp-auth\" not found"
Sep 24 18:42:28 addons-783184 kubelet[1497]: I0924 18:42:28.807864 1497 scope.go:117] "RemoveContainer" containerID="461faadb3012b5090ff3df734ab3983893efa078f39713a04b3ec24d93985411"
Sep 24 18:42:28 addons-783184 kubelet[1497]: E0924 18:42:28.808059 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-n4hxg_gadget(766b85f6-6e39-42ae-a8d7-d232d3903192)\"" pod="gadget/gadget-n4hxg" podUID="766b85f6-6e39-42ae-a8d7-d232d3903192"
Sep 24 18:42:41 addons-783184 kubelet[1497]: I0924 18:42:41.807946 1497 scope.go:117] "RemoveContainer" containerID="461faadb3012b5090ff3df734ab3983893efa078f39713a04b3ec24d93985411"
Sep 24 18:42:41 addons-783184 kubelet[1497]: E0924 18:42:41.808151 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-n4hxg_gadget(766b85f6-6e39-42ae-a8d7-d232d3903192)\"" pod="gadget/gadget-n4hxg" podUID="766b85f6-6e39-42ae-a8d7-d232d3903192"
Sep 24 18:42:48 addons-783184 kubelet[1497]: I0924 18:42:48.807330 1497 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-k6vdg" secret="" err="secret \"gcp-auth\" not found"
Sep 24 18:42:56 addons-783184 kubelet[1497]: I0924 18:42:56.807875 1497 scope.go:117] "RemoveContainer" containerID="461faadb3012b5090ff3df734ab3983893efa078f39713a04b3ec24d93985411"
Sep 24 18:42:56 addons-783184 kubelet[1497]: E0924 18:42:56.808069 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-n4hxg_gadget(766b85f6-6e39-42ae-a8d7-d232d3903192)\"" pod="gadget/gadget-n4hxg" podUID="766b85f6-6e39-42ae-a8d7-d232d3903192"
Sep 24 18:43:11 addons-783184 kubelet[1497]: I0924 18:43:11.807877 1497 scope.go:117] "RemoveContainer" containerID="461faadb3012b5090ff3df734ab3983893efa078f39713a04b3ec24d93985411"
Sep 24 18:43:11 addons-783184 kubelet[1497]: E0924 18:43:11.808064 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-n4hxg_gadget(766b85f6-6e39-42ae-a8d7-d232d3903192)\"" pod="gadget/gadget-n4hxg" podUID="766b85f6-6e39-42ae-a8d7-d232d3903192"
Sep 24 18:43:24 addons-783184 kubelet[1497]: I0924 18:43:24.807209 1497 scope.go:117] "RemoveContainer" containerID="461faadb3012b5090ff3df734ab3983893efa078f39713a04b3ec24d93985411"
Sep 24 18:43:24 addons-783184 kubelet[1497]: E0924 18:43:24.807406 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-n4hxg_gadget(766b85f6-6e39-42ae-a8d7-d232d3903192)\"" pod="gadget/gadget-n4hxg" podUID="766b85f6-6e39-42ae-a8d7-d232d3903192"
Sep 24 18:43:33 addons-783184 kubelet[1497]: I0924 18:43:33.807965 1497 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-66c9cd494c-r9m2n" secret="" err="secret \"gcp-auth\" not found"
Sep 24 18:43:35 addons-783184 kubelet[1497]: I0924 18:43:35.807239 1497 scope.go:117] "RemoveContainer" containerID="461faadb3012b5090ff3df734ab3983893efa078f39713a04b3ec24d93985411"
Sep 24 18:43:35 addons-783184 kubelet[1497]: E0924 18:43:35.807859 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-n4hxg_gadget(766b85f6-6e39-42ae-a8d7-d232d3903192)\"" pod="gadget/gadget-n4hxg" podUID="766b85f6-6e39-42ae-a8d7-d232d3903192"
Sep 24 18:43:49 addons-783184 kubelet[1497]: I0924 18:43:49.806962 1497 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-6tcpv" secret="" err="secret \"gcp-auth\" not found"
Sep 24 18:43:49 addons-783184 kubelet[1497]: I0924 18:43:49.807039 1497 scope.go:117] "RemoveContainer" containerID="461faadb3012b5090ff3df734ab3983893efa078f39713a04b3ec24d93985411"
Sep 24 18:43:49 addons-783184 kubelet[1497]: E0924 18:43:49.807669 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-n4hxg_gadget(766b85f6-6e39-42ae-a8d7-d232d3903192)\"" pod="gadget/gadget-n4hxg" podUID="766b85f6-6e39-42ae-a8d7-d232d3903192"
Sep 24 18:43:57 addons-783184 kubelet[1497]: I0924 18:43:57.806984 1497 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-k6vdg" secret="" err="secret \"gcp-auth\" not found"
Sep 24 18:44:00 addons-783184 kubelet[1497]: I0924 18:44:00.807642 1497 scope.go:117] "RemoveContainer" containerID="461faadb3012b5090ff3df734ab3983893efa078f39713a04b3ec24d93985411"
Sep 24 18:44:00 addons-783184 kubelet[1497]: E0924 18:44:00.807824 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-n4hxg_gadget(766b85f6-6e39-42ae-a8d7-d232d3903192)\"" pod="gadget/gadget-n4hxg" podUID="766b85f6-6e39-42ae-a8d7-d232d3903192"
Sep 24 18:44:13 addons-783184 kubelet[1497]: I0924 18:44:13.807426 1497 scope.go:117] "RemoveContainer" containerID="461faadb3012b5090ff3df734ab3983893efa078f39713a04b3ec24d93985411"
Sep 24 18:44:13 addons-783184 kubelet[1497]: E0924 18:44:13.807631 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-n4hxg_gadget(766b85f6-6e39-42ae-a8d7-d232d3903192)\"" pod="gadget/gadget-n4hxg" podUID="766b85f6-6e39-42ae-a8d7-d232d3903192"
==> storage-provisioner [2bde223b96e609669b733bddcb24aad97765ce0342f2fd61c523a72defae2f04] <==
I0924 18:38:24.296343 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0924 18:38:24.317043 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0924 18:38:24.317112 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0924 18:38:24.343202 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0924 18:38:24.343470 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-783184_c6c94de1-1dab-40dc-9f2d-cbe1ad17268c!
I0924 18:38:24.343996 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"ad7ecc51-4668-4e8b-807d-e5d6fa3dc1ee", APIVersion:"v1", ResourceVersion:"557", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-783184_c6c94de1-1dab-40dc-9f2d-cbe1ad17268c became leader
I0924 18:38:24.443789 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-783184_c6c94de1-1dab-40dc-9f2d-cbe1ad17268c!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-783184 -n addons-783184
helpers_test.go:261: (dbg) Run: kubectl --context addons-783184 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: ingress-nginx-admission-create-f59th ingress-nginx-admission-patch-tlf2n test-job-nginx-0
helpers_test.go:274: ======> post-mortem[TestAddons/serial/Volcano]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-783184 describe pod ingress-nginx-admission-create-f59th ingress-nginx-admission-patch-tlf2n test-job-nginx-0
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-783184 describe pod ingress-nginx-admission-create-f59th ingress-nginx-admission-patch-tlf2n test-job-nginx-0: exit status 1 (87.229856ms)
** stderr **
Error from server (NotFound): pods "ingress-nginx-admission-create-f59th" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-tlf2n" not found
Error from server (NotFound): pods "test-job-nginx-0" not found
** /stderr **
helpers_test.go:279: kubectl --context addons-783184 describe pod ingress-nginx-admission-create-f59th ingress-nginx-admission-patch-tlf2n test-job-nginx-0: exit status 1
--- FAIL: TestAddons/serial/Volcano (199.89s)