=== RUN TestAddons/serial/Volcano
addons_test.go:905: volcano-admission stabilized in 48.394629ms
addons_test.go:913: volcano-controller stabilized in 48.494617ms
addons_test.go:897: volcano-scheduler stabilized in 48.538153ms
addons_test.go:919: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-scheduler-844f6db89b-rnl9q" [57bb5ff0-4dd5-4233-b434-64f27116dcea] Running
addons_test.go:919: (dbg) TestAddons/serial/Volcano: app=volcano-scheduler healthy within 6.003613132s
addons_test.go:923: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-admission-5f7844f7bc-c4gwm" [444c7ba1-127d-4801-8392-be25dd1a2b44] Running
addons_test.go:923: (dbg) TestAddons/serial/Volcano: app=volcano-admission healthy within 5.003824866s
addons_test.go:927: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-controllers-59cb4746db-gb4lm" [eeb90b2d-f818-4966-a920-7e4df1ca001d] Running
addons_test.go:927: (dbg) TestAddons/serial/Volcano: app=volcano-controller healthy within 5.003554461s
addons_test.go:932: (dbg) Run: kubectl --context addons-710864 delete -n volcano-system job volcano-admission-init
addons_test.go:938: (dbg) Run: kubectl --context addons-710864 create -f testdata/vcjob.yaml
addons_test.go:946: (dbg) Run: kubectl --context addons-710864 get vcjob -n my-volcano
addons_test.go:964: (dbg) TestAddons/serial/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...
helpers_test.go:344: "test-job-nginx-0" [d2a296b0-d366-40a9-939d-bee194d13432] Pending
helpers_test.go:344: "test-job-nginx-0" [d2a296b0-d366-40a9-939d-bee194d13432] Pending: PodScheduled:Unschedulable (0/1 nodes are unavailable: 1 Insufficient cpu.)
helpers_test.go:329: TestAddons/serial/Volcano: WARNING: pod list for "my-volcano" "volcano.sh/job-name=test-job" returned: client rate limiter Wait returned an error: context deadline exceeded
addons_test.go:964: ***** TestAddons/serial/Volcano: pod "volcano.sh/job-name=test-job" failed to start within 3m0s: context deadline exceeded ****
addons_test.go:964: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-710864 -n addons-710864
addons_test.go:964: TestAddons/serial/Volcano: showing logs for failed pods as of 2024-07-29 20:10:20.07965539 +0000 UTC m=+397.056318710
addons_test.go:964: (dbg) Run: kubectl --context addons-710864 describe po test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-710864 describe po test-job-nginx-0 -n my-volcano:
Name: test-job-nginx-0
Namespace: my-volcano
Priority: 0
Service Account: default
Node: <none>
Labels: volcano.sh/job-name=test-job
volcano.sh/job-namespace=my-volcano
volcano.sh/queue-name=test
volcano.sh/task-index=0
volcano.sh/task-spec=nginx
Annotations: scheduling.k8s.io/group-name: test-job-9d001b7e-c42b-4684-ab4a-cac5b4543d52
volcano.sh/job-name: test-job
volcano.sh/job-version: 0
volcano.sh/queue-name: test
volcano.sh/task-index: 0
volcano.sh/task-spec: nginx
volcano.sh/template-uid: test-job-nginx
Status: Pending
IP:
IPs: <none>
Controlled By: Job/test-job
Containers:
nginx:
Image: nginx:latest
Port: <none>
Host Port: <none>
Command:
sleep
10m
Limits:
cpu: 1
Requests:
cpu: 1
Environment:
GOOGLE_APPLICATION_CREDENTIALS: /google-app-creds.json
PROJECT_ID: this_is_fake
GCP_PROJECT: this_is_fake
GCLOUD_PROJECT: this_is_fake
GOOGLE_CLOUD_PROJECT: this_is_fake
CLOUDSDK_CORE_PROJECT: this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-qdl78 (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
kube-api-access-qdl78:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
gcp-creds:
Type: HostPath (bare host directory volume)
Path: /var/lib/minikube/google_application_credentials.json
HostPathType: File
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling 3m volcano 0/1 nodes are unavailable: 1 Insufficient cpu.
addons_test.go:964: (dbg) Run: kubectl --context addons-710864 logs test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-710864 logs test-job-nginx-0 -n my-volcano:
addons_test.go:965: failed waiting for test-local-path pod: volcano.sh/job-name=test-job within 3m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestAddons/serial/Volcano]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect addons-710864
helpers_test.go:235: (dbg) docker inspect addons-710864:
-- stdout --
[
{
"Id": "a6d5bb381688db8b23936b9f61db71ecc6aee669a5c6f010b935518dc5a4daae",
"Created": "2024-07-29T20:04:42.183804853Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 888297,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-07-29T20:04:42.335746802Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:2cd84ab2172023a68162f38a55db46353562cea41552fd8e8bdec97b31b2c495",
"ResolvConfPath": "/var/lib/docker/containers/a6d5bb381688db8b23936b9f61db71ecc6aee669a5c6f010b935518dc5a4daae/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/a6d5bb381688db8b23936b9f61db71ecc6aee669a5c6f010b935518dc5a4daae/hostname",
"HostsPath": "/var/lib/docker/containers/a6d5bb381688db8b23936b9f61db71ecc6aee669a5c6f010b935518dc5a4daae/hosts",
"LogPath": "/var/lib/docker/containers/a6d5bb381688db8b23936b9f61db71ecc6aee669a5c6f010b935518dc5a4daae/a6d5bb381688db8b23936b9f61db71ecc6aee669a5c6f010b935518dc5a4daae-json.log",
"Name": "/addons-710864",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"addons-710864:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "addons-710864",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4194304000,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8388608000,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/9b53c83b083372e274cb66f8b1c85958cbd46e98ccb8ee936b6054660e42f874-init/diff:/var/lib/docker/overlay2/0f9ee0dc660eb1a4fd8ebd86658867568e564b33a38e5c62951d9210de476c83/diff",
"MergedDir": "/var/lib/docker/overlay2/9b53c83b083372e274cb66f8b1c85958cbd46e98ccb8ee936b6054660e42f874/merged",
"UpperDir": "/var/lib/docker/overlay2/9b53c83b083372e274cb66f8b1c85958cbd46e98ccb8ee936b6054660e42f874/diff",
"WorkDir": "/var/lib/docker/overlay2/9b53c83b083372e274cb66f8b1c85958cbd46e98ccb8ee936b6054660e42f874/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "addons-710864",
"Source": "/var/lib/docker/volumes/addons-710864/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "addons-710864",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-710864",
"name.minikube.sigs.k8s.io": "addons-710864",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "db26639a4bd88a6a52c3890936e36d390694ae44588826fd9eac83db1762ab5f",
"SandboxKey": "/var/run/docker/netns/db26639a4bd8",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "39084"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "39085"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "39088"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "39086"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "39087"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"addons-710864": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:31:02",
"DriverOpts": null,
"NetworkID": "a5ed386adeac107cbf22f60af855bf481ebf1a12c1888e060ff809d79553a369",
"EndpointID": "810de32e5b386b011546cbcae63545902d63a5b0c88b8917efe95202bd6249ee",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-710864",
"a6d5bb381688"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p addons-710864 -n addons-710864
helpers_test.go:244: <<< TestAddons/serial/Volcano FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/serial/Volcano]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p addons-710864 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-710864 logs -n 25: (1.580363762s)
helpers_test.go:252: TestAddons/serial/Volcano logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| start | -o=json --download-only | download-only-896668 | jenkins | v1.33.1 | 29 Jul 24 20:03 UTC | |
| | -p download-only-896668 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.33.1 | 29 Jul 24 20:03 UTC | 29 Jul 24 20:03 UTC |
| delete | -p download-only-896668 | download-only-896668 | jenkins | v1.33.1 | 29 Jul 24 20:03 UTC | 29 Jul 24 20:03 UTC |
| start | -o=json --download-only | download-only-213677 | jenkins | v1.33.1 | 29 Jul 24 20:03 UTC | |
| | -p download-only-213677 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.30.3 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.33.1 | 29 Jul 24 20:04 UTC | 29 Jul 24 20:04 UTC |
| delete | -p download-only-213677 | download-only-213677 | jenkins | v1.33.1 | 29 Jul 24 20:04 UTC | 29 Jul 24 20:04 UTC |
| start | -o=json --download-only | download-only-245277 | jenkins | v1.33.1 | 29 Jul 24 20:04 UTC | |
| | -p download-only-245277 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.31.0-beta.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.33.1 | 29 Jul 24 20:04 UTC | 29 Jul 24 20:04 UTC |
| delete | -p download-only-245277 | download-only-245277 | jenkins | v1.33.1 | 29 Jul 24 20:04 UTC | 29 Jul 24 20:04 UTC |
| delete | -p download-only-896668 | download-only-896668 | jenkins | v1.33.1 | 29 Jul 24 20:04 UTC | 29 Jul 24 20:04 UTC |
| delete | -p download-only-213677 | download-only-213677 | jenkins | v1.33.1 | 29 Jul 24 20:04 UTC | 29 Jul 24 20:04 UTC |
| delete | -p download-only-245277 | download-only-245277 | jenkins | v1.33.1 | 29 Jul 24 20:04 UTC | 29 Jul 24 20:04 UTC |
| start | --download-only -p | download-docker-131466 | jenkins | v1.33.1 | 29 Jul 24 20:04 UTC | |
| | download-docker-131466 | | | | | |
| | --alsologtostderr | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p download-docker-131466 | download-docker-131466 | jenkins | v1.33.1 | 29 Jul 24 20:04 UTC | 29 Jul 24 20:04 UTC |
| start | --download-only -p | binary-mirror-539891 | jenkins | v1.33.1 | 29 Jul 24 20:04 UTC | |
| | binary-mirror-539891 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:38237 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p binary-mirror-539891 | binary-mirror-539891 | jenkins | v1.33.1 | 29 Jul 24 20:04 UTC | 29 Jul 24 20:04 UTC |
| addons | disable dashboard -p | addons-710864 | jenkins | v1.33.1 | 29 Jul 24 20:04 UTC | |
| | addons-710864 | | | | | |
| addons | enable dashboard -p | addons-710864 | jenkins | v1.33.1 | 29 Jul 24 20:04 UTC | |
| | addons-710864 | | | | | |
| start | -p addons-710864 --wait=true | addons-710864 | jenkins | v1.33.1 | 29 Jul 24 20:04 UTC | 29 Jul 24 20:07 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/07/29 20:04:17
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.22.5 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0729 20:04:17.013474 887796 out.go:291] Setting OutFile to fd 1 ...
I0729 20:04:17.013674 887796 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0729 20:04:17.013706 887796 out.go:304] Setting ErrFile to fd 2...
I0729 20:04:17.013726 887796 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0729 20:04:17.013981 887796 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19345-881398/.minikube/bin
I0729 20:04:17.014439 887796 out.go:298] Setting JSON to false
I0729 20:04:17.015342 887796 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":100007,"bootTime":1722183450,"procs":168,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1065-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0729 20:04:17.015450 887796 start.go:139] virtualization:
I0729 20:04:17.019020 887796 out.go:177] * [addons-710864] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0729 20:04:17.021619 887796 out.go:177] - MINIKUBE_LOCATION=19345
I0729 20:04:17.021731 887796 notify.go:220] Checking for updates...
I0729 20:04:17.027240 887796 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0729 20:04:17.030180 887796 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19345-881398/kubeconfig
I0729 20:04:17.032755 887796 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19345-881398/.minikube
I0729 20:04:17.035080 887796 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0729 20:04:17.038291 887796 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0729 20:04:17.041142 887796 driver.go:392] Setting default libvirt URI to qemu:///system
I0729 20:04:17.071017 887796 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
I0729 20:04:17.071122 887796 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0729 20:04:17.126114 887796 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-07-29 20:04:17.116378576 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1065-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0729 20:04:17.126221 887796 docker.go:307] overlay module found
I0729 20:04:17.129530 887796 out.go:177] * Using the docker driver based on user configuration
I0729 20:04:17.131987 887796 start.go:297] selected driver: docker
I0729 20:04:17.132005 887796 start.go:901] validating driver "docker" against <nil>
I0729 20:04:17.132019 887796 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0729 20:04:17.132640 887796 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0729 20:04:17.188284 887796 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-07-29 20:04:17.179702206 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1065-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0729 20:04:17.188477 887796 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0729 20:04:17.188704 887796 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0729 20:04:17.191152 887796 out.go:177] * Using Docker driver with root privileges
I0729 20:04:17.193283 887796 cni.go:84] Creating CNI manager for ""
I0729 20:04:17.193307 887796 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0729 20:04:17.193320 887796 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0729 20:04:17.193420 887796 start.go:340] cluster config:
{Name:addons-710864 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:addons-710864 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHA
uthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0729 20:04:17.197096 887796 out.go:177] * Starting "addons-710864" primary control-plane node in "addons-710864" cluster
I0729 20:04:17.198725 887796 cache.go:121] Beginning downloading kic base image for docker with containerd
I0729 20:04:17.200539 887796 out.go:177] * Pulling base image v0.0.44-1721902582-19326 ...
I0729 20:04:17.202090 887796 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime containerd
I0729 20:04:17.202135 887796 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19345-881398/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4
I0729 20:04:17.202146 887796 cache.go:56] Caching tarball of preloaded images
I0729 20:04:17.202174 887796 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local docker daemon
I0729 20:04:17.202236 887796 preload.go:172] Found /home/jenkins/minikube-integration/19345-881398/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0729 20:04:17.202247 887796 cache.go:59] Finished verifying existence of preloaded tar for v1.30.3 on containerd
I0729 20:04:17.202568 887796 profile.go:143] Saving config to /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/config.json ...
I0729 20:04:17.202592 887796 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/config.json: {Name:mk09549ccc7a2b3d3e41375458b9a48bd33fc6c8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 20:04:17.216384 887796 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 to local cache
I0729 20:04:17.216515 887796 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory
I0729 20:04:17.216538 887796 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory, skipping pull
I0729 20:04:17.216543 887796 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 exists in cache, skipping pull
I0729 20:04:17.216555 887796 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 as a tarball
I0729 20:04:17.216561 887796 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from local cache
I0729 20:04:34.170897 887796 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from cached tarball
I0729 20:04:34.170936 887796 cache.go:194] Successfully downloaded all kic artifacts
I0729 20:04:34.170982 887796 start.go:360] acquireMachinesLock for addons-710864: {Name:mk920ef379401b1be2591e2b4cbc36c446e5fe33 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0729 20:04:34.171114 887796 start.go:364] duration metric: took 113.387µs to acquireMachinesLock for "addons-710864"
I0729 20:04:34.171140 887796 start.go:93] Provisioning new machine with config: &{Name:addons-710864 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:addons-710864 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fa
lse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0729 20:04:34.171233 887796 start.go:125] createHost starting for "" (driver="docker")
I0729 20:04:34.173702 887796 out.go:204] * Creating docker container (CPUs=2, Memory=4000MB) ...
I0729 20:04:34.173958 887796 start.go:159] libmachine.API.Create for "addons-710864" (driver="docker")
I0729 20:04:34.173996 887796 client.go:168] LocalClient.Create starting
I0729 20:04:34.174115 887796 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19345-881398/.minikube/certs/ca.pem
I0729 20:04:34.870049 887796 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19345-881398/.minikube/certs/cert.pem
I0729 20:04:35.548719 887796 cli_runner.go:164] Run: docker network inspect addons-710864 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0729 20:04:35.564903 887796 cli_runner.go:211] docker network inspect addons-710864 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0729 20:04:35.564996 887796 network_create.go:284] running [docker network inspect addons-710864] to gather additional debugging logs...
I0729 20:04:35.565021 887796 cli_runner.go:164] Run: docker network inspect addons-710864
W0729 20:04:35.579898 887796 cli_runner.go:211] docker network inspect addons-710864 returned with exit code 1
I0729 20:04:35.579937 887796 network_create.go:287] error running [docker network inspect addons-710864]: docker network inspect addons-710864: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-710864 not found
I0729 20:04:35.579964 887796 network_create.go:289] output of [docker network inspect addons-710864]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-710864 not found
** /stderr **
I0729 20:04:35.580076 887796 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0729 20:04:35.598413 887796 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4000461a40}
I0729 20:04:35.598453 887796 network_create.go:124] attempt to create docker network addons-710864 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0729 20:04:35.598527 887796 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-710864 addons-710864
I0729 20:04:35.671902 887796 network_create.go:108] docker network addons-710864 192.168.49.0/24 created
I0729 20:04:35.671940 887796 kic.go:121] calculated static IP "192.168.49.2" for the "addons-710864" container
I0729 20:04:35.672021 887796 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0729 20:04:35.686310 887796 cli_runner.go:164] Run: docker volume create addons-710864 --label name.minikube.sigs.k8s.io=addons-710864 --label created_by.minikube.sigs.k8s.io=true
I0729 20:04:35.704377 887796 oci.go:103] Successfully created a docker volume addons-710864
I0729 20:04:35.704481 887796 cli_runner.go:164] Run: docker run --rm --name addons-710864-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-710864 --entrypoint /usr/bin/test -v addons-710864:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 -d /var/lib
I0729 20:04:37.798149 887796 cli_runner.go:217] Completed: docker run --rm --name addons-710864-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-710864 --entrypoint /usr/bin/test -v addons-710864:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 -d /var/lib: (2.093625981s)
I0729 20:04:37.798181 887796 oci.go:107] Successfully prepared a docker volume addons-710864
I0729 20:04:37.798202 887796 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime containerd
I0729 20:04:37.798222 887796 kic.go:194] Starting extracting preloaded images to volume ...
I0729 20:04:37.798313 887796 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19345-881398/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-710864:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 -I lz4 -xf /preloaded.tar -C /extractDir
I0729 20:04:42.106160 887796 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19345-881398/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-710864:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 -I lz4 -xf /preloaded.tar -C /extractDir: (4.307799388s)
I0729 20:04:42.106205 887796 kic.go:203] duration metric: took 4.307978703s to extract preloaded images to volume ...
W0729 20:04:42.106356 887796 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0729 20:04:42.106480 887796 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0729 20:04:42.167089 887796 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-710864 --name addons-710864 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-710864 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-710864 --network addons-710864 --ip 192.168.49.2 --volume addons-710864:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7
I0729 20:04:42.512368 887796 cli_runner.go:164] Run: docker container inspect addons-710864 --format={{.State.Running}}
I0729 20:04:42.532258 887796 cli_runner.go:164] Run: docker container inspect addons-710864 --format={{.State.Status}}
I0729 20:04:42.553687 887796 cli_runner.go:164] Run: docker exec addons-710864 stat /var/lib/dpkg/alternatives/iptables
I0729 20:04:42.638290 887796 oci.go:144] the created container "addons-710864" has a running status.
I0729 20:04:42.638319 887796 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19345-881398/.minikube/machines/addons-710864/id_rsa...
I0729 20:04:42.885424 887796 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19345-881398/.minikube/machines/addons-710864/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0729 20:04:42.914888 887796 cli_runner.go:164] Run: docker container inspect addons-710864 --format={{.State.Status}}
I0729 20:04:42.941294 887796 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0729 20:04:42.941318 887796 kic_runner.go:114] Args: [docker exec --privileged addons-710864 chown docker:docker /home/docker/.ssh/authorized_keys]
I0729 20:04:42.987734 887796 cli_runner.go:164] Run: docker container inspect addons-710864 --format={{.State.Status}}
I0729 20:04:43.007847 887796 machine.go:94] provisionDockerMachine start ...
I0729 20:04:43.007946 887796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-710864
I0729 20:04:43.031369 887796 main.go:141] libmachine: Using SSH client type: native
I0729 20:04:43.031637 887796 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 39084 <nil> <nil>}
I0729 20:04:43.031654 887796 main.go:141] libmachine: About to run SSH command:
hostname
I0729 20:04:43.032385 887796 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0729 20:04:46.163365 887796 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-710864
I0729 20:04:46.163387 887796 ubuntu.go:169] provisioning hostname "addons-710864"
I0729 20:04:46.163455 887796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-710864
I0729 20:04:46.179902 887796 main.go:141] libmachine: Using SSH client type: native
I0729 20:04:46.180141 887796 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 39084 <nil> <nil>}
I0729 20:04:46.180153 887796 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-710864 && echo "addons-710864" | sudo tee /etc/hostname
I0729 20:04:46.327457 887796 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-710864
I0729 20:04:46.327578 887796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-710864
I0729 20:04:46.344048 887796 main.go:141] libmachine: Using SSH client type: native
I0729 20:04:46.344292 887796 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 39084 <nil> <nil>}
I0729 20:04:46.344314 887796 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-710864' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-710864/g' /etc/hosts;
else
echo '127.0.1.1 addons-710864' | sudo tee -a /etc/hosts;
fi
fi
I0729 20:04:46.475917 887796 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0729 20:04:46.475947 887796 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19345-881398/.minikube CaCertPath:/home/jenkins/minikube-integration/19345-881398/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19345-881398/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19345-881398/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19345-881398/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19345-881398/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19345-881398/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19345-881398/.minikube}
I0729 20:04:46.475975 887796 ubuntu.go:177] setting up certificates
I0729 20:04:46.475984 887796 provision.go:84] configureAuth start
I0729 20:04:46.476046 887796 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-710864
I0729 20:04:46.492861 887796 provision.go:143] copyHostCerts
I0729 20:04:46.492954 887796 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19345-881398/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19345-881398/.minikube/ca.pem (1078 bytes)
I0729 20:04:46.493094 887796 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19345-881398/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19345-881398/.minikube/cert.pem (1123 bytes)
I0729 20:04:46.493163 887796 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19345-881398/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19345-881398/.minikube/key.pem (1675 bytes)
I0729 20:04:46.493220 887796 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19345-881398/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19345-881398/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19345-881398/.minikube/certs/ca-key.pem org=jenkins.addons-710864 san=[127.0.0.1 192.168.49.2 addons-710864 localhost minikube]
I0729 20:04:47.202424 887796 provision.go:177] copyRemoteCerts
I0729 20:04:47.202498 887796 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0729 20:04:47.202541 887796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-710864
I0729 20:04:47.219679 887796 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39084 SSHKeyPath:/home/jenkins/minikube-integration/19345-881398/.minikube/machines/addons-710864/id_rsa Username:docker}
I0729 20:04:47.312394 887796 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-881398/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0729 20:04:47.335266 887796 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-881398/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0729 20:04:47.358423 887796 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-881398/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0729 20:04:47.381849 887796 provision.go:87] duration metric: took 905.846827ms to configureAuth
I0729 20:04:47.381876 887796 ubuntu.go:193] setting minikube options for container-runtime
I0729 20:04:47.382049 887796 config.go:182] Loaded profile config "addons-710864": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0729 20:04:47.382062 887796 machine.go:97] duration metric: took 4.374198011s to provisionDockerMachine
I0729 20:04:47.382069 887796 client.go:171] duration metric: took 13.208064146s to LocalClient.Create
I0729 20:04:47.382087 887796 start.go:167] duration metric: took 13.208130319s to libmachine.API.Create "addons-710864"
I0729 20:04:47.382099 887796 start.go:293] postStartSetup for "addons-710864" (driver="docker")
I0729 20:04:47.382109 887796 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0729 20:04:47.382163 887796 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0729 20:04:47.382210 887796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-710864
I0729 20:04:47.399341 887796 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39084 SSHKeyPath:/home/jenkins/minikube-integration/19345-881398/.minikube/machines/addons-710864/id_rsa Username:docker}
I0729 20:04:47.497396 887796 ssh_runner.go:195] Run: cat /etc/os-release
I0729 20:04:47.500882 887796 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0729 20:04:47.500919 887796 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0729 20:04:47.500930 887796 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0729 20:04:47.500937 887796 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0729 20:04:47.500948 887796 filesync.go:126] Scanning /home/jenkins/minikube-integration/19345-881398/.minikube/addons for local assets ...
I0729 20:04:47.501030 887796 filesync.go:126] Scanning /home/jenkins/minikube-integration/19345-881398/.minikube/files for local assets ...
I0729 20:04:47.501056 887796 start.go:296] duration metric: took 118.951741ms for postStartSetup
I0729 20:04:47.501398 887796 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-710864
I0729 20:04:47.518247 887796 profile.go:143] Saving config to /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/config.json ...
I0729 20:04:47.518547 887796 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0729 20:04:47.518599 887796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-710864
I0729 20:04:47.536538 887796 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39084 SSHKeyPath:/home/jenkins/minikube-integration/19345-881398/.minikube/machines/addons-710864/id_rsa Username:docker}
I0729 20:04:47.628780 887796 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0729 20:04:47.633321 887796 start.go:128] duration metric: took 13.462070688s to createHost
I0729 20:04:47.633351 887796 start.go:83] releasing machines lock for "addons-710864", held for 13.462227275s
I0729 20:04:47.633431 887796 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-710864
I0729 20:04:47.650297 887796 ssh_runner.go:195] Run: cat /version.json
I0729 20:04:47.650363 887796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-710864
I0729 20:04:47.650620 887796 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0729 20:04:47.650659 887796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-710864
I0729 20:04:47.671183 887796 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39084 SSHKeyPath:/home/jenkins/minikube-integration/19345-881398/.minikube/machines/addons-710864/id_rsa Username:docker}
I0729 20:04:47.687942 887796 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39084 SSHKeyPath:/home/jenkins/minikube-integration/19345-881398/.minikube/machines/addons-710864/id_rsa Username:docker}
I0729 20:04:47.763129 887796 ssh_runner.go:195] Run: systemctl --version
I0729 20:04:47.924107 887796 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0729 20:04:47.928400 887796 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0729 20:04:47.953147 887796 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0729 20:04:47.953228 887796 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0729 20:04:47.981854 887796 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0729 20:04:47.981877 887796 start.go:495] detecting cgroup driver to use...
I0729 20:04:47.981914 887796 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0729 20:04:47.981977 887796 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0729 20:04:47.994829 887796 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0729 20:04:48.009217 887796 docker.go:217] disabling cri-docker service (if available) ...
I0729 20:04:48.009291 887796 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0729 20:04:48.025466 887796 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0729 20:04:48.041921 887796 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0729 20:04:48.130541 887796 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0729 20:04:48.219709 887796 docker.go:233] disabling docker service ...
I0729 20:04:48.219868 887796 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0729 20:04:48.240295 887796 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0729 20:04:48.252462 887796 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0729 20:04:48.338243 887796 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0729 20:04:48.427597 887796 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0729 20:04:48.439142 887796 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0729 20:04:48.455973 887796 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0729 20:04:48.466774 887796 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0729 20:04:48.477585 887796 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0729 20:04:48.477669 887796 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0729 20:04:48.488597 887796 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0729 20:04:48.499424 887796 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0729 20:04:48.510212 887796 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0729 20:04:48.520448 887796 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0729 20:04:48.530036 887796 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0729 20:04:48.540363 887796 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0729 20:04:48.550546 887796 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0729 20:04:48.560754 887796 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0729 20:04:48.569442 887796 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0729 20:04:48.578189 887796 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0729 20:04:48.660243 887796 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0729 20:04:48.790608 887796 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0729 20:04:48.790736 887796 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0729 20:04:48.794222 887796 start.go:563] Will wait 60s for crictl version
I0729 20:04:48.794326 887796 ssh_runner.go:195] Run: which crictl
I0729 20:04:48.798652 887796 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0729 20:04:48.835626 887796 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.19
RuntimeApiVersion: v1
I0729 20:04:48.835762 887796 ssh_runner.go:195] Run: containerd --version
I0729 20:04:48.863853 887796 ssh_runner.go:195] Run: containerd --version
I0729 20:04:48.887528 887796 out.go:177] * Preparing Kubernetes v1.30.3 on containerd 1.7.19 ...
I0729 20:04:48.889359 887796 cli_runner.go:164] Run: docker network inspect addons-710864 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0729 20:04:48.904581 887796 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I0729 20:04:48.908231 887796 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0729 20:04:48.919158 887796 kubeadm.go:883] updating cluster {Name:addons-710864 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:addons-710864 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cus
tomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0729 20:04:48.919277 887796 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime containerd
I0729 20:04:48.919355 887796 ssh_runner.go:195] Run: sudo crictl images --output json
I0729 20:04:48.955043 887796 containerd.go:627] all images are preloaded for containerd runtime.
I0729 20:04:48.955071 887796 containerd.go:534] Images already preloaded, skipping extraction
I0729 20:04:48.955133 887796 ssh_runner.go:195] Run: sudo crictl images --output json
I0729 20:04:48.991445 887796 containerd.go:627] all images are preloaded for containerd runtime.
I0729 20:04:48.991468 887796 cache_images.go:84] Images are preloaded, skipping loading
I0729 20:04:48.991477 887796 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.30.3 containerd true true} ...
I0729 20:04:48.991584 887796 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.30.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-710864 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.30.3 ClusterName:addons-710864 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0729 20:04:48.991658 887796 ssh_runner.go:195] Run: sudo crictl info
I0729 20:04:49.030546 887796 cni.go:84] Creating CNI manager for ""
I0729 20:04:49.030569 887796 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0729 20:04:49.030578 887796 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0729 20:04:49.030619 887796 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.30.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-710864 NodeName:addons-710864 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc
/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0729 20:04:49.030780 887796 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "addons-710864"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.30.3
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0729 20:04:49.030850 887796 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.3
I0729 20:04:49.040276 887796 binaries.go:44] Found k8s binaries, skipping transfer
I0729 20:04:49.040346 887796 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0729 20:04:49.049455 887796 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (317 bytes)
I0729 20:04:49.067499 887796 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0729 20:04:49.086461 887796 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2167 bytes)
I0729 20:04:49.105628 887796 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0729 20:04:49.109250 887796 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0729 20:04:49.120438 887796 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0729 20:04:49.201312 887796 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0729 20:04:49.220316 887796 certs.go:68] Setting up /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864 for IP: 192.168.49.2
I0729 20:04:49.220340 887796 certs.go:194] generating shared ca certs ...
I0729 20:04:49.220356 887796 certs.go:226] acquiring lock for ca certs: {Name:mk11623c1f822b0f0d377c976617812765f20fa5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 20:04:49.220531 887796 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19345-881398/.minikube/ca.key
I0729 20:04:49.510814 887796 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19345-881398/.minikube/ca.crt ...
I0729 20:04:49.510842 887796 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19345-881398/.minikube/ca.crt: {Name:mk1dff16101c52891e1d663162d133419be8f832 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 20:04:49.511048 887796 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19345-881398/.minikube/ca.key ...
I0729 20:04:49.511060 887796 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19345-881398/.minikube/ca.key: {Name:mk5534b010eade24f84f2ec6685c12bc96ab8c0f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 20:04:49.511144 887796 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19345-881398/.minikube/proxy-client-ca.key
I0729 20:04:49.873855 887796 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19345-881398/.minikube/proxy-client-ca.crt ...
I0729 20:04:49.873886 887796 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19345-881398/.minikube/proxy-client-ca.crt: {Name:mk25507c41d29587190e90767e4f6d5e7cbfdf93 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 20:04:49.874090 887796 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19345-881398/.minikube/proxy-client-ca.key ...
I0729 20:04:49.874106 887796 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19345-881398/.minikube/proxy-client-ca.key: {Name:mk446d57c4ce70b493cd7e10732871a11202d449 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 20:04:49.874187 887796 certs.go:256] generating profile certs ...
I0729 20:04:49.874245 887796 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/client.key
I0729 20:04:49.874262 887796 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/client.crt with IP's: []
I0729 20:04:50.262022 887796 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/client.crt ...
I0729 20:04:50.262056 887796 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/client.crt: {Name:mk006c6a60564c2f5e3e7e9c7a9db7bc955aca51 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 20:04:50.262252 887796 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/client.key ...
I0729 20:04:50.262265 887796 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/client.key: {Name:mk5600ad33bb3bece99f07b0740aa98b9330e919 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 20:04:50.262810 887796 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/apiserver.key.d236b487
I0729 20:04:50.262836 887796 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/apiserver.crt.d236b487 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I0729 20:04:50.596892 887796 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/apiserver.crt.d236b487 ...
I0729 20:04:50.596926 887796 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/apiserver.crt.d236b487: {Name:mkb99f6380787326c88d6db2d1f9f5fcf98574a0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 20:04:50.597885 887796 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/apiserver.key.d236b487 ...
I0729 20:04:50.597904 887796 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/apiserver.key.d236b487: {Name:mkcd9bc35b70b9e6767fcf729cb0319aa94dce32 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 20:04:50.597998 887796 certs.go:381] copying /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/apiserver.crt.d236b487 -> /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/apiserver.crt
I0729 20:04:50.598088 887796 certs.go:385] copying /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/apiserver.key.d236b487 -> /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/apiserver.key
I0729 20:04:50.598144 887796 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/proxy-client.key
I0729 20:04:50.598166 887796 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/proxy-client.crt with IP's: []
I0729 20:04:50.819705 887796 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/proxy-client.crt ...
I0729 20:04:50.819738 887796 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/proxy-client.crt: {Name:mkf100a45cb120336418705fbb3917a0f0310172 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 20:04:50.819937 887796 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/proxy-client.key ...
I0729 20:04:50.819953 887796 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/proxy-client.key: {Name:mk569de465cda4afdcb5e60fa5be2919124fe90c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 20:04:50.820683 887796 certs.go:484] found cert: /home/jenkins/minikube-integration/19345-881398/.minikube/certs/ca-key.pem (1675 bytes)
I0729 20:04:50.820731 887796 certs.go:484] found cert: /home/jenkins/minikube-integration/19345-881398/.minikube/certs/ca.pem (1078 bytes)
I0729 20:04:50.820761 887796 certs.go:484] found cert: /home/jenkins/minikube-integration/19345-881398/.minikube/certs/cert.pem (1123 bytes)
I0729 20:04:50.820791 887796 certs.go:484] found cert: /home/jenkins/minikube-integration/19345-881398/.minikube/certs/key.pem (1675 bytes)
I0729 20:04:50.821538 887796 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-881398/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0729 20:04:50.850072 887796 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-881398/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0729 20:04:50.874698 887796 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-881398/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0729 20:04:50.899895 887796 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-881398/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0729 20:04:50.924825 887796 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0729 20:04:50.949768 887796 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0729 20:04:50.974069 887796 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0729 20:04:50.998820 887796 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-881398/.minikube/profiles/addons-710864/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0729 20:04:51.040974 887796 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-881398/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0729 20:04:51.068555 887796 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0729 20:04:51.088778 887796 ssh_runner.go:195] Run: openssl version
I0729 20:04:51.094522 887796 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0729 20:04:51.104510 887796 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0729 20:04:51.108317 887796 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 29 20:04 /usr/share/ca-certificates/minikubeCA.pem
I0729 20:04:51.108385 887796 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0729 20:04:51.115462 887796 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0729 20:04:51.125375 887796 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0729 20:04:51.128951 887796 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0729 20:04:51.129002 887796 kubeadm.go:392] StartCluster: {Name:addons-710864 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:addons-710864 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom
QemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0729 20:04:51.129098 887796 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0729 20:04:51.129164 887796 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0729 20:04:51.166744 887796 cri.go:89] found id: ""
I0729 20:04:51.166840 887796 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0729 20:04:51.175961 887796 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0729 20:04:51.184870 887796 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0729 20:04:51.184937 887796 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0729 20:04:51.194303 887796 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0729 20:04:51.194325 887796 kubeadm.go:157] found existing configuration files:
I0729 20:04:51.194379 887796 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0729 20:04:51.203277 887796 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0729 20:04:51.203395 887796 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0729 20:04:51.211754 887796 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0729 20:04:51.220491 887796 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0729 20:04:51.220644 887796 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0729 20:04:51.229441 887796 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0729 20:04:51.238259 887796 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0729 20:04:51.238351 887796 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0729 20:04:51.246901 887796 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0729 20:04:51.256132 887796 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0729 20:04:51.256196 887796 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0729 20:04:51.264827 887796 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0729 20:04:51.349624 887796 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1065-aws\n", err: exit status 1
I0729 20:04:51.423017 887796 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0729 20:05:10.058407 887796 kubeadm.go:310] [init] Using Kubernetes version: v1.30.3
I0729 20:05:10.058468 887796 kubeadm.go:310] [preflight] Running pre-flight checks
I0729 20:05:10.058553 887796 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0729 20:05:10.058615 887796 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1065-aws[0m
I0729 20:05:10.058653 887796 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0729 20:05:10.058724 887796 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0729 20:05:10.058782 887796 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0729 20:05:10.058831 887796 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0729 20:05:10.058892 887796 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0729 20:05:10.058940 887796 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0729 20:05:10.059002 887796 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0729 20:05:10.059058 887796 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0729 20:05:10.059112 887796 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0729 20:05:10.059161 887796 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0729 20:05:10.059233 887796 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0729 20:05:10.059327 887796 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0729 20:05:10.059419 887796 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0729 20:05:10.059482 887796 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0729 20:05:10.061624 887796 out.go:204] - Generating certificates and keys ...
I0729 20:05:10.061716 887796 kubeadm.go:310] [certs] Using existing ca certificate authority
I0729 20:05:10.061786 887796 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0729 20:05:10.061857 887796 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0729 20:05:10.061916 887796 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0729 20:05:10.061981 887796 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0729 20:05:10.062036 887796 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0729 20:05:10.062092 887796 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0729 20:05:10.062214 887796 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-710864 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0729 20:05:10.062268 887796 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0729 20:05:10.062384 887796 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-710864 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0729 20:05:10.062451 887796 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0729 20:05:10.062515 887796 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0729 20:05:10.062563 887796 kubeadm.go:310] [certs] Generating "sa" key and public key
I0729 20:05:10.062620 887796 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0729 20:05:10.062672 887796 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0729 20:05:10.062731 887796 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0729 20:05:10.062794 887796 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0729 20:05:10.062858 887796 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0729 20:05:10.062914 887796 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0729 20:05:10.062999 887796 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0729 20:05:10.063067 887796 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0729 20:05:10.066995 887796 out.go:204] - Booting up control plane ...
I0729 20:05:10.067106 887796 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0729 20:05:10.067186 887796 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0729 20:05:10.067255 887796 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0729 20:05:10.067358 887796 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0729 20:05:10.067447 887796 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0729 20:05:10.067499 887796 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0729 20:05:10.067626 887796 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0729 20:05:10.067699 887796 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s
I0729 20:05:10.067766 887796 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.501049316s
I0729 20:05:10.067888 887796 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0729 20:05:10.067947 887796 kubeadm.go:310] [api-check] The API server is healthy after 6.002232167s
I0729 20:05:10.068052 887796 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0729 20:05:10.068176 887796 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0729 20:05:10.068238 887796 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0729 20:05:10.068415 887796 kubeadm.go:310] [mark-control-plane] Marking the node addons-710864 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0729 20:05:10.068474 887796 kubeadm.go:310] [bootstrap-token] Using token: 6xh03c.s8xy2t73jh1x9ggr
I0729 20:05:10.070878 887796 out.go:204] - Configuring RBAC rules ...
I0729 20:05:10.071038 887796 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0729 20:05:10.071130 887796 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0729 20:05:10.071330 887796 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0729 20:05:10.071481 887796 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0729 20:05:10.071602 887796 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0729 20:05:10.071690 887796 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0729 20:05:10.071829 887796 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0729 20:05:10.071876 887796 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0729 20:05:10.071926 887796 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0729 20:05:10.071934 887796 kubeadm.go:310]
I0729 20:05:10.071993 887796 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0729 20:05:10.072002 887796 kubeadm.go:310]
I0729 20:05:10.072076 887796 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0729 20:05:10.072084 887796 kubeadm.go:310]
I0729 20:05:10.072109 887796 kubeadm.go:310] mkdir -p $HOME/.kube
I0729 20:05:10.072168 887796 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0729 20:05:10.072221 887796 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0729 20:05:10.072231 887796 kubeadm.go:310]
I0729 20:05:10.072283 887796 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0729 20:05:10.072290 887796 kubeadm.go:310]
I0729 20:05:10.072336 887796 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0729 20:05:10.072344 887796 kubeadm.go:310]
I0729 20:05:10.072394 887796 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0729 20:05:10.072470 887796 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0729 20:05:10.072539 887796 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0729 20:05:10.072546 887796 kubeadm.go:310]
I0729 20:05:10.072628 887796 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0729 20:05:10.072705 887796 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0729 20:05:10.072713 887796 kubeadm.go:310]
I0729 20:05:10.072793 887796 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token 6xh03c.s8xy2t73jh1x9ggr \
I0729 20:05:10.072896 887796 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:1a1f7b352d27d7d6de7cff20a52ee9a4980af514df9b5bc74da65698f088be93 \
I0729 20:05:10.072920 887796 kubeadm.go:310] --control-plane
I0729 20:05:10.072927 887796 kubeadm.go:310]
I0729 20:05:10.073012 887796 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0729 20:05:10.073021 887796 kubeadm.go:310]
I0729 20:05:10.073100 887796 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token 6xh03c.s8xy2t73jh1x9ggr \
I0729 20:05:10.073215 887796 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:1a1f7b352d27d7d6de7cff20a52ee9a4980af514df9b5bc74da65698f088be93
I0729 20:05:10.073230 887796 cni.go:84] Creating CNI manager for ""
I0729 20:05:10.073238 887796 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0729 20:05:10.077037 887796 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0729 20:05:10.079258 887796 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0729 20:05:10.084365 887796 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.30.3/kubectl ...
I0729 20:05:10.084403 887796 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
I0729 20:05:10.106377 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0729 20:05:10.373098 887796 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0729 20:05:10.373260 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:10.373360 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-710864 minikube.k8s.io/updated_at=2024_07_29T20_05_10_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=8b24aa06450b07a59980f53ae4b9b78f9c5a1899 minikube.k8s.io/name=addons-710864 minikube.k8s.io/primary=true
I0729 20:05:10.601728 887796 ops.go:34] apiserver oom_adj: -16
I0729 20:05:10.601816 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:11.101964 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:11.602203 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:12.102891 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:12.601883 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:13.102131 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:13.601924 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:14.102711 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:14.602724 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:15.102034 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:15.602607 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:16.102285 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:16.602455 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:17.102552 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:17.602476 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:18.102026 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:18.602559 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:19.102977 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:19.602626 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:20.102100 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:20.602625 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:21.102594 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:21.602132 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:22.102767 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:22.602265 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:23.102357 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:23.601991 887796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0729 20:05:23.725378 887796 kubeadm.go:1113] duration metric: took 13.352189082s to wait for elevateKubeSystemPrivileges
I0729 20:05:23.725417 887796 kubeadm.go:394] duration metric: took 32.596418724s to StartCluster
I0729 20:05:23.725434 887796 settings.go:142] acquiring lock: {Name:mk74b57669458de6c7bcb2fd29a062961a0f4240 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 20:05:23.725550 887796 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19345-881398/kubeconfig
I0729 20:05:23.725902 887796 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19345-881398/kubeconfig: {Name:mk707200dd4a23965f0e8ec3f68d8aec9c5a655b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 20:05:23.726074 887796 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0729 20:05:23.726208 887796 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0729 20:05:23.726453 887796 config.go:182] Loaded profile config "addons-710864": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0729 20:05:23.726408 887796 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I0729 20:05:23.726504 887796 addons.go:69] Setting yakd=true in profile "addons-710864"
I0729 20:05:23.726511 887796 addons.go:69] Setting inspektor-gadget=true in profile "addons-710864"
I0729 20:05:23.726527 887796 addons.go:234] Setting addon yakd=true in "addons-710864"
I0729 20:05:23.726530 887796 addons.go:234] Setting addon inspektor-gadget=true in "addons-710864"
I0729 20:05:23.726553 887796 host.go:66] Checking if "addons-710864" exists ...
I0729 20:05:23.726558 887796 addons.go:69] Setting metrics-server=true in profile "addons-710864"
I0729 20:05:23.726577 887796 addons.go:234] Setting addon metrics-server=true in "addons-710864"
I0729 20:05:23.726591 887796 host.go:66] Checking if "addons-710864" exists ...
I0729 20:05:23.726663 887796 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-710864"
I0729 20:05:23.726676 887796 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-710864"
I0729 20:05:23.726689 887796 host.go:66] Checking if "addons-710864" exists ...
I0729 20:05:23.727039 887796 cli_runner.go:164] Run: docker container inspect addons-710864 --format={{.State.Status}}
I0729 20:05:23.727073 887796 cli_runner.go:164] Run: docker container inspect addons-710864 --format={{.State.Status}}
I0729 20:05:23.727974 887796 cli_runner.go:164] Run: docker container inspect addons-710864 --format={{.State.Status}}
I0729 20:05:23.731004 887796 addons.go:69] Setting registry=true in profile "addons-710864"
I0729 20:05:23.731085 887796 addons.go:234] Setting addon registry=true in "addons-710864"
I0729 20:05:23.731137 887796 host.go:66] Checking if "addons-710864" exists ...
I0729 20:05:23.731610 887796 cli_runner.go:164] Run: docker container inspect addons-710864 --format={{.State.Status}}
I0729 20:05:23.734382 887796 addons.go:69] Setting cloud-spanner=true in profile "addons-710864"
I0729 20:05:23.734423 887796 addons.go:234] Setting addon cloud-spanner=true in "addons-710864"
I0729 20:05:23.734457 887796 host.go:66] Checking if "addons-710864" exists ...
I0729 20:05:23.734876 887796 cli_runner.go:164] Run: docker container inspect addons-710864 --format={{.State.Status}}
I0729 20:05:23.742114 887796 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-710864"
I0729 20:05:23.742206 887796 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-710864"
I0729 20:05:23.742244 887796 host.go:66] Checking if "addons-710864" exists ...
I0729 20:05:23.742671 887796 cli_runner.go:164] Run: docker container inspect addons-710864 --format={{.State.Status}}
I0729 20:05:23.742922 887796 addons.go:69] Setting storage-provisioner=true in profile "addons-710864"
I0729 20:05:23.742953 887796 addons.go:234] Setting addon storage-provisioner=true in "addons-710864"
I0729 20:05:23.742979 887796 host.go:66] Checking if "addons-710864" exists ...
I0729 20:05:23.743363 887796 cli_runner.go:164] Run: docker container inspect addons-710864 --format={{.State.Status}}
I0729 20:05:23.753323 887796 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-710864"
I0729 20:05:23.753385 887796 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-710864"
I0729 20:05:23.753729 887796 cli_runner.go:164] Run: docker container inspect addons-710864 --format={{.State.Status}}
I0729 20:05:23.756083 887796 addons.go:69] Setting default-storageclass=true in profile "addons-710864"
I0729 20:05:23.756126 887796 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-710864"
I0729 20:05:23.756436 887796 cli_runner.go:164] Run: docker container inspect addons-710864 --format={{.State.Status}}
I0729 20:05:23.769311 887796 addons.go:69] Setting gcp-auth=true in profile "addons-710864"
I0729 20:05:23.769368 887796 mustload.go:65] Loading cluster: addons-710864
I0729 20:05:23.769560 887796 config.go:182] Loaded profile config "addons-710864": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0729 20:05:23.769814 887796 cli_runner.go:164] Run: docker container inspect addons-710864 --format={{.State.Status}}
I0729 20:05:23.781911 887796 addons.go:69] Setting volcano=true in profile "addons-710864"
I0729 20:05:23.781965 887796 addons.go:234] Setting addon volcano=true in "addons-710864"
I0729 20:05:23.782002 887796 host.go:66] Checking if "addons-710864" exists ...
I0729 20:05:23.782438 887796 cli_runner.go:164] Run: docker container inspect addons-710864 --format={{.State.Status}}
I0729 20:05:23.812940 887796 addons.go:69] Setting ingress=true in profile "addons-710864"
I0729 20:05:23.813015 887796 addons.go:234] Setting addon ingress=true in "addons-710864"
I0729 20:05:23.813070 887796 host.go:66] Checking if "addons-710864" exists ...
I0729 20:05:23.813552 887796 cli_runner.go:164] Run: docker container inspect addons-710864 --format={{.State.Status}}
I0729 20:05:23.814041 887796 addons.go:69] Setting volumesnapshots=true in profile "addons-710864"
I0729 20:05:23.814073 887796 addons.go:234] Setting addon volumesnapshots=true in "addons-710864"
I0729 20:05:23.814101 887796 host.go:66] Checking if "addons-710864" exists ...
I0729 20:05:23.814485 887796 cli_runner.go:164] Run: docker container inspect addons-710864 --format={{.State.Status}}
I0729 20:05:23.852878 887796 addons.go:69] Setting ingress-dns=true in profile "addons-710864"
I0729 20:05:23.852967 887796 addons.go:234] Setting addon ingress-dns=true in "addons-710864"
I0729 20:05:23.853028 887796 host.go:66] Checking if "addons-710864" exists ...
I0729 20:05:23.853528 887796 cli_runner.go:164] Run: docker container inspect addons-710864 --format={{.State.Status}}
I0729 20:05:23.853962 887796 out.go:177] * Verifying Kubernetes components...
I0729 20:05:23.857848 887796 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0729 20:05:23.726553 887796 host.go:66] Checking if "addons-710864" exists ...
I0729 20:05:23.883706 887796 cli_runner.go:164] Run: docker container inspect addons-710864 --format={{.State.Status}}
I0729 20:05:23.921627 887796 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.1
I0729 20:05:23.921780 887796 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.30.0
I0729 20:05:23.921855 887796 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.0
I0729 20:05:23.930949 887796 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0729 20:05:23.930973 887796 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0729 20:05:23.931045 887796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-710864
I0729 20:05:23.932361 887796 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0729 20:05:23.932431 887796 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0729 20:05:23.932455 887796 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
I0729 20:05:23.932464 887796 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I0729 20:05:23.932530 887796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-710864
I0729 20:05:23.946464 887796 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.22
I0729 20:05:23.951362 887796 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
I0729 20:05:23.951404 887796 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0729 20:05:23.951476 887796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-710864
I0729 20:05:23.952513 887796 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0729 20:05:23.952535 887796 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0729 20:05:23.952586 887796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-710864
I0729 20:05:23.954888 887796 addons.go:234] Setting addon default-storageclass=true in "addons-710864"
I0729 20:05:23.954933 887796 host.go:66] Checking if "addons-710864" exists ...
I0729 20:05:23.955334 887796 cli_runner.go:164] Run: docker container inspect addons-710864 --format={{.State.Status}}
I0729 20:05:23.972294 887796 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0729 20:05:23.972316 887796 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0729 20:05:23.972382 887796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-710864
I0729 20:05:23.988105 887796 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0729 20:05:23.991913 887796 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0729 20:05:23.994869 887796 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0729 20:05:23.999535 887796 host.go:66] Checking if "addons-710864" exists ...
I0729 20:05:24.005157 887796 out.go:177] - Using image docker.io/registry:2.8.3
I0729 20:05:24.005327 887796 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0729 20:05:24.007568 887796 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
I0729 20:05:24.013534 887796 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
I0729 20:05:24.013562 887796 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I0729 20:05:24.013632 887796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-710864
I0729 20:05:24.014184 887796 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0729 20:05:24.052444 887796 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0729 20:05:24.056806 887796 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0729 20:05:24.058867 887796 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0729 20:05:24.058895 887796 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0729 20:05:24.058972 887796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-710864
I0729 20:05:24.078206 887796 out.go:177] - Using image docker.io/volcanosh/vc-scheduler:v1.9.0
I0729 20:05:24.083897 887796 out.go:177] - Using image docker.io/volcanosh/vc-webhook-manager:v1.9.0
I0729 20:05:24.089152 887796 out.go:177] - Using image docker.io/volcanosh/vc-controller-manager:v1.9.0
I0729 20:05:24.097085 887796 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml
I0729 20:05:24.097166 887796 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (434001 bytes)
I0729 20:05:24.097276 887796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-710864
I0729 20:05:24.119888 887796 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.1
I0729 20:05:24.121224 887796 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-710864"
I0729 20:05:24.121266 887796 host.go:66] Checking if "addons-710864" exists ...
I0729 20:05:24.121676 887796 cli_runner.go:164] Run: docker container inspect addons-710864 --format={{.State.Status}}
I0729 20:05:24.127491 887796 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1
I0729 20:05:24.133677 887796 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1
I0729 20:05:24.133810 887796 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0729 20:05:24.138139 887796 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0729 20:05:24.138182 887796 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I0729 20:05:24.138255 887796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-710864
I0729 20:05:24.152437 887796 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0729 20:05:24.152461 887796 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0729 20:05:24.152536 887796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-710864
I0729 20:05:24.189280 887796 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I0729 20:05:24.194451 887796 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0729 20:05:24.194475 887796 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0729 20:05:24.194548 887796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-710864
I0729 20:05:24.228658 887796 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39084 SSHKeyPath:/home/jenkins/minikube-integration/19345-881398/.minikube/machines/addons-710864/id_rsa Username:docker}
I0729 20:05:24.275400 887796 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39084 SSHKeyPath:/home/jenkins/minikube-integration/19345-881398/.minikube/machines/addons-710864/id_rsa Username:docker}
I0729 20:05:24.278927 887796 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39084 SSHKeyPath:/home/jenkins/minikube-integration/19345-881398/.minikube/machines/addons-710864/id_rsa Username:docker}
I0729 20:05:24.279407 887796 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I0729 20:05:24.282357 887796 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
I0729 20:05:24.282380 887796 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0729 20:05:24.282445 887796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-710864
I0729 20:05:24.285362 887796 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39084 SSHKeyPath:/home/jenkins/minikube-integration/19345-881398/.minikube/machines/addons-710864/id_rsa Username:docker}
I0729 20:05:24.286690 887796 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39084 SSHKeyPath:/home/jenkins/minikube-integration/19345-881398/.minikube/machines/addons-710864/id_rsa Username:docker}
I0729 20:05:24.290753 887796 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39084 SSHKeyPath:/home/jenkins/minikube-integration/19345-881398/.minikube/machines/addons-710864/id_rsa Username:docker}
I0729 20:05:24.293694 887796 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0729 20:05:24.293713 887796 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0729 20:05:24.293774 887796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-710864
I0729 20:05:24.336633 887796 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39084 SSHKeyPath:/home/jenkins/minikube-integration/19345-881398/.minikube/machines/addons-710864/id_rsa Username:docker}
I0729 20:05:24.360660 887796 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0729 20:05:24.361194 887796 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39084 SSHKeyPath:/home/jenkins/minikube-integration/19345-881398/.minikube/machines/addons-710864/id_rsa Username:docker}
I0729 20:05:24.364528 887796 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39084 SSHKeyPath:/home/jenkins/minikube-integration/19345-881398/.minikube/machines/addons-710864/id_rsa Username:docker}
I0729 20:05:24.369490 887796 out.go:177] - Using image docker.io/busybox:stable
I0729 20:05:24.369764 887796 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39084 SSHKeyPath:/home/jenkins/minikube-integration/19345-881398/.minikube/machines/addons-710864/id_rsa Username:docker}
I0729 20:05:24.372665 887796 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0729 20:05:24.372686 887796 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0729 20:05:24.372752 887796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-710864
I0729 20:05:24.374743 887796 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39084 SSHKeyPath:/home/jenkins/minikube-integration/19345-881398/.minikube/machines/addons-710864/id_rsa Username:docker}
W0729 20:05:24.383915 887796 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0729 20:05:24.383945 887796 retry.go:31] will retry after 368.25148ms: ssh: handshake failed: EOF
I0729 20:05:24.408042 887796 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39084 SSHKeyPath:/home/jenkins/minikube-integration/19345-881398/.minikube/machines/addons-710864/id_rsa Username:docker}
I0729 20:05:24.413823 887796 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39084 SSHKeyPath:/home/jenkins/minikube-integration/19345-881398/.minikube/machines/addons-710864/id_rsa Username:docker}
I0729 20:05:24.455565 887796 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39084 SSHKeyPath:/home/jenkins/minikube-integration/19345-881398/.minikube/machines/addons-710864/id_rsa Username:docker}
I0729 20:05:24.795886 887796 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0729 20:05:24.795989 887796 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml": (1.069763699s)
I0729 20:05:24.796312 887796 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0729 20:05:24.950740 887796 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
I0729 20:05:24.950767 887796 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0729 20:05:24.974794 887796 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0729 20:05:24.974821 887796 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0729 20:05:25.000345 887796 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0729 20:05:25.000446 887796 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0729 20:05:25.033107 887796 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0729 20:05:25.051181 887796 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
I0729 20:05:25.051300 887796 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0729 20:05:25.056292 887796 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0729 20:05:25.125540 887796 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0729 20:05:25.141711 887796 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0729 20:05:25.192374 887796 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I0729 20:05:25.192455 887796 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I0729 20:05:25.270199 887796 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0729 20:05:25.270357 887796 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
I0729 20:05:25.283660 887796 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0729 20:05:25.283727 887796 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0729 20:05:25.295088 887796 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0729 20:05:25.309459 887796 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
I0729 20:05:25.309534 887796 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0729 20:05:25.316515 887796 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0729 20:05:25.322634 887796 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0729 20:05:25.322713 887796 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0729 20:05:25.338736 887796 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
I0729 20:05:25.338815 887796 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0729 20:05:25.439100 887796 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0729 20:05:25.439180 887796 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0729 20:05:25.457427 887796 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
I0729 20:05:25.457492 887796 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I0729 20:05:25.581142 887796 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0729 20:05:25.594804 887796 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0729 20:05:25.594881 887796 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0729 20:05:25.600143 887796 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
I0729 20:05:25.600225 887796 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0729 20:05:25.637683 887796 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0729 20:05:25.637761 887796 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0729 20:05:25.717664 887796 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0729 20:05:25.717733 887796 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0729 20:05:25.729976 887796 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I0729 20:05:25.730049 887796 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I0729 20:05:25.819453 887796 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0729 20:05:25.831087 887796 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
I0729 20:05:25.831150 887796 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0729 20:05:25.842903 887796 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0729 20:05:25.842967 887796 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0729 20:05:25.966000 887796 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I0729 20:05:25.966081 887796 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I0729 20:05:26.175229 887796 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0729 20:05:26.175253 887796 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0729 20:05:26.211871 887796 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0729 20:05:26.353957 887796 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0729 20:05:26.354029 887796 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0729 20:05:26.671028 887796 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I0729 20:05:26.671097 887796 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I0729 20:05:26.798432 887796 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0729 20:05:26.798498 887796 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0729 20:05:26.967934 887796 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
I0729 20:05:26.968016 887796 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I0729 20:05:26.975205 887796 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0729 20:05:26.975270 887796 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0729 20:05:27.143308 887796 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0729 20:05:27.143371 887796 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0729 20:05:27.170629 887796 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
I0729 20:05:27.170703 887796 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
I0729 20:05:27.299582 887796 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I0729 20:05:27.306154 887796 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0729 20:05:27.306220 887796 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0729 20:05:27.338062 887796 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0729 20:05:27.421133 887796 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.624768025s)
I0729 20:05:27.421257 887796 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I0729 20:05:27.421226 887796 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (2.625311966s)
I0729 20:05:27.422188 887796 node_ready.go:35] waiting up to 6m0s for node "addons-710864" to be "Ready" ...
I0729 20:05:27.428290 887796 node_ready.go:49] node "addons-710864" has status "Ready":"True"
I0729 20:05:27.428370 887796 node_ready.go:38] duration metric: took 6.162487ms for node "addons-710864" to be "Ready" ...
I0729 20:05:27.428396 887796 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0729 20:05:27.441462 887796 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-28xtg" in "kube-system" namespace to be "Ready" ...
I0729 20:05:27.695145 887796 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0729 20:05:27.695171 887796 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0729 20:05:27.925880 887796 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-710864" context rescaled to 1 replicas
I0729 20:05:27.936713 887796 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0729 20:05:27.936739 887796 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0729 20:05:28.330887 887796 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0729 20:05:28.330911 887796 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0729 20:05:28.688755 887796 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0729 20:05:29.022267 887796 pod_ready.go:97] error getting pod "coredns-7db6d8ff4d-28xtg" in "kube-system" namespace (skipping!): pods "coredns-7db6d8ff4d-28xtg" not found
I0729 20:05:29.022343 887796 pod_ready.go:81] duration metric: took 1.580806369s for pod "coredns-7db6d8ff4d-28xtg" in "kube-system" namespace to be "Ready" ...
E0729 20:05:29.022370 887796 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-7db6d8ff4d-28xtg" in "kube-system" namespace (skipping!): pods "coredns-7db6d8ff4d-28xtg" not found
I0729 20:05:29.022403 887796 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-vjc6z" in "kube-system" namespace to be "Ready" ...
I0729 20:05:29.320287 887796 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (4.287094018s)
I0729 20:05:31.029158 887796 pod_ready.go:102] pod "coredns-7db6d8ff4d-vjc6z" in "kube-system" namespace has status "Ready":"False"
I0729 20:05:31.231473 887796 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0729 20:05:31.231568 887796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-710864
I0729 20:05:31.257494 887796 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39084 SSHKeyPath:/home/jenkins/minikube-integration/19345-881398/.minikube/machines/addons-710864/id_rsa Username:docker}
I0729 20:05:31.703413 887796 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0729 20:05:31.779260 887796 addons.go:234] Setting addon gcp-auth=true in "addons-710864"
I0729 20:05:31.779316 887796 host.go:66] Checking if "addons-710864" exists ...
I0729 20:05:31.779796 887796 cli_runner.go:164] Run: docker container inspect addons-710864 --format={{.State.Status}}
I0729 20:05:31.799059 887796 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0729 20:05:31.799133 887796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-710864
I0729 20:05:31.828018 887796 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39084 SSHKeyPath:/home/jenkins/minikube-integration/19345-881398/.minikube/machines/addons-710864/id_rsa Username:docker}
I0729 20:05:32.604198 887796 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (7.547813504s)
I0729 20:05:32.604280 887796 addons.go:475] Verifying addon ingress=true in "addons-710864"
I0729 20:05:32.604498 887796 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (7.478932192s)
I0729 20:05:32.604780 887796 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (7.462985366s)
I0729 20:05:32.606935 887796 out.go:177] * Verifying ingress addon...
I0729 20:05:32.611105 887796 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0729 20:05:32.618033 887796 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0729 20:05:32.618112 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:33.032659 887796 pod_ready.go:102] pod "coredns-7db6d8ff4d-vjc6z" in "kube-system" namespace has status "Ready":"False"
I0729 20:05:33.159477 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:33.666753 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:34.120777 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:34.309233 887796 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (9.038831779s)
I0729 20:05:34.309381 887796 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (9.039139897s)
I0729 20:05:34.309447 887796 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (9.014297375s)
I0729 20:05:34.309536 887796 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (8.992947729s)
I0729 20:05:34.309740 887796 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (8.728518424s)
I0729 20:05:34.309854 887796 addons.go:475] Verifying addon registry=true in "addons-710864"
I0729 20:05:34.309970 887796 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.490442298s)
I0729 20:05:34.310407 887796 addons.go:475] Verifying addon metrics-server=true in "addons-710864"
I0729 20:05:34.310126 887796 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (8.098188374s)
I0729 20:05:34.310214 887796 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (7.010558192s)
I0729 20:05:34.310308 887796 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (6.972179302s)
W0729 20:05:34.310853 887796 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0729 20:05:34.310886 887796 retry.go:31] will retry after 296.045745ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0729 20:05:34.315005 887796 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-710864 service yakd-dashboard -n yakd-dashboard
I0729 20:05:34.315136 887796 out.go:177] * Verifying registry addon...
I0729 20:05:34.318303 887796 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0729 20:05:34.345842 887796 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0729 20:05:34.345870 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:34.607692 887796 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0729 20:05:34.680173 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:34.824006 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:35.049882 887796 pod_ready.go:102] pod "coredns-7db6d8ff4d-vjc6z" in "kube-system" namespace has status "Ready":"False"
I0729 20:05:35.138846 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:35.335637 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:35.344212 887796 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (6.655409899s)
I0729 20:05:35.344248 887796 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-710864"
I0729 20:05:35.344403 887796 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (3.545316478s)
I0729 20:05:35.353808 887796 out.go:177] * Verifying csi-hostpath-driver addon...
I0729 20:05:35.353880 887796 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1
I0729 20:05:35.373741 887796 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
I0729 20:05:35.374459 887796 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0729 20:05:35.380981 887796 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0729 20:05:35.381005 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:35.382621 887796 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0729 20:05:35.382689 887796 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0729 20:05:35.500882 887796 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0729 20:05:35.500909 887796 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0729 20:05:35.571402 887796 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0729 20:05:35.571465 887796 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I0729 20:05:35.606569 887796 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0729 20:05:35.618688 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:35.822833 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:35.880816 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:36.121204 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:36.325185 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:36.381178 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:36.421325 887796 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.813527236s)
I0729 20:05:36.639272 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:36.648721 887796 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.042068773s)
I0729 20:05:36.651908 887796 addons.go:475] Verifying addon gcp-auth=true in "addons-710864"
I0729 20:05:36.656384 887796 out.go:177] * Verifying gcp-auth addon...
I0729 20:05:36.659627 887796 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0729 20:05:36.662028 887796 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0729 20:05:36.823443 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:36.880092 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:37.121148 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:37.323535 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:37.380386 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:37.529976 887796 pod_ready.go:102] pod "coredns-7db6d8ff4d-vjc6z" in "kube-system" namespace has status "Ready":"False"
I0729 20:05:37.618057 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:37.822842 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:37.883817 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:38.124283 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:38.324228 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:38.382306 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:38.616086 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:38.827618 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:38.921708 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:39.125434 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:39.326641 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:39.380306 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:39.530380 887796 pod_ready.go:102] pod "coredns-7db6d8ff4d-vjc6z" in "kube-system" namespace has status "Ready":"False"
I0729 20:05:39.617287 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:39.823757 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:39.882903 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:40.030137 887796 pod_ready.go:92] pod "coredns-7db6d8ff4d-vjc6z" in "kube-system" namespace has status "Ready":"True"
I0729 20:05:40.030164 887796 pod_ready.go:81] duration metric: took 11.007736063s for pod "coredns-7db6d8ff4d-vjc6z" in "kube-system" namespace to be "Ready" ...
I0729 20:05:40.030176 887796 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-710864" in "kube-system" namespace to be "Ready" ...
I0729 20:05:40.037274 887796 pod_ready.go:92] pod "etcd-addons-710864" in "kube-system" namespace has status "Ready":"True"
I0729 20:05:40.037304 887796 pod_ready.go:81] duration metric: took 7.11985ms for pod "etcd-addons-710864" in "kube-system" namespace to be "Ready" ...
I0729 20:05:40.037320 887796 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-710864" in "kube-system" namespace to be "Ready" ...
I0729 20:05:40.044458 887796 pod_ready.go:92] pod "kube-apiserver-addons-710864" in "kube-system" namespace has status "Ready":"True"
I0729 20:05:40.044500 887796 pod_ready.go:81] duration metric: took 7.16035ms for pod "kube-apiserver-addons-710864" in "kube-system" namespace to be "Ready" ...
I0729 20:05:40.044512 887796 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-710864" in "kube-system" namespace to be "Ready" ...
I0729 20:05:40.050270 887796 pod_ready.go:92] pod "kube-controller-manager-addons-710864" in "kube-system" namespace has status "Ready":"True"
I0729 20:05:40.050298 887796 pod_ready.go:81] duration metric: took 5.777939ms for pod "kube-controller-manager-addons-710864" in "kube-system" namespace to be "Ready" ...
I0729 20:05:40.050309 887796 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-msdff" in "kube-system" namespace to be "Ready" ...
I0729 20:05:40.055723 887796 pod_ready.go:92] pod "kube-proxy-msdff" in "kube-system" namespace has status "Ready":"True"
I0729 20:05:40.055751 887796 pod_ready.go:81] duration metric: took 5.435204ms for pod "kube-proxy-msdff" in "kube-system" namespace to be "Ready" ...
I0729 20:05:40.055770 887796 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-710864" in "kube-system" namespace to be "Ready" ...
I0729 20:05:40.116876 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:40.323598 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:40.381133 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:40.426705 887796 pod_ready.go:92] pod "kube-scheduler-addons-710864" in "kube-system" namespace has status "Ready":"True"
I0729 20:05:40.426740 887796 pod_ready.go:81] duration metric: took 370.955609ms for pod "kube-scheduler-addons-710864" in "kube-system" namespace to be "Ready" ...
I0729 20:05:40.426755 887796 pod_ready.go:78] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-9bqzf" in "kube-system" namespace to be "Ready" ...
I0729 20:05:40.616965 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:40.826023 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:40.880664 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:41.121311 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:41.323701 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:41.382053 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:41.617742 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:41.823164 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:41.880381 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:42.131112 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:42.323350 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:42.380776 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:42.433859 887796 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-9bqzf" in "kube-system" namespace has status "Ready":"False"
I0729 20:05:42.617478 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:42.824944 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:42.881273 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:43.124219 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:43.324260 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:43.381401 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:43.617469 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:43.826450 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:43.883499 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:44.122817 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:44.325144 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:44.383093 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:44.618762 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:44.823008 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:44.881048 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:44.934183 887796 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-9bqzf" in "kube-system" namespace has status "Ready":"False"
I0729 20:05:45.133514 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:45.325776 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:45.381686 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:45.620075 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:45.824225 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:45.880592 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:46.120122 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:46.326557 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:46.380273 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:46.616557 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:46.823360 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:46.881311 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:47.121012 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:47.324153 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:47.381820 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:47.435742 887796 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-9bqzf" in "kube-system" namespace has status "Ready":"False"
I0729 20:05:47.618776 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:47.826902 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:47.880863 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:47.932597 887796 pod_ready.go:92] pod "nvidia-device-plugin-daemonset-9bqzf" in "kube-system" namespace has status "Ready":"True"
I0729 20:05:47.932625 887796 pod_ready.go:81] duration metric: took 7.505861342s for pod "nvidia-device-plugin-daemonset-9bqzf" in "kube-system" namespace to be "Ready" ...
I0729 20:05:47.932634 887796 pod_ready.go:38] duration metric: took 20.504196708s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0729 20:05:47.932650 887796 api_server.go:52] waiting for apiserver process to appear ...
I0729 20:05:47.932713 887796 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0729 20:05:47.949583 887796 api_server.go:72] duration metric: took 24.223481126s to wait for apiserver process to appear ...
I0729 20:05:47.949609 887796 api_server.go:88] waiting for apiserver healthz status ...
I0729 20:05:47.949633 887796 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I0729 20:05:47.957828 887796 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I0729 20:05:47.959017 887796 api_server.go:141] control plane version: v1.30.3
I0729 20:05:47.959044 887796 api_server.go:131] duration metric: took 9.427738ms to wait for apiserver health ...
I0729 20:05:47.959053 887796 system_pods.go:43] waiting for kube-system pods to appear ...
I0729 20:05:47.973477 887796 system_pods.go:59] 18 kube-system pods found
I0729 20:05:47.973527 887796 system_pods.go:61] "coredns-7db6d8ff4d-vjc6z" [56636536-ef2f-4c0f-bbc2-3f2c88a05199] Running
I0729 20:05:47.973537 887796 system_pods.go:61] "csi-hostpath-attacher-0" [4dce8bc4-10ed-48d0-922c-167202dea24d] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0729 20:05:47.973545 887796 system_pods.go:61] "csi-hostpath-resizer-0" [166a68a7-abe6-4f86-89aa-6cd43b1c4b90] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0729 20:05:47.973557 887796 system_pods.go:61] "csi-hostpathplugin-fdnsh" [c616f967-78f8-41b8-8de8-30d11a1db61e] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0729 20:05:47.973563 887796 system_pods.go:61] "etcd-addons-710864" [482805b8-ff51-489b-8e00-da097ee19c41] Running
I0729 20:05:47.973568 887796 system_pods.go:61] "kindnet-f8djz" [9220350d-6394-4df9-8010-1422f1d40e50] Running
I0729 20:05:47.973572 887796 system_pods.go:61] "kube-apiserver-addons-710864" [7e46e2a7-d17c-4543-958b-8db0ac4a5eb3] Running
I0729 20:05:47.973576 887796 system_pods.go:61] "kube-controller-manager-addons-710864" [69dc30e4-ec0a-453c-b4de-fb98bb713e5c] Running
I0729 20:05:47.973588 887796 system_pods.go:61] "kube-ingress-dns-minikube" [2e0003f4-0721-4f36-a8ac-6a343974a279] Running
I0729 20:05:47.973591 887796 system_pods.go:61] "kube-proxy-msdff" [1eabbf9a-3876-4ff7-928f-e970fdd836da] Running
I0729 20:05:47.973595 887796 system_pods.go:61] "kube-scheduler-addons-710864" [ba0737cf-4813-430d-9f83-7f24f8d8669f] Running
I0729 20:05:47.973601 887796 system_pods.go:61] "metrics-server-c59844bb4-s2g9l" [b3bf93b5-5e3a-49b3-85af-23c295a7e601] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0729 20:05:47.973609 887796 system_pods.go:61] "nvidia-device-plugin-daemonset-9bqzf" [e42a63f1-d74e-4bf6-bccc-a31c0ba49b6c] Running
I0729 20:05:47.973616 887796 system_pods.go:61] "registry-656c9c8d9c-svczd" [0df954b7-27d2-43e3-9c9a-b736caf4f418] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0729 20:05:47.973627 887796 system_pods.go:61] "registry-proxy-nvsv2" [e1d2e888-af66-470c-b5ca-19631b639559] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0729 20:05:47.973635 887796 system_pods.go:61] "snapshot-controller-745499f584-66czj" [46a6d8f3-c6b6-4d2f-ad5c-a0b27ecdaffe] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0729 20:05:47.973647 887796 system_pods.go:61] "snapshot-controller-745499f584-ftr8n" [80d32bb9-d882-45ab-8ff4-6b94dc32fd79] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0729 20:05:47.973651 887796 system_pods.go:61] "storage-provisioner" [86661a50-f634-4099-b289-75259c3003ba] Running
I0729 20:05:47.973658 887796 system_pods.go:74] duration metric: took 14.59827ms to wait for pod list to return data ...
I0729 20:05:47.973676 887796 default_sa.go:34] waiting for default service account to be created ...
I0729 20:05:47.976093 887796 default_sa.go:45] found service account: "default"
I0729 20:05:47.976118 887796 default_sa.go:55] duration metric: took 2.435683ms for default service account to be created ...
I0729 20:05:47.976128 887796 system_pods.go:116] waiting for k8s-apps to be running ...
I0729 20:05:47.986167 887796 system_pods.go:86] 18 kube-system pods found
I0729 20:05:47.986206 887796 system_pods.go:89] "coredns-7db6d8ff4d-vjc6z" [56636536-ef2f-4c0f-bbc2-3f2c88a05199] Running
I0729 20:05:47.986216 887796 system_pods.go:89] "csi-hostpath-attacher-0" [4dce8bc4-10ed-48d0-922c-167202dea24d] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0729 20:05:47.986252 887796 system_pods.go:89] "csi-hostpath-resizer-0" [166a68a7-abe6-4f86-89aa-6cd43b1c4b90] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0729 20:05:47.986270 887796 system_pods.go:89] "csi-hostpathplugin-fdnsh" [c616f967-78f8-41b8-8de8-30d11a1db61e] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0729 20:05:47.986276 887796 system_pods.go:89] "etcd-addons-710864" [482805b8-ff51-489b-8e00-da097ee19c41] Running
I0729 20:05:47.986281 887796 system_pods.go:89] "kindnet-f8djz" [9220350d-6394-4df9-8010-1422f1d40e50] Running
I0729 20:05:47.986293 887796 system_pods.go:89] "kube-apiserver-addons-710864" [7e46e2a7-d17c-4543-958b-8db0ac4a5eb3] Running
I0729 20:05:47.986298 887796 system_pods.go:89] "kube-controller-manager-addons-710864" [69dc30e4-ec0a-453c-b4de-fb98bb713e5c] Running
I0729 20:05:47.986303 887796 system_pods.go:89] "kube-ingress-dns-minikube" [2e0003f4-0721-4f36-a8ac-6a343974a279] Running
I0729 20:05:47.986307 887796 system_pods.go:89] "kube-proxy-msdff" [1eabbf9a-3876-4ff7-928f-e970fdd836da] Running
I0729 20:05:47.986322 887796 system_pods.go:89] "kube-scheduler-addons-710864" [ba0737cf-4813-430d-9f83-7f24f8d8669f] Running
I0729 20:05:47.986331 887796 system_pods.go:89] "metrics-server-c59844bb4-s2g9l" [b3bf93b5-5e3a-49b3-85af-23c295a7e601] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0729 20:05:47.986336 887796 system_pods.go:89] "nvidia-device-plugin-daemonset-9bqzf" [e42a63f1-d74e-4bf6-bccc-a31c0ba49b6c] Running
I0729 20:05:47.986343 887796 system_pods.go:89] "registry-656c9c8d9c-svczd" [0df954b7-27d2-43e3-9c9a-b736caf4f418] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0729 20:05:47.986352 887796 system_pods.go:89] "registry-proxy-nvsv2" [e1d2e888-af66-470c-b5ca-19631b639559] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0729 20:05:47.986359 887796 system_pods.go:89] "snapshot-controller-745499f584-66czj" [46a6d8f3-c6b6-4d2f-ad5c-a0b27ecdaffe] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0729 20:05:47.986371 887796 system_pods.go:89] "snapshot-controller-745499f584-ftr8n" [80d32bb9-d882-45ab-8ff4-6b94dc32fd79] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0729 20:05:47.986380 887796 system_pods.go:89] "storage-provisioner" [86661a50-f634-4099-b289-75259c3003ba] Running
I0729 20:05:47.986387 887796 system_pods.go:126] duration metric: took 10.25354ms to wait for k8s-apps to be running ...
I0729 20:05:47.986401 887796 system_svc.go:44] waiting for kubelet service to be running ....
I0729 20:05:47.986462 887796 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0729 20:05:48.000100 887796 system_svc.go:56] duration metric: took 13.685823ms WaitForService to wait for kubelet
I0729 20:05:48.000143 887796 kubeadm.go:582] duration metric: took 24.274044977s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0729 20:05:48.000167 887796 node_conditions.go:102] verifying NodePressure condition ...
I0729 20:05:48.005690 887796 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0729 20:05:48.005734 887796 node_conditions.go:123] node cpu capacity is 2
I0729 20:05:48.005749 887796 node_conditions.go:105] duration metric: took 5.576258ms to run NodePressure ...
I0729 20:05:48.005765 887796 start.go:241] waiting for startup goroutines ...
I0729 20:05:48.119999 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:48.323426 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:48.381534 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:48.616863 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:48.823425 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:48.880647 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:49.119994 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:49.323423 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:49.379992 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:49.617799 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:49.824107 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:49.882112 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:50.120286 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:50.327229 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:50.380877 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:50.615971 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:50.824124 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:50.883497 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:51.121093 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:51.324131 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:51.380127 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:51.616629 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:51.823133 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:51.881072 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:52.120523 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:52.323886 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:52.381704 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:52.617450 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:52.835835 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:52.901326 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:53.120265 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:53.323265 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:53.380456 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:53.615500 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:53.823486 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:53.879657 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:54.119358 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:54.324068 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:54.381190 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:54.620204 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:54.822947 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:54.881253 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:55.121117 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:55.323537 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:55.389202 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:55.615245 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:55.823517 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:55.880485 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:56.119640 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:56.323023 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:56.380600 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:56.616151 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:56.825600 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:56.886434 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:57.132360 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:57.332005 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:57.381599 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:57.615615 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:57.824998 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:57.881099 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:58.119615 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:58.323896 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:58.380433 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:58.618540 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:58.823820 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:58.880823 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:59.120280 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:59.323816 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:59.383678 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:05:59.616869 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:05:59.828451 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:05:59.892521 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:00.116681 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:00.328541 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:06:00.381150 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:00.615269 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:00.824127 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:06:00.888530 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:01.120891 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:01.325954 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:06:01.380783 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:01.619525 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:01.823307 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:06:01.880736 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:02.123662 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:02.323420 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:06:02.380444 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:02.616597 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:02.823318 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:06:02.879991 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:03.121663 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:03.324522 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:06:03.383279 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:03.617111 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:03.824838 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:06:03.881618 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:04.116741 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:04.323303 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:06:04.380097 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:04.616589 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:04.823601 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:06:04.881019 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:05.121189 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:05.324811 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:06:05.381272 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:05.616096 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:05.823424 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:06:05.880199 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:06.119874 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:06.323151 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:06:06.380298 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:06.616083 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:06.823602 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0729 20:06:06.882533 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:07.120300 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:07.323737 887796 kapi.go:107] duration metric: took 33.005430811s to wait for kubernetes.io/minikube-addons=registry ...
I0729 20:06:07.380245 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:07.616211 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:07.880288 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:08.119676 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:08.380611 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:08.615851 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:08.880023 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:09.123684 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:09.380888 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:09.616469 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:09.880843 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:10.120559 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:10.380682 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:10.615864 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:10.892901 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:11.127475 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:11.380748 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:11.616430 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:11.882116 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:12.118684 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:12.380262 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:12.616344 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:12.880790 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:13.118963 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:13.380109 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:13.617037 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:13.880472 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:14.116467 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:14.389047 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:14.616214 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:14.880746 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:15.121323 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:15.381923 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:15.615666 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:15.880146 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:16.120304 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:16.380091 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:16.615697 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:16.883376 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:17.122413 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:17.379911 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:17.615439 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:17.880576 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:18.119979 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:18.380243 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:18.615426 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:18.882562 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:19.117828 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:19.391620 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:19.616060 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:19.881398 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:20.120861 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:20.381274 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:20.616262 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:20.879703 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:21.121274 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:21.385406 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:21.616114 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:21.880712 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:22.120118 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:22.380757 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:22.618416 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:22.880446 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:23.119743 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:23.380432 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:23.616501 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:23.880308 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:24.120177 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:24.380309 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:24.615895 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:24.880001 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:25.120613 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:25.380522 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:25.615649 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:25.883485 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:26.119492 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:26.380538 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:26.616416 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:26.879605 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:27.121134 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:27.381197 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:27.616432 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:27.880388 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0729 20:06:28.115421 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:28.380302 887796 kapi.go:107] duration metric: took 53.005839726s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0729 20:06:28.615551 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:29.118896 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:29.615752 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:30.120922 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:30.615731 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:31.120442 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:31.615108 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:32.120608 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:32.615526 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:33.115629 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:33.616076 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:34.120806 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:34.615911 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:35.120710 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:35.616012 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:36.120256 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:36.615518 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:37.119734 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:37.616107 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:38.120219 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:38.615656 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:39.124612 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:39.616639 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:40.122795 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:40.616569 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:41.118959 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:41.620815 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:42.120989 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:42.616175 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:43.119966 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:43.616231 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:44.119473 887796 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0729 20:06:44.616167 887796 kapi.go:107] duration metric: took 1m12.005060123s to wait for app.kubernetes.io/name=ingress-nginx ...
I0729 20:06:58.663350 887796 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0729 20:06:58.663379 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0729 20:06:59.162842 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0729 20:06:59.663859 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0729 20:07:00.179358 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0729 20:07:00.663239 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0729 20:07:01.163290 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0729 20:07:01.663137 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0729 20:07:02.164593 887796 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0729 20:07:02.663486 887796 kapi.go:107] duration metric: took 1m26.003860684s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0729 20:07:02.665881 887796 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-710864 cluster.
I0729 20:07:02.668311 887796 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0729 20:07:02.670670 887796 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0729 20:07:02.673518 887796 out.go:177] * Enabled addons: storage-provisioner, ingress-dns, default-storageclass, volcano, nvidia-device-plugin, cloud-spanner, metrics-server, inspektor-gadget, yakd, storage-provisioner-rancher, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth
I0729 20:07:02.675856 887796 addons.go:510] duration metric: took 1m38.949447212s for enable addons: enabled=[storage-provisioner ingress-dns default-storageclass volcano nvidia-device-plugin cloud-spanner metrics-server inspektor-gadget yakd storage-provisioner-rancher volumesnapshots registry csi-hostpath-driver ingress gcp-auth]
I0729 20:07:02.675906 887796 start.go:246] waiting for cluster config update ...
I0729 20:07:02.675926 887796 start.go:255] writing updated cluster config ...
I0729 20:07:02.676216 887796 ssh_runner.go:195] Run: rm -f paused
I0729 20:07:03.067361 887796 start.go:600] kubectl: 1.30.3, cluster: 1.30.3 (minor skew: 0)
I0729 20:07:03.069902 887796 out.go:177] * Done! kubectl is now configured to use "addons-710864" cluster and "default" namespace by default
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
d30536810d22a d1ca868ab82aa About a minute ago Exited gadget 5 c3908ca6755f3 gadget-bx6st
d471aa5a40405 6ef582f3ec844 3 minutes ago Running gcp-auth 0 1ae4d1097289c gcp-auth-5db96cd9b4-t8qxw
cc3957086ad4f 24f8f979639f1 3 minutes ago Running controller 0 8570c4bd80796 ingress-nginx-controller-6d9bd977d4-955pf
e97e5ebe632da ee6d597e62dc8 3 minutes ago Running csi-snapshotter 0 86f11e1b0e8c0 csi-hostpathplugin-fdnsh
8f71252181231 642ded511e141 3 minutes ago Running csi-provisioner 0 86f11e1b0e8c0 csi-hostpathplugin-fdnsh
eac3ae910d2b9 922312104da8a 3 minutes ago Running liveness-probe 0 86f11e1b0e8c0 csi-hostpathplugin-fdnsh
6064a67040789 08f6b2990811a 3 minutes ago Running hostpath 0 86f11e1b0e8c0 csi-hostpathplugin-fdnsh
91d67b40737d9 0107d56dbc0be 4 minutes ago Running node-driver-registrar 0 86f11e1b0e8c0 csi-hostpathplugin-fdnsh
f22231aad38e0 8b46b1cd48760 4 minutes ago Running admission 0 bacc0b728380a volcano-admission-5f7844f7bc-c4gwm
a95f9c781315d 487fa743e1e22 4 minutes ago Running csi-resizer 0 c3eef010908ec csi-hostpath-resizer-0
078aec3f4aa54 d9c7ad4c226bf 4 minutes ago Running volcano-scheduler 0 c5b00e2bdf9bc volcano-scheduler-844f6db89b-rnl9q
a4ad3a730cbbd 296b5f799fcd8 4 minutes ago Exited patch 0 d1c1cfcae56a0 ingress-nginx-admission-patch-t4pk6
089fae5307c8b 9a80d518f102c 4 minutes ago Running csi-attacher 0 2a1956adbfdb1 csi-hostpath-attacher-0
d737f631c50fd 1505f556b3a7b 4 minutes ago Running volcano-controllers 0 e182db94141af volcano-controllers-59cb4746db-gb4lm
6e31117df2a72 296b5f799fcd8 4 minutes ago Exited create 0 d31d92262b599 ingress-nginx-admission-create-lvzhq
c11c0a6b5b8cb 4d1e5c3e97420 4 minutes ago Running volume-snapshot-controller 0 7addf9a7a70bc snapshot-controller-745499f584-66czj
ba8e43377cc68 1461903ec4fe9 4 minutes ago Running csi-external-health-monitor-controller 0 86f11e1b0e8c0 csi-hostpathplugin-fdnsh
42ce59f82507f 4d1e5c3e97420 4 minutes ago Running volume-snapshot-controller 0 968f7e8bae8bb snapshot-controller-745499f584-ftr8n
b2a621bcef23c 3410e1561990a 4 minutes ago Running registry-proxy 0 7b1470cfbc576 registry-proxy-nvsv2
30d7f0d8a905c 95dccb4df54ab 4 minutes ago Running metrics-server 0 d9b46661d6d41 metrics-server-c59844bb4-s2g9l
ad9b9d5e2ca45 77bdba588b953 4 minutes ago Running yakd 0 a31906b7a8aa9 yakd-dashboard-799879c74f-5wmch
d3f9837498774 7ce2150c8929b 4 minutes ago Running local-path-provisioner 0 8bf15a5af3d52 local-path-provisioner-8d985888d-f2flv
6381687db59fa 40bd730847e7e 4 minutes ago Running registry 0 ac916959ba27e registry-656c9c8d9c-svczd
f4fb36c38b930 53af6e2c4c343 4 minutes ago Running cloud-spanner-emulator 0 d833792e32325 cloud-spanner-emulator-5455fb9b69-p4cjh
3dcc8166b3c9e b644f4c9bf9c7 4 minutes ago Running nvidia-device-plugin-ctr 0 0e929d490cabb nvidia-device-plugin-daemonset-9bqzf
686f0828afff2 2437cf7621777 4 minutes ago Running coredns 0 9253a54f60497 coredns-7db6d8ff4d-vjc6z
1121edd102870 35508c2f890c4 4 minutes ago Running minikube-ingress-dns 0 28614b9887c7e kube-ingress-dns-minikube
15342d26df0c2 ba04bb24b9575 4 minutes ago Running storage-provisioner 0 6860a1e843591 storage-provisioner
0dabe203af354 f42786f8afd22 4 minutes ago Running kindnet-cni 0 95a79b90cf1d7 kindnet-f8djz
c587c0c8399de 2351f570ed0ea 4 minutes ago Running kube-proxy 0 20175951a6e7e kube-proxy-msdff
ef6f50d7545db 014faa467e297 5 minutes ago Running etcd 0 a6193b38de94a etcd-addons-710864
38fa4d212bf64 8e97cdb19e7cc 5 minutes ago Running kube-controller-manager 0 f168b0e9e9488 kube-controller-manager-addons-710864
b373c2f90cbc1 61773190d42ff 5 minutes ago Running kube-apiserver 0 4954e2a16dd33 kube-apiserver-addons-710864
2de1384672a2a d48f992a22722 5 minutes ago Running kube-scheduler 0 c4a1963961269 kube-scheduler-addons-710864
==> containerd <==
Jul 29 20:08:09 addons-710864 containerd[817]: time="2024-07-29T20:08:09.496763169Z" level=info msg="StopPodSandbox for \"9c5dfa56105749601f57f427bde5676e7e9f757e7167d05c1a4d3e2533ef3742\""
Jul 29 20:08:09 addons-710864 containerd[817]: time="2024-07-29T20:08:09.513228280Z" level=info msg="TearDown network for sandbox \"9c5dfa56105749601f57f427bde5676e7e9f757e7167d05c1a4d3e2533ef3742\" successfully"
Jul 29 20:08:09 addons-710864 containerd[817]: time="2024-07-29T20:08:09.513272013Z" level=info msg="StopPodSandbox for \"9c5dfa56105749601f57f427bde5676e7e9f757e7167d05c1a4d3e2533ef3742\" returns successfully"
Jul 29 20:08:09 addons-710864 containerd[817]: time="2024-07-29T20:08:09.513734329Z" level=info msg="RemovePodSandbox for \"9c5dfa56105749601f57f427bde5676e7e9f757e7167d05c1a4d3e2533ef3742\""
Jul 29 20:08:09 addons-710864 containerd[817]: time="2024-07-29T20:08:09.513844704Z" level=info msg="Forcibly stopping sandbox \"9c5dfa56105749601f57f427bde5676e7e9f757e7167d05c1a4d3e2533ef3742\""
Jul 29 20:08:09 addons-710864 containerd[817]: time="2024-07-29T20:08:09.525796691Z" level=info msg="TearDown network for sandbox \"9c5dfa56105749601f57f427bde5676e7e9f757e7167d05c1a4d3e2533ef3742\" successfully"
Jul 29 20:08:09 addons-710864 containerd[817]: time="2024-07-29T20:08:09.533724144Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"9c5dfa56105749601f57f427bde5676e7e9f757e7167d05c1a4d3e2533ef3742\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus."
Jul 29 20:08:09 addons-710864 containerd[817]: time="2024-07-29T20:08:09.534040352Z" level=info msg="RemovePodSandbox \"9c5dfa56105749601f57f427bde5676e7e9f757e7167d05c1a4d3e2533ef3742\" returns successfully"
Jul 29 20:09:00 addons-710864 containerd[817]: time="2024-07-29T20:09:00.374848700Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.30.0@sha256:bda802dd37a41ba160bf10134538fd1a1ce05efcc14ab4c38b5f6b1e6dccd734\""
Jul 29 20:09:00 addons-710864 containerd[817]: time="2024-07-29T20:09:00.519467134Z" level=info msg="ImageUpdate event name:\"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:bda802dd37a41ba160bf10134538fd1a1ce05efcc14ab4c38b5f6b1e6dccd734\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}"
Jul 29 20:09:00 addons-710864 containerd[817]: time="2024-07-29T20:09:00.521464008Z" level=info msg="stop pulling image ghcr.io/inspektor-gadget/inspektor-gadget@sha256:bda802dd37a41ba160bf10134538fd1a1ce05efcc14ab4c38b5f6b1e6dccd734: active requests=0, bytes read=89"
Jul 29 20:09:00 addons-710864 containerd[817]: time="2024-07-29T20:09:00.525611832Z" level=info msg="Pulled image \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.30.0@sha256:bda802dd37a41ba160bf10134538fd1a1ce05efcc14ab4c38b5f6b1e6dccd734\" with image id \"sha256:d1ca868ab82aa865a5f7b689c320359f3e31172de7b93dd0107fe2e49e617eeb\", repo tag \"\", repo digest \"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:bda802dd37a41ba160bf10134538fd1a1ce05efcc14ab4c38b5f6b1e6dccd734\", size \"73046218\" in 150.689164ms"
Jul 29 20:09:00 addons-710864 containerd[817]: time="2024-07-29T20:09:00.525678277Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.30.0@sha256:bda802dd37a41ba160bf10134538fd1a1ce05efcc14ab4c38b5f6b1e6dccd734\" returns image reference \"sha256:d1ca868ab82aa865a5f7b689c320359f3e31172de7b93dd0107fe2e49e617eeb\""
Jul 29 20:09:00 addons-710864 containerd[817]: time="2024-07-29T20:09:00.528373020Z" level=info msg="CreateContainer within sandbox \"c3908ca6755f31aacc48cd5487f6d0b1106f485ab6418de3bd265077b1af1fc4\" for container &ContainerMetadata{Name:gadget,Attempt:5,}"
Jul 29 20:09:00 addons-710864 containerd[817]: time="2024-07-29T20:09:00.554470134Z" level=info msg="CreateContainer within sandbox \"c3908ca6755f31aacc48cd5487f6d0b1106f485ab6418de3bd265077b1af1fc4\" for &ContainerMetadata{Name:gadget,Attempt:5,} returns container id \"d30536810d22ac00bfdb63f26c28fd613e2d5e322b227be9db0c268e5f859a73\""
Jul 29 20:09:00 addons-710864 containerd[817]: time="2024-07-29T20:09:00.555249963Z" level=info msg="StartContainer for \"d30536810d22ac00bfdb63f26c28fd613e2d5e322b227be9db0c268e5f859a73\""
Jul 29 20:09:00 addons-710864 containerd[817]: time="2024-07-29T20:09:00.615211408Z" level=info msg="StartContainer for \"d30536810d22ac00bfdb63f26c28fd613e2d5e322b227be9db0c268e5f859a73\" returns successfully"
Jul 29 20:09:01 addons-710864 containerd[817]: time="2024-07-29T20:09:01.658114467Z" level=error msg="ExecSync for \"d30536810d22ac00bfdb63f26c28fd613e2d5e322b227be9db0c268e5f859a73\" failed" error="failed to exec in container: failed to start exec \"3069327c5679a417d3857fa23be4e8481e7cac7a08dc7e425255d3884a0ea3e8\": OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown"
Jul 29 20:09:01 addons-710864 containerd[817]: time="2024-07-29T20:09:01.669204714Z" level=error msg="ExecSync for \"d30536810d22ac00bfdb63f26c28fd613e2d5e322b227be9db0c268e5f859a73\" failed" error="failed to exec in container: failed to start exec \"0578ebe6d74dd1890e19dd81a4f435d5ce6474d54b03897f6c8faca9e34d18ee\": OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown"
Jul 29 20:09:01 addons-710864 containerd[817]: time="2024-07-29T20:09:01.685624729Z" level=error msg="ExecSync for \"d30536810d22ac00bfdb63f26c28fd613e2d5e322b227be9db0c268e5f859a73\" failed" error="failed to exec in container: failed to start exec \"dbc526fdb74f83aa4657b62e0d13757ae2e1c570c39b02a34351b3a4d849ec00\": OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown"
Jul 29 20:09:01 addons-710864 containerd[817]: time="2024-07-29T20:09:01.822710269Z" level=info msg="shim disconnected" id=d30536810d22ac00bfdb63f26c28fd613e2d5e322b227be9db0c268e5f859a73 namespace=k8s.io
Jul 29 20:09:01 addons-710864 containerd[817]: time="2024-07-29T20:09:01.822772316Z" level=warning msg="cleaning up after shim disconnected" id=d30536810d22ac00bfdb63f26c28fd613e2d5e322b227be9db0c268e5f859a73 namespace=k8s.io
Jul 29 20:09:01 addons-710864 containerd[817]: time="2024-07-29T20:09:01.822925678Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Jul 29 20:09:02 addons-710864 containerd[817]: time="2024-07-29T20:09:02.617370404Z" level=info msg="RemoveContainer for \"833a10063a1701270299d2781655b31349198202efd3352dfedc00367f06f283\""
Jul 29 20:09:02 addons-710864 containerd[817]: time="2024-07-29T20:09:02.624577811Z" level=info msg="RemoveContainer for \"833a10063a1701270299d2781655b31349198202efd3352dfedc00367f06f283\" returns successfully"
==> coredns [686f0828afff210d4a61163b8f8f83625d04870e8a4fc9dfb1f0df9a1695fe9f] <==
[INFO] 10.244.0.9:55294 - 49836 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000169533s
[INFO] 10.244.0.9:44322 - 61759 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002724019s
[INFO] 10.244.0.9:44322 - 10552 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.003281801s
[INFO] 10.244.0.9:37473 - 25150 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000121452s
[INFO] 10.244.0.9:37473 - 10045 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000239458s
[INFO] 10.244.0.9:54855 - 27736 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000104082s
[INFO] 10.244.0.9:54855 - 58451 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000074683s
[INFO] 10.244.0.9:41938 - 12743 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000076718s
[INFO] 10.244.0.9:41938 - 48069 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000084406s
[INFO] 10.244.0.9:54662 - 29248 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000146453s
[INFO] 10.244.0.9:54662 - 2630 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.00005476s
[INFO] 10.244.0.9:56118 - 28820 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001273874s
[INFO] 10.244.0.9:56118 - 38298 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001436959s
[INFO] 10.244.0.9:33499 - 19131 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.00008361s
[INFO] 10.244.0.9:33499 - 3260 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000058839s
[INFO] 10.244.0.24:35952 - 54571 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.002907583s
[INFO] 10.244.0.24:32993 - 27866 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.00018075s
[INFO] 10.244.0.24:59272 - 18848 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000109333s
[INFO] 10.244.0.24:45154 - 9913 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000296171s
[INFO] 10.244.0.24:51870 - 42002 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000097797s
[INFO] 10.244.0.24:53581 - 22641 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000073247s
[INFO] 10.244.0.24:48032 - 38284 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002261235s
[INFO] 10.244.0.24:60872 - 17492 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.00237581s
[INFO] 10.244.0.24:56575 - 17093 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.000868928s
[INFO] 10.244.0.24:50177 - 26677 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 534 0.000898926s
==> describe nodes <==
Name: addons-710864
Roles: control-plane
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=addons-710864
kubernetes.io/os=linux
minikube.k8s.io/commit=8b24aa06450b07a59980f53ae4b9b78f9c5a1899
minikube.k8s.io/name=addons-710864
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_07_29T20_05_10_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-710864
Annotations: csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-710864"}
kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Mon, 29 Jul 2024 20:05:06 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-710864
AcquireTime: <unset>
RenewTime: Mon, 29 Jul 2024 20:10:15 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Mon, 29 Jul 2024 20:07:12 +0000 Mon, 29 Jul 2024 20:05:04 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Mon, 29 Jul 2024 20:07:12 +0000 Mon, 29 Jul 2024 20:05:04 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Mon, 29 Jul 2024 20:07:12 +0000 Mon, 29 Jul 2024 20:05:04 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Mon, 29 Jul 2024 20:07:12 +0000 Mon, 29 Jul 2024 20:05:09 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-710864
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022364Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022364Ki
pods: 110
System Info:
Machine ID: d30c843108894ff2a3db9585b81353d5
System UUID: ebc9280b-b241-4e9f-b15f-c1d7c7ad0d69
Boot ID: 9d805461-0494-4168-a7a3-1fdbd78d16da
Kernel Version: 5.15.0-1065-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.19
Kubelet Version: v1.30.3
Kube-Proxy Version: v1.30.3
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (27 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default cloud-spanner-emulator-5455fb9b69-p4cjh 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m54s
gadget gadget-bx6st 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m51s
gcp-auth gcp-auth-5db96cd9b4-t8qxw 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 3m23s
ingress-nginx ingress-nginx-controller-6d9bd977d4-955pf 100m (5%!)(MISSING) 0 (0%!)(MISSING) 90Mi (1%!)(MISSING) 0 (0%!)(MISSING) 4m49s
kube-system coredns-7db6d8ff4d-vjc6z 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 4m58s
kube-system csi-hostpath-attacher-0 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m46s
kube-system csi-hostpath-resizer-0 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m46s
kube-system csi-hostpathplugin-fdnsh 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m46s
kube-system etcd-addons-710864 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 5m12s
kube-system kindnet-f8djz 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (0%!)(MISSING) 50Mi (0%!)(MISSING) 4m58s
kube-system kube-apiserver-addons-710864 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m12s
kube-system kube-controller-manager-addons-710864 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m12s
kube-system kube-ingress-dns-minikube 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m53s
kube-system kube-proxy-msdff 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m58s
kube-system kube-scheduler-addons-710864 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m12s
kube-system metrics-server-c59844bb4-s2g9l 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 4m52s
kube-system nvidia-device-plugin-daemonset-9bqzf 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m55s
kube-system registry-656c9c8d9c-svczd 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m53s
kube-system registry-proxy-nvsv2 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m53s
kube-system snapshot-controller-745499f584-66czj 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m50s
kube-system snapshot-controller-745499f584-ftr8n 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m50s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m52s
local-path-storage local-path-provisioner-8d985888d-f2flv 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m53s
volcano-system volcano-admission-5f7844f7bc-c4gwm 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m49s
volcano-system volcano-controllers-59cb4746db-gb4lm 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m48s
volcano-system volcano-scheduler-844f6db89b-rnl9q 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m48s
yakd-dashboard yakd-dashboard-799879c74f-5wmch 0 (0%!)(MISSING) 0 (0%!)(MISSING) 128Mi (1%!)(MISSING) 256Mi (3%!)(MISSING) 4m52s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 1050m (52%!)(MISSING) 100m (5%!)(MISSING)
memory 638Mi (8%!)(MISSING) 476Mi (6%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 4m56s kube-proxy
Normal NodeHasSufficientMemory 5m19s (x8 over 5m19s) kubelet Node addons-710864 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m19s (x8 over 5m19s) kubelet Node addons-710864 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m19s (x7 over 5m19s) kubelet Node addons-710864 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 5m19s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 5m12s kubelet Node addons-710864 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m12s kubelet Node addons-710864 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m12s kubelet Node addons-710864 status is now: NodeHasSufficientPID
Normal NodeNotReady 5m12s kubelet Node addons-710864 status is now: NodeNotReady
Normal NodeAllocatableEnforced 5m12s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 5m12s kubelet Node addons-710864 status is now: NodeReady
Normal Starting 5m12s kubelet Starting kubelet.
Normal RegisteredNode 4m59s node-controller Node addons-710864 event: Registered Node addons-710864 in Controller
==> dmesg <==
[ +0.001035] FS-Cache: O-key=[8] '9d585c0100000000'
[ +0.000692] FS-Cache: N-cookie c=0000012c [p=00000123 fl=2 nc=0 na=1]
[ +0.000945] FS-Cache: N-cookie d=00000000246b9f20{9p.inode} n=0000000041a3f6ea
[ +0.001072] FS-Cache: N-key=[8] '9d585c0100000000'
[ +0.004641] FS-Cache: Duplicate cookie detected
[ +0.000680] FS-Cache: O-cookie c=00000126 [p=00000123 fl=226 nc=0 na=1]
[ +0.000974] FS-Cache: O-cookie d=00000000246b9f20{9p.inode} n=000000009c9c1813
[ +0.001083] FS-Cache: O-key=[8] '9d585c0100000000'
[ +0.000712] FS-Cache: N-cookie c=0000012d [p=00000123 fl=2 nc=0 na=1]
[ +0.000936] FS-Cache: N-cookie d=00000000246b9f20{9p.inode} n=00000000c7342a74
[ +0.001059] FS-Cache: N-key=[8] '9d585c0100000000'
[ +2.620803] FS-Cache: Duplicate cookie detected
[ +0.000721] FS-Cache: O-cookie c=00000124 [p=00000123 fl=226 nc=0 na=1]
[ +0.000980] FS-Cache: O-cookie d=00000000246b9f20{9p.inode} n=0000000020633c42
[ +0.001064] FS-Cache: O-key=[8] '9c585c0100000000'
[ +0.000721] FS-Cache: N-cookie c=0000012f [p=00000123 fl=2 nc=0 na=1]
[ +0.000979] FS-Cache: N-cookie d=00000000246b9f20{9p.inode} n=0000000041a3f6ea
[ +0.001072] FS-Cache: N-key=[8] '9c585c0100000000'
[ +0.338643] FS-Cache: Duplicate cookie detected
[ +0.000710] FS-Cache: O-cookie c=00000129 [p=00000123 fl=226 nc=0 na=1]
[ +0.000986] FS-Cache: O-cookie d=00000000246b9f20{9p.inode} n=000000004adf4744
[ +0.001069] FS-Cache: O-key=[8] 'a2585c0100000000'
[ +0.000746] FS-Cache: N-cookie c=00000130 [p=00000123 fl=2 nc=0 na=1]
[ +0.000973] FS-Cache: N-cookie d=00000000246b9f20{9p.inode} n=00000000cc74dd36
[ +0.001064] FS-Cache: N-key=[8] 'a2585c0100000000'
==> etcd [ef6f50d7545dbfbd33cf6920307e2f6238147262024882006171922d44b0bb97] <==
{"level":"info","ts":"2024-07-29T20:05:03.574336Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc switched to configuration voters=(12593026477526642892)"}
{"level":"info","ts":"2024-07-29T20:05:03.574567Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","added-peer-id":"aec36adc501070cc","added-peer-peer-urls":["https://192.168.49.2:2380"]}
{"level":"info","ts":"2024-07-29T20:05:03.58593Z","caller":"embed/etcd.go:726","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
{"level":"info","ts":"2024-07-29T20:05:03.588104Z","caller":"embed/etcd.go:277","msg":"now serving peer/client/metrics","local-member-id":"aec36adc501070cc","initial-advertise-peer-urls":["https://192.168.49.2:2380"],"listen-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.49.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
{"level":"info","ts":"2024-07-29T20:05:03.58789Z","caller":"embed/etcd.go:597","msg":"serving peer traffic","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-07-29T20:05:03.592361Z","caller":"embed/etcd.go:857","msg":"serving metrics","address":"http://127.0.0.1:2381"}
{"level":"info","ts":"2024-07-29T20:05:03.592675Z","caller":"embed/etcd.go:569","msg":"cmux::serve","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-07-29T20:05:04.347829Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
{"level":"info","ts":"2024-07-29T20:05:04.347879Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
{"level":"info","ts":"2024-07-29T20:05:04.347896Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
{"level":"info","ts":"2024-07-29T20:05:04.347921Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
{"level":"info","ts":"2024-07-29T20:05:04.347934Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-07-29T20:05:04.347949Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
{"level":"info","ts":"2024-07-29T20:05:04.347958Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-07-29T20:05:04.351168Z","caller":"etcdserver/server.go:2068","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-710864 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
{"level":"info","ts":"2024-07-29T20:05:04.351224Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-07-29T20:05:04.351526Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-07-29T20:05:04.353342Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-07-29T20:05:04.354792Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
{"level":"info","ts":"2024-07-29T20:05:04.355182Z","caller":"etcdserver/server.go:2578","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-07-29T20:05:04.355375Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-07-29T20:05:04.355486Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-07-29T20:05:04.37987Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
{"level":"info","ts":"2024-07-29T20:05:04.38018Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-07-29T20:05:04.380281Z","caller":"etcdserver/server.go:2602","msg":"cluster version is updated","cluster-version":"3.5"}
==> gcp-auth [d471aa5a40405e66bf38487085f807d0d8e75b792d0d741d75fde6f379e976b2] <==
2024/07/29 20:07:01 GCP Auth Webhook started!
2024/07/29 20:07:19 Ready to marshal response ...
2024/07/29 20:07:19 Ready to write response ...
2024/07/29 20:07:19 Ready to marshal response ...
2024/07/29 20:07:19 Ready to write response ...
==> kernel <==
20:10:21 up 1 day, 3:52, 0 users, load average: 0.56, 1.85, 2.41
Linux addons-710864 5.15.0-1065-aws #71~20.04.1-Ubuntu SMP Fri Jun 28 19:59:49 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [0dabe203af3541a987e160c06590ccdf325a64547de9e70a80a35668d79fa625] <==
I0729 20:09:07.224495 1 main.go:299] handling current node
I0729 20:09:17.224392 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0729 20:09:17.224426 1 main.go:299] handling current node
W0729 20:09:26.067771 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0729 20:09:26.067835 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0729 20:09:27.224259 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0729 20:09:27.224297 1 main.go:299] handling current node
W0729 20:09:28.201310 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0729 20:09:28.201354 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
I0729 20:09:37.224191 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0729 20:09:37.224226 1 main.go:299] handling current node
W0729 20:09:43.478455 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0729 20:09:43.478493 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0729 20:09:47.224151 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0729 20:09:47.224191 1 main.go:299] handling current node
I0729 20:09:57.224987 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0729 20:09:57.225026 1 main.go:299] handling current node
I0729 20:10:07.224410 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0729 20:10:07.224448 1 main.go:299] handling current node
W0729 20:10:08.032466 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0729 20:10:08.032499 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
W0729 20:10:15.226219 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0729 20:10:15.226325 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0729 20:10:17.224527 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0729 20:10:17.224565 1 main.go:299] handling current node
==> kube-apiserver [b373c2f90cbc12c871992f3c3bc06e1ab59584aecf53fb798d55bcb87e955ac1] <==
E0729 20:06:07.597405 1 dispatcher.go:214] failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.101.79.94:443: connect: connection refused
W0729 20:06:07.597760 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.104.78.236:443: connect: connection refused
W0729 20:06:07.673534 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.101.79.94:443: connect: connection refused
E0729 20:06:07.673585 1 dispatcher.go:214] failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.101.79.94:443: connect: connection refused
W0729 20:06:07.674121 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.104.78.236:443: connect: connection refused
W0729 20:06:16.996501 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.78.236:443: connect: connection refused
W0729 20:06:17.590548 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.101.79.94:443: connect: connection refused
E0729 20:06:17.590599 1 dispatcher.go:214] failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.101.79.94:443: connect: connection refused
W0729 20:06:17.591252 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.104.78.236:443: connect: connection refused
W0729 20:06:18.049340 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.78.236:443: connect: connection refused
W0729 20:06:19.084667 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.78.236:443: connect: connection refused
W0729 20:06:20.138180 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.78.236:443: connect: connection refused
W0729 20:06:21.216140 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.78.236:443: connect: connection refused
W0729 20:06:22.301920 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.78.236:443: connect: connection refused
W0729 20:06:23.364647 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.78.236:443: connect: connection refused
W0729 20:06:24.451223 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.78.236:443: connect: connection refused
W0729 20:06:25.505886 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.78.236:443: connect: connection refused
W0729 20:06:39.604100 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.101.79.94:443: connect: connection refused
E0729 20:06:39.604138 1 dispatcher.go:214] failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.101.79.94:443: connect: connection refused
W0729 20:06:39.683981 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.101.79.94:443: connect: connection refused
E0729 20:06:39.684036 1 dispatcher.go:214] failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.101.79.94:443: connect: connection refused
W0729 20:06:58.555514 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.101.79.94:443: connect: connection refused
E0729 20:06:58.555548 1 dispatcher.go:214] failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.101.79.94:443: connect: connection refused
I0729 20:07:19.581144 1 controller.go:615] quota admission added evaluator for: jobs.batch.volcano.sh
I0729 20:07:19.616410 1 controller.go:615] quota admission added evaluator for: podgroups.scheduling.volcano.sh
==> kube-controller-manager [38fa4d212bf64df9021087af4bad9a19350be82cf78becc8ca1bc0407cb2ba9e] <==
I0729 20:06:41.218809 1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
I0729 20:06:42.637345 1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create"
I0729 20:06:42.657229 1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
I0729 20:06:43.223440 1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create"
I0729 20:06:43.252222 1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
I0729 20:06:43.646227 1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create"
I0729 20:06:43.662681 1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create"
I0729 20:06:43.671326 1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
I0729 20:06:43.682807 1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create"
I0729 20:06:43.684147 1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
I0729 20:06:43.697846 1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
I0729 20:06:44.235055 1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="ingress-nginx/ingress-nginx-controller-6d9bd977d4" duration="56.706µs"
I0729 20:06:56.715858 1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="ingress-nginx/ingress-nginx-controller-6d9bd977d4" duration="19.151804ms"
I0729 20:06:56.716980 1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="ingress-nginx/ingress-nginx-controller-6d9bd977d4" duration="63.409µs"
I0729 20:06:58.573281 1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-5db96cd9b4" duration="20.287816ms"
I0729 20:06:58.596653 1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-5db96cd9b4" duration="23.321388ms"
I0729 20:06:58.596737 1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-5db96cd9b4" duration="39.934µs"
I0729 20:06:58.605624 1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-5db96cd9b4" duration="31.295µs"
I0729 20:07:02.316100 1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-5db96cd9b4" duration="11.179732ms"
I0729 20:07:02.316592 1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-5db96cd9b4" duration="50.216µs"
I0729 20:07:13.019737 1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create"
I0729 20:07:13.022684 1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
I0729 20:07:13.059937 1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch"
I0729 20:07:13.066566 1 job_controller.go:566] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create"
I0729 20:07:19.320174 1 job_controller.go:566] "enqueueing job" logger="job-controller" key="volcano-system/volcano-admission-init"
==> kube-proxy [c587c0c8399dece1d9421515f9d6b0bee4dbff8179421abe9d69560c87e074b3] <==
I0729 20:05:24.877116 1 server_linux.go:69] "Using iptables proxy"
I0729 20:05:24.913430 1 server.go:1062] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
I0729 20:05:24.992755 1 server.go:659] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I0729 20:05:24.992819 1 server_linux.go:165] "Using iptables Proxier"
I0729 20:05:25.000355 1 server_linux.go:511] "Detect-local-mode set to ClusterCIDR, but no cluster CIDR for family" ipFamily="IPv6"
I0729 20:05:25.000393 1 server_linux.go:528] "Defaulting to no-op detect-local"
I0729 20:05:25.000458 1 proxier.go:243] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I0729 20:05:25.001027 1 server.go:872] "Version info" version="v1.30.3"
I0729 20:05:25.001074 1 server.go:874] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0729 20:05:25.009075 1 config.go:192] "Starting service config controller"
I0729 20:05:25.011045 1 shared_informer.go:313] Waiting for caches to sync for service config
I0729 20:05:25.011164 1 config.go:101] "Starting endpoint slice config controller"
I0729 20:05:25.011178 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0729 20:05:25.012167 1 config.go:319] "Starting node config controller"
I0729 20:05:25.012180 1 shared_informer.go:313] Waiting for caches to sync for node config
I0729 20:05:25.115949 1 shared_informer.go:320] Caches are synced for node config
I0729 20:05:25.115988 1 shared_informer.go:320] Caches are synced for service config
I0729 20:05:25.116040 1 shared_informer.go:320] Caches are synced for endpoint slice config
==> kube-scheduler [2de1384672a2a125884a6709f69b225efa5bc75cf7be5cd6ca8f185c4e58259b] <==
W0729 20:05:07.008750 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0729 20:05:07.008767 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
W0729 20:05:07.008957 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0729 20:05:07.009104 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
W0729 20:05:07.009270 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0729 20:05:07.009369 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
W0729 20:05:07.009588 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0729 20:05:07.009702 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
W0729 20:05:07.009913 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0729 20:05:07.010023 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
W0729 20:05:07.010213 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0729 20:05:07.010318 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
W0729 20:05:08.064652 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0729 20:05:08.064700 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
W0729 20:05:08.077118 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0729 20:05:08.077583 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
W0729 20:05:08.077963 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0729 20:05:08.078857 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
W0729 20:05:08.079226 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0729 20:05:08.079400 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
W0729 20:05:08.170434 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0729 20:05:08.170649 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
W0729 20:05:08.174614 1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0729 20:05:08.174649 1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
I0729 20:05:08.482558 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Jul 29 20:08:51 addons-710864 kubelet[1562]: I0729 20:08:51.373096 1562 kubelet_pods.go:988] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-nvsv2" secret="" err="secret \"gcp-auth\" not found"
Jul 29 20:09:00 addons-710864 kubelet[1562]: I0729 20:09:00.372595 1562 scope.go:117] "RemoveContainer" containerID="833a10063a1701270299d2781655b31349198202efd3352dfedc00367f06f283"
Jul 29 20:09:01 addons-710864 kubelet[1562]: E0729 20:09:01.658403 1562 remote_runtime.go:496] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = failed to exec in container: failed to start exec \"3069327c5679a417d3857fa23be4e8481e7cac7a08dc7e425255d3884a0ea3e8\": OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown" containerID="d30536810d22ac00bfdb63f26c28fd613e2d5e322b227be9db0c268e5f859a73" cmd=["/bin/gadgettracermanager","-liveness"]
Jul 29 20:09:01 addons-710864 kubelet[1562]: E0729 20:09:01.669563 1562 remote_runtime.go:496] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = failed to exec in container: failed to start exec \"0578ebe6d74dd1890e19dd81a4f435d5ce6474d54b03897f6c8faca9e34d18ee\": OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown" containerID="d30536810d22ac00bfdb63f26c28fd613e2d5e322b227be9db0c268e5f859a73" cmd=["/bin/gadgettracermanager","-liveness"]
Jul 29 20:09:01 addons-710864 kubelet[1562]: E0729 20:09:01.685873 1562 remote_runtime.go:496] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = failed to exec in container: failed to start exec \"dbc526fdb74f83aa4657b62e0d13757ae2e1c570c39b02a34351b3a4d849ec00\": OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown" containerID="d30536810d22ac00bfdb63f26c28fd613e2d5e322b227be9db0c268e5f859a73" cmd=["/bin/gadgettracermanager","-liveness"]
Jul 29 20:09:02 addons-710864 kubelet[1562]: I0729 20:09:02.613160 1562 scope.go:117] "RemoveContainer" containerID="833a10063a1701270299d2781655b31349198202efd3352dfedc00367f06f283"
Jul 29 20:09:02 addons-710864 kubelet[1562]: I0729 20:09:02.613625 1562 scope.go:117] "RemoveContainer" containerID="d30536810d22ac00bfdb63f26c28fd613e2d5e322b227be9db0c268e5f859a73"
Jul 29 20:09:02 addons-710864 kubelet[1562]: E0729 20:09:02.614100 1562 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-bx6st_gadget(0a9d249d-5ba3-4b57-a4f5-3b3f39b742f7)\"" pod="gadget/gadget-bx6st" podUID="0a9d249d-5ba3-4b57-a4f5-3b3f39b742f7"
Jul 29 20:09:03 addons-710864 kubelet[1562]: I0729 20:09:03.623847 1562 scope.go:117] "RemoveContainer" containerID="d30536810d22ac00bfdb63f26c28fd613e2d5e322b227be9db0c268e5f859a73"
Jul 29 20:09:03 addons-710864 kubelet[1562]: E0729 20:09:03.624316 1562 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-bx6st_gadget(0a9d249d-5ba3-4b57-a4f5-3b3f39b742f7)\"" pod="gadget/gadget-bx6st" podUID="0a9d249d-5ba3-4b57-a4f5-3b3f39b742f7"
Jul 29 20:09:05 addons-710864 kubelet[1562]: I0729 20:09:05.876610 1562 scope.go:117] "RemoveContainer" containerID="d30536810d22ac00bfdb63f26c28fd613e2d5e322b227be9db0c268e5f859a73"
Jul 29 20:09:05 addons-710864 kubelet[1562]: E0729 20:09:05.877096 1562 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-bx6st_gadget(0a9d249d-5ba3-4b57-a4f5-3b3f39b742f7)\"" pod="gadget/gadget-bx6st" podUID="0a9d249d-5ba3-4b57-a4f5-3b3f39b742f7"
Jul 29 20:09:19 addons-710864 kubelet[1562]: I0729 20:09:19.373679 1562 kubelet_pods.go:988] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-9bqzf" secret="" err="secret \"gcp-auth\" not found"
Jul 29 20:09:20 addons-710864 kubelet[1562]: I0729 20:09:20.372838 1562 scope.go:117] "RemoveContainer" containerID="d30536810d22ac00bfdb63f26c28fd613e2d5e322b227be9db0c268e5f859a73"
Jul 29 20:09:20 addons-710864 kubelet[1562]: E0729 20:09:20.373542 1562 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-bx6st_gadget(0a9d249d-5ba3-4b57-a4f5-3b3f39b742f7)\"" pod="gadget/gadget-bx6st" podUID="0a9d249d-5ba3-4b57-a4f5-3b3f39b742f7"
Jul 29 20:09:35 addons-710864 kubelet[1562]: I0729 20:09:35.375887 1562 scope.go:117] "RemoveContainer" containerID="d30536810d22ac00bfdb63f26c28fd613e2d5e322b227be9db0c268e5f859a73"
Jul 29 20:09:35 addons-710864 kubelet[1562]: E0729 20:09:35.377117 1562 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-bx6st_gadget(0a9d249d-5ba3-4b57-a4f5-3b3f39b742f7)\"" pod="gadget/gadget-bx6st" podUID="0a9d249d-5ba3-4b57-a4f5-3b3f39b742f7"
Jul 29 20:09:45 addons-710864 kubelet[1562]: I0729 20:09:45.372738 1562 kubelet_pods.go:988] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-656c9c8d9c-svczd" secret="" err="secret \"gcp-auth\" not found"
Jul 29 20:09:47 addons-710864 kubelet[1562]: I0729 20:09:47.372857 1562 scope.go:117] "RemoveContainer" containerID="d30536810d22ac00bfdb63f26c28fd613e2d5e322b227be9db0c268e5f859a73"
Jul 29 20:09:47 addons-710864 kubelet[1562]: E0729 20:09:47.373770 1562 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-bx6st_gadget(0a9d249d-5ba3-4b57-a4f5-3b3f39b742f7)\"" pod="gadget/gadget-bx6st" podUID="0a9d249d-5ba3-4b57-a4f5-3b3f39b742f7"
Jul 29 20:09:57 addons-710864 kubelet[1562]: I0729 20:09:57.372548 1562 kubelet_pods.go:988] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-nvsv2" secret="" err="secret \"gcp-auth\" not found"
Jul 29 20:09:59 addons-710864 kubelet[1562]: I0729 20:09:59.373512 1562 scope.go:117] "RemoveContainer" containerID="d30536810d22ac00bfdb63f26c28fd613e2d5e322b227be9db0c268e5f859a73"
Jul 29 20:09:59 addons-710864 kubelet[1562]: E0729 20:09:59.373985 1562 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-bx6st_gadget(0a9d249d-5ba3-4b57-a4f5-3b3f39b742f7)\"" pod="gadget/gadget-bx6st" podUID="0a9d249d-5ba3-4b57-a4f5-3b3f39b742f7"
Jul 29 20:10:12 addons-710864 kubelet[1562]: I0729 20:10:12.372600 1562 scope.go:117] "RemoveContainer" containerID="d30536810d22ac00bfdb63f26c28fd613e2d5e322b227be9db0c268e5f859a73"
Jul 29 20:10:12 addons-710864 kubelet[1562]: E0729 20:10:12.373109 1562 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-bx6st_gadget(0a9d249d-5ba3-4b57-a4f5-3b3f39b742f7)\"" pod="gadget/gadget-bx6st" podUID="0a9d249d-5ba3-4b57-a4f5-3b3f39b742f7"
==> storage-provisioner [15342d26df0c25d7bcee368c84967122f1dccf30cb70ac816f4ccb5d7805f399] <==
I0729 20:05:30.897084 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0729 20:05:30.918227 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0729 20:05:30.918292 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0729 20:05:30.930926 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0729 20:05:30.931161 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-710864_8234a4c8-ade8-4ae9-afaf-9dd15a1fdd66!
I0729 20:05:30.935553 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"0a2db7d1-7972-42d1-a3ee-f3d63ecc30d2", APIVersion:"v1", ResourceVersion:"649", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-710864_8234a4c8-ade8-4ae9-afaf-9dd15a1fdd66 became leader
I0729 20:05:31.036130 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-710864_8234a4c8-ade8-4ae9-afaf-9dd15a1fdd66!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-710864 -n addons-710864
helpers_test.go:261: (dbg) Run: kubectl --context addons-710864 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: ingress-nginx-admission-create-lvzhq ingress-nginx-admission-patch-t4pk6 test-job-nginx-0
helpers_test.go:274: ======> post-mortem[TestAddons/serial/Volcano]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-710864 describe pod ingress-nginx-admission-create-lvzhq ingress-nginx-admission-patch-t4pk6 test-job-nginx-0
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-710864 describe pod ingress-nginx-admission-create-lvzhq ingress-nginx-admission-patch-t4pk6 test-job-nginx-0: exit status 1 (98.071684ms)
** stderr **
Error from server (NotFound): pods "ingress-nginx-admission-create-lvzhq" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-t4pk6" not found
Error from server (NotFound): pods "test-job-nginx-0" not found
** /stderr **
helpers_test.go:279: kubectl --context addons-710864 describe pod ingress-nginx-admission-create-lvzhq ingress-nginx-admission-patch-t4pk6 test-job-nginx-0: exit status 1
--- FAIL: TestAddons/serial/Volcano (199.81s)