=== RUN TestAddons/serial/Volcano
addons_test.go:803: volcano-scheduler stabilized in 65.527715ms
addons_test.go:811: volcano-admission stabilized in 66.023524ms
addons_test.go:819: volcano-controller stabilized in 66.0688ms
addons_test.go:825: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-scheduler-6c9778cbdf-dkzrl" [13d59d7b-0f84-4393-a6f1-71b796967004] Running
addons_test.go:825: (dbg) TestAddons/serial/Volcano: app=volcano-scheduler healthy within 6.004403773s
addons_test.go:829: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-admission-5874dfdd79-w22cw" [40beafa5-88b8-4dcb-9686-a2841cc76427] Running
addons_test.go:829: (dbg) TestAddons/serial/Volcano: app=volcano-admission healthy within 5.004309409s
addons_test.go:833: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-controllers-789ffc5785-qv8nc" [60e94204-8930-44c2-9007-693e8746defc] Running
addons_test.go:833: (dbg) TestAddons/serial/Volcano: app=volcano-controller healthy within 5.006063682s
addons_test.go:838: (dbg) Run: kubectl --context addons-874682 delete -n volcano-system job volcano-admission-init
addons_test.go:844: (dbg) Run: kubectl --context addons-874682 create -f testdata/vcjob.yaml
addons_test.go:852: (dbg) Run: kubectl --context addons-874682 get vcjob -n my-volcano
addons_test.go:870: (dbg) TestAddons/serial/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...
helpers_test.go:344: "test-job-nginx-0" [406daa93-c19e-447c-985e-6e9b59ec7f48] Pending
helpers_test.go:344: "test-job-nginx-0" [406daa93-c19e-447c-985e-6e9b59ec7f48] Pending: PodScheduled:Unschedulable (0/1 nodes are unavailable: 1 Insufficient cpu.)
helpers_test.go:329: TestAddons/serial/Volcano: WARNING: pod list for "my-volcano" "volcano.sh/job-name=test-job" returned: client rate limiter Wait returned an error: context deadline exceeded
addons_test.go:870: ***** TestAddons/serial/Volcano: pod "volcano.sh/job-name=test-job" failed to start within 3m0s: context deadline exceeded ****
addons_test.go:870: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-874682 -n addons-874682
addons_test.go:870: TestAddons/serial/Volcano: showing logs for failed pods as of 2024-10-10 19:12:49.171747128 +0000 UTC m=+434.787122167
addons_test.go:870: (dbg) Run: kubectl --context addons-874682 describe po test-job-nginx-0 -n my-volcano
addons_test.go:870: (dbg) kubectl --context addons-874682 describe po test-job-nginx-0 -n my-volcano:
Name: test-job-nginx-0
Namespace: my-volcano
Priority: 0
Service Account: default
Node: <none>
Labels: volcano.sh/job-name=test-job
volcano.sh/job-namespace=my-volcano
volcano.sh/queue-name=test
volcano.sh/task-index=0
volcano.sh/task-spec=nginx
Annotations: scheduling.k8s.io/group-name: test-job-35c372c1-0a05-4517-9ac5-6df4fa2a42b1
volcano.sh/job-name: test-job
volcano.sh/job-retry-count: 0
volcano.sh/job-version: 0
volcano.sh/queue-name: test
volcano.sh/task-index: 0
volcano.sh/task-spec: nginx
volcano.sh/template-uid: test-job-nginx
Status: Pending
IP:
IPs: <none>
Controlled By: Job/test-job
Containers:
nginx:
Image: nginx:latest
Port: <none>
Host Port: <none>
Command:
sleep
10m
Limits:
cpu: 1
Requests:
cpu: 1
Environment:
GOOGLE_APPLICATION_CREDENTIALS: /google-app-creds.json
PROJECT_ID: this_is_fake
GCP_PROJECT: this_is_fake
GCLOUD_PROJECT: this_is_fake
GOOGLE_CLOUD_PROJECT: this_is_fake
CLOUDSDK_CORE_PROJECT: this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-2cm9h (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
kube-api-access-2cm9h:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
gcp-creds:
Type: HostPath (bare host directory volume)
Path: /var/lib/minikube/google_application_credentials.json
HostPathType: File
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling 2m59s volcano 0/1 nodes are unavailable: 1 Insufficient cpu.
addons_test.go:870: (dbg) Run: kubectl --context addons-874682 logs test-job-nginx-0 -n my-volcano
addons_test.go:870: (dbg) kubectl --context addons-874682 logs test-job-nginx-0 -n my-volcano:
addons_test.go:871: failed waiting for test-local-path pod: volcano.sh/job-name=test-job within 3m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestAddons/serial/Volcano]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect addons-874682
helpers_test.go:235: (dbg) docker inspect addons-874682:
-- stdout --
[
{
"Id": "3494659e176024305dbfefd98966e01feffb205cc7163c533b4345502b70e82a",
"Created": "2024-10-10T19:06:16.389506571Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 577019,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-10-10T19:06:16.547678423Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:e5ca9b83e048da5ecbd9864892b13b9f06d661ec5eae41590141157c6fe62bf7",
"ResolvConfPath": "/var/lib/docker/containers/3494659e176024305dbfefd98966e01feffb205cc7163c533b4345502b70e82a/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/3494659e176024305dbfefd98966e01feffb205cc7163c533b4345502b70e82a/hostname",
"HostsPath": "/var/lib/docker/containers/3494659e176024305dbfefd98966e01feffb205cc7163c533b4345502b70e82a/hosts",
"LogPath": "/var/lib/docker/containers/3494659e176024305dbfefd98966e01feffb205cc7163c533b4345502b70e82a/3494659e176024305dbfefd98966e01feffb205cc7163c533b4345502b70e82a-json.log",
"Name": "/addons-874682",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"addons-874682:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "addons-874682",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4194304000,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8388608000,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/58b277eee43aa943869b3f5228547a4aaed9baa413e135f215cad5e6074d6c5a-init/diff:/var/lib/docker/overlay2/e05ae2c1788a586720d1bd4bb5d9758651c5147c0197d24b88bbf71b6ab26a8e/diff",
"MergedDir": "/var/lib/docker/overlay2/58b277eee43aa943869b3f5228547a4aaed9baa413e135f215cad5e6074d6c5a/merged",
"UpperDir": "/var/lib/docker/overlay2/58b277eee43aa943869b3f5228547a4aaed9baa413e135f215cad5e6074d6c5a/diff",
"WorkDir": "/var/lib/docker/overlay2/58b277eee43aa943869b3f5228547a4aaed9baa413e135f215cad5e6074d6c5a/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "addons-874682",
"Source": "/var/lib/docker/volumes/addons-874682/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "addons-874682",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-874682",
"name.minikube.sigs.k8s.io": "addons-874682",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "4fc131ec62392932de17e1a30925ddb86741e9496dfa95eb3f0c4c5e0c25339c",
"SandboxKey": "/var/run/docker/netns/4fc131ec6239",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33505"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33506"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33509"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33507"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33508"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"addons-874682": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:31:02",
"DriverOpts": null,
"NetworkID": "f97035a29b9294f881e9fab7fd3765d3b36cfe5520285e25cf3c27c1fa987de9",
"EndpointID": "636c8c3f3b158a42f511494f6052d1dffe26d6db079ad8a5fefc798894f4651d",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-874682",
"3494659e1760"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p addons-874682 -n addons-874682
helpers_test.go:244: <<< TestAddons/serial/Volcano FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/serial/Volcano]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p addons-874682 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-874682 logs -n 25: (1.569850095s)
helpers_test.go:252: TestAddons/serial/Volcano logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| start | -o=json --download-only | download-only-652277 | jenkins | v1.34.0 | 10 Oct 24 19:05 UTC | |
| | -p download-only-652277 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 10 Oct 24 19:05 UTC | 10 Oct 24 19:05 UTC |
| delete | -p download-only-652277 | download-only-652277 | jenkins | v1.34.0 | 10 Oct 24 19:05 UTC | 10 Oct 24 19:05 UTC |
| start | -o=json --download-only | download-only-012816 | jenkins | v1.34.0 | 10 Oct 24 19:05 UTC | |
| | -p download-only-012816 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 10 Oct 24 19:05 UTC | 10 Oct 24 19:05 UTC |
| delete | -p download-only-012816 | download-only-012816 | jenkins | v1.34.0 | 10 Oct 24 19:05 UTC | 10 Oct 24 19:05 UTC |
| delete | -p download-only-652277 | download-only-652277 | jenkins | v1.34.0 | 10 Oct 24 19:05 UTC | 10 Oct 24 19:05 UTC |
| delete | -p download-only-012816 | download-only-012816 | jenkins | v1.34.0 | 10 Oct 24 19:05 UTC | 10 Oct 24 19:05 UTC |
| start | --download-only -p | download-docker-464061 | jenkins | v1.34.0 | 10 Oct 24 19:05 UTC | |
| | download-docker-464061 | | | | | |
| | --alsologtostderr | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p download-docker-464061 | download-docker-464061 | jenkins | v1.34.0 | 10 Oct 24 19:05 UTC | 10 Oct 24 19:05 UTC |
| start | --download-only -p | binary-mirror-043320 | jenkins | v1.34.0 | 10 Oct 24 19:05 UTC | |
| | binary-mirror-043320 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:32921 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p binary-mirror-043320 | binary-mirror-043320 | jenkins | v1.34.0 | 10 Oct 24 19:05 UTC | 10 Oct 24 19:05 UTC |
| addons | enable dashboard -p | addons-874682 | jenkins | v1.34.0 | 10 Oct 24 19:05 UTC | |
| | addons-874682 | | | | | |
| addons | disable dashboard -p | addons-874682 | jenkins | v1.34.0 | 10 Oct 24 19:05 UTC | |
| | addons-874682 | | | | | |
| start | -p addons-874682 --wait=true | addons-874682 | jenkins | v1.34.0 | 10 Oct 24 19:05 UTC | 10 Oct 24 19:09 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/10/10 19:05:51
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.23.1 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1010 19:05:51.178789 576524 out.go:345] Setting OutFile to fd 1 ...
I1010 19:05:51.178917 576524 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1010 19:05:51.178928 576524 out.go:358] Setting ErrFile to fd 2...
I1010 19:05:51.178934 576524 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1010 19:05:51.179175 576524 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19787-570360/.minikube/bin
I1010 19:05:51.179605 576524 out.go:352] Setting JSON to false
I1010 19:05:51.180516 576524 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":10098,"bootTime":1728577054,"procs":159,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I1010 19:05:51.180600 576524 start.go:139] virtualization:
I1010 19:05:51.183264 576524 out.go:177] * [addons-874682] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I1010 19:05:51.185405 576524 out.go:177] - MINIKUBE_LOCATION=19787
I1010 19:05:51.185577 576524 notify.go:220] Checking for updates...
I1010 19:05:51.188798 576524 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1010 19:05:51.190834 576524 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19787-570360/kubeconfig
I1010 19:05:51.192747 576524 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19787-570360/.minikube
I1010 19:05:51.194575 576524 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I1010 19:05:51.196553 576524 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I1010 19:05:51.198647 576524 driver.go:394] Setting default libvirt URI to qemu:///system
I1010 19:05:51.226597 576524 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
I1010 19:05:51.226728 576524 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1010 19:05:51.285470 576524 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-10-10 19:05:51.275812625 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214827008 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I1010 19:05:51.285583 576524 docker.go:318] overlay module found
I1010 19:05:51.289232 576524 out.go:177] * Using the docker driver based on user configuration
I1010 19:05:51.291090 576524 start.go:297] selected driver: docker
I1010 19:05:51.291106 576524 start.go:901] validating driver "docker" against <nil>
I1010 19:05:51.291120 576524 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1010 19:05:51.291751 576524 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1010 19:05:51.342487 576524 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-10-10 19:05:51.332819728 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214827008 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I1010 19:05:51.342708 576524 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I1010 19:05:51.342930 576524 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1010 19:05:51.345292 576524 out.go:177] * Using Docker driver with root privileges
I1010 19:05:51.347302 576524 cni.go:84] Creating CNI manager for ""
I1010 19:05:51.347363 576524 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I1010 19:05:51.347375 576524 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I1010 19:05:51.347446 576524 start.go:340] cluster config:
{Name:addons-874682 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-874682 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHA
uthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1010 19:05:51.349768 576524 out.go:177] * Starting "addons-874682" primary control-plane node in "addons-874682" cluster
I1010 19:05:51.351479 576524 cache.go:121] Beginning downloading kic base image for docker with containerd
I1010 19:05:51.353261 576524 out.go:177] * Pulling base image v0.0.45-1728382586-19774 ...
I1010 19:05:51.355049 576524 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I1010 19:05:51.355095 576524 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19787-570360/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4
I1010 19:05:51.355108 576524 cache.go:56] Caching tarball of preloaded images
I1010 19:05:51.355137 576524 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec in local docker daemon
I1010 19:05:51.355185 576524 preload.go:172] Found /home/jenkins/minikube-integration/19787-570360/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I1010 19:05:51.355195 576524 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on containerd
I1010 19:05:51.355546 576524 profile.go:143] Saving config to /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/config.json ...
I1010 19:05:51.355618 576524 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/config.json: {Name:mkf1a495e43beb8fe425e5480748ee4d49aca017 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1010 19:05:51.370239 576524 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec to local cache
I1010 19:05:51.370351 576524 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec in local cache directory
I1010 19:05:51.370383 576524 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec in local cache directory, skipping pull
I1010 19:05:51.370389 576524 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec exists in cache, skipping pull
I1010 19:05:51.370405 576524 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec as a tarball
I1010 19:05:51.370410 576524 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec from local cache
I1010 19:06:08.797276 576524 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec from cached tarball
I1010 19:06:08.797315 576524 cache.go:194] Successfully downloaded all kic artifacts
I1010 19:06:08.797366 576524 start.go:360] acquireMachinesLock for addons-874682: {Name:mk7ff9a9a0db5893dcccf193f4873461da47016d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1010 19:06:08.797496 576524 start.go:364] duration metric: took 111.269µs to acquireMachinesLock for "addons-874682"
I1010 19:06:08.797533 576524 start.go:93] Provisioning new machine with config: &{Name:addons-874682 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-874682 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fa
lse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I1010 19:06:08.797618 576524 start.go:125] createHost starting for "" (driver="docker")
I1010 19:06:08.801278 576524 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
I1010 19:06:08.801527 576524 start.go:159] libmachine.API.Create for "addons-874682" (driver="docker")
I1010 19:06:08.801566 576524 client.go:168] LocalClient.Create starting
I1010 19:06:08.801680 576524 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19787-570360/.minikube/certs/ca.pem
I1010 19:06:09.443700 576524 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19787-570360/.minikube/certs/cert.pem
I1010 19:06:10.015995 576524 cli_runner.go:164] Run: docker network inspect addons-874682 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W1010 19:06:10.066083 576524 cli_runner.go:211] docker network inspect addons-874682 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I1010 19:06:10.066214 576524 network_create.go:284] running [docker network inspect addons-874682] to gather additional debugging logs...
I1010 19:06:10.066240 576524 cli_runner.go:164] Run: docker network inspect addons-874682
W1010 19:06:10.082174 576524 cli_runner.go:211] docker network inspect addons-874682 returned with exit code 1
I1010 19:06:10.082215 576524 network_create.go:287] error running [docker network inspect addons-874682]: docker network inspect addons-874682: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-874682 not found
I1010 19:06:10.082232 576524 network_create.go:289] output of [docker network inspect addons-874682]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-874682 not found
** /stderr **
I1010 19:06:10.082372 576524 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1010 19:06:10.099613 576524 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x400193c880}
I1010 19:06:10.099656 576524 network_create.go:124] attempt to create docker network addons-874682 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I1010 19:06:10.099715 576524 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-874682 addons-874682
I1010 19:06:10.182474 576524 network_create.go:108] docker network addons-874682 192.168.49.0/24 created
I1010 19:06:10.182508 576524 kic.go:121] calculated static IP "192.168.49.2" for the "addons-874682" container
I1010 19:06:10.182612 576524 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I1010 19:06:10.198918 576524 cli_runner.go:164] Run: docker volume create addons-874682 --label name.minikube.sigs.k8s.io=addons-874682 --label created_by.minikube.sigs.k8s.io=true
I1010 19:06:10.218465 576524 oci.go:103] Successfully created a docker volume addons-874682
I1010 19:06:10.218567 576524 cli_runner.go:164] Run: docker run --rm --name addons-874682-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-874682 --entrypoint /usr/bin/test -v addons-874682:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec -d /var/lib
I1010 19:06:12.297143 576524 cli_runner.go:217] Completed: docker run --rm --name addons-874682-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-874682 --entrypoint /usr/bin/test -v addons-874682:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec -d /var/lib: (2.078539449s)
I1010 19:06:12.297180 576524 oci.go:107] Successfully prepared a docker volume addons-874682
I1010 19:06:12.297206 576524 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I1010 19:06:12.297225 576524 kic.go:194] Starting extracting preloaded images to volume ...
I1010 19:06:12.297293 576524 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19787-570360/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-874682:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec -I lz4 -xf /preloaded.tar -C /extractDir
I1010 19:06:16.323611 576524 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19787-570360/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-874682:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec -I lz4 -xf /preloaded.tar -C /extractDir: (4.026273742s)
I1010 19:06:16.323643 576524 kic.go:203] duration metric: took 4.026415213s to extract preloaded images to volume ...
W1010 19:06:16.323774 576524 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I1010 19:06:16.323887 576524 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I1010 19:06:16.375374 576524 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-874682 --name addons-874682 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-874682 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-874682 --network addons-874682 --ip 192.168.49.2 --volume addons-874682:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec
I1010 19:06:16.714427 576524 cli_runner.go:164] Run: docker container inspect addons-874682 --format={{.State.Running}}
I1010 19:06:16.742107 576524 cli_runner.go:164] Run: docker container inspect addons-874682 --format={{.State.Status}}
I1010 19:06:16.768019 576524 cli_runner.go:164] Run: docker exec addons-874682 stat /var/lib/dpkg/alternatives/iptables
I1010 19:06:16.837895 576524 oci.go:144] the created container "addons-874682" has a running status.
I1010 19:06:16.837925 576524 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19787-570360/.minikube/machines/addons-874682/id_rsa...
I1010 19:06:17.057123 576524 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19787-570360/.minikube/machines/addons-874682/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I1010 19:06:17.075473 576524 cli_runner.go:164] Run: docker container inspect addons-874682 --format={{.State.Status}}
I1010 19:06:17.092241 576524 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I1010 19:06:17.092260 576524 kic_runner.go:114] Args: [docker exec --privileged addons-874682 chown docker:docker /home/docker/.ssh/authorized_keys]
I1010 19:06:17.172353 576524 cli_runner.go:164] Run: docker container inspect addons-874682 --format={{.State.Status}}
I1010 19:06:17.195001 576524 machine.go:93] provisionDockerMachine start ...
I1010 19:06:17.195097 576524 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-874682
I1010 19:06:17.225410 576524 main.go:141] libmachine: Using SSH client type: native
I1010 19:06:17.225679 576524 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413e90] 0x4166d0 <nil> [] 0s} 127.0.0.1 33505 <nil> <nil>}
I1010 19:06:17.225692 576524 main.go:141] libmachine: About to run SSH command:
hostname
I1010 19:06:17.226358 576524 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:33080->127.0.0.1:33505: read: connection reset by peer
I1010 19:06:20.355680 576524 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-874682
I1010 19:06:20.355703 576524 ubuntu.go:169] provisioning hostname "addons-874682"
I1010 19:06:20.355781 576524 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-874682
I1010 19:06:20.372236 576524 main.go:141] libmachine: Using SSH client type: native
I1010 19:06:20.372518 576524 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413e90] 0x4166d0 <nil> [] 0s} 127.0.0.1 33505 <nil> <nil>}
I1010 19:06:20.372539 576524 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-874682 && echo "addons-874682" | sudo tee /etc/hostname
I1010 19:06:20.512467 576524 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-874682
I1010 19:06:20.512562 576524 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-874682
I1010 19:06:20.529095 576524 main.go:141] libmachine: Using SSH client type: native
I1010 19:06:20.529360 576524 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413e90] 0x4166d0 <nil> [] 0s} 127.0.0.1 33505 <nil> <nil>}
I1010 19:06:20.529384 576524 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-874682' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-874682/g' /etc/hosts;
else
echo '127.0.1.1 addons-874682' | sudo tee -a /etc/hosts;
fi
fi
I1010 19:06:20.660228 576524 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1010 19:06:20.660259 576524 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19787-570360/.minikube CaCertPath:/home/jenkins/minikube-integration/19787-570360/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19787-570360/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19787-570360/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19787-570360/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19787-570360/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19787-570360/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19787-570360/.minikube}
I1010 19:06:20.660287 576524 ubuntu.go:177] setting up certificates
I1010 19:06:20.660300 576524 provision.go:84] configureAuth start
I1010 19:06:20.660364 576524 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-874682
I1010 19:06:20.677668 576524 provision.go:143] copyHostCerts
I1010 19:06:20.677751 576524 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19787-570360/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19787-570360/.minikube/ca.pem (1078 bytes)
I1010 19:06:20.677891 576524 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19787-570360/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19787-570360/.minikube/cert.pem (1123 bytes)
I1010 19:06:20.677955 576524 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19787-570360/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19787-570360/.minikube/key.pem (1675 bytes)
I1010 19:06:20.678005 576524 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19787-570360/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19787-570360/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19787-570360/.minikube/certs/ca-key.pem org=jenkins.addons-874682 san=[127.0.0.1 192.168.49.2 addons-874682 localhost minikube]
I1010 19:06:21.334789 576524 provision.go:177] copyRemoteCerts
I1010 19:06:21.334858 576524 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1010 19:06:21.334902 576524 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-874682
I1010 19:06:21.351703 576524 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33505 SSHKeyPath:/home/jenkins/minikube-integration/19787-570360/.minikube/machines/addons-874682/id_rsa Username:docker}
I1010 19:06:21.446164 576524 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19787-570360/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1010 19:06:21.470530 576524 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19787-570360/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I1010 19:06:21.494120 576524 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19787-570360/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I1010 19:06:21.517619 576524 provision.go:87] duration metric: took 857.300617ms to configureAuth
I1010 19:06:21.517649 576524 ubuntu.go:193] setting minikube options for container-runtime
I1010 19:06:21.517844 576524 config.go:182] Loaded profile config "addons-874682": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I1010 19:06:21.517858 576524 machine.go:96] duration metric: took 4.322834938s to provisionDockerMachine
I1010 19:06:21.517865 576524 client.go:171] duration metric: took 12.716289009s to LocalClient.Create
I1010 19:06:21.517884 576524 start.go:167] duration metric: took 12.716358415s to libmachine.API.Create "addons-874682"
I1010 19:06:21.517897 576524 start.go:293] postStartSetup for "addons-874682" (driver="docker")
I1010 19:06:21.517906 576524 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1010 19:06:21.517961 576524 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1010 19:06:21.518011 576524 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-874682
I1010 19:06:21.533806 576524 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33505 SSHKeyPath:/home/jenkins/minikube-integration/19787-570360/.minikube/machines/addons-874682/id_rsa Username:docker}
I1010 19:06:21.626571 576524 ssh_runner.go:195] Run: cat /etc/os-release
I1010 19:06:21.629918 576524 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1010 19:06:21.629971 576524 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I1010 19:06:21.629984 576524 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I1010 19:06:21.629991 576524 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I1010 19:06:21.630001 576524 filesync.go:126] Scanning /home/jenkins/minikube-integration/19787-570360/.minikube/addons for local assets ...
I1010 19:06:21.630072 576524 filesync.go:126] Scanning /home/jenkins/minikube-integration/19787-570360/.minikube/files for local assets ...
I1010 19:06:21.630103 576524 start.go:296] duration metric: took 112.199554ms for postStartSetup
I1010 19:06:21.630426 576524 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-874682
I1010 19:06:21.646959 576524 profile.go:143] Saving config to /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/config.json ...
I1010 19:06:21.647250 576524 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1010 19:06:21.647302 576524 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-874682
I1010 19:06:21.663339 576524 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33505 SSHKeyPath:/home/jenkins/minikube-integration/19787-570360/.minikube/machines/addons-874682/id_rsa Username:docker}
I1010 19:06:21.756995 576524 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1010 19:06:21.761363 576524 start.go:128] duration metric: took 12.963727877s to createHost
I1010 19:06:21.761393 576524 start.go:83] releasing machines lock for "addons-874682", held for 12.963878703s
I1010 19:06:21.761491 576524 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-874682
I1010 19:06:21.778861 576524 ssh_runner.go:195] Run: cat /version.json
I1010 19:06:21.778885 576524 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1010 19:06:21.778919 576524 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-874682
I1010 19:06:21.778953 576524 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-874682
I1010 19:06:21.795307 576524 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33505 SSHKeyPath:/home/jenkins/minikube-integration/19787-570360/.minikube/machines/addons-874682/id_rsa Username:docker}
I1010 19:06:21.796618 576524 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33505 SSHKeyPath:/home/jenkins/minikube-integration/19787-570360/.minikube/machines/addons-874682/id_rsa Username:docker}
I1010 19:06:21.883836 576524 ssh_runner.go:195] Run: systemctl --version
I1010 19:06:22.016908 576524 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I1010 19:06:22.021432 576524 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I1010 19:06:22.045888 576524 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I1010 19:06:22.045990 576524 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1010 19:06:22.075254 576524 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I1010 19:06:22.075277 576524 start.go:495] detecting cgroup driver to use...
I1010 19:06:22.075309 576524 detect.go:187] detected "cgroupfs" cgroup driver on host os
I1010 19:06:22.075365 576524 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I1010 19:06:22.087865 576524 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1010 19:06:22.099957 576524 docker.go:217] disabling cri-docker service (if available) ...
I1010 19:06:22.100058 576524 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1010 19:06:22.114658 576524 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1010 19:06:22.129103 576524 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1010 19:06:22.215281 576524 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1010 19:06:22.313289 576524 docker.go:233] disabling docker service ...
I1010 19:06:22.313362 576524 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1010 19:06:22.332820 576524 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1010 19:06:22.344958 576524 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1010 19:06:22.439152 576524 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1010 19:06:22.530335 576524 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1010 19:06:22.541297 576524 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I1010 19:06:22.557798 576524 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I1010 19:06:22.567463 576524 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I1010 19:06:22.576900 576524 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I1010 19:06:22.577035 576524 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I1010 19:06:22.587732 576524 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1010 19:06:22.598196 576524 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I1010 19:06:22.608175 576524 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1010 19:06:22.617842 576524 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1010 19:06:22.627272 576524 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I1010 19:06:22.637120 576524 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I1010 19:06:22.646870 576524 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I1010 19:06:22.656691 576524 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1010 19:06:22.665104 576524 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1010 19:06:22.673550 576524 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1010 19:06:22.757650 576524 ssh_runner.go:195] Run: sudo systemctl restart containerd
I1010 19:06:22.892730 576524 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I1010 19:06:22.892843 576524 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I1010 19:06:22.896522 576524 start.go:563] Will wait 60s for crictl version
I1010 19:06:22.896623 576524 ssh_runner.go:195] Run: which crictl
I1010 19:06:22.900068 576524 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I1010 19:06:22.938545 576524 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.22
RuntimeApiVersion: v1
I1010 19:06:22.938657 576524 ssh_runner.go:195] Run: containerd --version
I1010 19:06:22.963260 576524 ssh_runner.go:195] Run: containerd --version
I1010 19:06:22.987801 576524 out.go:177] * Preparing Kubernetes v1.31.1 on containerd 1.7.22 ...
I1010 19:06:22.989715 576524 cli_runner.go:164] Run: docker network inspect addons-874682 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1010 19:06:23.009094 576524 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I1010 19:06:23.012830 576524 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1010 19:06:23.023407 576524 kubeadm.go:883] updating cluster {Name:addons-874682 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-874682 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cus
tomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1010 19:06:23.023526 576524 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I1010 19:06:23.023588 576524 ssh_runner.go:195] Run: sudo crictl images --output json
I1010 19:06:23.064717 576524 containerd.go:627] all images are preloaded for containerd runtime.
I1010 19:06:23.064742 576524 containerd.go:534] Images already preloaded, skipping extraction
I1010 19:06:23.064805 576524 ssh_runner.go:195] Run: sudo crictl images --output json
I1010 19:06:23.102462 576524 containerd.go:627] all images are preloaded for containerd runtime.
I1010 19:06:23.102484 576524 cache_images.go:84] Images are preloaded, skipping loading
I1010 19:06:23.102493 576524 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.1 containerd true true} ...
I1010 19:06:23.102639 576524 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-874682 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.31.1 ClusterName:addons-874682 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1010 19:06:23.102714 576524 ssh_runner.go:195] Run: sudo crictl info
I1010 19:06:23.141875 576524 cni.go:84] Creating CNI manager for ""
I1010 19:06:23.141903 576524 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I1010 19:06:23.141914 576524 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I1010 19:06:23.141942 576524 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-874682 NodeName:addons-874682 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc
/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1010 19:06:23.142074 576524 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "addons-874682"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1010 19:06:23.142146 576524 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1
I1010 19:06:23.150945 576524 binaries.go:44] Found k8s binaries, skipping transfer
I1010 19:06:23.151077 576524 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1010 19:06:23.159704 576524 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (317 bytes)
I1010 19:06:23.177091 576524 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1010 19:06:23.195022 576524 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2167 bytes)
I1010 19:06:23.212535 576524 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I1010 19:06:23.215776 576524 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1010 19:06:23.226246 576524 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1010 19:06:23.311188 576524 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1010 19:06:23.326044 576524 certs.go:68] Setting up /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682 for IP: 192.168.49.2
I1010 19:06:23.326116 576524 certs.go:194] generating shared ca certs ...
I1010 19:06:23.326147 576524 certs.go:226] acquiring lock for ca certs: {Name:mk492e576303d81eeeb5b49e9a60ee1ee62929b7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1010 19:06:23.327189 576524 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19787-570360/.minikube/ca.key
I1010 19:06:23.773600 576524 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19787-570360/.minikube/ca.crt ...
I1010 19:06:23.773641 576524 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19787-570360/.minikube/ca.crt: {Name:mk18f3794cbe4181a8f1b988f32b4452b841e0ad Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1010 19:06:23.774804 576524 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19787-570360/.minikube/ca.key ...
I1010 19:06:23.774827 576524 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19787-570360/.minikube/ca.key: {Name:mk11abc7feeefe0e62c8d0ed5db5c77a5d35c11d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1010 19:06:23.775524 576524 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19787-570360/.minikube/proxy-client-ca.key
I1010 19:06:24.274233 576524 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19787-570360/.minikube/proxy-client-ca.crt ...
I1010 19:06:24.274264 576524 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19787-570360/.minikube/proxy-client-ca.crt: {Name:mk175ff083c3672a6ba4aac1c483f3286c5de6ec Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1010 19:06:24.275089 576524 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19787-570360/.minikube/proxy-client-ca.key ...
I1010 19:06:24.275105 576524 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19787-570360/.minikube/proxy-client-ca.key: {Name:mkd48def57ffb892b74b2efd9b80326c83c2f756 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1010 19:06:24.275194 576524 certs.go:256] generating profile certs ...
I1010 19:06:24.275260 576524 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/client.key
I1010 19:06:24.275278 576524 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/client.crt with IP's: []
I1010 19:06:24.542829 576524 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/client.crt ...
I1010 19:06:24.542875 576524 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/client.crt: {Name:mk6d8cf73f345e4512c186ff057e71a0d9e93c30 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1010 19:06:24.543515 576524 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/client.key ...
I1010 19:06:24.543532 576524 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/client.key: {Name:mk315c4bd6a22972a6ad97a14923ea373b5d4446 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1010 19:06:24.543988 576524 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/apiserver.key.a18064c5
I1010 19:06:24.544012 576524 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/apiserver.crt.a18064c5 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I1010 19:06:25.176520 576524 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/apiserver.crt.a18064c5 ...
I1010 19:06:25.176568 576524 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/apiserver.crt.a18064c5: {Name:mk0b371de9ed1ee794fad059f157dff91d053cf6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1010 19:06:25.176773 576524 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/apiserver.key.a18064c5 ...
I1010 19:06:25.176789 576524 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/apiserver.key.a18064c5: {Name:mkf799111807ca7e5b198f306bb397a35482bdf7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1010 19:06:25.177879 576524 certs.go:381] copying /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/apiserver.crt.a18064c5 -> /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/apiserver.crt
I1010 19:06:25.177972 576524 certs.go:385] copying /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/apiserver.key.a18064c5 -> /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/apiserver.key
I1010 19:06:25.178028 576524 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/proxy-client.key
I1010 19:06:25.178048 576524 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/proxy-client.crt with IP's: []
I1010 19:06:26.279278 576524 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/proxy-client.crt ...
I1010 19:06:26.279319 576524 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/proxy-client.crt: {Name:mke5afd6b4c8940c8cf7cb04d90a144c0d6b86b7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1010 19:06:26.279561 576524 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/proxy-client.key ...
I1010 19:06:26.279585 576524 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/proxy-client.key: {Name:mk94aa3ecdb6a422a729eca3b9154951de809548 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1010 19:06:26.280620 576524 certs.go:484] found cert: /home/jenkins/minikube-integration/19787-570360/.minikube/certs/ca-key.pem (1675 bytes)
I1010 19:06:26.280683 576524 certs.go:484] found cert: /home/jenkins/minikube-integration/19787-570360/.minikube/certs/ca.pem (1078 bytes)
I1010 19:06:26.280719 576524 certs.go:484] found cert: /home/jenkins/minikube-integration/19787-570360/.minikube/certs/cert.pem (1123 bytes)
I1010 19:06:26.280746 576524 certs.go:484] found cert: /home/jenkins/minikube-integration/19787-570360/.minikube/certs/key.pem (1675 bytes)
I1010 19:06:26.281400 576524 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19787-570360/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1010 19:06:26.305971 576524 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19787-570360/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1010 19:06:26.330282 576524 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19787-570360/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1010 19:06:26.354092 576524 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19787-570360/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1010 19:06:26.381868 576524 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I1010 19:06:26.407529 576524 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1010 19:06:26.434306 576524 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1010 19:06:26.458612 576524 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19787-570360/.minikube/profiles/addons-874682/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1010 19:06:26.482406 576524 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19787-570360/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1010 19:06:26.506208 576524 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1010 19:06:26.523976 576524 ssh_runner.go:195] Run: openssl version
I1010 19:06:26.529407 576524 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1010 19:06:26.538477 576524 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1010 19:06:26.541712 576524 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Oct 10 19:06 /usr/share/ca-certificates/minikubeCA.pem
I1010 19:06:26.541772 576524 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1010 19:06:26.548301 576524 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1010 19:06:26.557674 576524 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1010 19:06:26.560786 576524 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I1010 19:06:26.560884 576524 kubeadm.go:392] StartCluster: {Name:addons-874682 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-874682 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom
QemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1010 19:06:26.560977 576524 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I1010 19:06:26.561034 576524 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1010 19:06:26.597429 576524 cri.go:89] found id: ""
I1010 19:06:26.597524 576524 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1010 19:06:26.606419 576524 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1010 19:06:26.615232 576524 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I1010 19:06:26.615314 576524 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1010 19:06:26.624595 576524 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1010 19:06:26.624615 576524 kubeadm.go:157] found existing configuration files:
I1010 19:06:26.624687 576524 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I1010 19:06:26.633574 576524 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I1010 19:06:26.633679 576524 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I1010 19:06:26.642075 576524 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I1010 19:06:26.650832 576524 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I1010 19:06:26.650928 576524 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I1010 19:06:26.659253 576524 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I1010 19:06:26.668359 576524 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I1010 19:06:26.668443 576524 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I1010 19:06:26.677041 576524 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I1010 19:06:26.685577 576524 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I1010 19:06:26.685694 576524 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I1010 19:06:26.694352 576524 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I1010 19:06:26.738745 576524 kubeadm.go:310] [init] Using Kubernetes version: v1.31.1
I1010 19:06:26.738921 576524 kubeadm.go:310] [preflight] Running pre-flight checks
I1010 19:06:26.758545 576524 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I1010 19:06:26.758662 576524 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1070-aws[0m
I1010 19:06:26.758728 576524 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I1010 19:06:26.758909 576524 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I1010 19:06:26.758976 576524 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I1010 19:06:26.759052 576524 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I1010 19:06:26.759120 576524 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I1010 19:06:26.759200 576524 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I1010 19:06:26.759268 576524 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I1010 19:06:26.759341 576524 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I1010 19:06:26.759410 576524 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I1010 19:06:26.759483 576524 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I1010 19:06:26.815690 576524 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I1010 19:06:26.815890 576524 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1010 19:06:26.816012 576524 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I1010 19:06:26.821914 576524 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1010 19:06:26.825644 576524 out.go:235] - Generating certificates and keys ...
I1010 19:06:26.825824 576524 kubeadm.go:310] [certs] Using existing ca certificate authority
I1010 19:06:26.825935 576524 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I1010 19:06:27.438979 576524 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I1010 19:06:28.083798 576524 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I1010 19:06:28.441682 576524 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I1010 19:06:28.837953 576524 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I1010 19:06:29.224805 576524 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I1010 19:06:29.225222 576524 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-874682 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I1010 19:06:29.681577 576524 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I1010 19:06:29.681945 576524 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-874682 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I1010 19:06:29.853428 576524 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I1010 19:06:30.198165 576524 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I1010 19:06:30.638262 576524 kubeadm.go:310] [certs] Generating "sa" key and public key
I1010 19:06:30.638520 576524 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1010 19:06:31.017783 576524 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I1010 19:06:31.485905 576524 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I1010 19:06:31.927945 576524 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1010 19:06:32.478241 576524 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1010 19:06:33.045510 576524 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1010 19:06:33.046267 576524 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1010 19:06:33.049526 576524 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1010 19:06:33.052707 576524 out.go:235] - Booting up control plane ...
I1010 19:06:33.052824 576524 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1010 19:06:33.052901 576524 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1010 19:06:33.052967 576524 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1010 19:06:33.084506 576524 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1010 19:06:33.090224 576524 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1010 19:06:33.090281 576524 kubeadm.go:310] [kubelet-start] Starting the kubelet
I1010 19:06:33.183643 576524 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I1010 19:06:33.183764 576524 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I1010 19:06:34.189518 576524 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.006646612s
I1010 19:06:34.189607 576524 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I1010 19:06:40.691440 576524 kubeadm.go:310] [api-check] The API server is healthy after 6.502162937s
I1010 19:06:40.710981 576524 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I1010 19:06:40.725477 576524 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I1010 19:06:40.749944 576524 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I1010 19:06:40.750401 576524 kubeadm.go:310] [mark-control-plane] Marking the node addons-874682 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I1010 19:06:40.761553 576524 kubeadm.go:310] [bootstrap-token] Using token: pd2jr8.b111iybtldrb4pgu
I1010 19:06:40.764273 576524 out.go:235] - Configuring RBAC rules ...
I1010 19:06:40.764425 576524 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I1010 19:06:40.770694 576524 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I1010 19:06:40.779198 576524 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I1010 19:06:40.787399 576524 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I1010 19:06:40.792040 576524 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I1010 19:06:40.797163 576524 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I1010 19:06:41.098284 576524 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I1010 19:06:41.524487 576524 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I1010 19:06:42.099900 576524 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I1010 19:06:42.103722 576524 kubeadm.go:310]
I1010 19:06:42.103828 576524 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I1010 19:06:42.103845 576524 kubeadm.go:310]
I1010 19:06:42.103924 576524 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I1010 19:06:42.103936 576524 kubeadm.go:310]
I1010 19:06:42.103962 576524 kubeadm.go:310] mkdir -p $HOME/.kube
I1010 19:06:42.104041 576524 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I1010 19:06:42.104100 576524 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I1010 19:06:42.104113 576524 kubeadm.go:310]
I1010 19:06:42.104169 576524 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I1010 19:06:42.104179 576524 kubeadm.go:310]
I1010 19:06:42.104227 576524 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I1010 19:06:42.104235 576524 kubeadm.go:310]
I1010 19:06:42.104290 576524 kubeadm.go:310] You should now deploy a pod network to the cluster.
I1010 19:06:42.104370 576524 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I1010 19:06:42.104512 576524 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I1010 19:06:42.104530 576524 kubeadm.go:310]
I1010 19:06:42.104615 576524 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I1010 19:06:42.104697 576524 kubeadm.go:310] and service account keys on each node and then running the following as root:
I1010 19:06:42.104708 576524 kubeadm.go:310]
I1010 19:06:42.104792 576524 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token pd2jr8.b111iybtldrb4pgu \
I1010 19:06:42.104894 576524 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:3e260b24ebe45e61a0db85b69c983fb4bdba9dfa7bd5adc576e0900a94f18c2c \
I1010 19:06:42.104915 576524 kubeadm.go:310] --control-plane
I1010 19:06:42.104920 576524 kubeadm.go:310]
I1010 19:06:42.105004 576524 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I1010 19:06:42.105009 576524 kubeadm.go:310]
I1010 19:06:42.105090 576524 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token pd2jr8.b111iybtldrb4pgu \
I1010 19:06:42.105209 576524 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:3e260b24ebe45e61a0db85b69c983fb4bdba9dfa7bd5adc576e0900a94f18c2c
I1010 19:06:42.108769 576524 kubeadm.go:310] W1010 19:06:26.733831 1031 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I1010 19:06:42.109101 576524 kubeadm.go:310] W1010 19:06:26.734627 1031 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I1010 19:06:42.109329 576524 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1070-aws\n", err: exit status 1
I1010 19:06:42.109515 576524 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1010 19:06:42.109559 576524 cni.go:84] Creating CNI manager for ""
I1010 19:06:42.109578 576524 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I1010 19:06:42.113335 576524 out.go:177] * Configuring CNI (Container Networking Interface) ...
I1010 19:06:42.115862 576524 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I1010 19:06:42.122736 576524 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.1/kubectl ...
I1010 19:06:42.122774 576524 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I1010 19:06:42.153622 576524 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I1010 19:06:42.526109 576524 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I1010 19:06:42.526233 576524 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I1010 19:06:42.526305 576524 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-874682 minikube.k8s.io/updated_at=2024_10_10T19_06_42_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=e90d7de550e839433dc631623053398b652747fc minikube.k8s.io/name=addons-874682 minikube.k8s.io/primary=true
I1010 19:06:42.750808 576524 ops.go:34] apiserver oom_adj: -16
I1010 19:06:42.750999 576524 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1010 19:06:43.251809 576524 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1010 19:06:43.751565 576524 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1010 19:06:44.251064 576524 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1010 19:06:44.751857 576524 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1010 19:06:45.252090 576524 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1010 19:06:45.751925 576524 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1010 19:06:46.251847 576524 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1010 19:06:46.751262 576524 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1010 19:06:46.841197 576524 kubeadm.go:1113] duration metric: took 4.315005381s to wait for elevateKubeSystemPrivileges
I1010 19:06:46.841227 576524 kubeadm.go:394] duration metric: took 20.280347704s to StartCluster
I1010 19:06:46.841245 576524 settings.go:142] acquiring lock: {Name:mka40a9b35e8c200ed75b9614f1d554a67d02c7a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1010 19:06:46.841374 576524 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19787-570360/kubeconfig
I1010 19:06:46.841763 576524 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19787-570360/kubeconfig: {Name:mk730f2402d93b950781e597a58fee757da86f2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1010 19:06:46.843105 576524 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I1010 19:06:46.843128 576524 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I1010 19:06:46.843398 576524 config.go:182] Loaded profile config "addons-874682": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I1010 19:06:46.843433 576524 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I1010 19:06:46.843528 576524 addons.go:69] Setting yakd=true in profile "addons-874682"
I1010 19:06:46.843543 576524 addons.go:234] Setting addon yakd=true in "addons-874682"
I1010 19:06:46.843570 576524 host.go:66] Checking if "addons-874682" exists ...
I1010 19:06:46.844056 576524 cli_runner.go:164] Run: docker container inspect addons-874682 --format={{.State.Status}}
I1010 19:06:46.844620 576524 addons.go:69] Setting cloud-spanner=true in profile "addons-874682"
I1010 19:06:46.844642 576524 addons.go:234] Setting addon cloud-spanner=true in "addons-874682"
I1010 19:06:46.844670 576524 host.go:66] Checking if "addons-874682" exists ...
I1010 19:06:46.845114 576524 cli_runner.go:164] Run: docker container inspect addons-874682 --format={{.State.Status}}
I1010 19:06:46.845856 576524 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-874682"
I1010 19:06:46.845948 576524 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-874682"
I1010 19:06:46.846015 576524 host.go:66] Checking if "addons-874682" exists ...
I1010 19:06:46.849777 576524 cli_runner.go:164] Run: docker container inspect addons-874682 --format={{.State.Status}}
I1010 19:06:46.849938 576524 addons.go:69] Setting default-storageclass=true in profile "addons-874682"
I1010 19:06:46.849957 576524 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-874682"
I1010 19:06:46.850256 576524 cli_runner.go:164] Run: docker container inspect addons-874682 --format={{.State.Status}}
I1010 19:06:46.866192 576524 out.go:177] * Verifying Kubernetes components...
I1010 19:06:46.866369 576524 addons.go:69] Setting gcp-auth=true in profile "addons-874682"
I1010 19:06:46.866395 576524 mustload.go:65] Loading cluster: addons-874682
I1010 19:06:46.866581 576524 config.go:182] Loaded profile config "addons-874682": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I1010 19:06:46.866943 576524 cli_runner.go:164] Run: docker container inspect addons-874682 --format={{.State.Status}}
I1010 19:06:46.868358 576524 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1010 19:06:46.872191 576524 addons.go:69] Setting ingress=true in profile "addons-874682"
I1010 19:06:46.872226 576524 addons.go:234] Setting addon ingress=true in "addons-874682"
I1010 19:06:46.872280 576524 host.go:66] Checking if "addons-874682" exists ...
I1010 19:06:46.872599 576524 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-874682"
I1010 19:06:46.872619 576524 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-874682"
I1010 19:06:46.872982 576524 cli_runner.go:164] Run: docker container inspect addons-874682 --format={{.State.Status}}
I1010 19:06:46.875490 576524 cli_runner.go:164] Run: docker container inspect addons-874682 --format={{.State.Status}}
I1010 19:06:46.885918 576524 addons.go:69] Setting volcano=true in profile "addons-874682"
I1010 19:06:46.885967 576524 addons.go:234] Setting addon volcano=true in "addons-874682"
I1010 19:06:46.886018 576524 host.go:66] Checking if "addons-874682" exists ...
I1010 19:06:46.886538 576524 cli_runner.go:164] Run: docker container inspect addons-874682 --format={{.State.Status}}
I1010 19:06:46.893939 576524 addons.go:69] Setting ingress-dns=true in profile "addons-874682"
I1010 19:06:46.893989 576524 addons.go:234] Setting addon ingress-dns=true in "addons-874682"
I1010 19:06:46.894035 576524 host.go:66] Checking if "addons-874682" exists ...
I1010 19:06:46.894541 576524 cli_runner.go:164] Run: docker container inspect addons-874682 --format={{.State.Status}}
I1010 19:06:46.902858 576524 addons.go:69] Setting volumesnapshots=true in profile "addons-874682"
I1010 19:06:46.902900 576524 addons.go:234] Setting addon volumesnapshots=true in "addons-874682"
I1010 19:06:46.902943 576524 host.go:66] Checking if "addons-874682" exists ...
I1010 19:06:46.903463 576524 cli_runner.go:164] Run: docker container inspect addons-874682 --format={{.State.Status}}
I1010 19:06:46.906103 576524 addons.go:69] Setting inspektor-gadget=true in profile "addons-874682"
I1010 19:06:46.906135 576524 addons.go:234] Setting addon inspektor-gadget=true in "addons-874682"
I1010 19:06:46.906176 576524 host.go:66] Checking if "addons-874682" exists ...
I1010 19:06:46.906651 576524 cli_runner.go:164] Run: docker container inspect addons-874682 --format={{.State.Status}}
I1010 19:06:46.933718 576524 addons.go:69] Setting metrics-server=true in profile "addons-874682"
I1010 19:06:46.933756 576524 addons.go:234] Setting addon metrics-server=true in "addons-874682"
I1010 19:06:46.933804 576524 host.go:66] Checking if "addons-874682" exists ...
I1010 19:06:46.934341 576524 cli_runner.go:164] Run: docker container inspect addons-874682 --format={{.State.Status}}
I1010 19:06:46.967341 576524 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-874682"
I1010 19:06:46.967377 576524 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-874682"
I1010 19:06:46.967415 576524 host.go:66] Checking if "addons-874682" exists ...
I1010 19:06:46.967933 576524 cli_runner.go:164] Run: docker container inspect addons-874682 --format={{.State.Status}}
I1010 19:06:46.980600 576524 addons.go:69] Setting registry=true in profile "addons-874682"
I1010 19:06:46.980645 576524 addons.go:234] Setting addon registry=true in "addons-874682"
I1010 19:06:46.980686 576524 host.go:66] Checking if "addons-874682" exists ...
I1010 19:06:46.981186 576524 cli_runner.go:164] Run: docker container inspect addons-874682 --format={{.State.Status}}
I1010 19:06:46.997616 576524 addons.go:234] Setting addon default-storageclass=true in "addons-874682"
I1010 19:06:46.997891 576524 host.go:66] Checking if "addons-874682" exists ...
I1010 19:06:46.998982 576524 cli_runner.go:164] Run: docker container inspect addons-874682 --format={{.State.Status}}
I1010 19:06:47.000571 576524 addons.go:69] Setting storage-provisioner=true in profile "addons-874682"
I1010 19:06:47.000608 576524 addons.go:234] Setting addon storage-provisioner=true in "addons-874682"
I1010 19:06:47.000650 576524 host.go:66] Checking if "addons-874682" exists ...
I1010 19:06:47.001160 576524 cli_runner.go:164] Run: docker container inspect addons-874682 --format={{.State.Status}}
I1010 19:06:47.014534 576524 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I1010 19:06:47.050410 576524 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
I1010 19:06:47.050433 576524 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I1010 19:06:47.050510 576524 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-874682
I1010 19:06:47.075474 576524 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I1010 19:06:47.079839 576524 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.24
I1010 19:06:47.096595 576524 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.33.0
I1010 19:06:47.096811 576524 host.go:66] Checking if "addons-874682" exists ...
I1010 19:06:47.098478 576524 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I1010 19:06:47.098497 576524 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I1010 19:06:47.098561 576524 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-874682
I1010 19:06:47.105127 576524 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
I1010 19:06:47.105180 576524 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5248 bytes)
I1010 19:06:47.105273 576524 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-874682
I1010 19:06:47.114889 576524 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I1010 19:06:47.124265 576524 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
I1010 19:06:47.126314 576524 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I1010 19:06:47.126384 576524 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-874682
I1010 19:06:47.138764 576524 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.4
I1010 19:06:47.140570 576524 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.3
I1010 19:06:47.142168 576524 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.4
I1010 19:06:47.144008 576524 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I1010 19:06:47.152386 576524 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I1010 19:06:47.144025 576524 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
I1010 19:06:47.152680 576524 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I1010 19:06:47.152771 576524 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-874682
I1010 19:06:47.175386 576524 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I1010 19:06:47.181456 576524 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I1010 19:06:47.184526 576524 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I1010 19:06:47.126207 576524 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-874682"
I1010 19:06:47.184807 576524 host.go:66] Checking if "addons-874682" exists ...
I1010 19:06:47.185360 576524 cli_runner.go:164] Run: docker container inspect addons-874682 --format={{.State.Status}}
I1010 19:06:47.191857 576524 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I1010 19:06:47.192828 576524 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2
I1010 19:06:47.213773 576524 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I1010 19:06:47.216311 576524 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I1010 19:06:47.216339 576524 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I1010 19:06:47.216428 576524 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-874682
I1010 19:06:47.219084 576524 out.go:177] - Using image docker.io/volcanosh/vc-controller-manager:v1.10.0
I1010 19:06:47.227055 576524 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I1010 19:06:47.227296 576524 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I1010 19:06:47.227310 576524 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I1010 19:06:47.227387 576524 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-874682
I1010 19:06:47.229985 576524 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I1010 19:06:47.230006 576524 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I1010 19:06:47.230073 576524 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-874682
I1010 19:06:47.258577 576524 out.go:177] - Using image docker.io/volcanosh/vc-scheduler:v1.10.0
I1010 19:06:47.263978 576524 out.go:177] - Using image docker.io/volcanosh/vc-webhook-manager:v1.10.0
I1010 19:06:47.265128 576524 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
I1010 19:06:47.266186 576524 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I1010 19:06:47.266202 576524 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1010 19:06:47.266260 576524 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-874682
I1010 19:06:47.293475 576524 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml
I1010 19:06:47.293545 576524 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (471825 bytes)
I1010 19:06:47.293682 576524 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-874682
I1010 19:06:47.304196 576524 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1010 19:06:47.309625 576524 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1010 19:06:47.309653 576524 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1010 19:06:47.309719 576524 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-874682
I1010 19:06:47.319916 576524 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33505 SSHKeyPath:/home/jenkins/minikube-integration/19787-570360/.minikube/machines/addons-874682/id_rsa Username:docker}
I1010 19:06:47.320773 576524 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I1010 19:06:47.320822 576524 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I1010 19:06:47.320907 576524 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-874682
I1010 19:06:47.321231 576524 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33505 SSHKeyPath:/home/jenkins/minikube-integration/19787-570360/.minikube/machines/addons-874682/id_rsa Username:docker}
I1010 19:06:47.321757 576524 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33505 SSHKeyPath:/home/jenkins/minikube-integration/19787-570360/.minikube/machines/addons-874682/id_rsa Username:docker}
I1010 19:06:47.337115 576524 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33505 SSHKeyPath:/home/jenkins/minikube-integration/19787-570360/.minikube/machines/addons-874682/id_rsa Username:docker}
I1010 19:06:47.341726 576524 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.8
I1010 19:06:47.344642 576524 out.go:177] - Using image docker.io/registry:2.8.3
I1010 19:06:47.348999 576524 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
I1010 19:06:47.349024 576524 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I1010 19:06:47.349086 576524 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-874682
I1010 19:06:47.363910 576524 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33505 SSHKeyPath:/home/jenkins/minikube-integration/19787-570360/.minikube/machines/addons-874682/id_rsa Username:docker}
I1010 19:06:47.409039 576524 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33505 SSHKeyPath:/home/jenkins/minikube-integration/19787-570360/.minikube/machines/addons-874682/id_rsa Username:docker}
I1010 19:06:47.409459 576524 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33505 SSHKeyPath:/home/jenkins/minikube-integration/19787-570360/.minikube/machines/addons-874682/id_rsa Username:docker}
I1010 19:06:47.427011 576524 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33505 SSHKeyPath:/home/jenkins/minikube-integration/19787-570360/.minikube/machines/addons-874682/id_rsa Username:docker}
I1010 19:06:47.447249 576524 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I1010 19:06:47.454153 576524 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33505 SSHKeyPath:/home/jenkins/minikube-integration/19787-570360/.minikube/machines/addons-874682/id_rsa Username:docker}
I1010 19:06:47.456987 576524 out.go:177] - Using image docker.io/busybox:stable
I1010 19:06:47.462875 576524 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I1010 19:06:47.462895 576524 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I1010 19:06:47.462960 576524 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-874682
I1010 19:06:47.464860 576524 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I1010 19:06:47.465039 576524 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1010 19:06:47.465153 576524 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33505 SSHKeyPath:/home/jenkins/minikube-integration/19787-570360/.minikube/machines/addons-874682/id_rsa Username:docker}
I1010 19:06:47.494027 576524 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33505 SSHKeyPath:/home/jenkins/minikube-integration/19787-570360/.minikube/machines/addons-874682/id_rsa Username:docker}
W1010 19:06:47.497634 576524 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I1010 19:06:47.497666 576524 retry.go:31] will retry after 342.962896ms: ssh: handshake failed: EOF
I1010 19:06:47.500028 576524 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33505 SSHKeyPath:/home/jenkins/minikube-integration/19787-570360/.minikube/machines/addons-874682/id_rsa Username:docker}
I1010 19:06:47.524977 576524 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33505 SSHKeyPath:/home/jenkins/minikube-integration/19787-570360/.minikube/machines/addons-874682/id_rsa Username:docker}
I1010 19:06:47.532025 576524 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33505 SSHKeyPath:/home/jenkins/minikube-integration/19787-570360/.minikube/machines/addons-874682/id_rsa Username:docker}
I1010 19:06:47.759852 576524 addons.go:431] installing /etc/kubernetes/addons/ig-deployment.yaml
I1010 19:06:47.759915 576524 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-deployment.yaml (14451 bytes)
I1010 19:06:47.798253 576524 node_ready.go:35] waiting up to 6m0s for node "addons-874682" to be "Ready" ...
I1010 19:06:47.801486 576524 node_ready.go:49] node "addons-874682" has status "Ready":"True"
I1010 19:06:47.801552 576524 node_ready.go:38] duration metric: took 3.207291ms for node "addons-874682" to be "Ready" ...
I1010 19:06:47.801591 576524 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I1010 19:06:47.812943 576524 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-28kcp" in "kube-system" namespace to be "Ready" ...
I1010 19:06:48.049189 576524 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I1010 19:06:48.059089 576524 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml
I1010 19:06:48.153825 576524 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I1010 19:06:48.182372 576524 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I1010 19:06:48.182393 576524 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I1010 19:06:48.239857 576524 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I1010 19:06:48.242031 576524 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I1010 19:06:48.286604 576524 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I1010 19:06:48.286688 576524 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I1010 19:06:48.292456 576524 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I1010 19:06:48.292526 576524 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I1010 19:06:48.331228 576524 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I1010 19:06:48.337298 576524 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1010 19:06:48.345521 576524 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
I1010 19:06:48.364101 576524 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1010 19:06:48.374933 576524 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
I1010 19:06:48.375012 576524 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I1010 19:06:48.390687 576524 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I1010 19:06:48.390799 576524 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I1010 19:06:48.417860 576524 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
I1010 19:06:48.417935 576524 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I1010 19:06:48.601899 576524 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I1010 19:06:48.601977 576524 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I1010 19:06:48.605348 576524 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I1010 19:06:48.605427 576524 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I1010 19:06:48.685788 576524 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
I1010 19:06:48.685875 576524 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I1010 19:06:48.715149 576524 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I1010 19:06:48.715171 576524 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I1010 19:06:48.758185 576524 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
I1010 19:06:48.758210 576524 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I1010 19:06:48.808963 576524 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
I1010 19:06:48.808988 576524 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I1010 19:06:48.840411 576524 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I1010 19:06:48.840437 576524 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I1010 19:06:48.854558 576524 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I1010 19:06:48.994254 576524 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I1010 19:06:48.994279 576524 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I1010 19:06:49.080957 576524 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I1010 19:06:49.080992 576524 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I1010 19:06:49.130760 576524 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I1010 19:06:49.174934 576524 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
I1010 19:06:49.174961 576524 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I1010 19:06:49.314008 576524 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I1010 19:06:49.314033 576524 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I1010 19:06:49.324718 576524 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I1010 19:06:49.324747 576524 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I1010 19:06:49.510702 576524 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I1010 19:06:49.510727 576524 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I1010 19:06:49.583014 576524 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I1010 19:06:49.679496 576524 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I1010 19:06:49.679521 576524 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I1010 19:06:49.747086 576524 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I1010 19:06:49.853490 576524 pod_ready.go:103] pod "coredns-7c65d6cfc9-28kcp" in "kube-system" namespace has status "Ready":"False"
I1010 19:06:49.998256 576524 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I1010 19:06:49.998285 576524 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I1010 19:06:50.154611 576524 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.689709979s)
I1010 19:06:50.154641 576524 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I1010 19:06:50.289653 576524 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I1010 19:06:50.289679 576524 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I1010 19:06:50.659040 576524 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-874682" context rescaled to 1 replicas
I1010 19:06:50.793207 576524 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I1010 19:06:50.793278 576524 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I1010 19:06:50.826989 576524 pod_ready.go:98] error getting pod "coredns-7c65d6cfc9-28kcp" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-28kcp" not found
I1010 19:06:50.827065 576524 pod_ready.go:82] duration metric: took 3.014050172s for pod "coredns-7c65d6cfc9-28kcp" in "kube-system" namespace to be "Ready" ...
E1010 19:06:50.827091 576524 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-7c65d6cfc9-28kcp" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-28kcp" not found
I1010 19:06:50.827128 576524 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-k7dbk" in "kube-system" namespace to be "Ready" ...
I1010 19:06:51.085903 576524 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I1010 19:06:51.085982 576524 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I1010 19:06:51.522612 576524 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (3.473320998s)
I1010 19:06:51.674411 576524 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I1010 19:06:52.834156 576524 pod_ready.go:103] pod "coredns-7c65d6cfc9-k7dbk" in "kube-system" namespace has status "Ready":"False"
I1010 19:06:52.885466 576524 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: (4.826336988s)
I1010 19:06:54.307961 576524 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I1010 19:06:54.308138 576524 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-874682
I1010 19:06:54.339233 576524 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33505 SSHKeyPath:/home/jenkins/minikube-integration/19787-570360/.minikube/machines/addons-874682/id_rsa Username:docker}
I1010 19:06:54.834558 576524 pod_ready.go:103] pod "coredns-7c65d6cfc9-k7dbk" in "kube-system" namespace has status "Ready":"False"
I1010 19:06:54.895569 576524 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I1010 19:06:55.096306 576524 addons.go:234] Setting addon gcp-auth=true in "addons-874682"
I1010 19:06:55.096437 576524 host.go:66] Checking if "addons-874682" exists ...
I1010 19:06:55.096961 576524 cli_runner.go:164] Run: docker container inspect addons-874682 --format={{.State.Status}}
I1010 19:06:55.125462 576524 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I1010 19:06:55.125523 576524 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-874682
I1010 19:06:55.147798 576524 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33505 SSHKeyPath:/home/jenkins/minikube-integration/19787-570360/.minikube/machines/addons-874682/id_rsa Username:docker}
I1010 19:06:55.171532 576524 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (7.017621477s)
I1010 19:06:55.171566 576524 addons.go:475] Verifying addon ingress=true in "addons-874682"
I1010 19:06:55.171738 576524 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (6.931858481s)
I1010 19:06:55.171776 576524 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (6.929687531s)
I1010 19:06:55.171804 576524 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (6.840510639s)
I1010 19:06:55.171851 576524 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (6.834488342s)
I1010 19:06:55.174619 576524 out.go:177] * Verifying ingress addon...
I1010 19:06:55.177419 576524 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I1010 19:06:55.183729 576524 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I1010 19:06:55.183759 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:06:55.683375 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:06:56.213111 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:06:56.706390 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:06:56.839875 576524 pod_ready.go:103] pod "coredns-7c65d6cfc9-k7dbk" in "kube-system" namespace has status "Ready":"False"
I1010 19:06:57.108072 576524 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (8.76244866s)
I1010 19:06:57.108135 576524 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (8.743976994s)
I1010 19:06:57.108347 576524 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.253761144s)
I1010 19:06:57.108369 576524 addons.go:475] Verifying addon metrics-server=true in "addons-874682"
I1010 19:06:57.108432 576524 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (7.977615742s)
I1010 19:06:57.108449 576524 addons.go:475] Verifying addon registry=true in "addons-874682"
I1010 19:06:57.108604 576524 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (7.525558051s)
I1010 19:06:57.108941 576524 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (7.36182254s)
W1010 19:06:57.108978 576524 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I1010 19:06:57.108996 576524 retry.go:31] will retry after 354.86372ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I1010 19:06:57.111221 576524 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-874682 service yakd-dashboard -n yakd-dashboard
I1010 19:06:57.111330 576524 out.go:177] * Verifying registry addon...
I1010 19:06:57.114838 576524 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I1010 19:06:57.128925 576524 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I1010 19:06:57.128952 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:06:57.250495 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:06:57.464163 576524 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I1010 19:06:57.655928 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:06:57.736759 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:06:57.984754 576524 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (6.310233489s)
I1010 19:06:57.984789 576524 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-874682"
I1010 19:06:57.984989 576524 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (2.859504935s)
I1010 19:06:57.987227 576524 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.4
I1010 19:06:57.987286 576524 out.go:177] * Verifying csi-hostpath-driver addon...
I1010 19:06:57.990163 576524 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.3
I1010 19:06:57.991020 576524 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I1010 19:06:57.992941 576524 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I1010 19:06:57.992965 576524 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I1010 19:06:58.024602 576524 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I1010 19:06:58.024632 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:06:58.119198 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:06:58.123815 576524 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I1010 19:06:58.123840 576524 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I1010 19:06:58.149864 576524 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I1010 19:06:58.149888 576524 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I1010 19:06:58.203320 576524 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I1010 19:06:58.220084 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:06:58.497641 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:06:58.618817 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:06:58.681957 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:06:58.996984 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:06:59.072305 576524 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.608040111s)
I1010 19:06:59.120629 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:06:59.208718 576524 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.005355235s)
I1010 19:06:59.212428 576524 addons.go:475] Verifying addon gcp-auth=true in "addons-874682"
I1010 19:06:59.215580 576524 out.go:177] * Verifying gcp-auth addon...
I1010 19:06:59.218816 576524 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I1010 19:06:59.227031 576524 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I1010 19:06:59.228393 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:06:59.334289 576524 pod_ready.go:103] pod "coredns-7c65d6cfc9-k7dbk" in "kube-system" namespace has status "Ready":"False"
I1010 19:06:59.497242 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:06:59.619719 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:06:59.682216 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:06:59.996597 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:00.120826 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:00.183547 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:00.497275 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:00.619625 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:00.682140 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:00.996303 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:01.119679 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:01.185917 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:01.334617 576524 pod_ready.go:103] pod "coredns-7c65d6cfc9-k7dbk" in "kube-system" namespace has status "Ready":"False"
I1010 19:07:01.497175 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:01.618884 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:01.682972 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:01.996101 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:02.118351 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:02.181727 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:02.495861 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:02.619258 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:02.681597 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:02.995804 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:03.119264 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:03.181615 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:03.496470 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:03.620088 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:03.723015 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:03.834778 576524 pod_ready.go:103] pod "coredns-7c65d6cfc9-k7dbk" in "kube-system" namespace has status "Ready":"False"
I1010 19:07:03.997049 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:04.119273 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:04.181746 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:04.497173 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:04.619164 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:04.687119 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:04.836323 576524 pod_ready.go:93] pod "coredns-7c65d6cfc9-k7dbk" in "kube-system" namespace has status "Ready":"True"
I1010 19:07:04.836350 576524 pod_ready.go:82] duration metric: took 14.009196184s for pod "coredns-7c65d6cfc9-k7dbk" in "kube-system" namespace to be "Ready" ...
I1010 19:07:04.836363 576524 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-874682" in "kube-system" namespace to be "Ready" ...
I1010 19:07:04.842881 576524 pod_ready.go:93] pod "etcd-addons-874682" in "kube-system" namespace has status "Ready":"True"
I1010 19:07:04.842955 576524 pod_ready.go:82] duration metric: took 6.583295ms for pod "etcd-addons-874682" in "kube-system" namespace to be "Ready" ...
I1010 19:07:04.842985 576524 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-874682" in "kube-system" namespace to be "Ready" ...
I1010 19:07:04.849426 576524 pod_ready.go:93] pod "kube-apiserver-addons-874682" in "kube-system" namespace has status "Ready":"True"
I1010 19:07:04.849512 576524 pod_ready.go:82] duration metric: took 6.504805ms for pod "kube-apiserver-addons-874682" in "kube-system" namespace to be "Ready" ...
I1010 19:07:04.849554 576524 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-874682" in "kube-system" namespace to be "Ready" ...
I1010 19:07:04.857292 576524 pod_ready.go:93] pod "kube-controller-manager-addons-874682" in "kube-system" namespace has status "Ready":"True"
I1010 19:07:04.857314 576524 pod_ready.go:82] duration metric: took 7.723555ms for pod "kube-controller-manager-addons-874682" in "kube-system" namespace to be "Ready" ...
I1010 19:07:04.857326 576524 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-kxfpl" in "kube-system" namespace to be "Ready" ...
I1010 19:07:04.864505 576524 pod_ready.go:93] pod "kube-proxy-kxfpl" in "kube-system" namespace has status "Ready":"True"
I1010 19:07:04.864532 576524 pod_ready.go:82] duration metric: took 7.195362ms for pod "kube-proxy-kxfpl" in "kube-system" namespace to be "Ready" ...
I1010 19:07:04.864544 576524 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-874682" in "kube-system" namespace to be "Ready" ...
I1010 19:07:04.997119 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:05.122176 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:05.182838 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:05.231904 576524 pod_ready.go:93] pod "kube-scheduler-addons-874682" in "kube-system" namespace has status "Ready":"True"
I1010 19:07:05.231977 576524 pod_ready.go:82] duration metric: took 367.424419ms for pod "kube-scheduler-addons-874682" in "kube-system" namespace to be "Ready" ...
I1010 19:07:05.232008 576524 pod_ready.go:39] duration metric: took 17.430385569s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I1010 19:07:05.232049 576524 api_server.go:52] waiting for apiserver process to appear ...
I1010 19:07:05.232137 576524 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1010 19:07:05.248780 576524 api_server.go:72] duration metric: took 18.405608318s to wait for apiserver process to appear ...
I1010 19:07:05.248852 576524 api_server.go:88] waiting for apiserver healthz status ...
I1010 19:07:05.248886 576524 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I1010 19:07:05.256907 576524 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I1010 19:07:05.257994 576524 api_server.go:141] control plane version: v1.31.1
I1010 19:07:05.258056 576524 api_server.go:131] duration metric: took 9.184231ms to wait for apiserver health ...
I1010 19:07:05.258081 576524 system_pods.go:43] waiting for kube-system pods to appear ...
I1010 19:07:05.440676 576524 system_pods.go:59] 18 kube-system pods found
I1010 19:07:05.440758 576524 system_pods.go:61] "coredns-7c65d6cfc9-k7dbk" [4d4599da-c5c4-4b55-9d43-96df54216ffe] Running
I1010 19:07:05.440783 576524 system_pods.go:61] "csi-hostpath-attacher-0" [15c678fd-4f85-4ecf-a593-cc7dad3213f0] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I1010 19:07:05.440811 576524 system_pods.go:61] "csi-hostpath-resizer-0" [f3ceb01e-9504-4061-9103-2a027c0f5b73] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I1010 19:07:05.440838 576524 system_pods.go:61] "csi-hostpathplugin-g9pph" [b234f982-f58f-4296-ab81-5db816f925f8] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I1010 19:07:05.440865 576524 system_pods.go:61] "etcd-addons-874682" [812c7d61-9312-4744-9956-1004cbda1ddd] Running
I1010 19:07:05.440885 576524 system_pods.go:61] "kindnet-zn8rq" [4cbfdd04-4c7e-4bab-8835-b35c80c2b307] Running
I1010 19:07:05.440906 576524 system_pods.go:61] "kube-apiserver-addons-874682" [7d0a8c1c-8ad5-4ba9-81a5-2c7ef188a6c6] Running
I1010 19:07:05.440928 576524 system_pods.go:61] "kube-controller-manager-addons-874682" [91aa8fc6-deb8-4a17-9532-db1421f1801e] Running
I1010 19:07:05.440949 576524 system_pods.go:61] "kube-ingress-dns-minikube" [b55d6d28-1014-458b-bd0f-4b52c834b183] Running
I1010 19:07:05.440970 576524 system_pods.go:61] "kube-proxy-kxfpl" [0892d1ed-df5b-4e9b-839c-2e265c5eb4e1] Running
I1010 19:07:05.440990 576524 system_pods.go:61] "kube-scheduler-addons-874682" [1dd686c6-0fa7-4900-9e2f-9a640638a2b4] Running
I1010 19:07:05.441013 576524 system_pods.go:61] "metrics-server-84c5f94fbc-4v65j" [514e81c5-9419-4b88-b2df-b8a128b72aef] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I1010 19:07:05.441037 576524 system_pods.go:61] "nvidia-device-plugin-daemonset-6mkwn" [3b126d1c-c77e-4215-9f5a-5907ff785c4b] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I1010 19:07:05.441060 576524 system_pods.go:61] "registry-66c9cd494c-t6lqg" [8f9a4c22-9796-4b54-8a90-d41f3390868a] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I1010 19:07:05.441082 576524 system_pods.go:61] "registry-proxy-54kdz" [f8265b07-ab1f-4951-b734-9a0b780f37f1] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I1010 19:07:05.441116 576524 system_pods.go:61] "snapshot-controller-56fcc65765-845lk" [1fe934ce-3ff6-4ee4-8ffe-49723d4a1363] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1010 19:07:05.441141 576524 system_pods.go:61] "snapshot-controller-56fcc65765-lqwx4" [f6f80f2a-713c-4b40-b1a5-a61b2a949415] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1010 19:07:05.441160 576524 system_pods.go:61] "storage-provisioner" [e91b3d51-f745-4add-993e-ee7e1afca492] Running
I1010 19:07:05.441188 576524 system_pods.go:74] duration metric: took 183.087508ms to wait for pod list to return data ...
I1010 19:07:05.441214 576524 default_sa.go:34] waiting for default service account to be created ...
I1010 19:07:05.495533 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:05.619979 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:05.630878 576524 default_sa.go:45] found service account: "default"
I1010 19:07:05.630952 576524 default_sa.go:55] duration metric: took 189.707471ms for default service account to be created ...
I1010 19:07:05.630977 576524 system_pods.go:116] waiting for k8s-apps to be running ...
I1010 19:07:05.682433 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:05.839611 576524 system_pods.go:86] 18 kube-system pods found
I1010 19:07:05.839647 576524 system_pods.go:89] "coredns-7c65d6cfc9-k7dbk" [4d4599da-c5c4-4b55-9d43-96df54216ffe] Running
I1010 19:07:05.839658 576524 system_pods.go:89] "csi-hostpath-attacher-0" [15c678fd-4f85-4ecf-a593-cc7dad3213f0] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I1010 19:07:05.839665 576524 system_pods.go:89] "csi-hostpath-resizer-0" [f3ceb01e-9504-4061-9103-2a027c0f5b73] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I1010 19:07:05.839675 576524 system_pods.go:89] "csi-hostpathplugin-g9pph" [b234f982-f58f-4296-ab81-5db816f925f8] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I1010 19:07:05.839680 576524 system_pods.go:89] "etcd-addons-874682" [812c7d61-9312-4744-9956-1004cbda1ddd] Running
I1010 19:07:05.839685 576524 system_pods.go:89] "kindnet-zn8rq" [4cbfdd04-4c7e-4bab-8835-b35c80c2b307] Running
I1010 19:07:05.839689 576524 system_pods.go:89] "kube-apiserver-addons-874682" [7d0a8c1c-8ad5-4ba9-81a5-2c7ef188a6c6] Running
I1010 19:07:05.839701 576524 system_pods.go:89] "kube-controller-manager-addons-874682" [91aa8fc6-deb8-4a17-9532-db1421f1801e] Running
I1010 19:07:05.839713 576524 system_pods.go:89] "kube-ingress-dns-minikube" [b55d6d28-1014-458b-bd0f-4b52c834b183] Running
I1010 19:07:05.839721 576524 system_pods.go:89] "kube-proxy-kxfpl" [0892d1ed-df5b-4e9b-839c-2e265c5eb4e1] Running
I1010 19:07:05.839726 576524 system_pods.go:89] "kube-scheduler-addons-874682" [1dd686c6-0fa7-4900-9e2f-9a640638a2b4] Running
I1010 19:07:05.839735 576524 system_pods.go:89] "metrics-server-84c5f94fbc-4v65j" [514e81c5-9419-4b88-b2df-b8a128b72aef] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I1010 19:07:05.839744 576524 system_pods.go:89] "nvidia-device-plugin-daemonset-6mkwn" [3b126d1c-c77e-4215-9f5a-5907ff785c4b] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I1010 19:07:05.839755 576524 system_pods.go:89] "registry-66c9cd494c-t6lqg" [8f9a4c22-9796-4b54-8a90-d41f3390868a] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I1010 19:07:05.839763 576524 system_pods.go:89] "registry-proxy-54kdz" [f8265b07-ab1f-4951-b734-9a0b780f37f1] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I1010 19:07:05.839769 576524 system_pods.go:89] "snapshot-controller-56fcc65765-845lk" [1fe934ce-3ff6-4ee4-8ffe-49723d4a1363] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1010 19:07:05.839777 576524 system_pods.go:89] "snapshot-controller-56fcc65765-lqwx4" [f6f80f2a-713c-4b40-b1a5-a61b2a949415] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1010 19:07:05.839784 576524 system_pods.go:89] "storage-provisioner" [e91b3d51-f745-4add-993e-ee7e1afca492] Running
I1010 19:07:05.839803 576524 system_pods.go:126] duration metric: took 208.806113ms to wait for k8s-apps to be running ...
I1010 19:07:05.839814 576524 system_svc.go:44] waiting for kubelet service to be running ....
I1010 19:07:05.839871 576524 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1010 19:07:05.852178 576524 system_svc.go:56] duration metric: took 12.354337ms WaitForService to wait for kubelet
I1010 19:07:05.852207 576524 kubeadm.go:582] duration metric: took 19.009049842s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1010 19:07:05.852227 576524 node_conditions.go:102] verifying NodePressure condition ...
I1010 19:07:05.996130 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:06.032717 576524 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I1010 19:07:06.032756 576524 node_conditions.go:123] node cpu capacity is 2
I1010 19:07:06.032770 576524 node_conditions.go:105] duration metric: took 180.536639ms to run NodePressure ...
I1010 19:07:06.032784 576524 start.go:241] waiting for startup goroutines ...
I1010 19:07:06.119227 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:06.182956 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:06.496783 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:06.618616 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:06.682475 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:06.995881 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:07.118854 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:07.182491 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:07.496716 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:07.620015 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:07.682637 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:07.996763 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:08.119451 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:08.181887 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:08.495938 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:08.619561 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:08.681889 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:08.997767 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:09.119183 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:09.221967 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:09.496699 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:09.619033 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:09.720288 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:09.996713 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:10.127586 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:10.222346 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:10.496765 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:10.618549 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:10.682388 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:10.995734 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:11.118576 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:11.181784 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:11.495911 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:11.618365 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:11.681112 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:11.995500 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:12.120463 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:12.182241 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:12.496665 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:12.619389 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:12.681427 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:12.995704 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:13.119495 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:13.181892 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:13.496251 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:13.619151 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:13.682042 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:13.995583 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:14.119176 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:14.182171 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:14.495717 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:14.618423 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:14.682195 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:14.996327 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:15.120478 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:15.221175 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:15.498065 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:15.619938 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:15.682342 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:16.010310 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:16.119282 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:16.202156 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:16.504022 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:16.623690 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1010 19:07:16.725500 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:16.997428 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:17.120820 576524 kapi.go:107] duration metric: took 20.005977785s to wait for kubernetes.io/minikube-addons=registry ...
I1010 19:07:17.183017 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:17.496827 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:17.682007 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:17.996665 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:18.182608 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:18.496753 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:18.683227 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:18.996712 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:19.181721 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:19.496501 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:19.682392 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:19.996368 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:20.182611 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:20.497100 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:20.683167 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:20.997253 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:21.183225 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:21.495906 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:21.683056 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:21.996702 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:22.182536 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:22.496336 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:22.682265 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:22.995990 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:23.182120 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:23.497063 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:23.682664 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:23.996162 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:24.182267 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:24.496443 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:24.681888 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:24.997552 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:25.182013 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:25.495862 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:25.682217 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:25.999093 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:26.182722 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:26.496108 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:26.683146 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:26.996505 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:27.184845 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:27.496377 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:27.681717 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:27.996348 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:28.181580 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:28.495994 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:28.681811 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:28.996605 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:29.182993 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:29.497151 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:29.684230 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:29.998976 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:30.185625 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:30.498749 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:30.685896 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:30.997152 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:31.181835 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:31.496643 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:31.681726 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:31.997240 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:32.181959 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:32.498613 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:32.682762 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:33.002913 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:33.182454 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:33.496073 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:33.682350 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:33.996815 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:34.181796 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:34.497547 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:34.682044 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:34.999488 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:35.182439 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:35.496264 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:35.682262 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:35.996635 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:36.184780 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:36.496053 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:36.682805 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:36.997282 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:37.182513 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:37.496702 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:37.681225 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:37.996548 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:38.183211 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:38.500103 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:38.683334 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:38.996143 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:39.187498 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:39.497215 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:39.682287 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:39.995775 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:40.182549 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:40.496348 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:40.684795 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:40.996224 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:41.182388 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:41.496849 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:41.681983 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:41.996706 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:42.183238 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:42.496472 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:42.682604 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:43.004563 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:43.187020 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:43.496468 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:43.682917 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:43.996978 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:44.182191 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:44.496483 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:44.682691 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:44.996084 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:45.184512 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:45.496855 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:45.681437 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:45.995844 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:46.182407 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:46.496151 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:46.690935 576524 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I1010 19:07:46.997435 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:47.181822 576524 kapi.go:107] duration metric: took 52.004403204s to wait for app.kubernetes.io/name=ingress-nginx ...
I1010 19:07:47.496132 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:47.996325 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:48.497669 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:49.005212 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:49.495713 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:49.998435 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:50.496458 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:50.995758 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:51.497836 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:51.997296 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:52.496094 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:52.995519 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:53.496519 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:54.000085 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1010 19:07:54.496612 576524 kapi.go:107] duration metric: took 56.505588966s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I1010 19:08:22.722330 576524 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I1010 19:08:22.722356 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:23.223142 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:23.723268 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:24.222471 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:24.722732 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:25.223107 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:25.722233 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:26.222779 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:26.723086 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:27.225629 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:27.723394 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:28.221936 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:28.722876 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:29.222375 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:29.722846 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:30.223146 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:30.723234 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:31.222823 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:31.723304 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:32.223169 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:32.722750 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:33.222368 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:33.722594 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:34.222939 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:34.723107 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:35.221972 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:35.722411 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:36.222650 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:36.722608 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:37.225273 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:37.722958 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:38.222886 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:38.722571 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:39.222153 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:39.723960 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:40.222273 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:40.722904 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:41.222480 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:41.722587 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:42.223697 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:42.723111 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:43.222917 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:43.723163 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:44.222622 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:44.722127 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:45.240584 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:45.723021 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:46.221930 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:46.723062 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:47.225565 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:47.722351 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:48.222551 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:48.722399 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:49.222194 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:49.722980 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:50.223121 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:50.723416 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:51.223311 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:51.721869 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:52.222988 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:52.722505 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:53.222328 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:53.721944 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:54.222880 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:54.722596 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:55.221954 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:55.723050 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:56.222755 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:56.721858 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:57.225381 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:57.722068 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:58.223087 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:58.722870 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:59.224600 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:08:59.722176 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:00.235259 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:00.723178 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:01.223003 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:01.723128 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:02.224767 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:02.722588 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:03.222134 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:03.723213 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:04.222716 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:04.722206 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:05.221876 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:05.722221 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:06.222278 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:06.723292 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:07.225208 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:07.722824 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:08.223323 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:08.722311 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:09.222789 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:09.722241 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:10.223712 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:10.723340 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:11.222935 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:11.722679 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:12.222514 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:12.722211 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:13.222919 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:13.722211 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:14.223194 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:14.722884 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:15.222862 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:15.722014 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:16.223523 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:16.722999 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:17.227340 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:17.722799 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:18.222939 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:18.722713 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:19.223202 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:19.723225 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:20.223292 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:20.723291 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:21.222442 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:21.722012 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:22.223095 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:22.723785 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:23.222163 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:23.722250 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:24.223252 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:24.722872 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:25.222275 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:25.722836 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:26.222870 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:26.722933 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:27.225747 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:27.723006 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:28.222971 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:28.722728 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:29.222056 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:29.724951 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:30.222857 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:30.723206 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:31.222649 576524 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I1010 19:09:31.722953 576524 kapi.go:107] duration metric: took 2m32.504135161s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I1010 19:09:31.725702 576524 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-874682 cluster.
I1010 19:09:31.728581 576524 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I1010 19:09:31.730930 576524 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I1010 19:09:31.733790 576524 out.go:177] * Enabled addons: storage-provisioner-rancher, inspektor-gadget, ingress-dns, cloud-spanner, nvidia-device-plugin, storage-provisioner, volcano, metrics-server, yakd, default-storageclass, volumesnapshots, registry, ingress, csi-hostpath-driver, gcp-auth
I1010 19:09:31.736572 576524 addons.go:510] duration metric: took 2m44.893132019s for enable addons: enabled=[storage-provisioner-rancher inspektor-gadget ingress-dns cloud-spanner nvidia-device-plugin storage-provisioner volcano metrics-server yakd default-storageclass volumesnapshots registry ingress csi-hostpath-driver gcp-auth]
I1010 19:09:31.736626 576524 start.go:246] waiting for cluster config update ...
I1010 19:09:31.736651 576524 start.go:255] writing updated cluster config ...
I1010 19:09:31.736960 576524 ssh_runner.go:195] Run: rm -f paused
I1010 19:09:32.122865 576524 start.go:600] kubectl: 1.31.1, cluster: 1.31.1 (minor skew: 0)
I1010 19:09:32.125433 576524 out.go:177] * Done! kubectl is now configured to use "addons-874682" cluster and "default" namespace by default
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
82da3f7a2d274 9c8d328e7d9e8 3 minutes ago Running gcp-auth 0 34989640284a2 gcp-auth-c684cb797-whskb
04664dec80841 1a9605c872c1d 4 minutes ago Running admission 0 07ea45925540a volcano-admission-5874dfdd79-w22cw
7c2bfe790a5ab ee6d597e62dc8 4 minutes ago Running csi-snapshotter 0 cf45eb731bc8d csi-hostpathplugin-g9pph
ddbc626a37ded 642ded511e141 4 minutes ago Running csi-provisioner 0 cf45eb731bc8d csi-hostpathplugin-g9pph
ed8e123004b40 922312104da8a 5 minutes ago Running liveness-probe 0 cf45eb731bc8d csi-hostpathplugin-g9pph
6bd479868c38d 08f6b2990811a 5 minutes ago Running hostpath 0 cf45eb731bc8d csi-hostpathplugin-g9pph
8096a443c2fe1 0107d56dbc0be 5 minutes ago Running node-driver-registrar 0 cf45eb731bc8d csi-hostpathplugin-g9pph
b1bdd615e2f78 2d37f5a3dd01b 5 minutes ago Running controller 0 a858b81dfe69a ingress-nginx-controller-5f85ff4588-hfmbk
09395c1b97d7f 487fa743e1e22 5 minutes ago Running csi-resizer 0 751adebfc4b78 csi-hostpath-resizer-0
187f6250b6d68 1461903ec4fe9 5 minutes ago Running csi-external-health-monitor-controller 0 cf45eb731bc8d csi-hostpathplugin-g9pph
6c678d4165bad 9a80d518f102c 5 minutes ago Running csi-attacher 0 f0182688e1522 csi-hostpath-attacher-0
bba994ec1e3ca 23cbb28ae641a 5 minutes ago Running volcano-controllers 0 42ef17b64eddc volcano-controllers-789ffc5785-qv8nc
dc37df66f0e83 d54655ed3a854 5 minutes ago Exited patch 0 05e0be39769d1 ingress-nginx-admission-patch-bz6kw
37754c0094779 77bdba588b953 5 minutes ago Running yakd 0 23ddb78a1d0a9 yakd-dashboard-67d98fc6b-562jc
a12ec88d00900 68de1ddeaded8 5 minutes ago Running gadget 0 9ad6bf45ee35e gadget-ld25h
aba83c58e970a 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 79ad44ce7f102 snapshot-controller-56fcc65765-845lk
a1253f088251c d54655ed3a854 5 minutes ago Exited create 0 a0a785a12c5e0 ingress-nginx-admission-create-5plgm
296a08875f4ef 6aa88c604f2b4 5 minutes ago Running volcano-scheduler 0 6991f38635f50 volcano-scheduler-6c9778cbdf-dkzrl
87f8c76991af8 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 e57077b623291 snapshot-controller-56fcc65765-lqwx4
cee230c49a1ee be9cac3585579 5 minutes ago Running cloud-spanner-emulator 0 a8ea715534798 cloud-spanner-emulator-5b584cc74-bwbnl
ab5f6a5b4a95e c9cf76bb104e1 5 minutes ago Running registry 0 2e1c5a3175699 registry-66c9cd494c-t6lqg
4f5bf8a4c93a9 5548a49bb60ba 5 minutes ago Running metrics-server 0 85b824663c81f metrics-server-84c5f94fbc-4v65j
5e435e8321eae 434d64ac3dbf3 5 minutes ago Running registry-proxy 0 951ecf3bd2b96 registry-proxy-54kdz
3ec1e3a8044dd 7ce2150c8929b 5 minutes ago Running local-path-provisioner 0 df03597566c66 local-path-provisioner-86d989889c-qhs4l
4990f1f56214b a9bac31a5be8d 5 minutes ago Running nvidia-device-plugin-ctr 0 d82c561d84785 nvidia-device-plugin-daemonset-6mkwn
04d9341bcbdc8 2f6c962e7b831 5 minutes ago Running coredns 0 205df0882426d coredns-7c65d6cfc9-k7dbk
373800f34a3a9 35508c2f890c4 5 minutes ago Running minikube-ingress-dns 0 5b365c3ce8817 kube-ingress-dns-minikube
ad45af6019278 ba04bb24b9575 5 minutes ago Running storage-provisioner 0 32d8e0c01a0b2 storage-provisioner
850f4060c158c 6a23fa8fd2b78 6 minutes ago Running kindnet-cni 0 f8d98d7f40afe kindnet-zn8rq
6d8e919c955dd 24a140c548c07 6 minutes ago Running kube-proxy 0 e8ff705be8967 kube-proxy-kxfpl
1882c208394a9 27e3830e14027 6 minutes ago Running etcd 0 88accf3b6c8d7 etcd-addons-874682
14b056da2e8a1 7f8aa378bb47d 6 minutes ago Running kube-scheduler 0 cb8c83c40aaf6 kube-scheduler-addons-874682
6be806c6721ca d3f53a98c0a9d 6 minutes ago Running kube-apiserver 0 27eb02ed638bf kube-apiserver-addons-874682
3348ced37201b 279f381cb3736 6 minutes ago Running kube-controller-manager 0 1038f28131e15 kube-controller-manager-addons-874682
==> containerd <==
Oct 10 19:09:41 addons-874682 containerd[817]: time="2024-10-10T19:09:41.480336717Z" level=info msg="RemovePodSandbox for \"d5b90732c5c12b19b53630ca77bd72a3c5160b312e1865915eafd813caecb448\""
Oct 10 19:09:41 addons-874682 containerd[817]: time="2024-10-10T19:09:41.480460113Z" level=info msg="Forcibly stopping sandbox \"d5b90732c5c12b19b53630ca77bd72a3c5160b312e1865915eafd813caecb448\""
Oct 10 19:09:41 addons-874682 containerd[817]: time="2024-10-10T19:09:41.487721131Z" level=info msg="TearDown network for sandbox \"d5b90732c5c12b19b53630ca77bd72a3c5160b312e1865915eafd813caecb448\" successfully"
Oct 10 19:09:41 addons-874682 containerd[817]: time="2024-10-10T19:09:41.494377212Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"d5b90732c5c12b19b53630ca77bd72a3c5160b312e1865915eafd813caecb448\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus."
Oct 10 19:09:41 addons-874682 containerd[817]: time="2024-10-10T19:09:41.494528867Z" level=info msg="RemovePodSandbox \"d5b90732c5c12b19b53630ca77bd72a3c5160b312e1865915eafd813caecb448\" returns successfully"
Oct 10 19:10:41 addons-874682 containerd[817]: time="2024-10-10T19:10:41.498722025Z" level=info msg="RemoveContainer for \"d83bba1977cba06acfe2e907f95e1814393ce6274d8e99865c01a291844b4fdd\""
Oct 10 19:10:41 addons-874682 containerd[817]: time="2024-10-10T19:10:41.511078725Z" level=info msg="RemoveContainer for \"d83bba1977cba06acfe2e907f95e1814393ce6274d8e99865c01a291844b4fdd\" returns successfully"
Oct 10 19:10:41 addons-874682 containerd[817]: time="2024-10-10T19:10:41.513437206Z" level=info msg="RemoveContainer for \"a0a8db193893553fcf9d89dcfec16b534d8b87aaa5f18f818f2c64c6e71d9354\""
Oct 10 19:10:41 addons-874682 containerd[817]: time="2024-10-10T19:10:41.519661763Z" level=info msg="RemoveContainer for \"a0a8db193893553fcf9d89dcfec16b534d8b87aaa5f18f818f2c64c6e71d9354\" returns successfully"
Oct 10 19:10:41 addons-874682 containerd[817]: time="2024-10-10T19:10:41.521660245Z" level=info msg="StopPodSandbox for \"7d5ed9ee9b69d33e712029c06e3c6f8e95607c988a4321147c820284f8eb44e0\""
Oct 10 19:10:41 addons-874682 containerd[817]: time="2024-10-10T19:10:41.542102081Z" level=info msg="TearDown network for sandbox \"7d5ed9ee9b69d33e712029c06e3c6f8e95607c988a4321147c820284f8eb44e0\" successfully"
Oct 10 19:10:41 addons-874682 containerd[817]: time="2024-10-10T19:10:41.542149613Z" level=info msg="StopPodSandbox for \"7d5ed9ee9b69d33e712029c06e3c6f8e95607c988a4321147c820284f8eb44e0\" returns successfully"
Oct 10 19:10:41 addons-874682 containerd[817]: time="2024-10-10T19:10:41.542748003Z" level=info msg="RemovePodSandbox for \"7d5ed9ee9b69d33e712029c06e3c6f8e95607c988a4321147c820284f8eb44e0\""
Oct 10 19:10:41 addons-874682 containerd[817]: time="2024-10-10T19:10:41.542786928Z" level=info msg="Forcibly stopping sandbox \"7d5ed9ee9b69d33e712029c06e3c6f8e95607c988a4321147c820284f8eb44e0\""
Oct 10 19:10:41 addons-874682 containerd[817]: time="2024-10-10T19:10:41.551107123Z" level=info msg="TearDown network for sandbox \"7d5ed9ee9b69d33e712029c06e3c6f8e95607c988a4321147c820284f8eb44e0\" successfully"
Oct 10 19:10:41 addons-874682 containerd[817]: time="2024-10-10T19:10:41.557065392Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"7d5ed9ee9b69d33e712029c06e3c6f8e95607c988a4321147c820284f8eb44e0\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus."
Oct 10 19:10:41 addons-874682 containerd[817]: time="2024-10-10T19:10:41.557323886Z" level=info msg="RemovePodSandbox \"7d5ed9ee9b69d33e712029c06e3c6f8e95607c988a4321147c820284f8eb44e0\" returns successfully"
Oct 10 19:10:41 addons-874682 containerd[817]: time="2024-10-10T19:10:41.557786653Z" level=info msg="StopPodSandbox for \"ba8295e1e0ebe0fd52d2f0498491351f10d8eaec0ddb61586f7fda99878fda74\""
Oct 10 19:10:41 addons-874682 containerd[817]: time="2024-10-10T19:10:41.565763408Z" level=info msg="TearDown network for sandbox \"ba8295e1e0ebe0fd52d2f0498491351f10d8eaec0ddb61586f7fda99878fda74\" successfully"
Oct 10 19:10:41 addons-874682 containerd[817]: time="2024-10-10T19:10:41.565802513Z" level=info msg="StopPodSandbox for \"ba8295e1e0ebe0fd52d2f0498491351f10d8eaec0ddb61586f7fda99878fda74\" returns successfully"
Oct 10 19:10:41 addons-874682 containerd[817]: time="2024-10-10T19:10:41.566316604Z" level=info msg="RemovePodSandbox for \"ba8295e1e0ebe0fd52d2f0498491351f10d8eaec0ddb61586f7fda99878fda74\""
Oct 10 19:10:41 addons-874682 containerd[817]: time="2024-10-10T19:10:41.566447951Z" level=info msg="Forcibly stopping sandbox \"ba8295e1e0ebe0fd52d2f0498491351f10d8eaec0ddb61586f7fda99878fda74\""
Oct 10 19:10:41 addons-874682 containerd[817]: time="2024-10-10T19:10:41.586177774Z" level=info msg="TearDown network for sandbox \"ba8295e1e0ebe0fd52d2f0498491351f10d8eaec0ddb61586f7fda99878fda74\" successfully"
Oct 10 19:10:41 addons-874682 containerd[817]: time="2024-10-10T19:10:41.593149125Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"ba8295e1e0ebe0fd52d2f0498491351f10d8eaec0ddb61586f7fda99878fda74\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus."
Oct 10 19:10:41 addons-874682 containerd[817]: time="2024-10-10T19:10:41.593337843Z" level=info msg="RemovePodSandbox \"ba8295e1e0ebe0fd52d2f0498491351f10d8eaec0ddb61586f7fda99878fda74\" returns successfully"
==> coredns [04d9341bcbdc88b087504c5fc39fd364f35cc570ce616d13e6eefe1dfe044a65] <==
[INFO] 10.244.0.5:46499 - 20621 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 81 false 1232" NXDOMAIN qr,aa,rd 163 0.000045161s
[INFO] 10.244.0.5:46499 - 63757 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 94 false 1232" NXDOMAIN qr,rd,ra 83 0.001881047s
[INFO] 10.244.0.5:46499 - 12786 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 94 false 1232" NXDOMAIN qr,rd,ra 83 0.001854389s
[INFO] 10.244.0.5:46499 - 52507 "A IN registry.kube-system.svc.cluster.local. udp 67 false 1232" NOERROR qr,aa,rd 110 0.000073493s
[INFO] 10.244.0.5:46499 - 28241 "AAAA IN registry.kube-system.svc.cluster.local. udp 67 false 1232" NOERROR qr,aa,rd 149 0.000043298s
[INFO] 10.244.0.5:56454 - 51764 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000114157s
[INFO] 10.244.0.5:56454 - 51510 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000158465s
[INFO] 10.244.0.5:43496 - 57289 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000062269s
[INFO] 10.244.0.5:43496 - 56844 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000095179s
[INFO] 10.244.0.5:48515 - 14427 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.00004594s
[INFO] 10.244.0.5:48515 - 14599 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000047048s
[INFO] 10.244.0.5:60488 - 34559 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.00651338s
[INFO] 10.244.0.5:60488 - 34122 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.006885562s
[INFO] 10.244.0.5:36101 - 9542 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000053932s
[INFO] 10.244.0.5:36101 - 9970 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000043594s
[INFO] 10.244.0.25:42931 - 62170 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000208172s
[INFO] 10.244.0.25:38323 - 31767 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000249106s
[INFO] 10.244.0.25:51775 - 47507 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000202149s
[INFO] 10.244.0.25:56095 - 6137 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000162945s
[INFO] 10.244.0.25:46218 - 1087 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000219642s
[INFO] 10.244.0.25:60488 - 42475 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000189423s
[INFO] 10.244.0.25:58968 - 58859 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002745359s
[INFO] 10.244.0.25:55437 - 3715 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002208681s
[INFO] 10.244.0.25:58839 - 38645 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.002790184s
[INFO] 10.244.0.25:34697 - 42147 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 648 0.002169666s
==> describe nodes <==
Name: addons-874682
Roles: control-plane
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=addons-874682
kubernetes.io/os=linux
minikube.k8s.io/commit=e90d7de550e839433dc631623053398b652747fc
minikube.k8s.io/name=addons-874682
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_10_10T19_06_42_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-874682
Annotations: csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-874682"}
kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Thu, 10 Oct 2024 19:06:38 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-874682
AcquireTime: <unset>
RenewTime: Thu, 10 Oct 2024 19:12:47 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Thu, 10 Oct 2024 19:09:45 +0000 Thu, 10 Oct 2024 19:06:35 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Thu, 10 Oct 2024 19:09:45 +0000 Thu, 10 Oct 2024 19:06:35 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Thu, 10 Oct 2024 19:09:45 +0000 Thu, 10 Oct 2024 19:06:35 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Thu, 10 Oct 2024 19:09:45 +0000 Thu, 10 Oct 2024 19:06:38 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-874682
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022292Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022292Ki
pods: 110
System Info:
Machine ID: 131bff12da3a44998b26e91d5b290634
System UUID: dd6ed34d-e80b-42d7-b580-34d9017bcf51
Boot ID: 81acb813-f359-4e5c-b3de-7f41998fd9b3
Kernel Version: 5.15.0-1070-aws
OS Image: Ubuntu 22.04.5 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.22
Kubelet Version: v1.31.1
Kube-Proxy Version: v1.31.1
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (27 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default cloud-spanner-emulator-5b584cc74-bwbnl 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m
gadget gadget-ld25h 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
gcp-auth gcp-auth-c684cb797-whskb 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m28s
ingress-nginx ingress-nginx-controller-5f85ff4588-hfmbk 100m (5%) 0 (0%) 90Mi (1%) 0 (0%) 5m56s
kube-system coredns-7c65d6cfc9-k7dbk 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 6m4s
kube-system csi-hostpath-attacher-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m53s
kube-system csi-hostpath-resizer-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m53s
kube-system csi-hostpathplugin-g9pph 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m53s
kube-system etcd-addons-874682 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 6m9s
kube-system kindnet-zn8rq 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 6m4s
kube-system kube-apiserver-addons-874682 250m (12%) 0 (0%) 0 (0%) 0 (0%) 6m9s
kube-system kube-controller-manager-addons-874682 200m (10%) 0 (0%) 0 (0%) 0 (0%) 6m9s
kube-system kube-ingress-dns-minikube 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m
kube-system kube-proxy-kxfpl 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m4s
kube-system kube-scheduler-addons-874682 100m (5%) 0 (0%) 0 (0%) 0 (0%) 6m9s
kube-system metrics-server-84c5f94fbc-4v65j 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 5m58s
kube-system nvidia-device-plugin-daemonset-6mkwn 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m1s
kube-system registry-66c9cd494c-t6lqg 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m59s
kube-system registry-proxy-54kdz 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m59s
kube-system snapshot-controller-56fcc65765-845lk 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
kube-system snapshot-controller-56fcc65765-lqwx4 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m59s
local-path-storage local-path-provisioner-86d989889c-qhs4l 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m59s
volcano-system volcano-admission-5874dfdd79-w22cw 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m55s
volcano-system volcano-controllers-789ffc5785-qv8nc 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m54s
volcano-system volcano-scheduler-6c9778cbdf-dkzrl 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m54s
yakd-dashboard yakd-dashboard-67d98fc6b-562jc 0 (0%) 0 (0%) 128Mi (1%) 256Mi (3%) 5m57s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 1050m (52%) 100m (5%)
memory 638Mi (8%) 476Mi (6%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 6m3s kube-proxy
Normal Starting 6m9s kubelet Starting kubelet.
Warning CgroupV1 6m9s kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeAllocatableEnforced 6m9s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 6m9s kubelet Node addons-874682 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m9s kubelet Node addons-874682 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m9s kubelet Node addons-874682 status is now: NodeHasSufficientPID
Normal RegisteredNode 6m5s node-controller Node addons-874682 event: Registered Node addons-874682 in Controller
==> dmesg <==
[Oct10 18:05] FS-Cache: Duplicate cookie detected
[ +0.000771] FS-Cache: O-cookie c=00000025 [p=00000002 fl=222 nc=0 na=1]
[ +0.001032] FS-Cache: O-cookie d=000000002d03fbc2{9P.session} n=00000000c1f71fe5
[ +0.001149] FS-Cache: O-key=[10] '34323936353137363232'
[ +0.000832] FS-Cache: N-cookie c=00000026 [p=00000002 fl=2 nc=0 na=1]
[ +0.001010] FS-Cache: N-cookie d=000000002d03fbc2{9P.session} n=000000005d5656e6
[ +0.001134] FS-Cache: N-key=[10] '34323936353137363232'
[Oct10 18:10] hrtimer: interrupt took 1024274 ns
[Oct10 18:39] overlayfs: '/var/lib/containers/storage/overlay/l/ZLTOCNGE2IGM6DT7VP2QP7OV3M' not a directory
==> etcd [1882c208394a909012e83b4dc45f5c6acea0d6763838c695a5ab1e0b0a7f58a7] <==
{"level":"info","ts":"2024-10-10T19:06:35.106277Z","caller":"embed/etcd.go:728","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
{"level":"info","ts":"2024-10-10T19:06:35.106597Z","caller":"embed/etcd.go:599","msg":"serving peer traffic","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-10-10T19:06:35.106792Z","caller":"embed/etcd.go:571","msg":"cmux::serve","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-10-10T19:06:35.108086Z","caller":"embed/etcd.go:279","msg":"now serving peer/client/metrics","local-member-id":"aec36adc501070cc","initial-advertise-peer-urls":["https://192.168.49.2:2380"],"listen-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.49.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
{"level":"info","ts":"2024-10-10T19:06:35.108212Z","caller":"embed/etcd.go:870","msg":"serving metrics","address":"http://127.0.0.1:2381"}
{"level":"info","ts":"2024-10-10T19:06:35.382516Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
{"level":"info","ts":"2024-10-10T19:06:35.382793Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
{"level":"info","ts":"2024-10-10T19:06:35.382917Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
{"level":"info","ts":"2024-10-10T19:06:35.383016Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
{"level":"info","ts":"2024-10-10T19:06:35.383102Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-10-10T19:06:35.383193Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
{"level":"info","ts":"2024-10-10T19:06:35.383279Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-10-10T19:06:35.386132Z","caller":"etcdserver/server.go:2629","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-10-10T19:06:35.388611Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-874682 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
{"level":"info","ts":"2024-10-10T19:06:35.388766Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-10-10T19:06:35.389359Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
{"level":"info","ts":"2024-10-10T19:06:35.389644Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-10-10T19:06:35.389793Z","caller":"etcdserver/server.go:2653","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2024-10-10T19:06:35.389906Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-10-10T19:06:35.390848Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-10-10T19:06:35.391977Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
{"level":"info","ts":"2024-10-10T19:06:35.392889Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-10-10T19:06:35.393019Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-10-10T19:06:35.393033Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-10-10T19:06:35.394058Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
==> gcp-auth [82da3f7a2d27432a19c50677daecd399eeecece1d269ed12db79f2dcb5704cde] <==
2024/10/10 19:09:30 GCP Auth Webhook started!
2024/10/10 19:09:48 Ready to marshal response ...
2024/10/10 19:09:48 Ready to write response ...
2024/10/10 19:09:49 Ready to marshal response ...
2024/10/10 19:09:49 Ready to write response ...
==> kernel <==
19:12:51 up 2:55, 0 users, load average: 0.53, 1.87, 2.36
Linux addons-874682 5.15.0-1070-aws #76~20.04.1-Ubuntu SMP Mon Sep 2 12:20:48 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.5 LTS"
==> kindnet [850f4060c158c33dc00dadabe47b87c01ed05b6f15e6b61a4e9c141dbe74541c] <==
I1010 19:10:48.405663 1 main.go:299] handling current node
I1010 19:10:58.407410 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I1010 19:10:58.407448 1 main.go:299] handling current node
I1010 19:11:08.414447 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I1010 19:11:08.414539 1 main.go:299] handling current node
I1010 19:11:18.413999 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I1010 19:11:18.414033 1 main.go:299] handling current node
I1010 19:11:28.412658 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I1010 19:11:28.412845 1 main.go:299] handling current node
I1010 19:11:38.412942 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I1010 19:11:38.413064 1 main.go:299] handling current node
I1010 19:11:48.405793 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I1010 19:11:48.405828 1 main.go:299] handling current node
I1010 19:11:58.407630 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I1010 19:11:58.407686 1 main.go:299] handling current node
I1010 19:12:08.404922 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I1010 19:12:08.405035 1 main.go:299] handling current node
I1010 19:12:18.411182 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I1010 19:12:18.411218 1 main.go:299] handling current node
I1010 19:12:28.410417 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I1010 19:12:28.410449 1 main.go:299] handling current node
I1010 19:12:38.412676 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I1010 19:12:38.412868 1 main.go:299] handling current node
I1010 19:12:48.405226 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I1010 19:12:48.405262 1 main.go:299] handling current node
==> kube-apiserver [6be806c6721cae6830081daefc420afde42f6bb6990560820ffe5ec3d1159510] <==
W1010 19:07:56.761805 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.98.113.203:443: connect: connection refused
W1010 19:07:57.772631 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.98.113.203:443: connect: connection refused
W1010 19:07:58.778196 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.98.113.203:443: connect: connection refused
W1010 19:07:59.864993 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.98.113.203:443: connect: connection refused
W1010 19:08:00.929552 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.98.113.203:443: connect: connection refused
W1010 19:08:01.961471 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.98.113.203:443: connect: connection refused
W1010 19:08:02.289906 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.96.19.254:443: connect: connection refused
E1010 19:08:02.289945 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.96.19.254:443: connect: connection refused" logger="UnhandledError"
W1010 19:08:02.291620 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.98.113.203:443: connect: connection refused
W1010 19:08:03.027779 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.98.113.203:443: connect: connection refused
W1010 19:08:03.225261 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.96.19.254:443: connect: connection refused
E1010 19:08:03.225297 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.96.19.254:443: connect: connection refused" logger="UnhandledError"
W1010 19:08:03.227035 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.98.113.203:443: connect: connection refused
W1010 19:08:04.129125 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.98.113.203:443: connect: connection refused
W1010 19:08:05.231803 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.98.113.203:443: connect: connection refused
W1010 19:08:06.285413 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.98.113.203:443: connect: connection refused
W1010 19:08:07.362753 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.98.113.203:443: connect: connection refused
W1010 19:08:22.238920 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.96.19.254:443: connect: connection refused
E1010 19:08:22.239039 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.96.19.254:443: connect: connection refused" logger="UnhandledError"
W1010 19:09:02.301375 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.96.19.254:443: connect: connection refused
E1010 19:09:02.301421 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.96.19.254:443: connect: connection refused" logger="UnhandledError"
W1010 19:09:03.234240 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.96.19.254:443: connect: connection refused
E1010 19:09:03.234278 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.96.19.254:443: connect: connection refused" logger="UnhandledError"
I1010 19:09:48.704173 1 controller.go:615] quota admission added evaluator for: jobs.batch.volcano.sh
I1010 19:09:48.742498 1 controller.go:615] quota admission added evaluator for: podgroups.scheduling.volcano.sh
==> kube-controller-manager [3348ced37201bf5954a496f0ca5e756edbdbc5f724fd2ea7f46c8b1900b728cb] <==
I1010 19:09:03.361013 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I1010 19:09:03.367467 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I1010 19:09:03.372919 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I1010 19:09:03.403250 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I1010 19:09:04.253910 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I1010 19:09:04.264880 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I1010 19:09:05.338514 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I1010 19:09:06.345098 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I1010 19:09:06.355757 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I1010 19:09:06.362522 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I1010 19:09:16.430258 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I1010 19:09:17.287761 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I1010 19:09:18.300368 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I1010 19:09:18.406283 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I1010 19:09:19.306812 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I1010 19:09:19.323903 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I1010 19:09:19.330841 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I1010 19:09:31.367579 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-c684cb797" duration="17.180463ms"
I1010 19:09:31.367656 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-c684cb797" duration="35.832µs"
I1010 19:09:36.033865 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I1010 19:09:36.075532 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I1010 19:09:45.701529 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-874682"
I1010 19:09:48.424499 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="volcano-system/volcano-admission-init" delay="0s"
I1010 19:09:49.014777 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I1010 19:09:49.055741 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
==> kube-proxy [6d8e919c955ddd4121ce12a7de9bb91e4fd29234080f4b5e4aee88a3ba33f99a] <==
I1010 19:06:47.687248 1 server_linux.go:66] "Using iptables proxy"
I1010 19:06:47.801427 1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
E1010 19:06:47.801501 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I1010 19:06:47.849401 1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I1010 19:06:47.849482 1 server_linux.go:169] "Using iptables Proxier"
I1010 19:06:47.851388 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I1010 19:06:47.851890 1 server.go:483] "Version info" version="v1.31.1"
I1010 19:06:47.851910 1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1010 19:06:47.854223 1 config.go:199] "Starting service config controller"
I1010 19:06:47.854242 1 shared_informer.go:313] Waiting for caches to sync for service config
I1010 19:06:47.854262 1 config.go:105] "Starting endpoint slice config controller"
I1010 19:06:47.854266 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I1010 19:06:47.857547 1 config.go:328] "Starting node config controller"
I1010 19:06:47.857577 1 shared_informer.go:313] Waiting for caches to sync for node config
I1010 19:06:47.954869 1 shared_informer.go:320] Caches are synced for endpoint slice config
I1010 19:06:47.954918 1 shared_informer.go:320] Caches are synced for service config
I1010 19:06:47.957978 1 shared_informer.go:320] Caches are synced for node config
==> kube-scheduler [14b056da2e8a143c40934cbca36a1152c035535877334c3884dc7b97aeda768f] <==
I1010 19:06:39.066019 1 serving.go:386] Generated self-signed cert in-memory
W1010 19:06:40.011104 1 requestheader_controller.go:196] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W1010 19:06:40.011221 1 authentication.go:370] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W1010 19:06:40.011252 1 authentication.go:371] Continuing without authentication configuration. This may treat all requests as anonymous.
W1010 19:06:40.011315 1 authentication.go:372] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I1010 19:06:40.040753 1 server.go:167] "Starting Kubernetes Scheduler" version="v1.31.1"
I1010 19:06:40.042429 1 server.go:169] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1010 19:06:40.045164 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1010 19:06:40.045503 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
W1010 19:06:40.047508 1 reflector.go:561] runtime/asm_arm64.s:1222: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E1010 19:06:40.047850 1 reflector.go:158] "Unhandled Error" err="runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"
I1010 19:06:40.048484 1 secure_serving.go:213] Serving securely on 127.0.0.1:10259
I1010 19:06:40.048683 1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
I1010 19:06:41.546182 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Oct 10 19:09:05 addons-874682 kubelet[1497]: I1010 19:09:05.388661 1497 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/508251b0-3072-4115-b57f-d5677492c92a-kube-api-access-t224b" (OuterVolumeSpecName: "kube-api-access-t224b") pod "508251b0-3072-4115-b57f-d5677492c92a" (UID: "508251b0-3072-4115-b57f-d5677492c92a"). InnerVolumeSpecName "kube-api-access-t224b". PluginName "kubernetes.io/projected", VolumeGidValue ""
Oct 10 19:09:05 addons-874682 kubelet[1497]: I1010 19:09:05.484001 1497 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-t224b\" (UniqueName: \"kubernetes.io/projected/508251b0-3072-4115-b57f-d5677492c92a-kube-api-access-t224b\") on node \"addons-874682\" DevicePath \"\""
Oct 10 19:09:06 addons-874682 kubelet[1497]: I1010 19:09:06.246669 1497 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5b90732c5c12b19b53630ca77bd72a3c5160b312e1865915eafd813caecb448"
Oct 10 19:09:16 addons-874682 kubelet[1497]: I1010 19:09:16.415500 1497 scope.go:117] "RemoveContainer" containerID="2130c898a5c00b26cb16199a5c37033f8c1fd91a9b3cb26dd1b5c79e7f48de41"
Oct 10 19:09:17 addons-874682 kubelet[1497]: I1010 19:09:17.274066 1497 scope.go:117] "RemoveContainer" containerID="2130c898a5c00b26cb16199a5c37033f8c1fd91a9b3cb26dd1b5c79e7f48de41"
Oct 10 19:09:18 addons-874682 kubelet[1497]: I1010 19:09:18.491218 1497 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xcnb\" (UniqueName: \"kubernetes.io/projected/bb15b48e-1de9-4868-b5b4-f14bd9fda73f-kube-api-access-9xcnb\") pod \"bb15b48e-1de9-4868-b5b4-f14bd9fda73f\" (UID: \"bb15b48e-1de9-4868-b5b4-f14bd9fda73f\") "
Oct 10 19:09:18 addons-874682 kubelet[1497]: I1010 19:09:18.496716 1497 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb15b48e-1de9-4868-b5b4-f14bd9fda73f-kube-api-access-9xcnb" (OuterVolumeSpecName: "kube-api-access-9xcnb") pod "bb15b48e-1de9-4868-b5b4-f14bd9fda73f" (UID: "bb15b48e-1de9-4868-b5b4-f14bd9fda73f"). InnerVolumeSpecName "kube-api-access-9xcnb". PluginName "kubernetes.io/projected", VolumeGidValue ""
Oct 10 19:09:18 addons-874682 kubelet[1497]: I1010 19:09:18.592336 1497 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-9xcnb\" (UniqueName: \"kubernetes.io/projected/bb15b48e-1de9-4868-b5b4-f14bd9fda73f-kube-api-access-9xcnb\") on node \"addons-874682\" DevicePath \"\""
Oct 10 19:09:19 addons-874682 kubelet[1497]: I1010 19:09:19.282807 1497 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d5ed9ee9b69d33e712029c06e3c6f8e95607c988a4321147c820284f8eb44e0"
Oct 10 19:09:36 addons-874682 kubelet[1497]: I1010 19:09:36.055209 1497 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="gcp-auth/gcp-auth-c684cb797-whskb" podStartSLOduration=70.485637447 podStartE2EDuration="1m14.055188594s" podCreationTimestamp="2024-10-10 19:08:22 +0000 UTC" firstStartedPulling="2024-10-10 19:09:26.639993718 +0000 UTC m=+165.340764000" lastFinishedPulling="2024-10-10 19:09:30.209544865 +0000 UTC m=+168.910315147" observedRunningTime="2024-10-10 19:09:31.348309143 +0000 UTC m=+170.049079433" watchObservedRunningTime="2024-10-10 19:09:36.055188594 +0000 UTC m=+174.755958875"
Oct 10 19:09:37 addons-874682 kubelet[1497]: I1010 19:09:37.418591 1497 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="508251b0-3072-4115-b57f-d5677492c92a" path="/var/lib/kubelet/pods/508251b0-3072-4115-b57f-d5677492c92a/volumes"
Oct 10 19:09:41 addons-874682 kubelet[1497]: I1010 19:09:41.461919 1497 scope.go:117] "RemoveContainer" containerID="aecc89ca1b7fd9245ce731c710bfb2edd159b0f8392a258106ff99cc1481394a"
Oct 10 19:09:49 addons-874682 kubelet[1497]: I1010 19:09:49.419694 1497 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb15b48e-1de9-4868-b5b4-f14bd9fda73f" path="/var/lib/kubelet/pods/bb15b48e-1de9-4868-b5b4-f14bd9fda73f/volumes"
Oct 10 19:09:49 addons-874682 kubelet[1497]: I1010 19:09:49.420128 1497 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff993c3c-965d-4ed3-b6c1-799cb065e123" path="/var/lib/kubelet/pods/ff993c3c-965d-4ed3-b6c1-799cb065e123/volumes"
Oct 10 19:09:50 addons-874682 kubelet[1497]: I1010 19:09:50.415502 1497 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-66c9cd494c-t6lqg" secret="" err="secret \"gcp-auth\" not found"
Oct 10 19:09:51 addons-874682 kubelet[1497]: I1010 19:09:51.416828 1497 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-6mkwn" secret="" err="secret \"gcp-auth\" not found"
Oct 10 19:09:55 addons-874682 kubelet[1497]: I1010 19:09:55.415946 1497 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-54kdz" secret="" err="secret \"gcp-auth\" not found"
Oct 10 19:10:41 addons-874682 kubelet[1497]: I1010 19:10:41.497426 1497 scope.go:117] "RemoveContainer" containerID="d83bba1977cba06acfe2e907f95e1814393ce6274d8e99865c01a291844b4fdd"
Oct 10 19:10:41 addons-874682 kubelet[1497]: I1010 19:10:41.511382 1497 scope.go:117] "RemoveContainer" containerID="a0a8db193893553fcf9d89dcfec16b534d8b87aaa5f18f818f2c64c6e71d9354"
Oct 10 19:11:00 addons-874682 kubelet[1497]: I1010 19:11:00.416547 1497 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-66c9cd494c-t6lqg" secret="" err="secret \"gcp-auth\" not found"
Oct 10 19:11:09 addons-874682 kubelet[1497]: I1010 19:11:09.415460 1497 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-54kdz" secret="" err="secret \"gcp-auth\" not found"
Oct 10 19:11:14 addons-874682 kubelet[1497]: I1010 19:11:14.415371 1497 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-6mkwn" secret="" err="secret \"gcp-auth\" not found"
Oct 10 19:12:04 addons-874682 kubelet[1497]: I1010 19:12:04.416188 1497 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-66c9cd494c-t6lqg" secret="" err="secret \"gcp-auth\" not found"
Oct 10 19:12:21 addons-874682 kubelet[1497]: I1010 19:12:21.416037 1497 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-6mkwn" secret="" err="secret \"gcp-auth\" not found"
Oct 10 19:12:37 addons-874682 kubelet[1497]: I1010 19:12:37.416098 1497 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-54kdz" secret="" err="secret \"gcp-auth\" not found"
==> storage-provisioner [ad45af60192782cbf2d8f6b088db28f47c9f2b130a3cd3d2f9d4957bc5c15433] <==
I1010 19:06:52.959297 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I1010 19:06:52.984391 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I1010 19:06:52.984519 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I1010 19:06:52.997278 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I1010 19:06:52.998224 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-874682_24ad0836-616d-4ad8-bbd6-8b2dc1e7831e!
I1010 19:06:52.998988 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"657b9fa2-79d1-4d9a-9ae2-3d362e03ddea", APIVersion:"v1", ResourceVersion:"581", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-874682_24ad0836-616d-4ad8-bbd6-8b2dc1e7831e became leader
I1010 19:06:53.098450 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-874682_24ad0836-616d-4ad8-bbd6-8b2dc1e7831e!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-874682 -n addons-874682
helpers_test.go:261: (dbg) Run: kubectl --context addons-874682 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: ingress-nginx-admission-create-5plgm ingress-nginx-admission-patch-bz6kw test-job-nginx-0
helpers_test.go:274: ======> post-mortem[TestAddons/serial/Volcano]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-874682 describe pod ingress-nginx-admission-create-5plgm ingress-nginx-admission-patch-bz6kw test-job-nginx-0
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-874682 describe pod ingress-nginx-admission-create-5plgm ingress-nginx-admission-patch-bz6kw test-job-nginx-0: exit status 1 (84.617534ms)
** stderr **
Error from server (NotFound): pods "ingress-nginx-admission-create-5plgm" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-bz6kw" not found
Error from server (NotFound): pods "test-job-nginx-0" not found
** /stderr **
helpers_test.go:279: kubectl --context addons-874682 describe pod ingress-nginx-admission-create-5plgm ingress-nginx-admission-patch-bz6kw test-job-nginx-0: exit status 1
addons_test.go:975: (dbg) Run: out/minikube-linux-arm64 -p addons-874682 addons disable volcano --alsologtostderr -v=1
addons_test.go:975: (dbg) Done: out/minikube-linux-arm64 -p addons-874682 addons disable volcano --alsologtostderr -v=1: (11.23115603s)
--- FAIL: TestAddons/serial/Volcano (211.09s)