=== RUN TestAddons/serial/Volcano
addons_test.go:835: volcano-scheduler stabilized in 57.06621ms
addons_test.go:843: volcano-admission stabilized in 57.975049ms
addons_test.go:851: volcano-controller stabilized in 58.0304ms
addons_test.go:857: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-scheduler-6c9778cbdf-mbvfg" [d6dde1c8-8103-4e54-ab7f-ad51644ba6f4] Running
addons_test.go:857: (dbg) TestAddons/serial/Volcano: app=volcano-scheduler healthy within 6.003366118s
addons_test.go:861: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-admission-5874dfdd79-dvr69" [a34c89d3-c723-4afa-b4fa-3cad566481ed] Running
addons_test.go:861: (dbg) TestAddons/serial/Volcano: app=volcano-admission healthy within 5.00316728s
addons_test.go:865: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-controllers-789ffc5785-vx57k" [a5e47f78-8e3d-4d02-bc54-d8496aa7ec52] Running
addons_test.go:865: (dbg) TestAddons/serial/Volcano: app=volcano-controller healthy within 6.023717816s
addons_test.go:870: (dbg) Run: kubectl --context addons-583947 delete -n volcano-system job volcano-admission-init
addons_test.go:876: (dbg) Run: kubectl --context addons-583947 create -f testdata/vcjob.yaml
addons_test.go:884: (dbg) Run: kubectl --context addons-583947 get vcjob -n my-volcano
addons_test.go:902: (dbg) TestAddons/serial/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...
helpers_test.go:344: "test-job-nginx-0" [4718477b-7617-4fb3-b681-d310bdc9c1eb] Pending
helpers_test.go:344: "test-job-nginx-0" [4718477b-7617-4fb3-b681-d310bdc9c1eb] Pending: PodScheduled:Unschedulable (0/1 nodes are unavailable: 1 Insufficient cpu.)
helpers_test.go:329: TestAddons/serial/Volcano: WARNING: pod list for "my-volcano" "volcano.sh/job-name=test-job" returned: client rate limiter Wait returned an error: context deadline exceeded
addons_test.go:902: ***** TestAddons/serial/Volcano: pod "volcano.sh/job-name=test-job" failed to start within 3m0s: context deadline exceeded ****
addons_test.go:902: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-583947 -n addons-583947
addons_test.go:902: TestAddons/serial/Volcano: showing logs for failed pods as of 2024-09-27 17:46:46.149879555 +0000 UTC m=+433.716583811
addons_test.go:902: (dbg) Run: kubectl --context addons-583947 describe po test-job-nginx-0 -n my-volcano
addons_test.go:902: (dbg) kubectl --context addons-583947 describe po test-job-nginx-0 -n my-volcano:
Name: test-job-nginx-0
Namespace: my-volcano
Priority: 0
Service Account: default
Node: <none>
Labels: volcano.sh/job-name=test-job
volcano.sh/job-namespace=my-volcano
volcano.sh/queue-name=test
volcano.sh/task-index=0
volcano.sh/task-spec=nginx
Annotations: scheduling.k8s.io/group-name: test-job-1d36637a-c994-43d1-85a4-188abdde5044
volcano.sh/job-name: test-job
volcano.sh/job-retry-count: 0
volcano.sh/job-version: 0
volcano.sh/queue-name: test
volcano.sh/task-index: 0
volcano.sh/task-spec: nginx
volcano.sh/template-uid: test-job-nginx
Status: Pending
IP:
IPs: <none>
Controlled By: Job/test-job
Containers:
nginx:
Image: nginx:latest
Port: <none>
Host Port: <none>
Command:
sleep
10m
Limits:
cpu: 1
Requests:
cpu: 1
Environment:
GOOGLE_APPLICATION_CREDENTIALS: /google-app-creds.json
PROJECT_ID: this_is_fake
GCP_PROJECT: this_is_fake
GCLOUD_PROJECT: this_is_fake
GOOGLE_CLOUD_PROJECT: this_is_fake
CLOUDSDK_CORE_PROJECT: this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-chtfq (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
kube-api-access-chtfq:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
gcp-creds:
Type: HostPath (bare host directory volume)
Path: /var/lib/minikube/google_application_credentials.json
HostPathType: File
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling 2m59s volcano 0/1 nodes are unavailable: 1 Insufficient cpu.
addons_test.go:902: (dbg) Run: kubectl --context addons-583947 logs test-job-nginx-0 -n my-volcano
addons_test.go:902: (dbg) kubectl --context addons-583947 logs test-job-nginx-0 -n my-volcano:
addons_test.go:903: failed waiting for test-local-path pod: volcano.sh/job-name=test-job within 3m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestAddons/serial/Volcano]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect addons-583947
helpers_test.go:235: (dbg) docker inspect addons-583947:
-- stdout --
[
{
"Id": "0c7a0efa915c7db07956a4b5b0a7fbfc510abab1dc7f899fe6dba94a991c2492",
"Created": "2024-09-27T17:40:13.140348239Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 300646,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-09-27T17:40:13.286117289Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:62002f6a97ad1f6cd4117c29b1c488a6bf3b6255c8231f0d600b1bc7ba1bcfd6",
"ResolvConfPath": "/var/lib/docker/containers/0c7a0efa915c7db07956a4b5b0a7fbfc510abab1dc7f899fe6dba94a991c2492/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/0c7a0efa915c7db07956a4b5b0a7fbfc510abab1dc7f899fe6dba94a991c2492/hostname",
"HostsPath": "/var/lib/docker/containers/0c7a0efa915c7db07956a4b5b0a7fbfc510abab1dc7f899fe6dba94a991c2492/hosts",
"LogPath": "/var/lib/docker/containers/0c7a0efa915c7db07956a4b5b0a7fbfc510abab1dc7f899fe6dba94a991c2492/0c7a0efa915c7db07956a4b5b0a7fbfc510abab1dc7f899fe6dba94a991c2492-json.log",
"Name": "/addons-583947",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"addons-583947:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "addons-583947",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4194304000,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8388608000,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/7db4c1cbdc396638accb2b508caa384e31fd4cec50b10bf739f2689c02bc6d10-init/diff:/var/lib/docker/overlay2/a37a697d35bc9dd6b22fe821f055b93d8ecad36dc406167b9eb9ad78951bada0/diff",
"MergedDir": "/var/lib/docker/overlay2/7db4c1cbdc396638accb2b508caa384e31fd4cec50b10bf739f2689c02bc6d10/merged",
"UpperDir": "/var/lib/docker/overlay2/7db4c1cbdc396638accb2b508caa384e31fd4cec50b10bf739f2689c02bc6d10/diff",
"WorkDir": "/var/lib/docker/overlay2/7db4c1cbdc396638accb2b508caa384e31fd4cec50b10bf739f2689c02bc6d10/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "addons-583947",
"Source": "/var/lib/docker/volumes/addons-583947/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "addons-583947",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-583947",
"name.minikube.sigs.k8s.io": "addons-583947",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "3ebc20ca29f78320e9462590de67f5bbb1f3848bc3eb325afe696cfc859a532c",
"SandboxKey": "/var/run/docker/netns/3ebc20ca29f7",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33138"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33139"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33142"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33140"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33141"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"addons-583947": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:31:02",
"DriverOpts": null,
"NetworkID": "f5eaff548005d97efdfeb19b99273f3ddfd6889279cb6c2789ff3a3c06139775",
"EndpointID": "80dcadf37b610b5f36e9defb9f1d0c3927f4a385f0d918155c14db90981aa22c",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-583947",
"0c7a0efa915c"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p addons-583947 -n addons-583947
helpers_test.go:244: <<< TestAddons/serial/Volcano FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/serial/Volcano]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p addons-583947 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-583947 logs -n 25: (1.666391823s)
helpers_test.go:252: TestAddons/serial/Volcano logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| start | -o=json --download-only | download-only-324473 | jenkins | v1.34.0 | 27 Sep 24 17:39 UTC | |
| | -p download-only-324473 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 27 Sep 24 17:39 UTC | 27 Sep 24 17:39 UTC |
| delete | -p download-only-324473 | download-only-324473 | jenkins | v1.34.0 | 27 Sep 24 17:39 UTC | 27 Sep 24 17:39 UTC |
| start | -o=json --download-only | download-only-496322 | jenkins | v1.34.0 | 27 Sep 24 17:39 UTC | |
| | -p download-only-496322 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 27 Sep 24 17:39 UTC | 27 Sep 24 17:39 UTC |
| delete | -p download-only-496322 | download-only-496322 | jenkins | v1.34.0 | 27 Sep 24 17:39 UTC | 27 Sep 24 17:39 UTC |
| delete | -p download-only-324473 | download-only-324473 | jenkins | v1.34.0 | 27 Sep 24 17:39 UTC | 27 Sep 24 17:39 UTC |
| delete | -p download-only-496322 | download-only-496322 | jenkins | v1.34.0 | 27 Sep 24 17:39 UTC | 27 Sep 24 17:39 UTC |
| start | --download-only -p | download-docker-268027 | jenkins | v1.34.0 | 27 Sep 24 17:39 UTC | |
| | download-docker-268027 | | | | | |
| | --alsologtostderr | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p download-docker-268027 | download-docker-268027 | jenkins | v1.34.0 | 27 Sep 24 17:39 UTC | 27 Sep 24 17:39 UTC |
| start | --download-only -p | binary-mirror-691798 | jenkins | v1.34.0 | 27 Sep 24 17:39 UTC | |
| | binary-mirror-691798 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:44453 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p binary-mirror-691798 | binary-mirror-691798 | jenkins | v1.34.0 | 27 Sep 24 17:39 UTC | 27 Sep 24 17:39 UTC |
| addons | enable dashboard -p | addons-583947 | jenkins | v1.34.0 | 27 Sep 24 17:39 UTC | |
| | addons-583947 | | | | | |
| addons | disable dashboard -p | addons-583947 | jenkins | v1.34.0 | 27 Sep 24 17:39 UTC | |
| | addons-583947 | | | | | |
| start | -p addons-583947 --wait=true | addons-583947 | jenkins | v1.34.0 | 27 Sep 24 17:39 UTC | 27 Sep 24 17:43 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/09/27 17:39:47
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.23.0 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0927 17:39:47.975473 300155 out.go:345] Setting OutFile to fd 1 ...
I0927 17:39:47.975655 300155 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0927 17:39:47.975668 300155 out.go:358] Setting ErrFile to fd 2...
I0927 17:39:47.975676 300155 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0927 17:39:47.975942 300155 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19712-294006/.minikube/bin
I0927 17:39:47.976437 300155 out.go:352] Setting JSON to false
I0927 17:39:47.977480 300155 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":4939,"bootTime":1727453849,"procs":174,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0927 17:39:47.977556 300155 start.go:139] virtualization:
I0927 17:39:47.979980 300155 out.go:177] * [addons-583947] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I0927 17:39:47.982349 300155 out.go:177] - MINIKUBE_LOCATION=19712
I0927 17:39:47.982442 300155 notify.go:220] Checking for updates...
I0927 17:39:47.986077 300155 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0927 17:39:47.988031 300155 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19712-294006/kubeconfig
I0927 17:39:47.989940 300155 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19712-294006/.minikube
I0927 17:39:47.991613 300155 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0927 17:39:47.993438 300155 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0927 17:39:47.995725 300155 driver.go:394] Setting default libvirt URI to qemu:///system
I0927 17:39:48.024024 300155 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
I0927 17:39:48.024196 300155 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0927 17:39:48.085765 300155 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-27 17:39:48.076083428 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214839296 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I0927 17:39:48.085895 300155 docker.go:318] overlay module found
I0927 17:39:48.088969 300155 out.go:177] * Using the docker driver based on user configuration
I0927 17:39:48.090631 300155 start.go:297] selected driver: docker
I0927 17:39:48.090651 300155 start.go:901] validating driver "docker" against <nil>
I0927 17:39:48.090667 300155 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0927 17:39:48.091429 300155 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0927 17:39:48.141226 300155 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-27 17:39:48.131639441 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214839296 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I0927 17:39:48.141526 300155 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0927 17:39:48.141755 300155 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0927 17:39:48.143807 300155 out.go:177] * Using Docker driver with root privileges
I0927 17:39:48.145983 300155 cni.go:84] Creating CNI manager for ""
I0927 17:39:48.146059 300155 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0927 17:39:48.146074 300155 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0927 17:39:48.146170 300155 start.go:340] cluster config:
{Name:addons-583947 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-583947 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHA
uthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0927 17:39:48.149294 300155 out.go:177] * Starting "addons-583947" primary control-plane node in "addons-583947" cluster
I0927 17:39:48.150842 300155 cache.go:121] Beginning downloading kic base image for docker with containerd
I0927 17:39:48.152494 300155 out.go:177] * Pulling base image v0.0.45-1727108449-19696 ...
I0927 17:39:48.154011 300155 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I0927 17:39:48.154066 300155 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19712-294006/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4
I0927 17:39:48.154080 300155 cache.go:56] Caching tarball of preloaded images
I0927 17:39:48.154165 300155 preload.go:172] Found /home/jenkins/minikube-integration/19712-294006/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0927 17:39:48.154179 300155 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on containerd
I0927 17:39:48.154548 300155 profile.go:143] Saving config to /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/config.json ...
I0927 17:39:48.154579 300155 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/config.json: {Name:mk7cd4ba870d1b8238f50a977a0978625ab10cc2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 17:39:48.154756 300155 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local docker daemon
I0927 17:39:48.169188 300155 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 to local cache
I0927 17:39:48.169364 300155 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local cache directory
I0927 17:39:48.169389 300155 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local cache directory, skipping pull
I0927 17:39:48.169399 300155 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 exists in cache, skipping pull
I0927 17:39:48.169407 300155 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 as a tarball
I0927 17:39:48.169416 300155 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 from local cache
I0927 17:40:05.891995 300155 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 from cached tarball
I0927 17:40:05.892035 300155 cache.go:194] Successfully downloaded all kic artifacts
I0927 17:40:05.892065 300155 start.go:360] acquireMachinesLock for addons-583947: {Name:mk872710b255576436d83c5540a2b2688217a7c9 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0927 17:40:05.893595 300155 start.go:364] duration metric: took 1.501683ms to acquireMachinesLock for "addons-583947"
I0927 17:40:05.893643 300155 start.go:93] Provisioning new machine with config: &{Name:addons-583947 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-583947 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fa
lse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0927 17:40:05.893738 300155 start.go:125] createHost starting for "" (driver="docker")
I0927 17:40:05.897353 300155 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
I0927 17:40:05.897623 300155 start.go:159] libmachine.API.Create for "addons-583947" (driver="docker")
I0927 17:40:05.897668 300155 client.go:168] LocalClient.Create starting
I0927 17:40:05.897787 300155 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19712-294006/.minikube/certs/ca.pem
I0927 17:40:06.376339 300155 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19712-294006/.minikube/certs/cert.pem
I0927 17:40:06.720773 300155 cli_runner.go:164] Run: docker network inspect addons-583947 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0927 17:40:06.736503 300155 cli_runner.go:211] docker network inspect addons-583947 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0927 17:40:06.736608 300155 network_create.go:284] running [docker network inspect addons-583947] to gather additional debugging logs...
I0927 17:40:06.736631 300155 cli_runner.go:164] Run: docker network inspect addons-583947
W0927 17:40:06.752065 300155 cli_runner.go:211] docker network inspect addons-583947 returned with exit code 1
I0927 17:40:06.752106 300155 network_create.go:287] error running [docker network inspect addons-583947]: docker network inspect addons-583947: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-583947 not found
I0927 17:40:06.752122 300155 network_create.go:289] output of [docker network inspect addons-583947]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-583947 not found
** /stderr **
I0927 17:40:06.752242 300155 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0927 17:40:06.768193 300155 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4001cac7a0}
I0927 17:40:06.768240 300155 network_create.go:124] attempt to create docker network addons-583947 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0927 17:40:06.768300 300155 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-583947 addons-583947
I0927 17:40:06.837360 300155 network_create.go:108] docker network addons-583947 192.168.49.0/24 created
I0927 17:40:06.837394 300155 kic.go:121] calculated static IP "192.168.49.2" for the "addons-583947" container
I0927 17:40:06.837473 300155 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0927 17:40:06.853226 300155 cli_runner.go:164] Run: docker volume create addons-583947 --label name.minikube.sigs.k8s.io=addons-583947 --label created_by.minikube.sigs.k8s.io=true
I0927 17:40:06.871620 300155 oci.go:103] Successfully created a docker volume addons-583947
I0927 17:40:06.871715 300155 cli_runner.go:164] Run: docker run --rm --name addons-583947-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-583947 --entrypoint /usr/bin/test -v addons-583947:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 -d /var/lib
I0927 17:40:09.000455 300155 cli_runner.go:217] Completed: docker run --rm --name addons-583947-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-583947 --entrypoint /usr/bin/test -v addons-583947:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 -d /var/lib: (2.128690433s)
I0927 17:40:09.000485 300155 oci.go:107] Successfully prepared a docker volume addons-583947
I0927 17:40:09.000515 300155 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I0927 17:40:09.000535 300155 kic.go:194] Starting extracting preloaded images to volume ...
I0927 17:40:09.000600 300155 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19712-294006/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-583947:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 -I lz4 -xf /preloaded.tar -C /extractDir
I0927 17:40:13.073532 300155 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19712-294006/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-583947:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 -I lz4 -xf /preloaded.tar -C /extractDir: (4.072891209s)
I0927 17:40:13.073565 300155 kic.go:203] duration metric: took 4.073026213s to extract preloaded images to volume ...
W0927 17:40:13.073720 300155 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0927 17:40:13.073838 300155 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0927 17:40:13.125712 300155 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-583947 --name addons-583947 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-583947 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-583947 --network addons-583947 --ip 192.168.49.2 --volume addons-583947:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21
I0927 17:40:13.444141 300155 cli_runner.go:164] Run: docker container inspect addons-583947 --format={{.State.Running}}
I0927 17:40:13.477784 300155 cli_runner.go:164] Run: docker container inspect addons-583947 --format={{.State.Status}}
I0927 17:40:13.499144 300155 cli_runner.go:164] Run: docker exec addons-583947 stat /var/lib/dpkg/alternatives/iptables
I0927 17:40:13.559280 300155 oci.go:144] the created container "addons-583947" has a running status.
I0927 17:40:13.559321 300155 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19712-294006/.minikube/machines/addons-583947/id_rsa...
I0927 17:40:14.753440 300155 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19712-294006/.minikube/machines/addons-583947/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0927 17:40:14.772201 300155 cli_runner.go:164] Run: docker container inspect addons-583947 --format={{.State.Status}}
I0927 17:40:14.789922 300155 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0927 17:40:14.789944 300155 kic_runner.go:114] Args: [docker exec --privileged addons-583947 chown docker:docker /home/docker/.ssh/authorized_keys]
I0927 17:40:14.833390 300155 cli_runner.go:164] Run: docker container inspect addons-583947 --format={{.State.Status}}
I0927 17:40:14.852093 300155 machine.go:93] provisionDockerMachine start ...
I0927 17:40:14.852197 300155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-583947
I0927 17:40:14.868592 300155 main.go:141] libmachine: Using SSH client type: native
I0927 17:40:14.868863 300155 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0927 17:40:14.868873 300155 main.go:141] libmachine: About to run SSH command:
hostname
I0927 17:40:14.996830 300155 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-583947
I0927 17:40:14.996854 300155 ubuntu.go:169] provisioning hostname "addons-583947"
I0927 17:40:14.996922 300155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-583947
I0927 17:40:15.014064 300155 main.go:141] libmachine: Using SSH client type: native
I0927 17:40:15.014321 300155 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0927 17:40:15.014341 300155 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-583947 && echo "addons-583947" | sudo tee /etc/hostname
I0927 17:40:15.180375 300155 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-583947
I0927 17:40:15.180457 300155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-583947
I0927 17:40:15.198303 300155 main.go:141] libmachine: Using SSH client type: native
I0927 17:40:15.198570 300155 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0927 17:40:15.198593 300155 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-583947' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-583947/g' /etc/hosts;
else
echo '127.0.1.1 addons-583947' | sudo tee -a /etc/hosts;
fi
fi
I0927 17:40:15.329337 300155 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0927 17:40:15.329364 300155 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19712-294006/.minikube CaCertPath:/home/jenkins/minikube-integration/19712-294006/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19712-294006/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19712-294006/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19712-294006/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19712-294006/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19712-294006/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19712-294006/.minikube}
I0927 17:40:15.329389 300155 ubuntu.go:177] setting up certificates
I0927 17:40:15.329398 300155 provision.go:84] configureAuth start
I0927 17:40:15.329463 300155 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-583947
I0927 17:40:15.345963 300155 provision.go:143] copyHostCerts
I0927 17:40:15.346054 300155 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19712-294006/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19712-294006/.minikube/ca.pem (1078 bytes)
I0927 17:40:15.346192 300155 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19712-294006/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19712-294006/.minikube/cert.pem (1123 bytes)
I0927 17:40:15.346250 300155 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19712-294006/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19712-294006/.minikube/key.pem (1675 bytes)
I0927 17:40:15.346306 300155 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19712-294006/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19712-294006/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19712-294006/.minikube/certs/ca-key.pem org=jenkins.addons-583947 san=[127.0.0.1 192.168.49.2 addons-583947 localhost minikube]
I0927 17:40:15.598681 300155 provision.go:177] copyRemoteCerts
I0927 17:40:15.598751 300155 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0927 17:40:15.598794 300155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-583947
I0927 17:40:15.617126 300155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19712-294006/.minikube/machines/addons-583947/id_rsa Username:docker}
I0927 17:40:15.712843 300155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19712-294006/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0927 17:40:15.737010 300155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19712-294006/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0927 17:40:15.762669 300155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19712-294006/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0927 17:40:15.786760 300155 provision.go:87] duration metric: took 457.347453ms to configureAuth
I0927 17:40:15.786791 300155 ubuntu.go:193] setting minikube options for container-runtime
I0927 17:40:15.787008 300155 config.go:182] Loaded profile config "addons-583947": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I0927 17:40:15.787021 300155 machine.go:96] duration metric: took 934.904073ms to provisionDockerMachine
I0927 17:40:15.787030 300155 client.go:171] duration metric: took 9.889353174s to LocalClient.Create
I0927 17:40:15.787059 300155 start.go:167] duration metric: took 9.889437965s to libmachine.API.Create "addons-583947"
I0927 17:40:15.787075 300155 start.go:293] postStartSetup for "addons-583947" (driver="docker")
I0927 17:40:15.787086 300155 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0927 17:40:15.787166 300155 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0927 17:40:15.787212 300155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-583947
I0927 17:40:15.803722 300155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19712-294006/.minikube/machines/addons-583947/id_rsa Username:docker}
I0927 17:40:15.903112 300155 ssh_runner.go:195] Run: cat /etc/os-release
I0927 17:40:15.906657 300155 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0927 17:40:15.906697 300155 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0927 17:40:15.906710 300155 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0927 17:40:15.906717 300155 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I0927 17:40:15.906728 300155 filesync.go:126] Scanning /home/jenkins/minikube-integration/19712-294006/.minikube/addons for local assets ...
I0927 17:40:15.906797 300155 filesync.go:126] Scanning /home/jenkins/minikube-integration/19712-294006/.minikube/files for local assets ...
I0927 17:40:15.906827 300155 start.go:296] duration metric: took 119.744633ms for postStartSetup
I0927 17:40:15.907143 300155 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-583947
I0927 17:40:15.923827 300155 profile.go:143] Saving config to /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/config.json ...
I0927 17:40:15.924113 300155 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0927 17:40:15.924171 300155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-583947
I0927 17:40:15.940513 300155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19712-294006/.minikube/machines/addons-583947/id_rsa Username:docker}
I0927 17:40:16.030757 300155 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0927 17:40:16.035523 300155 start.go:128] duration metric: took 10.141765675s to createHost
I0927 17:40:16.035551 300155 start.go:83] releasing machines lock for "addons-583947", held for 10.141933131s
I0927 17:40:16.035627 300155 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-583947
I0927 17:40:16.052773 300155 ssh_runner.go:195] Run: cat /version.json
I0927 17:40:16.052829 300155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-583947
I0927 17:40:16.052844 300155 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0927 17:40:16.052919 300155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-583947
I0927 17:40:16.071405 300155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19712-294006/.minikube/machines/addons-583947/id_rsa Username:docker}
I0927 17:40:16.077560 300155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19712-294006/.minikube/machines/addons-583947/id_rsa Username:docker}
I0927 17:40:16.298615 300155 ssh_runner.go:195] Run: systemctl --version
I0927 17:40:16.303174 300155 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0927 17:40:16.307825 300155 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0927 17:40:16.331981 300155 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0927 17:40:16.332104 300155 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0927 17:40:16.363725 300155 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0927 17:40:16.363764 300155 start.go:495] detecting cgroup driver to use...
I0927 17:40:16.363799 300155 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0927 17:40:16.363859 300155 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0927 17:40:16.376852 300155 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0927 17:40:16.388663 300155 docker.go:217] disabling cri-docker service (if available) ...
I0927 17:40:16.388734 300155 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0927 17:40:16.402552 300155 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0927 17:40:16.417679 300155 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0927 17:40:16.499442 300155 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0927 17:40:16.600050 300155 docker.go:233] disabling docker service ...
I0927 17:40:16.600140 300155 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0927 17:40:16.619751 300155 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0927 17:40:16.631777 300155 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0927 17:40:16.725452 300155 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0927 17:40:16.825004 300155 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0927 17:40:16.836701 300155 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0927 17:40:16.854106 300155 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0927 17:40:16.864903 300155 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0927 17:40:16.875767 300155 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0927 17:40:16.875890 300155 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0927 17:40:16.886991 300155 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0927 17:40:16.897968 300155 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0927 17:40:16.908876 300155 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0927 17:40:16.919799 300155 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0927 17:40:16.929795 300155 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0927 17:40:16.940359 300155 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0927 17:40:16.951006 300155 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0927 17:40:16.961916 300155 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0927 17:40:16.970714 300155 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0927 17:40:16.979632 300155 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0927 17:40:17.060724 300155 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0927 17:40:17.187137 300155 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0927 17:40:17.187260 300155 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0927 17:40:17.191079 300155 start.go:563] Will wait 60s for crictl version
I0927 17:40:17.191153 300155 ssh_runner.go:195] Run: which crictl
I0927 17:40:17.194761 300155 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0927 17:40:17.232963 300155 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.22
RuntimeApiVersion: v1
I0927 17:40:17.233053 300155 ssh_runner.go:195] Run: containerd --version
I0927 17:40:17.255402 300155 ssh_runner.go:195] Run: containerd --version
I0927 17:40:17.282811 300155 out.go:177] * Preparing Kubernetes v1.31.1 on containerd 1.7.22 ...
I0927 17:40:17.284928 300155 cli_runner.go:164] Run: docker network inspect addons-583947 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0927 17:40:17.300335 300155 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I0927 17:40:17.303875 300155 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0927 17:40:17.315060 300155 kubeadm.go:883] updating cluster {Name:addons-583947 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-583947 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cus
tomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0927 17:40:17.315184 300155 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I0927 17:40:17.315247 300155 ssh_runner.go:195] Run: sudo crictl images --output json
I0927 17:40:17.353925 300155 containerd.go:627] all images are preloaded for containerd runtime.
I0927 17:40:17.353951 300155 containerd.go:534] Images already preloaded, skipping extraction
I0927 17:40:17.354020 300155 ssh_runner.go:195] Run: sudo crictl images --output json
I0927 17:40:17.393982 300155 containerd.go:627] all images are preloaded for containerd runtime.
I0927 17:40:17.394007 300155 cache_images.go:84] Images are preloaded, skipping loading
I0927 17:40:17.394015 300155 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.1 containerd true true} ...
I0927 17:40:17.394124 300155 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-583947 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.31.1 ClusterName:addons-583947 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0927 17:40:17.394195 300155 ssh_runner.go:195] Run: sudo crictl info
I0927 17:40:17.431108 300155 cni.go:84] Creating CNI manager for ""
I0927 17:40:17.431134 300155 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0927 17:40:17.431146 300155 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0927 17:40:17.431203 300155 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-583947 NodeName:addons-583947 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc
/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0927 17:40:17.431381 300155 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "addons-583947"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0927 17:40:17.431460 300155 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1
I0927 17:40:17.440642 300155 binaries.go:44] Found k8s binaries, skipping transfer
I0927 17:40:17.440724 300155 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0927 17:40:17.449573 300155 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (317 bytes)
I0927 17:40:17.467816 300155 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0927 17:40:17.486889 300155 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2167 bytes)
I0927 17:40:17.504581 300155 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0927 17:40:17.507866 300155 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0927 17:40:17.518675 300155 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0927 17:40:17.604525 300155 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0927 17:40:17.621955 300155 certs.go:68] Setting up /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947 for IP: 192.168.49.2
I0927 17:40:17.622030 300155 certs.go:194] generating shared ca certs ...
I0927 17:40:17.622062 300155 certs.go:226] acquiring lock for ca certs: {Name:mk0891ce7588143d48f2c5fb538d185b80c1ae26 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 17:40:17.622236 300155 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19712-294006/.minikube/ca.key
I0927 17:40:17.855554 300155 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19712-294006/.minikube/ca.crt ...
I0927 17:40:17.855589 300155 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19712-294006/.minikube/ca.crt: {Name:mkaa50c4b01de0557c702bf39d18a5fced802706 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 17:40:17.855792 300155 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19712-294006/.minikube/ca.key ...
I0927 17:40:17.855805 300155 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19712-294006/.minikube/ca.key: {Name:mk4e9d83c617f9aff0eb80310c9f92fd19452576 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 17:40:17.855907 300155 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19712-294006/.minikube/proxy-client-ca.key
I0927 17:40:18.268584 300155 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19712-294006/.minikube/proxy-client-ca.crt ...
I0927 17:40:18.268616 300155 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19712-294006/.minikube/proxy-client-ca.crt: {Name:mke2689da11e30dbfb41ca826eb6bbb5ff2216d4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 17:40:18.268803 300155 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19712-294006/.minikube/proxy-client-ca.key ...
I0927 17:40:18.268820 300155 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19712-294006/.minikube/proxy-client-ca.key: {Name:mk32c888d4fef2caf8b8726bf656f521563b7dde Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 17:40:18.268902 300155 certs.go:256] generating profile certs ...
I0927 17:40:18.268966 300155 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/client.key
I0927 17:40:18.268984 300155 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/client.crt with IP's: []
I0927 17:40:18.909733 300155 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/client.crt ...
I0927 17:40:18.909772 300155 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/client.crt: {Name:mkd9abf870fe4a863850e8ce5146fbf418f75870 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 17:40:18.909974 300155 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/client.key ...
I0927 17:40:18.909989 300155 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/client.key: {Name:mk8aaf11f0f4b9a411c47496a7de9f3b6ac16997 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 17:40:18.910088 300155 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/apiserver.key.ffc9b220
I0927 17:40:18.910112 300155 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/apiserver.crt.ffc9b220 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I0927 17:40:19.199614 300155 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/apiserver.crt.ffc9b220 ...
I0927 17:40:19.199650 300155 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/apiserver.crt.ffc9b220: {Name:mkff9598aec20c7cf81e244ea59602d2fe6072f4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 17:40:19.199856 300155 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/apiserver.key.ffc9b220 ...
I0927 17:40:19.199873 300155 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/apiserver.key.ffc9b220: {Name:mka06059fe35b558b2142658eac7918830be41b1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 17:40:19.199954 300155 certs.go:381] copying /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/apiserver.crt.ffc9b220 -> /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/apiserver.crt
I0927 17:40:19.200043 300155 certs.go:385] copying /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/apiserver.key.ffc9b220 -> /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/apiserver.key
I0927 17:40:19.200101 300155 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/proxy-client.key
I0927 17:40:19.200123 300155 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/proxy-client.crt with IP's: []
I0927 17:40:19.453845 300155 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/proxy-client.crt ...
I0927 17:40:19.453878 300155 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/proxy-client.crt: {Name:mke633d161fbf046651ee94e27f9c3c298a7d340 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 17:40:19.454688 300155 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/proxy-client.key ...
I0927 17:40:19.454709 300155 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/proxy-client.key: {Name:mk88d834ca0179d67d6c59a3ec6ee40e19843f5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 17:40:19.454922 300155 certs.go:484] found cert: /home/jenkins/minikube-integration/19712-294006/.minikube/certs/ca-key.pem (1675 bytes)
I0927 17:40:19.454966 300155 certs.go:484] found cert: /home/jenkins/minikube-integration/19712-294006/.minikube/certs/ca.pem (1078 bytes)
I0927 17:40:19.454993 300155 certs.go:484] found cert: /home/jenkins/minikube-integration/19712-294006/.minikube/certs/cert.pem (1123 bytes)
I0927 17:40:19.455022 300155 certs.go:484] found cert: /home/jenkins/minikube-integration/19712-294006/.minikube/certs/key.pem (1675 bytes)
I0927 17:40:19.455610 300155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19712-294006/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0927 17:40:19.483120 300155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19712-294006/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0927 17:40:19.508088 300155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19712-294006/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0927 17:40:19.532347 300155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19712-294006/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0927 17:40:19.556973 300155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0927 17:40:19.582552 300155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0927 17:40:19.607004 300155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0927 17:40:19.631620 300155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19712-294006/.minikube/profiles/addons-583947/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0927 17:40:19.656600 300155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19712-294006/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0927 17:40:19.681715 300155 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0927 17:40:19.701028 300155 ssh_runner.go:195] Run: openssl version
I0927 17:40:19.706576 300155 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0927 17:40:19.716259 300155 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0927 17:40:19.720025 300155 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 27 17:40 /usr/share/ca-certificates/minikubeCA.pem
I0927 17:40:19.720141 300155 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0927 17:40:19.727271 300155 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0927 17:40:19.737292 300155 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0927 17:40:19.740504 300155 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0927 17:40:19.740573 300155 kubeadm.go:392] StartCluster: {Name:addons-583947 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-583947 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom
QemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0927 17:40:19.740667 300155 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0927 17:40:19.740732 300155 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0927 17:40:19.776705 300155 cri.go:89] found id: ""
I0927 17:40:19.776777 300155 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0927 17:40:19.785730 300155 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0927 17:40:19.794790 300155 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0927 17:40:19.794935 300155 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0927 17:40:19.804132 300155 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0927 17:40:19.804154 300155 kubeadm.go:157] found existing configuration files:
I0927 17:40:19.804209 300155 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0927 17:40:19.813100 300155 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0927 17:40:19.813169 300155 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0927 17:40:19.821848 300155 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0927 17:40:19.831163 300155 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0927 17:40:19.831232 300155 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0927 17:40:19.839872 300155 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0927 17:40:19.848860 300155 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0927 17:40:19.848941 300155 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0927 17:40:19.857747 300155 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0927 17:40:19.867078 300155 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0927 17:40:19.867172 300155 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0927 17:40:19.875690 300155 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0927 17:40:19.916664 300155 kubeadm.go:310] W0927 17:40:19.915930 1022 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0927 17:40:19.917329 300155 kubeadm.go:310] W0927 17:40:19.916826 1022 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0927 17:40:19.937741 300155 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1070-aws\n", err: exit status 1
I0927 17:40:20.009606 300155 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0927 17:40:37.827120 300155 kubeadm.go:310] [init] Using Kubernetes version: v1.31.1
I0927 17:40:37.827182 300155 kubeadm.go:310] [preflight] Running pre-flight checks
I0927 17:40:37.827272 300155 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0927 17:40:37.827331 300155 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1070-aws[0m
I0927 17:40:37.827371 300155 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0927 17:40:37.827420 300155 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0927 17:40:37.827480 300155 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0927 17:40:37.827536 300155 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0927 17:40:37.827596 300155 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0927 17:40:37.827648 300155 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0927 17:40:37.827700 300155 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0927 17:40:37.827749 300155 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0927 17:40:37.827802 300155 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0927 17:40:37.827851 300155 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0927 17:40:37.827926 300155 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0927 17:40:37.828023 300155 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0927 17:40:37.828114 300155 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0927 17:40:37.828179 300155 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0927 17:40:37.830344 300155 out.go:235] - Generating certificates and keys ...
I0927 17:40:37.830445 300155 kubeadm.go:310] [certs] Using existing ca certificate authority
I0927 17:40:37.830515 300155 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0927 17:40:37.830585 300155 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0927 17:40:37.830644 300155 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0927 17:40:37.830710 300155 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0927 17:40:37.830764 300155 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0927 17:40:37.830822 300155 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0927 17:40:37.830944 300155 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-583947 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0927 17:40:37.831000 300155 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0927 17:40:37.831116 300155 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-583947 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0927 17:40:37.831185 300155 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0927 17:40:37.831251 300155 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0927 17:40:37.831298 300155 kubeadm.go:310] [certs] Generating "sa" key and public key
I0927 17:40:37.831357 300155 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0927 17:40:37.831412 300155 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0927 17:40:37.831471 300155 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0927 17:40:37.831528 300155 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0927 17:40:37.831594 300155 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0927 17:40:37.831651 300155 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0927 17:40:37.831736 300155 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0927 17:40:37.831805 300155 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0927 17:40:37.833874 300155 out.go:235] - Booting up control plane ...
I0927 17:40:37.834004 300155 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0927 17:40:37.834097 300155 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0927 17:40:37.834200 300155 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0927 17:40:37.834312 300155 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0927 17:40:37.834412 300155 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0927 17:40:37.834454 300155 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0927 17:40:37.834597 300155 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0927 17:40:37.834765 300155 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0927 17:40:37.834835 300155 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.501709543s
I0927 17:40:37.834927 300155 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0927 17:40:37.835002 300155 kubeadm.go:310] [api-check] The API server is healthy after 6.5021021s
I0927 17:40:37.835144 300155 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0927 17:40:37.835286 300155 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0927 17:40:37.835375 300155 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0927 17:40:37.835557 300155 kubeadm.go:310] [mark-control-plane] Marking the node addons-583947 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0927 17:40:37.835617 300155 kubeadm.go:310] [bootstrap-token] Using token: di1gyv.0em8exomdga425jk
I0927 17:40:37.837554 300155 out.go:235] - Configuring RBAC rules ...
I0927 17:40:37.837677 300155 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0927 17:40:37.837759 300155 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0927 17:40:37.837906 300155 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0927 17:40:37.838041 300155 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0927 17:40:37.838154 300155 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0927 17:40:37.838238 300155 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0927 17:40:37.838351 300155 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0927 17:40:37.838404 300155 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0927 17:40:37.838450 300155 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0927 17:40:37.838456 300155 kubeadm.go:310]
I0927 17:40:37.838516 300155 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0927 17:40:37.838520 300155 kubeadm.go:310]
I0927 17:40:37.838596 300155 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0927 17:40:37.838599 300155 kubeadm.go:310]
I0927 17:40:37.838625 300155 kubeadm.go:310] mkdir -p $HOME/.kube
I0927 17:40:37.838682 300155 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0927 17:40:37.838732 300155 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0927 17:40:37.838736 300155 kubeadm.go:310]
I0927 17:40:37.838789 300155 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0927 17:40:37.838793 300155 kubeadm.go:310]
I0927 17:40:37.838840 300155 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0927 17:40:37.838844 300155 kubeadm.go:310]
I0927 17:40:37.838896 300155 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0927 17:40:37.838969 300155 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0927 17:40:37.839036 300155 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0927 17:40:37.839040 300155 kubeadm.go:310]
I0927 17:40:37.839123 300155 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0927 17:40:37.839199 300155 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0927 17:40:37.839203 300155 kubeadm.go:310]
I0927 17:40:37.839286 300155 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token di1gyv.0em8exomdga425jk \
I0927 17:40:37.839387 300155 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:e36d06a61fed1cb797521692277c6fed05d87d948beae49341a57851e31b2de5 \
I0927 17:40:37.839408 300155 kubeadm.go:310] --control-plane
I0927 17:40:37.839412 300155 kubeadm.go:310]
I0927 17:40:37.839495 300155 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0927 17:40:37.839499 300155 kubeadm.go:310]
I0927 17:40:37.839581 300155 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token di1gyv.0em8exomdga425jk \
I0927 17:40:37.839694 300155 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:e36d06a61fed1cb797521692277c6fed05d87d948beae49341a57851e31b2de5
I0927 17:40:37.839703 300155 cni.go:84] Creating CNI manager for ""
I0927 17:40:37.839710 300155 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0927 17:40:37.841821 300155 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0927 17:40:37.843865 300155 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0927 17:40:37.847676 300155 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.1/kubectl ...
I0927 17:40:37.847698 300155 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I0927 17:40:37.866135 300155 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0927 17:40:38.146729 300155 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0927 17:40:38.146903 300155 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0927 17:40:38.146990 300155 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-583947 minikube.k8s.io/updated_at=2024_09_27T17_40_38_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=d0bb8598e36db8db200944ab6842cd553a7bd60c minikube.k8s.io/name=addons-583947 minikube.k8s.io/primary=true
I0927 17:40:38.286715 300155 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0927 17:40:38.286792 300155 ops.go:34] apiserver oom_adj: -16
I0927 17:40:38.786911 300155 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0927 17:40:39.287455 300155 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0927 17:40:39.787717 300155 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0927 17:40:40.287646 300155 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0927 17:40:40.787539 300155 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0927 17:40:41.286846 300155 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0927 17:40:41.787184 300155 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0927 17:40:41.887917 300155 kubeadm.go:1113] duration metric: took 3.741096118s to wait for elevateKubeSystemPrivileges
I0927 17:40:41.887996 300155 kubeadm.go:394] duration metric: took 22.147442286s to StartCluster
I0927 17:40:41.888020 300155 settings.go:142] acquiring lock: {Name:mk6311c862b19a3d49ef46b1e763e636e4ddd1db Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 17:40:41.888182 300155 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19712-294006/kubeconfig
I0927 17:40:41.888817 300155 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19712-294006/kubeconfig: {Name:mk3cffd40ec049ac1050f606c0f198b3abfa6caf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 17:40:41.889117 300155 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0927 17:40:41.889168 300155 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0927 17:40:41.889429 300155 config.go:182] Loaded profile config "addons-583947": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I0927 17:40:41.889465 300155 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I0927 17:40:41.889539 300155 addons.go:69] Setting yakd=true in profile "addons-583947"
I0927 17:40:41.889554 300155 addons.go:234] Setting addon yakd=true in "addons-583947"
I0927 17:40:41.889579 300155 host.go:66] Checking if "addons-583947" exists ...
I0927 17:40:41.890088 300155 cli_runner.go:164] Run: docker container inspect addons-583947 --format={{.State.Status}}
I0927 17:40:41.890257 300155 addons.go:69] Setting inspektor-gadget=true in profile "addons-583947"
I0927 17:40:41.890275 300155 addons.go:234] Setting addon inspektor-gadget=true in "addons-583947"
I0927 17:40:41.890297 300155 host.go:66] Checking if "addons-583947" exists ...
I0927 17:40:41.890698 300155 cli_runner.go:164] Run: docker container inspect addons-583947 --format={{.State.Status}}
I0927 17:40:41.891192 300155 addons.go:69] Setting cloud-spanner=true in profile "addons-583947"
I0927 17:40:41.891274 300155 addons.go:234] Setting addon cloud-spanner=true in "addons-583947"
I0927 17:40:41.891391 300155 host.go:66] Checking if "addons-583947" exists ...
I0927 17:40:41.892164 300155 cli_runner.go:164] Run: docker container inspect addons-583947 --format={{.State.Status}}
I0927 17:40:41.893127 300155 addons.go:69] Setting metrics-server=true in profile "addons-583947"
I0927 17:40:41.893208 300155 addons.go:234] Setting addon metrics-server=true in "addons-583947"
I0927 17:40:41.893782 300155 host.go:66] Checking if "addons-583947" exists ...
I0927 17:40:41.894391 300155 cli_runner.go:164] Run: docker container inspect addons-583947 --format={{.State.Status}}
I0927 17:40:41.893607 300155 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-583947"
I0927 17:40:41.895531 300155 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-583947"
I0927 17:40:41.893620 300155 addons.go:69] Setting registry=true in profile "addons-583947"
I0927 17:40:41.893625 300155 addons.go:69] Setting storage-provisioner=true in profile "addons-583947"
I0927 17:40:41.893629 300155 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-583947"
I0927 17:40:41.893632 300155 addons.go:69] Setting volcano=true in profile "addons-583947"
I0927 17:40:41.893636 300155 addons.go:69] Setting volumesnapshots=true in profile "addons-583947"
I0927 17:40:41.893696 300155 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-583947"
I0927 17:40:41.893705 300155 addons.go:69] Setting default-storageclass=true in profile "addons-583947"
I0927 17:40:41.893710 300155 addons.go:69] Setting gcp-auth=true in profile "addons-583947"
I0927 17:40:41.893714 300155 addons.go:69] Setting ingress=true in profile "addons-583947"
I0927 17:40:41.893718 300155 addons.go:69] Setting ingress-dns=true in profile "addons-583947"
I0927 17:40:41.893735 300155 out.go:177] * Verifying Kubernetes components...
I0927 17:40:41.899750 300155 host.go:66] Checking if "addons-583947" exists ...
I0927 17:40:41.901061 300155 cli_runner.go:164] Run: docker container inspect addons-583947 --format={{.State.Status}}
I0927 17:40:41.899776 300155 addons.go:234] Setting addon registry=true in "addons-583947"
I0927 17:40:41.909504 300155 host.go:66] Checking if "addons-583947" exists ...
I0927 17:40:41.910152 300155 cli_runner.go:164] Run: docker container inspect addons-583947 --format={{.State.Status}}
I0927 17:40:41.899784 300155 addons.go:234] Setting addon storage-provisioner=true in "addons-583947"
I0927 17:40:41.911110 300155 host.go:66] Checking if "addons-583947" exists ...
I0927 17:40:41.911830 300155 cli_runner.go:164] Run: docker container inspect addons-583947 --format={{.State.Status}}
I0927 17:40:41.916049 300155 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0927 17:40:41.899793 300155 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-583947"
I0927 17:40:41.929123 300155 cli_runner.go:164] Run: docker container inspect addons-583947 --format={{.State.Status}}
I0927 17:40:41.899805 300155 addons.go:234] Setting addon volcano=true in "addons-583947"
I0927 17:40:41.948449 300155 host.go:66] Checking if "addons-583947" exists ...
I0927 17:40:41.949076 300155 cli_runner.go:164] Run: docker container inspect addons-583947 --format={{.State.Status}}
I0927 17:40:41.899814 300155 addons.go:234] Setting addon volumesnapshots=true in "addons-583947"
I0927 17:40:41.975739 300155 host.go:66] Checking if "addons-583947" exists ...
I0927 17:40:41.976238 300155 cli_runner.go:164] Run: docker container inspect addons-583947 --format={{.State.Status}}
I0927 17:40:41.992707 300155 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.24
I0927 17:40:41.992989 300155 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0
I0927 17:40:41.899843 300155 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-583947"
I0927 17:40:41.993527 300155 host.go:66] Checking if "addons-583947" exists ...
I0927 17:40:41.995514 300155 cli_runner.go:164] Run: docker container inspect addons-583947 --format={{.State.Status}}
I0927 17:40:41.899850 300155 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-583947"
I0927 17:40:42.006697 300155 cli_runner.go:164] Run: docker container inspect addons-583947 --format={{.State.Status}}
I0927 17:40:42.015204 300155 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
I0927 17:40:42.015274 300155 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0927 17:40:42.015362 300155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-583947
I0927 17:40:41.899862 300155 mustload.go:65] Loading cluster: addons-583947
I0927 17:40:42.024760 300155 config.go:182] Loaded profile config "addons-583947": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I0927 17:40:42.025060 300155 cli_runner.go:164] Run: docker container inspect addons-583947 --format={{.State.Status}}
I0927 17:40:41.899868 300155 addons.go:234] Setting addon ingress=true in "addons-583947"
I0927 17:40:42.025230 300155 host.go:66] Checking if "addons-583947" exists ...
I0927 17:40:42.028141 300155 cli_runner.go:164] Run: docker container inspect addons-583947 --format={{.State.Status}}
I0927 17:40:42.037395 300155 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
I0927 17:40:42.037425 300155 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I0927 17:40:42.037507 300155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-583947
I0927 17:40:41.899874 300155 addons.go:234] Setting addon ingress-dns=true in "addons-583947"
I0927 17:40:42.045489 300155 host.go:66] Checking if "addons-583947" exists ...
I0927 17:40:42.084138 300155 cli_runner.go:164] Run: docker container inspect addons-583947 --format={{.State.Status}}
I0927 17:40:42.135736 300155 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I0927 17:40:42.137622 300155 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
I0927 17:40:42.137655 300155 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0927 17:40:42.137770 300155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-583947
I0927 17:40:42.158229 300155 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
I0927 17:40:42.160338 300155 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-583947"
I0927 17:40:42.160384 300155 host.go:66] Checking if "addons-583947" exists ...
I0927 17:40:42.160874 300155 cli_runner.go:164] Run: docker container inspect addons-583947 --format={{.State.Status}}
I0927 17:40:42.196898 300155 out.go:177] - Using image docker.io/registry:2.8.3
I0927 17:40:42.203268 300155 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0927 17:40:42.203295 300155 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0927 17:40:42.203377 300155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-583947
I0927 17:40:42.227987 300155 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2
I0927 17:40:42.231760 300155 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
I0927 17:40:42.236252 300155 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
I0927 17:40:42.236330 300155 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I0927 17:40:42.236447 300155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-583947
I0927 17:40:42.256845 300155 out.go:177] - Using image docker.io/volcanosh/vc-webhook-manager:v1.10.0
I0927 17:40:42.257112 300155 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0927 17:40:42.232497 300155 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0927 17:40:42.257376 300155 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0927 17:40:42.257489 300155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-583947
I0927 17:40:42.271531 300155 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0927 17:40:42.271560 300155 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0927 17:40:42.271761 300155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-583947
I0927 17:40:42.302676 300155 out.go:177] - Using image docker.io/volcanosh/vc-controller-manager:v1.10.0
I0927 17:40:42.303632 300155 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0927 17:40:42.306482 300155 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0927 17:40:42.315053 300155 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0927 17:40:42.315313 300155 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0927 17:40:42.315653 300155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-583947
I0927 17:40:42.316126 300155 out.go:177] - Using image docker.io/volcanosh/vc-scheduler:v1.10.0
I0927 17:40:42.323058 300155 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0927 17:40:42.325145 300155 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0927 17:40:42.329445 300155 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml
I0927 17:40:42.329531 300155 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (471825 bytes)
I0927 17:40:42.329668 300155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-583947
I0927 17:40:42.338609 300155 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0927 17:40:42.340957 300155 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0927 17:40:42.343555 300155 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0927 17:40:42.351458 300155 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0927 17:40:42.354672 300155 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0927 17:40:42.357175 300155 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0927 17:40:42.357276 300155 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0927 17:40:42.357424 300155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-583947
I0927 17:40:42.360860 300155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19712-294006/.minikube/machines/addons-583947/id_rsa Username:docker}
I0927 17:40:42.384261 300155 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0927 17:40:42.389096 300155 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0927 17:40:42.405630 300155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19712-294006/.minikube/machines/addons-583947/id_rsa Username:docker}
I0927 17:40:42.407506 300155 addons.go:234] Setting addon default-storageclass=true in "addons-583947"
I0927 17:40:42.407557 300155 host.go:66] Checking if "addons-583947" exists ...
I0927 17:40:42.407984 300155 cli_runner.go:164] Run: docker container inspect addons-583947 --format={{.State.Status}}
I0927 17:40:42.412288 300155 host.go:66] Checking if "addons-583947" exists ...
I0927 17:40:42.436742 300155 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0927 17:40:42.439023 300155 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2
I0927 17:40:42.440735 300155 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0927 17:40:42.441728 300155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19712-294006/.minikube/machines/addons-583947/id_rsa Username:docker}
I0927 17:40:42.446680 300155 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0927 17:40:42.446707 300155 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I0927 17:40:42.446777 300155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-583947
I0927 17:40:42.451339 300155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19712-294006/.minikube/machines/addons-583947/id_rsa Username:docker}
I0927 17:40:42.458249 300155 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I0927 17:40:42.464841 300155 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0927 17:40:42.464870 300155 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0927 17:40:42.464936 300155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-583947
I0927 17:40:42.481604 300155 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0927 17:40:42.483382 300155 out.go:177] - Using image docker.io/busybox:stable
I0927 17:40:42.486477 300155 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0927 17:40:42.486501 300155 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0927 17:40:42.486569 300155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-583947
I0927 17:40:42.495500 300155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19712-294006/.minikube/machines/addons-583947/id_rsa Username:docker}
I0927 17:40:42.533992 300155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19712-294006/.minikube/machines/addons-583947/id_rsa Username:docker}
I0927 17:40:42.561486 300155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19712-294006/.minikube/machines/addons-583947/id_rsa Username:docker}
I0927 17:40:42.581313 300155 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0927 17:40:42.581333 300155 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0927 17:40:42.581394 300155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-583947
I0927 17:40:42.583471 300155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19712-294006/.minikube/machines/addons-583947/id_rsa Username:docker}
I0927 17:40:42.590956 300155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19712-294006/.minikube/machines/addons-583947/id_rsa Username:docker}
I0927 17:40:42.601878 300155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19712-294006/.minikube/machines/addons-583947/id_rsa Username:docker}
I0927 17:40:42.604973 300155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19712-294006/.minikube/machines/addons-583947/id_rsa Username:docker}
I0927 17:40:42.611691 300155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19712-294006/.minikube/machines/addons-583947/id_rsa Username:docker}
I0927 17:40:42.625724 300155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19712-294006/.minikube/machines/addons-583947/id_rsa Username:docker}
W0927 17:40:42.646174 300155 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0927 17:40:42.646210 300155 retry.go:31] will retry after 275.607841ms: ssh: handshake failed: EOF
I0927 17:40:42.649455 300155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19712-294006/.minikube/machines/addons-583947/id_rsa Username:docker}
I0927 17:40:43.166263 300155 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I0927 17:40:43.166295 300155 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I0927 17:40:43.246115 300155 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0927 17:40:43.246142 300155 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0927 17:40:43.326648 300155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0927 17:40:43.365860 300155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0927 17:40:43.411695 300155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0927 17:40:43.416979 300155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0927 17:40:43.494635 300155 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0927 17:40:43.494659 300155 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0927 17:40:43.509827 300155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0927 17:40:43.540152 300155 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
I0927 17:40:43.540225 300155 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0927 17:40:43.542580 300155 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
I0927 17:40:43.542659 300155 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0927 17:40:43.546377 300155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0927 17:40:43.550358 300155 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0927 17:40:43.550429 300155 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0927 17:40:43.568255 300155 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0927 17:40:43.568328 300155 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0927 17:40:43.597806 300155 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
I0927 17:40:43.597877 300155 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I0927 17:40:43.656971 300155 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0927 17:40:43.657044 300155 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0927 17:40:43.696642 300155 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
I0927 17:40:43.696712 300155 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0927 17:40:43.733651 300155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
I0927 17:40:43.777341 300155 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I0927 17:40:43.777420 300155 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I0927 17:40:43.811828 300155 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0927 17:40:43.811900 300155 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0927 17:40:43.879895 300155 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
I0927 17:40:43.879966 300155 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0927 17:40:43.886148 300155 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0927 17:40:43.886222 300155 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0927 17:40:43.893345 300155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0927 17:40:43.943277 300155 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0927 17:40:43.943352 300155 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0927 17:40:44.039460 300155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0927 17:40:44.163766 300155 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
I0927 17:40:44.163842 300155 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0927 17:40:44.164996 300155 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0927 17:40:44.165045 300155 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0927 17:40:44.167524 300155 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I0927 17:40:44.167569 300155 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I0927 17:40:44.180179 300155 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0927 17:40:44.180257 300155 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0927 17:40:44.232151 300155 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0927 17:40:44.232229 300155 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0927 17:40:44.453510 300155 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0927 17:40:44.453593 300155 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0927 17:40:44.471725 300155 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I0927 17:40:44.471803 300155 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I0927 17:40:44.535664 300155 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
I0927 17:40:44.535736 300155 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0927 17:40:44.607132 300155 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0927 17:40:44.607205 300155 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0927 17:40:44.635699 300155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0927 17:40:44.788952 300155 addons.go:431] installing /etc/kubernetes/addons/ig-configmap.yaml
I0927 17:40:44.789028 300155 ssh_runner.go:362] scp inspektor-gadget/ig-configmap.yaml --> /etc/kubernetes/addons/ig-configmap.yaml (754 bytes)
I0927 17:40:44.826395 300155 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (2.43725742s)
I0927 17:40:44.827325 300155 node_ready.go:35] waiting up to 6m0s for node "addons-583947" to be "Ready" ...
I0927 17:40:44.827586 300155 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.443300402s)
I0927 17:40:44.827610 300155 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I0927 17:40:44.828589 300155 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (1.501911327s)
I0927 17:40:44.832818 300155 node_ready.go:49] node "addons-583947" has status "Ready":"True"
I0927 17:40:44.832845 300155 node_ready.go:38] duration metric: took 5.494446ms for node "addons-583947" to be "Ready" ...
I0927 17:40:44.832889 300155 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0927 17:40:44.851722 300155 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-7qtwt" in "kube-system" namespace to be "Ready" ...
I0927 17:40:44.880602 300155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0927 17:40:44.900477 300155 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0927 17:40:44.900506 300155 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0927 17:40:45.020658 300155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0927 17:40:45.332688 300155 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-583947" context rescaled to 1 replicas
I0927 17:40:45.357060 300155 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0927 17:40:45.357090 300155 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0927 17:40:45.399697 300155 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
I0927 17:40:45.399806 300155 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I0927 17:40:45.612737 300155 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0927 17:40:45.612765 300155 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0927 17:40:45.667307 300155 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
I0927 17:40:45.667334 300155 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (8196 bytes)
I0927 17:40:45.888194 300155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-configmap.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I0927 17:40:45.904896 300155 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0927 17:40:45.904923 300155 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0927 17:40:46.108255 300155 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0927 17:40:46.108283 300155 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0927 17:40:46.395817 300155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0927 17:40:46.891567 300155 pod_ready.go:103] pod "coredns-7c65d6cfc9-7qtwt" in "kube-system" namespace has status "Ready":"False"
I0927 17:40:47.513579 300155 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (4.147678553s)
I0927 17:40:47.513790 300155 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (4.102067445s)
I0927 17:40:47.513829 300155 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (4.096827509s)
I0927 17:40:47.513856 300155 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (4.003960126s)
I0927 17:40:47.513972 300155 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (3.967528766s)
W0927 17:40:47.537524 300155 out.go:270] ! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error while marking storage class local-path as non-default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]
I0927 17:40:49.359020 300155 pod_ready.go:103] pod "coredns-7c65d6cfc9-7qtwt" in "kube-system" namespace has status "Ready":"False"
I0927 17:40:49.623702 300155 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0927 17:40:49.623798 300155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-583947
I0927 17:40:49.649008 300155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19712-294006/.minikube/machines/addons-583947/id_rsa Username:docker}
I0927 17:40:50.382229 300155 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0927 17:40:50.422180 300155 addons.go:234] Setting addon gcp-auth=true in "addons-583947"
I0927 17:40:50.422237 300155 host.go:66] Checking if "addons-583947" exists ...
I0927 17:40:50.422695 300155 cli_runner.go:164] Run: docker container inspect addons-583947 --format={{.State.Status}}
I0927 17:40:50.447135 300155 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0927 17:40:50.447190 300155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-583947
I0927 17:40:50.476308 300155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19712-294006/.minikube/machines/addons-583947/id_rsa Username:docker}
I0927 17:40:51.860031 300155 pod_ready.go:103] pod "coredns-7c65d6cfc9-7qtwt" in "kube-system" namespace has status "Ready":"False"
I0927 17:40:53.405311 300155 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (9.511902405s)
I0927 17:40:53.405451 300155 addons.go:475] Verifying addon ingress=true in "addons-583947"
I0927 17:40:53.405469 300155 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.769747109s)
I0927 17:40:53.405493 300155 addons.go:475] Verifying addon metrics-server=true in "addons-583947"
I0927 17:40:53.405534 300155 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (8.524906227s)
I0927 17:40:53.405744 300155 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (8.384952818s)
W0927 17:40:53.405781 300155 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0927 17:40:53.405813 300155 retry.go:31] will retry after 370.234658ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0927 17:40:53.405375 300155 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (9.365842455s)
I0927 17:40:53.405877 300155 addons.go:475] Verifying addon registry=true in "addons-583947"
I0927 17:40:53.406107 300155 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-configmap.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (7.517762326s)
I0927 17:40:53.405331 300155 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (9.671509135s)
I0927 17:40:53.409269 300155 out.go:177] * Verifying ingress addon...
I0927 17:40:53.409301 300155 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-583947 service yakd-dashboard -n yakd-dashboard
I0927 17:40:53.410647 300155 out.go:177] * Verifying registry addon...
I0927 17:40:53.412537 300155 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0927 17:40:53.413710 300155 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0927 17:40:53.536317 300155 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0927 17:40:53.536349 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:40:53.537346 300155 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0927 17:40:53.537365 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:40:53.777060 300155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0927 17:40:53.895661 300155 pod_ready.go:103] pod "coredns-7c65d6cfc9-7qtwt" in "kube-system" namespace has status "Ready":"False"
I0927 17:40:53.925407 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:40:53.926005 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:40:54.213965 300155 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (3.766801084s)
I0927 17:40:54.214100 300155 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (7.818076256s)
I0927 17:40:54.214132 300155 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-583947"
I0927 17:40:54.216673 300155 out.go:177] * Verifying csi-hostpath-driver addon...
I0927 17:40:54.216748 300155 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
I0927 17:40:54.219222 300155 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0927 17:40:54.220170 300155 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0927 17:40:54.221644 300155 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0927 17:40:54.221666 300155 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0927 17:40:54.226179 300155 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0927 17:40:54.226211 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:40:54.284642 300155 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0927 17:40:54.284670 300155 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0927 17:40:54.313496 300155 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0927 17:40:54.313524 300155 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I0927 17:40:54.393098 300155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0927 17:40:54.420266 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:40:54.421205 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:40:54.746250 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:40:54.919233 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:40:54.919774 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:40:55.226517 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:40:55.392898 300155 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.615788235s)
I0927 17:40:55.419889 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:40:55.421442 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:40:55.675954 300155 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.282815255s)
I0927 17:40:55.679459 300155 addons.go:475] Verifying addon gcp-auth=true in "addons-583947"
I0927 17:40:55.682514 300155 out.go:177] * Verifying gcp-auth addon...
I0927 17:40:55.685622 300155 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0927 17:40:55.691291 300155 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0927 17:40:55.725735 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:40:55.918957 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:40:55.919605 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:40:56.226592 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:40:56.364555 300155 pod_ready.go:103] pod "coredns-7c65d6cfc9-7qtwt" in "kube-system" namespace has status "Ready":"False"
I0927 17:40:56.419729 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:40:56.421200 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:40:56.726235 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:40:56.920838 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:40:56.922144 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:40:57.300802 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:40:57.418589 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:40:57.419055 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:40:57.725221 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:40:57.918897 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:40:57.920413 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:40:58.291599 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:40:58.417787 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:40:58.418803 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:40:58.731880 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:40:58.866363 300155 pod_ready.go:103] pod "coredns-7c65d6cfc9-7qtwt" in "kube-system" namespace has status "Ready":"False"
I0927 17:40:58.920480 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:40:58.924501 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:40:59.225292 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:40:59.417689 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:40:59.418281 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:40:59.726262 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:40:59.917343 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:40:59.918751 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:00.292030 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:00.427872 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:00.430402 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:00.725019 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:00.918461 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:00.919332 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:01.225978 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:01.358409 300155 pod_ready.go:103] pod "coredns-7c65d6cfc9-7qtwt" in "kube-system" namespace has status "Ready":"False"
I0927 17:41:01.418996 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:01.419257 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:01.725069 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:01.917759 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:01.918207 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:02.231562 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:02.417571 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:02.418565 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:02.725883 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:02.916829 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:02.918276 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:03.225373 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:03.358934 300155 pod_ready.go:103] pod "coredns-7c65d6cfc9-7qtwt" in "kube-system" namespace has status "Ready":"False"
I0927 17:41:03.417841 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:03.418416 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:03.725053 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:03.917924 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:03.918808 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:04.225657 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:04.416911 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:04.418841 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:04.725732 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:04.917301 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:04.918140 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:05.225569 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:05.419498 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:05.420364 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:05.725117 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:05.858573 300155 pod_ready.go:103] pod "coredns-7c65d6cfc9-7qtwt" in "kube-system" namespace has status "Ready":"False"
I0927 17:41:05.917715 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:05.918065 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:06.225336 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:06.417599 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:06.418414 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:06.725713 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:06.917357 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:06.917739 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:07.225000 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:07.417711 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:07.417906 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:07.725560 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:07.916980 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:07.918601 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:08.226187 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:08.358580 300155 pod_ready.go:103] pod "coredns-7c65d6cfc9-7qtwt" in "kube-system" namespace has status "Ready":"False"
I0927 17:41:08.418412 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:08.419349 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:08.725622 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:08.917143 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:08.918284 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:09.229771 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:09.417557 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:09.419108 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:09.725635 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:09.917305 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:09.919152 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:10.232498 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:10.418880 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:10.420259 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:10.725949 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:10.858572 300155 pod_ready.go:103] pod "coredns-7c65d6cfc9-7qtwt" in "kube-system" namespace has status "Ready":"False"
I0927 17:41:10.918053 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:10.919682 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:11.228688 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:11.418488 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:11.419024 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:11.729303 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:11.918493 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:11.919615 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:12.225229 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:12.417753 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:12.418832 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:12.725588 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:12.858952 300155 pod_ready.go:103] pod "coredns-7c65d6cfc9-7qtwt" in "kube-system" namespace has status "Ready":"False"
I0927 17:41:12.917808 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:12.919787 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:13.224713 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:13.417653 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:13.419289 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:13.725697 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:13.917347 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:13.917909 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:14.234724 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:14.418036 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:14.419285 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:14.725183 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:14.918456 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:14.919047 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:15.225750 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:15.357851 300155 pod_ready.go:103] pod "coredns-7c65d6cfc9-7qtwt" in "kube-system" namespace has status "Ready":"False"
I0927 17:41:15.416922 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:15.419032 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:15.725049 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:15.917493 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:15.919164 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:16.226649 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:16.418911 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:16.419158 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:16.724724 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:16.917672 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:16.918670 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:17.226069 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:17.358175 300155 pod_ready.go:103] pod "coredns-7c65d6cfc9-7qtwt" in "kube-system" namespace has status "Ready":"False"
I0927 17:41:17.417786 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:17.418302 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:17.725034 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:17.917708 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:17.918935 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:18.225622 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:18.418691 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:18.419384 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:18.725587 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:18.918289 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:18.918336 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:19.228844 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:19.358529 300155 pod_ready.go:103] pod "coredns-7c65d6cfc9-7qtwt" in "kube-system" namespace has status "Ready":"False"
I0927 17:41:19.418055 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:19.418863 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:19.724692 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:19.917732 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:19.918674 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:20.226310 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:20.417751 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:20.418826 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:20.725385 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:20.918194 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:20.919050 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:21.225500 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:21.360013 300155 pod_ready.go:103] pod "coredns-7c65d6cfc9-7qtwt" in "kube-system" namespace has status "Ready":"False"
I0927 17:41:21.417662 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:21.418564 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:21.725141 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:21.917394 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:21.919994 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:22.231175 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:22.420352 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:22.421074 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:22.725122 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:22.917793 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:22.918733 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:23.291430 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:23.418168 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:23.418942 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:23.725441 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:23.858353 300155 pod_ready.go:103] pod "coredns-7c65d6cfc9-7qtwt" in "kube-system" namespace has status "Ready":"False"
I0927 17:41:23.918060 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:23.918941 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:24.227643 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:24.416835 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:24.417914 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:24.725375 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:24.917742 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:24.919481 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:25.225924 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:25.417908 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:25.419266 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:25.726464 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:25.918745 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:25.919657 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:26.293728 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:26.358299 300155 pod_ready.go:103] pod "coredns-7c65d6cfc9-7qtwt" in "kube-system" namespace has status "Ready":"False"
I0927 17:41:26.418550 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:26.418868 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:26.803687 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:26.918156 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:26.920008 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:27.225191 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:27.418988 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:27.419944 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:27.725183 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:27.917827 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:27.919640 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:28.225907 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:28.359498 300155 pod_ready.go:103] pod "coredns-7c65d6cfc9-7qtwt" in "kube-system" namespace has status "Ready":"False"
I0927 17:41:28.419137 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:28.419832 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:28.724999 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:28.917910 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:28.919219 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:29.226553 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:29.419984 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:29.421566 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:29.724984 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:29.919423 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:29.921280 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:30.228655 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:30.365521 300155 pod_ready.go:103] pod "coredns-7c65d6cfc9-7qtwt" in "kube-system" namespace has status "Ready":"False"
I0927 17:41:30.421914 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:30.422897 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:30.795288 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:30.917774 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:30.919039 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:31.225616 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:31.419023 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:31.420872 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:31.725197 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:31.918209 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:31.918878 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:32.225780 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:32.417578 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:32.419635 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:32.725966 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:32.858383 300155 pod_ready.go:103] pod "coredns-7c65d6cfc9-7qtwt" in "kube-system" namespace has status "Ready":"False"
I0927 17:41:32.917015 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:32.917878 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:33.226268 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:33.419684 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:33.420949 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:33.725632 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:33.917903 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:33.918432 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:34.225350 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:34.419118 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:34.421464 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:34.794432 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:34.858688 300155 pod_ready.go:103] pod "coredns-7c65d6cfc9-7qtwt" in "kube-system" namespace has status "Ready":"False"
I0927 17:41:34.918234 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:34.919468 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:35.225519 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:35.418919 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:35.420214 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:35.732670 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:35.857604 300155 pod_ready.go:93] pod "coredns-7c65d6cfc9-7qtwt" in "kube-system" namespace has status "Ready":"True"
I0927 17:41:35.857632 300155 pod_ready.go:82] duration metric: took 51.005868502s for pod "coredns-7c65d6cfc9-7qtwt" in "kube-system" namespace to be "Ready" ...
I0927 17:41:35.857644 300155 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-ljzsq" in "kube-system" namespace to be "Ready" ...
I0927 17:41:35.859470 300155 pod_ready.go:98] error getting pod "coredns-7c65d6cfc9-ljzsq" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-ljzsq" not found
I0927 17:41:35.859495 300155 pod_ready.go:82] duration metric: took 1.844583ms for pod "coredns-7c65d6cfc9-ljzsq" in "kube-system" namespace to be "Ready" ...
E0927 17:41:35.859507 300155 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-7c65d6cfc9-ljzsq" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-ljzsq" not found
I0927 17:41:35.859514 300155 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-583947" in "kube-system" namespace to be "Ready" ...
I0927 17:41:35.864410 300155 pod_ready.go:93] pod "etcd-addons-583947" in "kube-system" namespace has status "Ready":"True"
I0927 17:41:35.864437 300155 pod_ready.go:82] duration metric: took 4.915486ms for pod "etcd-addons-583947" in "kube-system" namespace to be "Ready" ...
I0927 17:41:35.864452 300155 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-583947" in "kube-system" namespace to be "Ready" ...
I0927 17:41:35.869341 300155 pod_ready.go:93] pod "kube-apiserver-addons-583947" in "kube-system" namespace has status "Ready":"True"
I0927 17:41:35.869366 300155 pod_ready.go:82] duration metric: took 4.906748ms for pod "kube-apiserver-addons-583947" in "kube-system" namespace to be "Ready" ...
I0927 17:41:35.869378 300155 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-583947" in "kube-system" namespace to be "Ready" ...
I0927 17:41:35.874569 300155 pod_ready.go:93] pod "kube-controller-manager-addons-583947" in "kube-system" namespace has status "Ready":"True"
I0927 17:41:35.874594 300155 pod_ready.go:82] duration metric: took 5.208224ms for pod "kube-controller-manager-addons-583947" in "kube-system" namespace to be "Ready" ...
I0927 17:41:35.874609 300155 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-xp2qc" in "kube-system" namespace to be "Ready" ...
I0927 17:41:35.917369 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:35.918532 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:36.056210 300155 pod_ready.go:93] pod "kube-proxy-xp2qc" in "kube-system" namespace has status "Ready":"True"
I0927 17:41:36.056239 300155 pod_ready.go:82] duration metric: took 181.621466ms for pod "kube-proxy-xp2qc" in "kube-system" namespace to be "Ready" ...
I0927 17:41:36.056252 300155 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-583947" in "kube-system" namespace to be "Ready" ...
I0927 17:41:36.225501 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:36.418162 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:36.419563 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:36.456914 300155 pod_ready.go:93] pod "kube-scheduler-addons-583947" in "kube-system" namespace has status "Ready":"True"
I0927 17:41:36.456940 300155 pod_ready.go:82] duration metric: took 400.679624ms for pod "kube-scheduler-addons-583947" in "kube-system" namespace to be "Ready" ...
I0927 17:41:36.456951 300155 pod_ready.go:39] duration metric: took 51.624041806s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0927 17:41:36.456976 300155 api_server.go:52] waiting for apiserver process to appear ...
I0927 17:41:36.457055 300155 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0927 17:41:36.473696 300155 api_server.go:72] duration metric: took 54.584492192s to wait for apiserver process to appear ...
I0927 17:41:36.473762 300155 api_server.go:88] waiting for apiserver healthz status ...
I0927 17:41:36.473799 300155 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I0927 17:41:36.482990 300155 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I0927 17:41:36.485665 300155 api_server.go:141] control plane version: v1.31.1
I0927 17:41:36.485746 300155 api_server.go:131] duration metric: took 11.96242ms to wait for apiserver health ...
I0927 17:41:36.485771 300155 system_pods.go:43] waiting for kube-system pods to appear ...
I0927 17:41:36.663054 300155 system_pods.go:59] 18 kube-system pods found
I0927 17:41:36.663143 300155 system_pods.go:61] "coredns-7c65d6cfc9-7qtwt" [66a7a9f2-5f87-4cd8-a043-824722429797] Running
I0927 17:41:36.663165 300155 system_pods.go:61] "csi-hostpath-attacher-0" [4fce2bbb-2b89-4b3b-9402-b505f6699450] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0927 17:41:36.663175 300155 system_pods.go:61] "csi-hostpath-resizer-0" [e8ac2b55-0cab-462f-aee6-b1bc4a3148a8] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0927 17:41:36.663185 300155 system_pods.go:61] "csi-hostpathplugin-sxlw6" [f13f701e-4b13-4973-978c-e7d79e6f1d4a] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0927 17:41:36.663190 300155 system_pods.go:61] "etcd-addons-583947" [f9dcf636-2692-42b2-8128-67dfec8422d9] Running
I0927 17:41:36.663212 300155 system_pods.go:61] "kindnet-9m7z7" [7f807db9-6972-4a6a-aade-69ee8405fbd3] Running
I0927 17:41:36.663227 300155 system_pods.go:61] "kube-apiserver-addons-583947" [f630e865-4ac6-4e44-9fb2-1ae0f50e3ef3] Running
I0927 17:41:36.663231 300155 system_pods.go:61] "kube-controller-manager-addons-583947" [961b771a-bdbe-4db1-827b-32512adde3dc] Running
I0927 17:41:36.663236 300155 system_pods.go:61] "kube-ingress-dns-minikube" [7325121b-061a-45ee-98e4-7c3bb953fe0a] Running
I0927 17:41:36.663253 300155 system_pods.go:61] "kube-proxy-xp2qc" [3e14d115-e325-43cf-906b-233ef212e08e] Running
I0927 17:41:36.663266 300155 system_pods.go:61] "kube-scheduler-addons-583947" [5ee31ad4-d0d6-4ceb-b4b3-b1584ecbe1bb] Running
I0927 17:41:36.663272 300155 system_pods.go:61] "metrics-server-84c5f94fbc-h78zb" [866e445c-c734-4c72-b8c1-55af9c7258fd] Running
I0927 17:41:36.663279 300155 system_pods.go:61] "nvidia-device-plugin-daemonset-9r5dq" [c3c31223-d780-4d40-836d-0fdcf06acfdf] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I0927 17:41:36.663285 300155 system_pods.go:61] "registry-66c9cd494c-zg7pk" [c6e96250-7c38-480c-842d-2d5612850d9f] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0927 17:41:36.663291 300155 system_pods.go:61] "registry-proxy-w654q" [5450ef2a-71a8-4be2-bd6d-c91f93d716b9] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0927 17:41:36.663299 300155 system_pods.go:61] "snapshot-controller-56fcc65765-cr5dc" [9b4b6f4a-c17e-41f9-938e-c13d5ae17c6c] Running
I0927 17:41:36.663303 300155 system_pods.go:61] "snapshot-controller-56fcc65765-v4w7f" [81ecf2b1-f403-4c50-b5a5-c6039a6483f8] Running
I0927 17:41:36.663309 300155 system_pods.go:61] "storage-provisioner" [eb043422-2620-4d4f-a305-0377e599ab4d] Running
I0927 17:41:36.663344 300155 system_pods.go:74] duration metric: took 177.542591ms to wait for pod list to return data ...
I0927 17:41:36.663361 300155 default_sa.go:34] waiting for default service account to be created ...
I0927 17:41:36.799404 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:36.855053 300155 default_sa.go:45] found service account: "default"
I0927 17:41:36.855081 300155 default_sa.go:55] duration metric: took 191.712739ms for default service account to be created ...
I0927 17:41:36.855091 300155 system_pods.go:116] waiting for k8s-apps to be running ...
I0927 17:41:36.916867 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:36.918442 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:37.064965 300155 system_pods.go:86] 18 kube-system pods found
I0927 17:41:37.065008 300155 system_pods.go:89] "coredns-7c65d6cfc9-7qtwt" [66a7a9f2-5f87-4cd8-a043-824722429797] Running
I0927 17:41:37.065022 300155 system_pods.go:89] "csi-hostpath-attacher-0" [4fce2bbb-2b89-4b3b-9402-b505f6699450] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0927 17:41:37.065032 300155 system_pods.go:89] "csi-hostpath-resizer-0" [e8ac2b55-0cab-462f-aee6-b1bc4a3148a8] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0927 17:41:37.065091 300155 system_pods.go:89] "csi-hostpathplugin-sxlw6" [f13f701e-4b13-4973-978c-e7d79e6f1d4a] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0927 17:41:37.065098 300155 system_pods.go:89] "etcd-addons-583947" [f9dcf636-2692-42b2-8128-67dfec8422d9] Running
I0927 17:41:37.065104 300155 system_pods.go:89] "kindnet-9m7z7" [7f807db9-6972-4a6a-aade-69ee8405fbd3] Running
I0927 17:41:37.065113 300155 system_pods.go:89] "kube-apiserver-addons-583947" [f630e865-4ac6-4e44-9fb2-1ae0f50e3ef3] Running
I0927 17:41:37.065118 300155 system_pods.go:89] "kube-controller-manager-addons-583947" [961b771a-bdbe-4db1-827b-32512adde3dc] Running
I0927 17:41:37.065135 300155 system_pods.go:89] "kube-ingress-dns-minikube" [7325121b-061a-45ee-98e4-7c3bb953fe0a] Running
I0927 17:41:37.065140 300155 system_pods.go:89] "kube-proxy-xp2qc" [3e14d115-e325-43cf-906b-233ef212e08e] Running
I0927 17:41:37.065144 300155 system_pods.go:89] "kube-scheduler-addons-583947" [5ee31ad4-d0d6-4ceb-b4b3-b1584ecbe1bb] Running
I0927 17:41:37.065149 300155 system_pods.go:89] "metrics-server-84c5f94fbc-h78zb" [866e445c-c734-4c72-b8c1-55af9c7258fd] Running
I0927 17:41:37.065158 300155 system_pods.go:89] "nvidia-device-plugin-daemonset-9r5dq" [c3c31223-d780-4d40-836d-0fdcf06acfdf] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I0927 17:41:37.065164 300155 system_pods.go:89] "registry-66c9cd494c-zg7pk" [c6e96250-7c38-480c-842d-2d5612850d9f] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0927 17:41:37.065170 300155 system_pods.go:89] "registry-proxy-w654q" [5450ef2a-71a8-4be2-bd6d-c91f93d716b9] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0927 17:41:37.065175 300155 system_pods.go:89] "snapshot-controller-56fcc65765-cr5dc" [9b4b6f4a-c17e-41f9-938e-c13d5ae17c6c] Running
I0927 17:41:37.065180 300155 system_pods.go:89] "snapshot-controller-56fcc65765-v4w7f" [81ecf2b1-f403-4c50-b5a5-c6039a6483f8] Running
I0927 17:41:37.065184 300155 system_pods.go:89] "storage-provisioner" [eb043422-2620-4d4f-a305-0377e599ab4d] Running
I0927 17:41:37.065192 300155 system_pods.go:126] duration metric: took 210.094968ms to wait for k8s-apps to be running ...
I0927 17:41:37.065201 300155 system_svc.go:44] waiting for kubelet service to be running ....
I0927 17:41:37.065309 300155 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0927 17:41:37.079681 300155 system_svc.go:56] duration metric: took 14.467875ms WaitForService to wait for kubelet
I0927 17:41:37.079818 300155 kubeadm.go:582] duration metric: took 55.190617969s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0927 17:41:37.079863 300155 node_conditions.go:102] verifying NodePressure condition ...
I0927 17:41:37.225368 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:37.255828 300155 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0927 17:41:37.255864 300155 node_conditions.go:123] node cpu capacity is 2
I0927 17:41:37.255879 300155 node_conditions.go:105] duration metric: took 175.985993ms to run NodePressure ...
I0927 17:41:37.255892 300155 start.go:241] waiting for startup goroutines ...
I0927 17:41:37.418593 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:37.420249 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:37.725087 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:37.918371 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:37.919182 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:38.225528 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:38.417669 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:38.418519 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:38.725962 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:38.917349 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:38.919246 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:39.225627 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:39.417154 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:39.419723 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:39.727491 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:39.918503 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:39.919268 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:40.225641 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:40.418456 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:40.419931 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:40.725896 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:40.920572 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:40.921885 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:41.226008 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:41.418164 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:41.418664 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:41.725682 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:41.917970 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:41.919826 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:42.227184 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:42.418258 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:42.420593 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:42.790829 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:42.917013 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:42.917741 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:43.226077 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:43.416935 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:43.417718 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:43.791991 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:43.917254 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:43.919383 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:44.224990 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:44.420261 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:44.423087 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:44.726651 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:44.918498 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:44.919893 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:45.285847 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:45.421538 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:45.424037 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:45.726706 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:45.918540 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:45.919893 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:46.225473 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:46.418734 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:46.419695 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:46.795566 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:46.926897 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:46.927100 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:47.225370 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:47.417028 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:47.417816 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:47.725606 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:47.920951 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:47.921650 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:48.225763 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:48.416452 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:48.418577 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:48.726288 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:48.919455 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:48.920380 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:49.226113 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:49.422078 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:49.422353 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:49.725674 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:49.922122 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:49.922794 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:50.224768 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:50.417341 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:50.417996 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:50.725323 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:50.919608 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:50.920787 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:51.225643 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:51.418420 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:51.419138 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:51.727187 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:51.921365 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:51.923254 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:52.225578 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:52.422568 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:52.423009 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:52.725318 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:52.919950 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:52.921017 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:53.225540 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:53.417572 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:53.417850 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:53.724903 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:53.917236 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:53.919166 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:54.225638 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:54.454364 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:54.455480 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:54.725492 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:54.919048 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:54.920096 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:55.225870 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:55.420650 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 17:41:55.422719 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:55.787721 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:55.918243 300155 kapi.go:107] duration metric: took 1m2.504529602s to wait for kubernetes.io/minikube-addons=registry ...
I0927 17:41:55.919690 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:56.225952 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:56.417674 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:56.725641 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:56.916889 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:57.225433 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:57.417918 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:57.729139 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:57.917786 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:58.225702 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:58.417315 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:58.792903 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:58.917140 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:59.225714 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:59.416977 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:41:59.725134 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:41:59.917541 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:42:00.279072 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:00.421665 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:42:00.725671 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:00.917284 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:42:01.226213 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:01.417370 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:42:01.726756 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:01.917920 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:42:02.226416 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:02.418499 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:42:02.725944 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:02.918296 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:42:03.224903 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:03.417111 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:42:03.725402 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:03.916951 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:42:04.225618 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:04.417115 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:42:04.726070 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:04.921098 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:42:05.225100 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:05.417216 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:42:05.725073 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:05.920188 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:42:06.225758 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:06.417846 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:42:06.725038 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:06.917675 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:42:07.228213 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:07.421439 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:42:07.726708 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:07.918079 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:42:08.226501 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:08.417587 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:42:08.726082 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:08.917894 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:42:09.225848 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:09.417137 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:42:09.730323 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:09.917438 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:42:10.225948 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:10.417405 300155 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 17:42:10.791842 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:10.922885 300155 kapi.go:107] duration metric: took 1m17.51034636s to wait for app.kubernetes.io/name=ingress-nginx ...
I0927 17:42:11.225973 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:11.727569 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:12.236560 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:12.725506 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:13.225811 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:13.725308 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:14.224632 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:14.725627 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 17:42:15.225636 300155 kapi.go:107] duration metric: took 1m21.005460936s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0927 17:42:18.700591 300155 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0927 17:42:18.700612 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:19.190980 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:19.690478 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:20.189445 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:20.689697 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:21.189862 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:21.690083 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:22.189388 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:22.689182 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:23.189945 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:23.689740 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:24.189667 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:24.688814 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:25.190182 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:25.690059 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:26.189426 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:26.689510 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:27.196801 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:27.688977 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:28.189107 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:28.689715 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:29.189805 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:29.690158 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:30.196866 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:30.689615 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:31.189512 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:31.689116 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:32.189542 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:32.688504 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:33.189852 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:33.688693 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:34.189420 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:34.689089 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:35.190203 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:35.689457 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:36.189515 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:36.689495 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:37.197088 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:37.690295 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:38.189542 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:38.689198 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:39.190307 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:39.689493 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:40.190222 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:40.688972 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:41.190487 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:41.690373 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:42.190771 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:42.689372 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:43.189881 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:43.689233 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:44.189004 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:44.688858 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:45.191089 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:45.690420 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:46.189803 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:46.689953 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:47.198736 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:47.689359 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:48.190090 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:48.689805 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:49.190045 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:49.689155 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:50.189830 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:50.689819 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:51.190375 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:51.690162 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:52.189811 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:52.689522 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:53.191784 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:53.689576 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:54.188783 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:54.689499 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:55.189807 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:55.689799 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:56.190099 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:56.689775 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:57.190412 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:57.689359 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:58.190161 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:58.691684 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:59.191876 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:42:59.689712 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:00.215558 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:00.689176 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:01.189722 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:01.688878 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:02.190114 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:02.690431 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:03.189512 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:03.689654 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:04.190624 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:04.689370 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:05.188958 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:05.690198 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:06.189666 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:06.689312 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:07.199046 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:07.690441 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:08.189800 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:08.689413 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:09.188920 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:09.690057 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:10.189809 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:10.689862 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:11.189912 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:11.690401 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:12.189107 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:12.689475 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:13.189974 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:13.689810 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:14.188909 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:14.689533 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:15.189647 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:15.689738 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:16.189118 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:16.690142 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:17.196377 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:17.689293 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:18.190112 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:18.689406 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:19.189415 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:19.689545 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:20.189057 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:20.688890 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:21.189772 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:21.689913 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:22.190539 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:22.689848 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:23.190352 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:23.689931 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:24.189572 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:24.689332 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:25.189424 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:25.689951 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:26.189452 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:26.689539 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:27.194888 300155 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 17:43:27.690229 300155 kapi.go:107] duration metric: took 2m32.004632097s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0927 17:43:27.692332 300155 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-583947 cluster.
I0927 17:43:27.694370 300155 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0927 17:43:27.695797 300155 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0927 17:43:27.697678 300155 out.go:177] * Enabled addons: ingress-dns, nvidia-device-plugin, cloud-spanner, storage-provisioner, storage-provisioner-rancher, metrics-server, inspektor-gadget, volcano, yakd, volumesnapshots, registry, ingress, csi-hostpath-driver, gcp-auth
I0927 17:43:27.699361 300155 addons.go:510] duration metric: took 2m45.809892522s for enable addons: enabled=[ingress-dns nvidia-device-plugin cloud-spanner storage-provisioner storage-provisioner-rancher metrics-server inspektor-gadget volcano yakd volumesnapshots registry ingress csi-hostpath-driver gcp-auth]
I0927 17:43:27.699406 300155 start.go:246] waiting for cluster config update ...
I0927 17:43:27.699431 300155 start.go:255] writing updated cluster config ...
I0927 17:43:27.699734 300155 ssh_runner.go:195] Run: rm -f paused
I0927 17:43:28.050360 300155 start.go:600] kubectl: 1.31.1, cluster: 1.31.1 (minor skew: 0)
I0927 17:43:28.052426 300155 out.go:177] * Done! kubectl is now configured to use "addons-583947" cluster and "default" namespace by default
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
e9149244f669d 6ef582f3ec844 3 minutes ago Running gcp-auth 0 d95c1061cc9c2 gcp-auth-89d5ffd79-8frvg
3920cd3bfb01e ee6d597e62dc8 4 minutes ago Running csi-snapshotter 0 a6c04b71a7a0c csi-hostpathplugin-sxlw6
f039e97a8d860 642ded511e141 4 minutes ago Running csi-provisioner 0 a6c04b71a7a0c csi-hostpathplugin-sxlw6
0eff59d19e493 1a9605c872c1d 4 minutes ago Running admission 0 6b4c92e4b237e volcano-admission-5874dfdd79-dvr69
20b31db3cb728 289a818c8d9c5 4 minutes ago Running controller 0 314b1499af5ea ingress-nginx-controller-bc57996ff-4bppd
2001754b57a08 922312104da8a 4 minutes ago Running liveness-probe 0 a6c04b71a7a0c csi-hostpathplugin-sxlw6
0c92a07ea9d61 a9bac31a5be8d 4 minutes ago Running nvidia-device-plugin-ctr 0 47d6f89710a64 nvidia-device-plugin-daemonset-9r5dq
db58bd763252b 487fa743e1e22 4 minutes ago Running csi-resizer 0 6a3ee53ba1978 csi-hostpath-resizer-0
83054eac77679 6aa88c604f2b4 4 minutes ago Running volcano-scheduler 0 9db0b4ba1f2df volcano-scheduler-6c9778cbdf-mbvfg
2c9501a8d7440 c9cf76bb104e1 4 minutes ago Running registry 0 661ce41f33702 registry-66c9cd494c-zg7pk
fb344b2bb44be 23cbb28ae641a 4 minutes ago Running volcano-controllers 0 6de3b096da59d volcano-controllers-789ffc5785-vx57k
3b771c5cadc67 420193b27261a 4 minutes ago Exited patch 0 5017dd1675a52 ingress-nginx-admission-patch-bk854
cc1bdfbe203ab 9a80d518f102c 4 minutes ago Running csi-attacher 0 3f683efad49eb csi-hostpath-attacher-0
9a724a849fa2e 7ce2150c8929b 4 minutes ago Running local-path-provisioner 0 09f69866b5dd2 local-path-provisioner-86d989889c-q4pxh
22a8e262b7b11 77bdba588b953 4 minutes ago Running yakd 0 71b18e1bc9552 yakd-dashboard-67d98fc6b-dm4sw
e39098b2f0a73 08f6b2990811a 5 minutes ago Running hostpath 0 a6c04b71a7a0c csi-hostpathplugin-sxlw6
3df1b61784410 3410e1561990a 5 minutes ago Running registry-proxy 0 e2259a900947a registry-proxy-w654q
67d095db5f9ea 420193b27261a 5 minutes ago Exited create 0 19ebe13bdbdbd ingress-nginx-admission-create-22b75
3fbcdb12b6acc be9cac3585579 5 minutes ago Running cloud-spanner-emulator 0 3684987d45496 cloud-spanner-emulator-5b584cc74-979s9
694e192499be1 2f6c962e7b831 5 minutes ago Running coredns 0 707d457cbb6b1 coredns-7c65d6cfc9-7qtwt
4334fcdc1edc2 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 f23af42761f2f snapshot-controller-56fcc65765-v4w7f
c82a1bd5a0a6b 0107d56dbc0be 5 minutes ago Running node-driver-registrar 0 a6c04b71a7a0c csi-hostpathplugin-sxlw6
860f5efe517fa 5548a49bb60ba 5 minutes ago Running metrics-server 0 cad05acc4d58e metrics-server-84c5f94fbc-h78zb
6923522606e84 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 fdf5b25ff7882 snapshot-controller-56fcc65765-cr5dc
1cd3236d17973 1461903ec4fe9 5 minutes ago Running csi-external-health-monitor-controller 0 a6c04b71a7a0c csi-hostpathplugin-sxlw6
96a28c564e915 4f725bf50aaa5 5 minutes ago Running gadget 0 622d304682165 gadget-x67ht
fa39ac1ec8d3f 35508c2f890c4 5 minutes ago Running minikube-ingress-dns 0 63738b95b573c kube-ingress-dns-minikube
696f8c7aa8afa ba04bb24b9575 5 minutes ago Running storage-provisioner 0 e2bebf504e46d storage-provisioner
4da7a7dbf34de 6a23fa8fd2b78 6 minutes ago Running kindnet-cni 0 5e84700a7987e kindnet-9m7z7
d6f0f812dfc47 24a140c548c07 6 minutes ago Running kube-proxy 0 d4ef13d4c52d0 kube-proxy-xp2qc
ba7f1a3252f5f 27e3830e14027 6 minutes ago Running etcd 0 50cab87c2ccca etcd-addons-583947
b8914c3ce3501 7f8aa378bb47d 6 minutes ago Running kube-scheduler 0 0c037c10ef28d kube-scheduler-addons-583947
e8e585e0f5102 279f381cb3736 6 minutes ago Running kube-controller-manager 0 0ff92bb5e74c6 kube-controller-manager-addons-583947
50a07df108621 d3f53a98c0a9d 6 minutes ago Running kube-apiserver 0 04df27a85b21c kube-apiserver-addons-583947
==> containerd <==
Sep 27 17:43:37 addons-583947 containerd[821]: time="2024-09-27T17:43:37.239149555Z" level=info msg="TearDown network for sandbox \"d745345370f2c5b183b008ce3a00cce8842f7e8bbb110b628a3284556c235c45\" successfully"
Sep 27 17:43:37 addons-583947 containerd[821]: time="2024-09-27T17:43:37.239189866Z" level=info msg="StopPodSandbox for \"d745345370f2c5b183b008ce3a00cce8842f7e8bbb110b628a3284556c235c45\" returns successfully"
Sep 27 17:43:37 addons-583947 containerd[821]: time="2024-09-27T17:43:37.239896180Z" level=info msg="RemovePodSandbox for \"d745345370f2c5b183b008ce3a00cce8842f7e8bbb110b628a3284556c235c45\""
Sep 27 17:43:37 addons-583947 containerd[821]: time="2024-09-27T17:43:37.240026369Z" level=info msg="Forcibly stopping sandbox \"d745345370f2c5b183b008ce3a00cce8842f7e8bbb110b628a3284556c235c45\""
Sep 27 17:43:37 addons-583947 containerd[821]: time="2024-09-27T17:43:37.248374368Z" level=info msg="TearDown network for sandbox \"d745345370f2c5b183b008ce3a00cce8842f7e8bbb110b628a3284556c235c45\" successfully"
Sep 27 17:43:37 addons-583947 containerd[821]: time="2024-09-27T17:43:37.254208697Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"d745345370f2c5b183b008ce3a00cce8842f7e8bbb110b628a3284556c235c45\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus."
Sep 27 17:43:37 addons-583947 containerd[821]: time="2024-09-27T17:43:37.254339551Z" level=info msg="RemovePodSandbox \"d745345370f2c5b183b008ce3a00cce8842f7e8bbb110b628a3284556c235c45\" returns successfully"
Sep 27 17:43:37 addons-583947 containerd[821]: time="2024-09-27T17:43:37.255037315Z" level=info msg="StopPodSandbox for \"c4e7b699d91db94a50fc23fb77c27efe31275a8d3b597baa7ab3a05cfe1c6244\""
Sep 27 17:43:37 addons-583947 containerd[821]: time="2024-09-27T17:43:37.262710441Z" level=info msg="TearDown network for sandbox \"c4e7b699d91db94a50fc23fb77c27efe31275a8d3b597baa7ab3a05cfe1c6244\" successfully"
Sep 27 17:43:37 addons-583947 containerd[821]: time="2024-09-27T17:43:37.262749817Z" level=info msg="StopPodSandbox for \"c4e7b699d91db94a50fc23fb77c27efe31275a8d3b597baa7ab3a05cfe1c6244\" returns successfully"
Sep 27 17:43:37 addons-583947 containerd[821]: time="2024-09-27T17:43:37.263223830Z" level=info msg="RemovePodSandbox for \"c4e7b699d91db94a50fc23fb77c27efe31275a8d3b597baa7ab3a05cfe1c6244\""
Sep 27 17:43:37 addons-583947 containerd[821]: time="2024-09-27T17:43:37.263263756Z" level=info msg="Forcibly stopping sandbox \"c4e7b699d91db94a50fc23fb77c27efe31275a8d3b597baa7ab3a05cfe1c6244\""
Sep 27 17:43:37 addons-583947 containerd[821]: time="2024-09-27T17:43:37.271214770Z" level=info msg="TearDown network for sandbox \"c4e7b699d91db94a50fc23fb77c27efe31275a8d3b597baa7ab3a05cfe1c6244\" successfully"
Sep 27 17:43:37 addons-583947 containerd[821]: time="2024-09-27T17:43:37.276723318Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"c4e7b699d91db94a50fc23fb77c27efe31275a8d3b597baa7ab3a05cfe1c6244\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus."
Sep 27 17:43:37 addons-583947 containerd[821]: time="2024-09-27T17:43:37.276867111Z" level=info msg="RemovePodSandbox \"c4e7b699d91db94a50fc23fb77c27efe31275a8d3b597baa7ab3a05cfe1c6244\" returns successfully"
Sep 27 17:44:37 addons-583947 containerd[821]: time="2024-09-27T17:44:37.281291592Z" level=info msg="RemoveContainer for \"0b8258051a47e7f0a17452d487888c4c4744a388f24d60a399a8c2d3e993bd63\""
Sep 27 17:44:37 addons-583947 containerd[821]: time="2024-09-27T17:44:37.287101988Z" level=info msg="RemoveContainer for \"0b8258051a47e7f0a17452d487888c4c4744a388f24d60a399a8c2d3e993bd63\" returns successfully"
Sep 27 17:44:37 addons-583947 containerd[821]: time="2024-09-27T17:44:37.289538452Z" level=info msg="StopPodSandbox for \"1917d3d19123c64ce3280c2cd772a896d88052cf6ac3ef21775ad98c876625b3\""
Sep 27 17:44:37 addons-583947 containerd[821]: time="2024-09-27T17:44:37.297497396Z" level=info msg="TearDown network for sandbox \"1917d3d19123c64ce3280c2cd772a896d88052cf6ac3ef21775ad98c876625b3\" successfully"
Sep 27 17:44:37 addons-583947 containerd[821]: time="2024-09-27T17:44:37.297543689Z" level=info msg="StopPodSandbox for \"1917d3d19123c64ce3280c2cd772a896d88052cf6ac3ef21775ad98c876625b3\" returns successfully"
Sep 27 17:44:37 addons-583947 containerd[821]: time="2024-09-27T17:44:37.298151502Z" level=info msg="RemovePodSandbox for \"1917d3d19123c64ce3280c2cd772a896d88052cf6ac3ef21775ad98c876625b3\""
Sep 27 17:44:37 addons-583947 containerd[821]: time="2024-09-27T17:44:37.298297741Z" level=info msg="Forcibly stopping sandbox \"1917d3d19123c64ce3280c2cd772a896d88052cf6ac3ef21775ad98c876625b3\""
Sep 27 17:44:37 addons-583947 containerd[821]: time="2024-09-27T17:44:37.308299192Z" level=info msg="TearDown network for sandbox \"1917d3d19123c64ce3280c2cd772a896d88052cf6ac3ef21775ad98c876625b3\" successfully"
Sep 27 17:44:37 addons-583947 containerd[821]: time="2024-09-27T17:44:37.314939184Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"1917d3d19123c64ce3280c2cd772a896d88052cf6ac3ef21775ad98c876625b3\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus."
Sep 27 17:44:37 addons-583947 containerd[821]: time="2024-09-27T17:44:37.315061742Z" level=info msg="RemovePodSandbox \"1917d3d19123c64ce3280c2cd772a896d88052cf6ac3ef21775ad98c876625b3\" returns successfully"
==> coredns [694e192499be19fabc3b6cac11ebd89628613ffafd22d5ae26768d5a0be19031] <==
[INFO] 10.244.0.7:45441 - 22345 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.0002483s
[INFO] 10.244.0.7:50510 - 37719 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001883337s
[INFO] 10.244.0.7:50510 - 13393 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001951512s
[INFO] 10.244.0.7:33771 - 20364 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000075486s
[INFO] 10.244.0.7:33771 - 7822 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000084873s
[INFO] 10.244.0.7:52519 - 61923 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000112852s
[INFO] 10.244.0.7:52519 - 799 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000258572s
[INFO] 10.244.0.7:45413 - 13163 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000075223s
[INFO] 10.244.0.7:45413 - 18024 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000164322s
[INFO] 10.244.0.7:37510 - 47233 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000078161s
[INFO] 10.244.0.7:37510 - 43911 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000172772s
[INFO] 10.244.0.7:54800 - 25841 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001743096s
[INFO] 10.244.0.7:54800 - 42995 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001771494s
[INFO] 10.244.0.7:38807 - 16989 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000065747s
[INFO] 10.244.0.7:38807 - 34655 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000086292s
[INFO] 10.244.0.24:43110 - 12235 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000352866s
[INFO] 10.244.0.24:52660 - 15427 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000396836s
[INFO] 10.244.0.24:58686 - 4434 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000187542s
[INFO] 10.244.0.24:50400 - 49742 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000167038s
[INFO] 10.244.0.24:41922 - 6871 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000132946s
[INFO] 10.244.0.24:41536 - 35793 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000145877s
[INFO] 10.244.0.24:39261 - 58567 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002311826s
[INFO] 10.244.0.24:39639 - 34342 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.00206766s
[INFO] 10.244.0.24:59755 - 23054 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.003346825s
[INFO] 10.244.0.24:46361 - 1533 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 648 0.003289701s
==> describe nodes <==
Name: addons-583947
Roles: control-plane
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=addons-583947
kubernetes.io/os=linux
minikube.k8s.io/commit=d0bb8598e36db8db200944ab6842cd553a7bd60c
minikube.k8s.io/name=addons-583947
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_09_27T17_40_38_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-583947
Annotations: csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-583947"}
kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Fri, 27 Sep 2024 17:40:34 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-583947
AcquireTime: <unset>
RenewTime: Fri, 27 Sep 2024 17:46:45 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Fri, 27 Sep 2024 17:43:41 +0000 Fri, 27 Sep 2024 17:40:31 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Fri, 27 Sep 2024 17:43:41 +0000 Fri, 27 Sep 2024 17:40:31 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Fri, 27 Sep 2024 17:43:41 +0000 Fri, 27 Sep 2024 17:40:31 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Fri, 27 Sep 2024 17:43:41 +0000 Fri, 27 Sep 2024 17:40:35 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-583947
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022304Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022304Ki
pods: 110
System Info:
Machine ID: f983571fe41145e89b863e1ac3391b0a
System UUID: ed8029b8-ca39-4998-9bc2-aa3f8ba8b41e
Boot ID: 7a34a0f0-976f-42af-914d-3a2d2373d850
Kernel Version: 5.15.0-1070-aws
OS Image: Ubuntu 22.04.5 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.22
Kubelet Version: v1.31.1
Kube-Proxy Version: v1.31.1
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (27 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default cloud-spanner-emulator-5b584cc74-979s9 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m2s
gadget gadget-x67ht 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
gcp-auth gcp-auth-89d5ffd79-8frvg 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m29s
ingress-nginx ingress-nginx-controller-bc57996ff-4bppd 100m (5%) 0 (0%) 90Mi (1%) 0 (0%) 5m56s
kube-system coredns-7c65d6cfc9-7qtwt 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 6m5s
kube-system csi-hostpath-attacher-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m54s
kube-system csi-hostpath-resizer-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m53s
kube-system csi-hostpathplugin-sxlw6 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m53s
kube-system etcd-addons-583947 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 6m10s
kube-system kindnet-9m7z7 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 6m5s
kube-system kube-apiserver-addons-583947 250m (12%) 0 (0%) 0 (0%) 0 (0%) 6m10s
kube-system kube-controller-manager-addons-583947 200m (10%) 0 (0%) 0 (0%) 0 (0%) 6m10s
kube-system kube-ingress-dns-minikube 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m3s
kube-system kube-proxy-xp2qc 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m5s
kube-system kube-scheduler-addons-583947 100m (5%) 0 (0%) 0 (0%) 0 (0%) 6m10s
kube-system metrics-server-84c5f94fbc-h78zb 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 6m
kube-system nvidia-device-plugin-daemonset-9r5dq 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m2s
kube-system registry-66c9cd494c-zg7pk 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m1s
kube-system registry-proxy-w654q 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m1s
kube-system snapshot-controller-56fcc65765-cr5dc 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
kube-system snapshot-controller-56fcc65765-v4w7f 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m1s
local-path-storage local-path-provisioner-86d989889c-q4pxh 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m
volcano-system volcano-admission-5874dfdd79-dvr69 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m55s
volcano-system volcano-controllers-789ffc5785-vx57k 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m55s
volcano-system volcano-scheduler-6c9778cbdf-mbvfg 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m55s
yakd-dashboard yakd-dashboard-67d98fc6b-dm4sw 0 (0%) 0 (0%) 128Mi (1%) 256Mi (3%) 5m59s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 1050m (52%) 100m (5%)
memory 638Mi (8%) 476Mi (6%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 6m4s kube-proxy
Normal NodeHasSufficientMemory 6m18s (x8 over 6m18s) kubelet Node addons-583947 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m18s (x7 over 6m18s) kubelet Node addons-583947 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m18s (x7 over 6m18s) kubelet Node addons-583947 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 6m18s kubelet Updated Node Allocatable limit across pods
Normal Starting 6m10s kubelet Starting kubelet.
Warning CgroupV1 6m10s kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeAllocatableEnforced 6m10s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 6m10s kubelet Node addons-583947 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m10s kubelet Node addons-583947 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m10s kubelet Node addons-583947 status is now: NodeHasSufficientPID
Normal RegisteredNode 6m6s node-controller Node addons-583947 event: Registered Node addons-583947 in Controller
==> dmesg <==
[Sep27 16:17] ACPI: SRAT not present
[ +0.000000] ACPI: SRAT not present
[ +0.000000] SPI driver altr_a10sr has no spi_device_id for altr,a10sr
[ +0.014096] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[ +0.483709] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
[ +0.056541] systemd[1]: /lib/systemd/system/cloud-init.service:20: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
[ +0.017956] systemd[1]: /lib/systemd/system/cloud-init-hotplugd.socket:11: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
[ +0.717856] ena 0000:00:05.0: LLQ is not supported Fallback to host mode policy.
[ +6.302460] kauditd_printk_skb: 36 callbacks suppressed
[Sep27 16:44] hrtimer: interrupt took 20639535 ns
[Sep27 17:07] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
==> etcd [ba7f1a3252f5fcdcfd95589714a8504d0609c30d862137862065522985a3b9b9] <==
{"level":"info","ts":"2024-09-27T17:40:30.527275Z","caller":"embed/etcd.go:728","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
{"level":"info","ts":"2024-09-27T17:40:30.527766Z","caller":"embed/etcd.go:279","msg":"now serving peer/client/metrics","local-member-id":"aec36adc501070cc","initial-advertise-peer-urls":["https://192.168.49.2:2380"],"listen-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.49.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
{"level":"info","ts":"2024-09-27T17:40:30.528940Z","caller":"embed/etcd.go:599","msg":"serving peer traffic","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-09-27T17:40:30.529388Z","caller":"embed/etcd.go:870","msg":"serving metrics","address":"http://127.0.0.1:2381"}
{"level":"info","ts":"2024-09-27T17:40:30.529522Z","caller":"embed/etcd.go:571","msg":"cmux::serve","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-09-27T17:40:30.793300Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
{"level":"info","ts":"2024-09-27T17:40:30.793524Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
{"level":"info","ts":"2024-09-27T17:40:30.793642Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
{"level":"info","ts":"2024-09-27T17:40:30.793753Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
{"level":"info","ts":"2024-09-27T17:40:30.793830Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-27T17:40:30.793926Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
{"level":"info","ts":"2024-09-27T17:40:30.794001Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-27T17:40:30.796808Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-583947 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
{"level":"info","ts":"2024-09-27T17:40:30.797093Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-27T17:40:30.797487Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-27T17:40:30.798307Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-27T17:40:30.799315Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
{"level":"info","ts":"2024-09-27T17:40:30.801860Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-27T17:40:30.802900Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-09-27T17:40:30.805314Z","caller":"etcdserver/server.go:2629","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-27T17:40:30.825260Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-09-27T17:40:30.825467Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-09-27T17:40:30.825612Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-27T17:40:30.825774Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-27T17:40:30.825873Z","caller":"etcdserver/server.go:2653","msg":"cluster version is updated","cluster-version":"3.5"}
==> gcp-auth [e9149244f669d6bbb007e2554f9817cebe5d10c4a237bb9c1473b364f4b68ee5] <==
2024/09/27 17:43:26 GCP Auth Webhook started!
2024/09/27 17:43:45 Ready to marshal response ...
2024/09/27 17:43:45 Ready to write response ...
2024/09/27 17:43:46 Ready to marshal response ...
2024/09/27 17:43:46 Ready to write response ...
==> kernel <==
17:46:47 up 1:29, 0 users, load average: 0.12, 1.15, 2.04
Linux addons-583947 5.15.0-1070-aws #76~20.04.1-Ubuntu SMP Mon Sep 2 12:20:48 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.5 LTS"
==> kindnet [4da7a7dbf34ded45c1d329f3f388c7df7049354635573cf71f36f40df7dc58ef] <==
I0927 17:44:43.918661 1 main.go:299] handling current node
I0927 17:44:53.923605 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0927 17:44:53.923649 1 main.go:299] handling current node
I0927 17:45:03.925551 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0927 17:45:03.925592 1 main.go:299] handling current node
I0927 17:45:13.925380 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0927 17:45:13.925421 1 main.go:299] handling current node
I0927 17:45:23.921355 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0927 17:45:23.921465 1 main.go:299] handling current node
I0927 17:45:33.926919 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0927 17:45:33.926953 1 main.go:299] handling current node
I0927 17:45:43.918577 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0927 17:45:43.918618 1 main.go:299] handling current node
I0927 17:45:53.921426 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0927 17:45:53.921529 1 main.go:299] handling current node
I0927 17:46:03.925342 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0927 17:46:03.925380 1 main.go:299] handling current node
I0927 17:46:13.919056 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0927 17:46:13.919106 1 main.go:299] handling current node
I0927 17:46:23.922163 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0927 17:46:23.922203 1 main.go:299] handling current node
I0927 17:46:33.920069 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0927 17:46:33.920106 1 main.go:299] handling current node
I0927 17:46:43.918507 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0927 17:46:43.918544 1 main.go:299] handling current node
==> kube-apiserver [50a07df1086218a338d1280db02c3d35e227c66cb27645ea79410f9428b81238] <==
W0927 17:42:00.598360 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.222.88:443: connect: connection refused
W0927 17:42:01.629552 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.222.88:443: connect: connection refused
W0927 17:42:02.635552 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.222.88:443: connect: connection refused
W0927 17:42:03.639485 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.222.88:443: connect: connection refused
W0927 17:42:04.713683 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.222.88:443: connect: connection refused
W0927 17:42:05.766614 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.222.88:443: connect: connection refused
W0927 17:42:06.783231 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.222.88:443: connect: connection refused
W0927 17:42:07.866845 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.222.88:443: connect: connection refused
W0927 17:42:08.883968 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.222.88:443: connect: connection refused
W0927 17:42:09.975255 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.222.88:443: connect: connection refused
W0927 17:42:11.007850 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.222.88:443: connect: connection refused
W0927 17:42:12.063594 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.222.88:443: connect: connection refused
W0927 17:42:13.310752 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.222.88:443: connect: connection refused
W0927 17:42:14.350336 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.222.88:443: connect: connection refused
W0927 17:42:15.419249 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.222.88:443: connect: connection refused
W0927 17:42:16.503047 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.222.88:443: connect: connection refused
W0927 17:42:17.594145 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.222.88:443: connect: connection refused
W0927 17:42:18.648349 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.111.91.94:443: connect: connection refused
E0927 17:42:18.648392 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.111.91.94:443: connect: connection refused" logger="UnhandledError"
W0927 17:42:58.653499 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.111.91.94:443: connect: connection refused
E0927 17:42:58.653541 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.111.91.94:443: connect: connection refused" logger="UnhandledError"
W0927 17:42:58.708022 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.111.91.94:443: connect: connection refused
E0927 17:42:58.708064 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.111.91.94:443: connect: connection refused" logger="UnhandledError"
I0927 17:43:45.666804 1 controller.go:615] quota admission added evaluator for: jobs.batch.volcano.sh
I0927 17:43:45.703871 1 controller.go:615] quota admission added evaluator for: podgroups.scheduling.volcano.sh
==> kube-controller-manager [e8e585e0f5102223ffed2d3138c3eafe55433b3ac44915670f48ba6f6a3878c4] <==
I0927 17:42:58.696981 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0927 17:42:58.718893 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0927 17:42:58.725143 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0927 17:42:58.734524 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0927 17:42:58.746779 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0927 17:43:00.145511 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0927 17:43:00.289690 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0927 17:43:01.243831 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0927 17:43:01.341155 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0927 17:43:02.254662 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0927 17:43:02.353483 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0927 17:43:02.359052 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0927 17:43:02.364957 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0927 17:43:02.373604 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0927 17:43:03.265509 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0927 17:43:03.275170 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0927 17:43:03.283807 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0927 17:43:27.332805 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="11.724867ms"
I0927 17:43:27.332889 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="47.015µs"
I0927 17:43:32.031589 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0927 17:43:32.067827 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0927 17:43:33.008269 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0927 17:43:33.056341 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0927 17:43:41.809831 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-583947"
I0927 17:43:45.365769 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="volcano-system/volcano-admission-init" delay="0s"
==> kube-proxy [d6f0f812dfc4709b87cf5775b4e2a0822f1bb2796e0a8a0d148ec88681c9f577] <==
I0927 17:40:43.421897 1 server_linux.go:66] "Using iptables proxy"
I0927 17:40:43.530539 1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
E0927 17:40:43.530624 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I0927 17:40:43.560406 1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I0927 17:40:43.560464 1 server_linux.go:169] "Using iptables Proxier"
I0927 17:40:43.562457 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I0927 17:40:43.562934 1 server.go:483] "Version info" version="v1.31.1"
I0927 17:40:43.562958 1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0927 17:40:43.574754 1 config.go:199] "Starting service config controller"
I0927 17:40:43.574797 1 shared_informer.go:313] Waiting for caches to sync for service config
I0927 17:40:43.574832 1 config.go:105] "Starting endpoint slice config controller"
I0927 17:40:43.574837 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0927 17:40:43.575550 1 config.go:328] "Starting node config controller"
I0927 17:40:43.575563 1 shared_informer.go:313] Waiting for caches to sync for node config
I0927 17:40:43.675059 1 shared_informer.go:320] Caches are synced for endpoint slice config
I0927 17:40:43.675119 1 shared_informer.go:320] Caches are synced for service config
I0927 17:40:43.676750 1 shared_informer.go:320] Caches are synced for node config
==> kube-scheduler [b8914c3ce35010b29d21c0e655c2e5414feee786b9a25b4c86dc390e60c88c9d] <==
W0927 17:40:35.744639 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0927 17:40:35.744819 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0927 17:40:35.745943 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0927 17:40:35.746114 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0927 17:40:35.748825 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0927 17:40:35.749038 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError"
W0927 17:40:35.749268 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0927 17:40:35.749376 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0927 17:40:35.749425 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0927 17:40:35.749601 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0927 17:40:35.749823 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0927 17:40:35.749946 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0927 17:40:35.750124 1 reflector.go:561] runtime/asm_arm64.s:1222: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0927 17:40:35.750180 1 reflector.go:158] "Unhandled Error" err="runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"
W0927 17:40:35.750416 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0927 17:40:35.750471 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0927 17:40:35.750608 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0927 17:40:35.750639 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0927 17:40:35.750785 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0927 17:40:35.750805 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0927 17:40:35.750969 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
E0927 17:40:35.750992 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0927 17:40:35.750977 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0927 17:40:35.751256 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"
I0927 17:40:36.934417 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Sep 27 17:43:01 addons-583947 kubelet[1493]: I0927 17:43:01.223665 1493 scope.go:117] "RemoveContainer" containerID="c96110c7177bc6170c1f3fb06e55b2c1757c55bb74818f3a1a6cbced492084f2"
Sep 27 17:43:01 addons-583947 kubelet[1493]: I0927 17:43:01.510920 1493 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdcj5\" (UniqueName: \"kubernetes.io/projected/8550d486-abbb-4149-9e05-a4ed68e4bfb2-kube-api-access-kdcj5\") pod \"8550d486-abbb-4149-9e05-a4ed68e4bfb2\" (UID: \"8550d486-abbb-4149-9e05-a4ed68e4bfb2\") "
Sep 27 17:43:01 addons-583947 kubelet[1493]: I0927 17:43:01.517497 1493 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8550d486-abbb-4149-9e05-a4ed68e4bfb2-kube-api-access-kdcj5" (OuterVolumeSpecName: "kube-api-access-kdcj5") pod "8550d486-abbb-4149-9e05-a4ed68e4bfb2" (UID: "8550d486-abbb-4149-9e05-a4ed68e4bfb2"). InnerVolumeSpecName "kube-api-access-kdcj5". PluginName "kubernetes.io/projected", VolumeGidValue ""
Sep 27 17:43:01 addons-583947 kubelet[1493]: I0927 17:43:01.612402 1493 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-kdcj5\" (UniqueName: \"kubernetes.io/projected/8550d486-abbb-4149-9e05-a4ed68e4bfb2-kube-api-access-kdcj5\") on node \"addons-583947\" DevicePath \"\""
Sep 27 17:43:02 addons-583947 kubelet[1493]: I0927 17:43:02.227746 1493 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d745345370f2c5b183b008ce3a00cce8842f7e8bbb110b628a3284556c235c45"
Sep 27 17:43:02 addons-583947 kubelet[1493]: I0927 17:43:02.417155 1493 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tl97\" (UniqueName: \"kubernetes.io/projected/c7cb8a25-1125-48a7-92bd-9a2928dfee51-kube-api-access-7tl97\") pod \"c7cb8a25-1125-48a7-92bd-9a2928dfee51\" (UID: \"c7cb8a25-1125-48a7-92bd-9a2928dfee51\") "
Sep 27 17:43:02 addons-583947 kubelet[1493]: I0927 17:43:02.422485 1493 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7cb8a25-1125-48a7-92bd-9a2928dfee51-kube-api-access-7tl97" (OuterVolumeSpecName: "kube-api-access-7tl97") pod "c7cb8a25-1125-48a7-92bd-9a2928dfee51" (UID: "c7cb8a25-1125-48a7-92bd-9a2928dfee51"). InnerVolumeSpecName "kube-api-access-7tl97". PluginName "kubernetes.io/projected", VolumeGidValue ""
Sep 27 17:43:02 addons-583947 kubelet[1493]: I0927 17:43:02.517834 1493 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-7tl97\" (UniqueName: \"kubernetes.io/projected/c7cb8a25-1125-48a7-92bd-9a2928dfee51-kube-api-access-7tl97\") on node \"addons-583947\" DevicePath \"\""
Sep 27 17:43:03 addons-583947 kubelet[1493]: I0927 17:43:03.239677 1493 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4e7b699d91db94a50fc23fb77c27efe31275a8d3b597baa7ab3a05cfe1c6244"
Sep 27 17:43:08 addons-583947 kubelet[1493]: I0927 17:43:08.203061 1493 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="default/cloud-spanner-emulator-5b584cc74-979s9" secret="" err="secret \"gcp-auth\" not found"
Sep 27 17:43:24 addons-583947 kubelet[1493]: I0927 17:43:24.203049 1493 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-9r5dq" secret="" err="secret \"gcp-auth\" not found"
Sep 27 17:43:26 addons-583947 kubelet[1493]: I0927 17:43:26.203801 1493 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-66c9cd494c-zg7pk" secret="" err="secret \"gcp-auth\" not found"
Sep 27 17:43:32 addons-583947 kubelet[1493]: I0927 17:43:32.048965 1493 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="gcp-auth/gcp-auth-89d5ffd79-8frvg" podStartSLOduration=71.081775704 podStartE2EDuration="1m14.048943986s" podCreationTimestamp="2024-09-27 17:42:18 +0000 UTC" firstStartedPulling="2024-09-27 17:43:23.913812905 +0000 UTC m=+166.872022964" lastFinishedPulling="2024-09-27 17:43:26.880981187 +0000 UTC m=+169.839191246" observedRunningTime="2024-09-27 17:43:27.325938931 +0000 UTC m=+170.284149031" watchObservedRunningTime="2024-09-27 17:43:32.048943986 +0000 UTC m=+175.007154053"
Sep 27 17:43:33 addons-583947 kubelet[1493]: I0927 17:43:33.207192 1493 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8550d486-abbb-4149-9e05-a4ed68e4bfb2" path="/var/lib/kubelet/pods/8550d486-abbb-4149-9e05-a4ed68e4bfb2/volumes"
Sep 27 17:43:33 addons-583947 kubelet[1493]: I0927 17:43:33.207604 1493 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7cb8a25-1125-48a7-92bd-9a2928dfee51" path="/var/lib/kubelet/pods/c7cb8a25-1125-48a7-92bd-9a2928dfee51/volumes"
Sep 27 17:43:37 addons-583947 kubelet[1493]: I0927 17:43:37.211016 1493 scope.go:117] "RemoveContainer" containerID="76a20bce00c80f21bf07af87006594fa5b0ef151ba958fd0cf604acfc6b90185"
Sep 27 17:43:37 addons-583947 kubelet[1493]: I0927 17:43:37.221060 1493 scope.go:117] "RemoveContainer" containerID="3e9b78a0d6a9117b71d7a5193ffc2bf979e9c144933e7b99db753c0abd7172ed"
Sep 27 17:43:47 addons-583947 kubelet[1493]: I0927 17:43:47.207854 1493 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ac1ff67-9bc5-4d1d-a0bf-6449a73b4f62" path="/var/lib/kubelet/pods/4ac1ff67-9bc5-4d1d-a0bf-6449a73b4f62/volumes"
Sep 27 17:44:20 addons-583947 kubelet[1493]: I0927 17:44:20.204114 1493 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-w654q" secret="" err="secret \"gcp-auth\" not found"
Sep 27 17:44:37 addons-583947 kubelet[1493]: I0927 17:44:37.279724 1493 scope.go:117] "RemoveContainer" containerID="0b8258051a47e7f0a17452d487888c4c4744a388f24d60a399a8c2d3e993bd63"
Sep 27 17:44:46 addons-583947 kubelet[1493]: I0927 17:44:46.203203 1493 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-9r5dq" secret="" err="secret \"gcp-auth\" not found"
Sep 27 17:44:51 addons-583947 kubelet[1493]: I0927 17:44:51.204321 1493 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-66c9cd494c-zg7pk" secret="" err="secret \"gcp-auth\" not found"
Sep 27 17:45:49 addons-583947 kubelet[1493]: I0927 17:45:49.204396 1493 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-w654q" secret="" err="secret \"gcp-auth\" not found"
Sep 27 17:46:01 addons-583947 kubelet[1493]: I0927 17:46:01.203356 1493 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-9r5dq" secret="" err="secret \"gcp-auth\" not found"
Sep 27 17:46:16 addons-583947 kubelet[1493]: I0927 17:46:16.204116 1493 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-66c9cd494c-zg7pk" secret="" err="secret \"gcp-auth\" not found"
==> storage-provisioner [696f8c7aa8afa7b64a08a4c08336f1064e2af23a302f1ce5871274fb59ef3203] <==
I0927 17:40:48.250204 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0927 17:40:48.272063 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0927 17:40:48.272106 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0927 17:40:48.283318 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0927 17:40:48.283518 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-583947_1f43a6e3-0c5e-4fb8-af6e-5aa0ae6f5e87!
I0927 17:40:48.284714 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"6c8c6016-ff25-4a6d-a71b-7ebe9a05093e", APIVersion:"v1", ResourceVersion:"588", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-583947_1f43a6e3-0c5e-4fb8-af6e-5aa0ae6f5e87 became leader
I0927 17:40:48.383652 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-583947_1f43a6e3-0c5e-4fb8-af6e-5aa0ae6f5e87!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-583947 -n addons-583947
helpers_test.go:261: (dbg) Run: kubectl --context addons-583947 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: ingress-nginx-admission-create-22b75 ingress-nginx-admission-patch-bk854 test-job-nginx-0
helpers_test.go:274: ======> post-mortem[TestAddons/serial/Volcano]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-583947 describe pod ingress-nginx-admission-create-22b75 ingress-nginx-admission-patch-bk854 test-job-nginx-0
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-583947 describe pod ingress-nginx-admission-create-22b75 ingress-nginx-admission-patch-bk854 test-job-nginx-0: exit status 1 (104.693218ms)
** stderr **
Error from server (NotFound): pods "ingress-nginx-admission-create-22b75" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-bk854" not found
Error from server (NotFound): pods "test-job-nginx-0" not found
** /stderr **
helpers_test.go:279: kubectl --context addons-583947 describe pod ingress-nginx-admission-create-22b75 ingress-nginx-admission-patch-bk854 test-job-nginx-0: exit status 1
--- FAIL: TestAddons/serial/Volcano (201.04s)