=== RUN TestAddons/serial/Volcano
addons_test.go:897: volcano-scheduler stabilized in 49.655565ms
addons_test.go:905: volcano-admission stabilized in 49.731027ms
addons_test.go:913: volcano-controller stabilized in 49.776123ms
addons_test.go:919: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-scheduler-576bc46687-dj5ch" [b1b19b7a-ed39-4b82-93fb-20f77d3edcac] Running
addons_test.go:919: (dbg) TestAddons/serial/Volcano: app=volcano-scheduler healthy within 6.004999698s
addons_test.go:923: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-admission-77d7d48b68-spsmg" [072c6e1a-7d77-445f-b6ca-1172bfcde8f0] Running
addons_test.go:923: (dbg) TestAddons/serial/Volcano: app=volcano-admission healthy within 6.003683068s
addons_test.go:927: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-controllers-56675bb4d5-7cvvq" [293022c5-4bd2-423e-bf07-413d0587dec2] Running
addons_test.go:927: (dbg) TestAddons/serial/Volcano: app=volcano-controller healthy within 5.003596333s
addons_test.go:932: (dbg) Run: kubectl --context addons-131319 delete -n volcano-system job volcano-admission-init
addons_test.go:938: (dbg) Run: kubectl --context addons-131319 create -f testdata/vcjob.yaml
addons_test.go:946: (dbg) Run: kubectl --context addons-131319 get vcjob -n my-volcano
addons_test.go:964: (dbg) TestAddons/serial/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...
helpers_test.go:344: "test-job-nginx-0" [d938520b-916d-4ebe-9178-71fe279e53dd] Pending: PodScheduled:Unschedulable (0/1 nodes are unavailable: 1 Insufficient cpu.)
helpers_test.go:329: TestAddons/serial/Volcano: WARNING: pod list for "my-volcano" "volcano.sh/job-name=test-job" returned: client rate limiter Wait returned an error: context deadline exceeded
addons_test.go:964: ***** TestAddons/serial/Volcano: pod "volcano.sh/job-name=test-job" failed to start within 3m0s: context deadline exceeded ****
addons_test.go:964: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-131319 -n addons-131319
addons_test.go:964: TestAddons/serial/Volcano: showing logs for failed pods as of 2024-09-14 00:28:47.688366271 +0000 UTC m=+435.268133226
addons_test.go:964: (dbg) Run: kubectl --context addons-131319 describe po test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-131319 describe po test-job-nginx-0 -n my-volcano:
Name: test-job-nginx-0
Namespace: my-volcano
Priority: 0
Service Account: default
Node: <none>
Labels: volcano.sh/job-name=test-job
volcano.sh/job-namespace=my-volcano
volcano.sh/queue-name=test
volcano.sh/task-index=0
volcano.sh/task-spec=nginx
Annotations: scheduling.k8s.io/group-name: test-job-fcfe0b61-a9e2-4f00-9e50-298458a9e378
volcano.sh/job-name: test-job
volcano.sh/job-version: 0
volcano.sh/queue-name: test
volcano.sh/task-index: 0
volcano.sh/task-spec: nginx
volcano.sh/template-uid: test-job-nginx
Status: Pending
IP:
IPs: <none>
Controlled By: Job/test-job
Containers:
nginx:
Image: nginx:latest
Port: <none>
Host Port: <none>
Command:
sleep
10m
Limits:
cpu: 1
Requests:
cpu: 1
Environment:
GOOGLE_APPLICATION_CREDENTIALS: /google-app-creds.json
PROJECT_ID: this_is_fake
GCP_PROJECT: this_is_fake
GCLOUD_PROJECT: this_is_fake
GOOGLE_CLOUD_PROJECT: this_is_fake
CLOUDSDK_CORE_PROJECT: this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-6l25m (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
kube-api-access-6l25m:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
gcp-creds:
Type: HostPath (bare host directory volume)
Path: /var/lib/minikube/google_application_credentials.json
HostPathType: File
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling 2m59s volcano 0/1 nodes are unavailable: 1 Insufficient cpu.
addons_test.go:964: (dbg) Run: kubectl --context addons-131319 logs test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-131319 logs test-job-nginx-0 -n my-volcano:
addons_test.go:965: failed waiting for test-local-path pod: volcano.sh/job-name=test-job within 3m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestAddons/serial/Volcano]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect addons-131319
helpers_test.go:235: (dbg) docker inspect addons-131319:
-- stdout --
[
{
"Id": "10f831698d93f854f8885156757e9bfb243afc16686dda2b77a7716f77ecfc77",
"Created": "2024-09-14T00:22:17.220131266Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 1461088,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-09-14T00:22:17.36413811Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:fe3365929e6ce54b4c06f0bc3d1500dff08f535844ef4978f2c45cd67c542134",
"ResolvConfPath": "/var/lib/docker/containers/10f831698d93f854f8885156757e9bfb243afc16686dda2b77a7716f77ecfc77/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/10f831698d93f854f8885156757e9bfb243afc16686dda2b77a7716f77ecfc77/hostname",
"HostsPath": "/var/lib/docker/containers/10f831698d93f854f8885156757e9bfb243afc16686dda2b77a7716f77ecfc77/hosts",
"LogPath": "/var/lib/docker/containers/10f831698d93f854f8885156757e9bfb243afc16686dda2b77a7716f77ecfc77/10f831698d93f854f8885156757e9bfb243afc16686dda2b77a7716f77ecfc77-json.log",
"Name": "/addons-131319",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"addons-131319:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "addons-131319",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4194304000,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8388608000,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/1fb11a7bfe4b2979a8761a46be0744b41bd509cddd1292ad10a3821118463645-init/diff:/var/lib/docker/overlay2/6c8a90774455b3f13d96b15ce5fd57cf56a284df68ee1777efc5fdfa6d28e51f/diff",
"MergedDir": "/var/lib/docker/overlay2/1fb11a7bfe4b2979a8761a46be0744b41bd509cddd1292ad10a3821118463645/merged",
"UpperDir": "/var/lib/docker/overlay2/1fb11a7bfe4b2979a8761a46be0744b41bd509cddd1292ad10a3821118463645/diff",
"WorkDir": "/var/lib/docker/overlay2/1fb11a7bfe4b2979a8761a46be0744b41bd509cddd1292ad10a3821118463645/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "addons-131319",
"Source": "/var/lib/docker/volumes/addons-131319/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "addons-131319",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-131319",
"name.minikube.sigs.k8s.io": "addons-131319",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "989c193c417b2dd2fe55a2230307898f0f922e1d1a5935edef6f4ef83d1088cc",
"SandboxKey": "/var/run/docker/netns/989c193c417b",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34624"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34625"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34628"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34626"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34627"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"addons-131319": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:31:02",
"DriverOpts": null,
"NetworkID": "ffd462664e1eee62320fbca4a2a28ac15b273f6f2593a4cfe3f759f824385405",
"EndpointID": "2d9a102b0c7e7806c3f52e88a63e80557b2bdcaa52d73627f6161ca89352e399",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-131319",
"10f831698d93"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p addons-131319 -n addons-131319
helpers_test.go:244: <<< TestAddons/serial/Volcano FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/serial/Volcano]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p addons-131319 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-131319 logs -n 25: (1.567083598s)
helpers_test.go:252: TestAddons/serial/Volcano logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| start | -o=json --download-only | download-only-815538 | jenkins | v1.34.0 | 14 Sep 24 00:21 UTC | |
| | -p download-only-815538 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 14 Sep 24 00:21 UTC | 14 Sep 24 00:21 UTC |
| delete | -p download-only-815538 | download-only-815538 | jenkins | v1.34.0 | 14 Sep 24 00:21 UTC | 14 Sep 24 00:21 UTC |
| start | -o=json --download-only | download-only-512994 | jenkins | v1.34.0 | 14 Sep 24 00:21 UTC | |
| | -p download-only-512994 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 14 Sep 24 00:21 UTC | 14 Sep 24 00:21 UTC |
| delete | -p download-only-512994 | download-only-512994 | jenkins | v1.34.0 | 14 Sep 24 00:21 UTC | 14 Sep 24 00:21 UTC |
| delete | -p download-only-815538 | download-only-815538 | jenkins | v1.34.0 | 14 Sep 24 00:21 UTC | 14 Sep 24 00:21 UTC |
| delete | -p download-only-512994 | download-only-512994 | jenkins | v1.34.0 | 14 Sep 24 00:21 UTC | 14 Sep 24 00:21 UTC |
| start | --download-only -p | download-docker-399396 | jenkins | v1.34.0 | 14 Sep 24 00:21 UTC | |
| | download-docker-399396 | | | | | |
| | --alsologtostderr | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p download-docker-399396 | download-docker-399396 | jenkins | v1.34.0 | 14 Sep 24 00:21 UTC | 14 Sep 24 00:21 UTC |
| start | --download-only -p | binary-mirror-987653 | jenkins | v1.34.0 | 14 Sep 24 00:21 UTC | |
| | binary-mirror-987653 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:34241 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p binary-mirror-987653 | binary-mirror-987653 | jenkins | v1.34.0 | 14 Sep 24 00:21 UTC | 14 Sep 24 00:21 UTC |
| addons | disable dashboard -p | addons-131319 | jenkins | v1.34.0 | 14 Sep 24 00:21 UTC | |
| | addons-131319 | | | | | |
| addons | enable dashboard -p | addons-131319 | jenkins | v1.34.0 | 14 Sep 24 00:21 UTC | |
| | addons-131319 | | | | | |
| start | -p addons-131319 --wait=true | addons-131319 | jenkins | v1.34.0 | 14 Sep 24 00:21 UTC | 14 Sep 24 00:25 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/09/14 00:21:53
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.23.0 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0914 00:21:53.062093 1460604 out.go:345] Setting OutFile to fd 1 ...
I0914 00:21:53.062312 1460604 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0914 00:21:53.062323 1460604 out.go:358] Setting ErrFile to fd 2...
I0914 00:21:53.062329 1460604 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0914 00:21:53.062595 1460604 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19640-1454467/.minikube/bin
I0914 00:21:53.063079 1460604 out.go:352] Setting JSON to false
I0914 00:21:53.064095 1460604 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":29060,"bootTime":1726244253,"procs":151,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1069-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0914 00:21:53.064177 1460604 start.go:139] virtualization:
I0914 00:21:53.067303 1460604 out.go:177] * [addons-131319] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I0914 00:21:53.070583 1460604 out.go:177] - MINIKUBE_LOCATION=19640
I0914 00:21:53.070668 1460604 notify.go:220] Checking for updates...
I0914 00:21:53.075897 1460604 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0914 00:21:53.078345 1460604 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19640-1454467/kubeconfig
I0914 00:21:53.081158 1460604 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19640-1454467/.minikube
I0914 00:21:53.083799 1460604 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0914 00:21:53.086293 1460604 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0914 00:21:53.089090 1460604 driver.go:394] Setting default libvirt URI to qemu:///system
I0914 00:21:53.118294 1460604 docker.go:123] docker version: linux-27.2.1:Docker Engine - Community
I0914 00:21:53.118425 1460604 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0914 00:21:53.176313 1460604 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-14 00:21:53.165529481 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1069-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.2.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0914 00:21:53.176443 1460604 docker.go:318] overlay module found
I0914 00:21:53.179337 1460604 out.go:177] * Using the docker driver based on user configuration
I0914 00:21:53.182028 1460604 start.go:297] selected driver: docker
I0914 00:21:53.182051 1460604 start.go:901] validating driver "docker" against <nil>
I0914 00:21:53.182067 1460604 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0914 00:21:53.182702 1460604 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0914 00:21:53.234980 1460604 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-14 00:21:53.225488846 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1069-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.2.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0914 00:21:53.235202 1460604 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0914 00:21:53.235438 1460604 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0914 00:21:53.238178 1460604 out.go:177] * Using Docker driver with root privileges
I0914 00:21:53.240668 1460604 cni.go:84] Creating CNI manager for ""
I0914 00:21:53.240736 1460604 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0914 00:21:53.240750 1460604 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0914 00:21:53.240853 1460604 start.go:340] cluster config:
{Name:addons-131319 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-131319 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHA
uthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0914 00:21:53.244034 1460604 out.go:177] * Starting "addons-131319" primary control-plane node in "addons-131319" cluster
I0914 00:21:53.246562 1460604 cache.go:121] Beginning downloading kic base image for docker with containerd
I0914 00:21:53.249416 1460604 out.go:177] * Pulling base image v0.0.45-1726243947-19640 ...
I0914 00:21:53.251991 1460604 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I0914 00:21:53.252052 1460604 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19640-1454467/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4
I0914 00:21:53.252066 1460604 cache.go:56] Caching tarball of preloaded images
I0914 00:21:53.252079 1460604 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 in local docker daemon
I0914 00:21:53.252150 1460604 preload.go:172] Found /home/jenkins/minikube-integration/19640-1454467/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0914 00:21:53.252160 1460604 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on containerd
I0914 00:21:53.252525 1460604 profile.go:143] Saving config to /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/config.json ...
I0914 00:21:53.252558 1460604 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/config.json: {Name:mke531f6e527668a345c20dba6e535e253b6735e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 00:21:53.266857 1460604 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 to local cache
I0914 00:21:53.266970 1460604 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 in local cache directory
I0914 00:21:53.266990 1460604 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 in local cache directory, skipping pull
I0914 00:21:53.266995 1460604 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 exists in cache, skipping pull
I0914 00:21:53.267003 1460604 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 as a tarball
I0914 00:21:53.267008 1460604 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 from local cache
I0914 00:22:10.854550 1460604 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 from cached tarball
I0914 00:22:10.854593 1460604 cache.go:194] Successfully downloaded all kic artifacts
I0914 00:22:10.854624 1460604 start.go:360] acquireMachinesLock for addons-131319: {Name:mk6279d16588c6b6e55d46ee8bb80a3f52ae4419 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0914 00:22:10.854758 1460604 start.go:364] duration metric: took 115.889µs to acquireMachinesLock for "addons-131319"
I0914 00:22:10.854787 1460604 start.go:93] Provisioning new machine with config: &{Name:addons-131319 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-131319 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fa
lse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0914 00:22:10.854869 1460604 start.go:125] createHost starting for "" (driver="docker")
I0914 00:22:10.857012 1460604 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
I0914 00:22:10.857294 1460604 start.go:159] libmachine.API.Create for "addons-131319" (driver="docker")
I0914 00:22:10.857334 1460604 client.go:168] LocalClient.Create starting
I0914 00:22:10.857461 1460604 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19640-1454467/.minikube/certs/ca.pem
I0914 00:22:11.027287 1460604 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19640-1454467/.minikube/certs/cert.pem
I0914 00:22:11.344061 1460604 cli_runner.go:164] Run: docker network inspect addons-131319 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0914 00:22:11.359312 1460604 cli_runner.go:211] docker network inspect addons-131319 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0914 00:22:11.359406 1460604 network_create.go:284] running [docker network inspect addons-131319] to gather additional debugging logs...
I0914 00:22:11.359429 1460604 cli_runner.go:164] Run: docker network inspect addons-131319
W0914 00:22:11.375634 1460604 cli_runner.go:211] docker network inspect addons-131319 returned with exit code 1
I0914 00:22:11.375669 1460604 network_create.go:287] error running [docker network inspect addons-131319]: docker network inspect addons-131319: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-131319 not found
I0914 00:22:11.375682 1460604 network_create.go:289] output of [docker network inspect addons-131319]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-131319 not found
** /stderr **
I0914 00:22:11.375781 1460604 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0914 00:22:11.391644 1460604 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4001a41110}
I0914 00:22:11.391687 1460604 network_create.go:124] attempt to create docker network addons-131319 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0914 00:22:11.391750 1460604 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-131319 addons-131319
I0914 00:22:11.464078 1460604 network_create.go:108] docker network addons-131319 192.168.49.0/24 created
I0914 00:22:11.464111 1460604 kic.go:121] calculated static IP "192.168.49.2" for the "addons-131319" container
I0914 00:22:11.464196 1460604 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0914 00:22:11.478405 1460604 cli_runner.go:164] Run: docker volume create addons-131319 --label name.minikube.sigs.k8s.io=addons-131319 --label created_by.minikube.sigs.k8s.io=true
I0914 00:22:11.495789 1460604 oci.go:103] Successfully created a docker volume addons-131319
I0914 00:22:11.495930 1460604 cli_runner.go:164] Run: docker run --rm --name addons-131319-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-131319 --entrypoint /usr/bin/test -v addons-131319:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 -d /var/lib
I0914 00:22:13.137014 1460604 cli_runner.go:217] Completed: docker run --rm --name addons-131319-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-131319 --entrypoint /usr/bin/test -v addons-131319:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 -d /var/lib: (1.641040343s)
I0914 00:22:13.137043 1460604 oci.go:107] Successfully prepared a docker volume addons-131319
I0914 00:22:13.137087 1460604 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I0914 00:22:13.137116 1460604 kic.go:194] Starting extracting preloaded images to volume ...
I0914 00:22:13.137182 1460604 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19640-1454467/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-131319:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 -I lz4 -xf /preloaded.tar -C /extractDir
I0914 00:22:17.143396 1460604 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19640-1454467/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-131319:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 -I lz4 -xf /preloaded.tar -C /extractDir: (4.00617208s)
I0914 00:22:17.143430 1460604 kic.go:203] duration metric: took 4.006312214s to extract preloaded images to volume ...
W0914 00:22:17.143567 1460604 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0914 00:22:17.143936 1460604 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0914 00:22:17.206795 1460604 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-131319 --name addons-131319 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-131319 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-131319 --network addons-131319 --ip 192.168.49.2 --volume addons-131319:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243
I0914 00:22:17.533924 1460604 cli_runner.go:164] Run: docker container inspect addons-131319 --format={{.State.Running}}
I0914 00:22:17.566131 1460604 cli_runner.go:164] Run: docker container inspect addons-131319 --format={{.State.Status}}
I0914 00:22:17.586742 1460604 cli_runner.go:164] Run: docker exec addons-131319 stat /var/lib/dpkg/alternatives/iptables
I0914 00:22:17.659696 1460604 oci.go:144] the created container "addons-131319" has a running status.
I0914 00:22:17.659726 1460604 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19640-1454467/.minikube/machines/addons-131319/id_rsa...
I0914 00:22:18.066192 1460604 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19640-1454467/.minikube/machines/addons-131319/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0914 00:22:18.103667 1460604 cli_runner.go:164] Run: docker container inspect addons-131319 --format={{.State.Status}}
I0914 00:22:18.128900 1460604 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0914 00:22:18.128927 1460604 kic_runner.go:114] Args: [docker exec --privileged addons-131319 chown docker:docker /home/docker/.ssh/authorized_keys]
I0914 00:22:18.193520 1460604 cli_runner.go:164] Run: docker container inspect addons-131319 --format={{.State.Status}}
I0914 00:22:18.222825 1460604 machine.go:93] provisionDockerMachine start ...
I0914 00:22:18.222920 1460604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-131319
I0914 00:22:18.250412 1460604 main.go:141] libmachine: Using SSH client type: native
I0914 00:22:18.250674 1460604 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x41abe0] 0x41d420 <nil> [] 0s} 127.0.0.1 34624 <nil> <nil>}
I0914 00:22:18.250684 1460604 main.go:141] libmachine: About to run SSH command:
hostname
I0914 00:22:18.424254 1460604 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-131319
I0914 00:22:18.424345 1460604 ubuntu.go:169] provisioning hostname "addons-131319"
I0914 00:22:18.424449 1460604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-131319
I0914 00:22:18.446563 1460604 main.go:141] libmachine: Using SSH client type: native
I0914 00:22:18.446811 1460604 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x41abe0] 0x41d420 <nil> [] 0s} 127.0.0.1 34624 <nil> <nil>}
I0914 00:22:18.446823 1460604 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-131319 && echo "addons-131319" | sudo tee /etc/hostname
I0914 00:22:18.589610 1460604 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-131319
I0914 00:22:18.589775 1460604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-131319
I0914 00:22:18.611737 1460604 main.go:141] libmachine: Using SSH client type: native
I0914 00:22:18.612027 1460604 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x41abe0] 0x41d420 <nil> [] 0s} 127.0.0.1 34624 <nil> <nil>}
I0914 00:22:18.612045 1460604 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-131319' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-131319/g' /etc/hosts;
else
echo '127.0.1.1 addons-131319' | sudo tee -a /etc/hosts;
fi
fi
I0914 00:22:18.743696 1460604 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0914 00:22:18.743725 1460604 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19640-1454467/.minikube CaCertPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19640-1454467/.minikube}
I0914 00:22:18.743798 1460604 ubuntu.go:177] setting up certificates
I0914 00:22:18.743808 1460604 provision.go:84] configureAuth start
I0914 00:22:18.743899 1460604 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-131319
I0914 00:22:18.759800 1460604 provision.go:143] copyHostCerts
I0914 00:22:18.759927 1460604 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19640-1454467/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19640-1454467/.minikube/ca.pem (1078 bytes)
I0914 00:22:18.760061 1460604 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19640-1454467/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19640-1454467/.minikube/cert.pem (1123 bytes)
I0914 00:22:18.760120 1460604 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19640-1454467/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19640-1454467/.minikube/key.pem (1679 bytes)
I0914 00:22:18.760174 1460604 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19640-1454467/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19640-1454467/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19640-1454467/.minikube/certs/ca-key.pem org=jenkins.addons-131319 san=[127.0.0.1 192.168.49.2 addons-131319 localhost minikube]
I0914 00:22:18.977784 1460604 provision.go:177] copyRemoteCerts
I0914 00:22:18.977850 1460604 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0914 00:22:18.977895 1460604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-131319
I0914 00:22:18.994065 1460604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34624 SSHKeyPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/machines/addons-131319/id_rsa Username:docker}
I0914 00:22:19.084822 1460604 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-1454467/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0914 00:22:19.108928 1460604 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-1454467/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0914 00:22:19.132564 1460604 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-1454467/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0914 00:22:19.156104 1460604 provision.go:87] duration metric: took 412.281621ms to configureAuth
I0914 00:22:19.156176 1460604 ubuntu.go:193] setting minikube options for container-runtime
I0914 00:22:19.156396 1460604 config.go:182] Loaded profile config "addons-131319": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I0914 00:22:19.156408 1460604 machine.go:96] duration metric: took 933.561347ms to provisionDockerMachine
I0914 00:22:19.156416 1460604 client.go:171] duration metric: took 8.299072625s to LocalClient.Create
I0914 00:22:19.156436 1460604 start.go:167] duration metric: took 8.299143788s to libmachine.API.Create "addons-131319"
I0914 00:22:19.156444 1460604 start.go:293] postStartSetup for "addons-131319" (driver="docker")
I0914 00:22:19.156457 1460604 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0914 00:22:19.156509 1460604 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0914 00:22:19.156556 1460604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-131319
I0914 00:22:19.172647 1460604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34624 SSHKeyPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/machines/addons-131319/id_rsa Username:docker}
I0914 00:22:19.260739 1460604 ssh_runner.go:195] Run: cat /etc/os-release
I0914 00:22:19.263765 1460604 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0914 00:22:19.263804 1460604 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0914 00:22:19.263819 1460604 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0914 00:22:19.263826 1460604 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0914 00:22:19.263836 1460604 filesync.go:126] Scanning /home/jenkins/minikube-integration/19640-1454467/.minikube/addons for local assets ...
I0914 00:22:19.263922 1460604 filesync.go:126] Scanning /home/jenkins/minikube-integration/19640-1454467/.minikube/files for local assets ...
I0914 00:22:19.263952 1460604 start.go:296] duration metric: took 107.498974ms for postStartSetup
I0914 00:22:19.264268 1460604 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-131319
I0914 00:22:19.280099 1460604 profile.go:143] Saving config to /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/config.json ...
I0914 00:22:19.280415 1460604 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0914 00:22:19.280466 1460604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-131319
I0914 00:22:19.296323 1460604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34624 SSHKeyPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/machines/addons-131319/id_rsa Username:docker}
I0914 00:22:19.380438 1460604 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0914 00:22:19.384900 1460604 start.go:128] duration metric: took 8.530014469s to createHost
I0914 00:22:19.384927 1460604 start.go:83] releasing machines lock for "addons-131319", held for 8.530159068s
I0914 00:22:19.385018 1460604 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-131319
I0914 00:22:19.400877 1460604 ssh_runner.go:195] Run: cat /version.json
I0914 00:22:19.400931 1460604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-131319
I0914 00:22:19.400992 1460604 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0914 00:22:19.401052 1460604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-131319
I0914 00:22:19.420362 1460604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34624 SSHKeyPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/machines/addons-131319/id_rsa Username:docker}
I0914 00:22:19.437711 1460604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34624 SSHKeyPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/machines/addons-131319/id_rsa Username:docker}
I0914 00:22:19.635814 1460604 ssh_runner.go:195] Run: systemctl --version
I0914 00:22:19.640029 1460604 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0914 00:22:19.644008 1460604 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0914 00:22:19.668356 1460604 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0914 00:22:19.668433 1460604 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0914 00:22:19.697412 1460604 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0914 00:22:19.697438 1460604 start.go:495] detecting cgroup driver to use...
I0914 00:22:19.697496 1460604 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0914 00:22:19.697573 1460604 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0914 00:22:19.709890 1460604 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0914 00:22:19.721854 1460604 docker.go:217] disabling cri-docker service (if available) ...
I0914 00:22:19.721942 1460604 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0914 00:22:19.736186 1460604 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0914 00:22:19.750924 1460604 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0914 00:22:19.843133 1460604 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0914 00:22:19.945682 1460604 docker.go:233] disabling docker service ...
I0914 00:22:19.945796 1460604 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0914 00:22:19.965124 1460604 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0914 00:22:19.978157 1460604 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0914 00:22:20.077581 1460604 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0914 00:22:20.187802 1460604 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0914 00:22:20.201464 1460604 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0914 00:22:20.218188 1460604 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0914 00:22:20.229334 1460604 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0914 00:22:20.240301 1460604 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0914 00:22:20.240419 1460604 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0914 00:22:20.251542 1460604 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0914 00:22:20.262817 1460604 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0914 00:22:20.276047 1460604 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0914 00:22:20.286221 1460604 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0914 00:22:20.295306 1460604 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0914 00:22:20.305669 1460604 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0914 00:22:20.315736 1460604 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0914 00:22:20.326341 1460604 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0914 00:22:20.334765 1460604 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0914 00:22:20.343270 1460604 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0914 00:22:20.444282 1460604 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0914 00:22:20.586126 1460604 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0914 00:22:20.586267 1460604 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0914 00:22:20.589892 1460604 start.go:563] Will wait 60s for crictl version
I0914 00:22:20.590001 1460604 ssh_runner.go:195] Run: which crictl
I0914 00:22:20.593347 1460604 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0914 00:22:20.630712 1460604 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.22
RuntimeApiVersion: v1
I0914 00:22:20.630843 1460604 ssh_runner.go:195] Run: containerd --version
I0914 00:22:20.652948 1460604 ssh_runner.go:195] Run: containerd --version
I0914 00:22:20.678454 1460604 out.go:177] * Preparing Kubernetes v1.31.1 on containerd 1.7.22 ...
I0914 00:22:20.680216 1460604 cli_runner.go:164] Run: docker network inspect addons-131319 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0914 00:22:20.696172 1460604 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I0914 00:22:20.699827 1460604 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0914 00:22:20.710345 1460604 kubeadm.go:883] updating cluster {Name:addons-131319 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-131319 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cus
tomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0914 00:22:20.710483 1460604 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I0914 00:22:20.710548 1460604 ssh_runner.go:195] Run: sudo crictl images --output json
I0914 00:22:20.746612 1460604 containerd.go:627] all images are preloaded for containerd runtime.
I0914 00:22:20.746637 1460604 containerd.go:534] Images already preloaded, skipping extraction
I0914 00:22:20.746699 1460604 ssh_runner.go:195] Run: sudo crictl images --output json
I0914 00:22:20.782309 1460604 containerd.go:627] all images are preloaded for containerd runtime.
I0914 00:22:20.782336 1460604 cache_images.go:84] Images are preloaded, skipping loading
I0914 00:22:20.782345 1460604 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.1 containerd true true} ...
I0914 00:22:20.782437 1460604 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-131319 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.31.1 ClusterName:addons-131319 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0914 00:22:20.782509 1460604 ssh_runner.go:195] Run: sudo crictl info
I0914 00:22:20.824794 1460604 cni.go:84] Creating CNI manager for ""
I0914 00:22:20.824824 1460604 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0914 00:22:20.824833 1460604 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0914 00:22:20.824888 1460604 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-131319 NodeName:addons-131319 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc
/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0914 00:22:20.825060 1460604 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "addons-131319"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0914 00:22:20.825137 1460604 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1
I0914 00:22:20.834062 1460604 binaries.go:44] Found k8s binaries, skipping transfer
I0914 00:22:20.834191 1460604 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0914 00:22:20.843135 1460604 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (317 bytes)
I0914 00:22:20.861157 1460604 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0914 00:22:20.879376 1460604 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2167 bytes)
I0914 00:22:20.899413 1460604 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0914 00:22:20.902807 1460604 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0914 00:22:20.913847 1460604 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0914 00:22:21.025832 1460604 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0914 00:22:21.042783 1460604 certs.go:68] Setting up /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319 for IP: 192.168.49.2
I0914 00:22:21.042863 1460604 certs.go:194] generating shared ca certs ...
I0914 00:22:21.042897 1460604 certs.go:226] acquiring lock for ca certs: {Name:mkfaf13a8785cc44d16a85b8163136271bcd698b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 00:22:21.043066 1460604 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19640-1454467/.minikube/ca.key
I0914 00:22:21.391542 1460604 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19640-1454467/.minikube/ca.crt ...
I0914 00:22:21.391578 1460604 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-1454467/.minikube/ca.crt: {Name:mk957f12523c408a8851b66851dde65727215012 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 00:22:21.392170 1460604 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19640-1454467/.minikube/ca.key ...
I0914 00:22:21.392188 1460604 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-1454467/.minikube/ca.key: {Name:mk4a28a0900393538b29cf5bb418999da9093075 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 00:22:21.392586 1460604 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19640-1454467/.minikube/proxy-client-ca.key
I0914 00:22:21.676981 1460604 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19640-1454467/.minikube/proxy-client-ca.crt ...
I0914 00:22:21.677015 1460604 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-1454467/.minikube/proxy-client-ca.crt: {Name:mkb2e798a60c086807a68a877c580ab6a2205bb3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 00:22:21.677198 1460604 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19640-1454467/.minikube/proxy-client-ca.key ...
I0914 00:22:21.677211 1460604 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-1454467/.minikube/proxy-client-ca.key: {Name:mk9784f09679493cc1baa9a88e7cb27f3d97181e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 00:22:21.677792 1460604 certs.go:256] generating profile certs ...
I0914 00:22:21.677862 1460604 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/client.key
I0914 00:22:21.677880 1460604 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/client.crt with IP's: []
I0914 00:22:21.922467 1460604 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/client.crt ...
I0914 00:22:21.922504 1460604 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/client.crt: {Name:mk58d6cddde5f8a0d8bb8794487e9cdfe3c0de70 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 00:22:21.923120 1460604 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/client.key ...
I0914 00:22:21.923138 1460604 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/client.key: {Name:mkbe15adfdf6ec8b5e74cb9e621b1819b31d3cee Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 00:22:21.923634 1460604 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/apiserver.key.02ec250f
I0914 00:22:21.923663 1460604 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/apiserver.crt.02ec250f with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I0914 00:22:22.241139 1460604 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/apiserver.crt.02ec250f ...
I0914 00:22:22.241179 1460604 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/apiserver.crt.02ec250f: {Name:mk5280abf928c1711235e18ff5acb9a296dbae86 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 00:22:22.241370 1460604 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/apiserver.key.02ec250f ...
I0914 00:22:22.241385 1460604 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/apiserver.key.02ec250f: {Name:mk53e748b85d70041789a427299b4e3149e1ed68 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 00:22:22.241852 1460604 certs.go:381] copying /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/apiserver.crt.02ec250f -> /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/apiserver.crt
I0914 00:22:22.241943 1460604 certs.go:385] copying /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/apiserver.key.02ec250f -> /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/apiserver.key
I0914 00:22:22.242001 1460604 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/proxy-client.key
I0914 00:22:22.242022 1460604 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/proxy-client.crt with IP's: []
I0914 00:22:22.946430 1460604 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/proxy-client.crt ...
I0914 00:22:22.946469 1460604 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/proxy-client.crt: {Name:mkaeb7e58802c3d1b3dec346b3e41e40558e4268 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 00:22:22.947262 1460604 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/proxy-client.key ...
I0914 00:22:22.947295 1460604 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/proxy-client.key: {Name:mk53aa1d7f2e2bb32f498891a97e8ef0f60e426a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 00:22:22.947523 1460604 certs.go:484] found cert: /home/jenkins/minikube-integration/19640-1454467/.minikube/certs/ca-key.pem (1675 bytes)
I0914 00:22:22.947568 1460604 certs.go:484] found cert: /home/jenkins/minikube-integration/19640-1454467/.minikube/certs/ca.pem (1078 bytes)
I0914 00:22:22.947601 1460604 certs.go:484] found cert: /home/jenkins/minikube-integration/19640-1454467/.minikube/certs/cert.pem (1123 bytes)
I0914 00:22:22.947634 1460604 certs.go:484] found cert: /home/jenkins/minikube-integration/19640-1454467/.minikube/certs/key.pem (1679 bytes)
I0914 00:22:22.948260 1460604 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-1454467/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0914 00:22:22.978665 1460604 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-1454467/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0914 00:22:23.006980 1460604 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-1454467/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0914 00:22:23.039889 1460604 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-1454467/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0914 00:22:23.065285 1460604 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0914 00:22:23.089917 1460604 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0914 00:22:23.113693 1460604 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0914 00:22:23.137915 1460604 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-1454467/.minikube/profiles/addons-131319/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0914 00:22:23.162196 1460604 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-1454467/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0914 00:22:23.189664 1460604 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0914 00:22:23.207947 1460604 ssh_runner.go:195] Run: openssl version
I0914 00:22:23.213635 1460604 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0914 00:22:23.223213 1460604 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0914 00:22:23.226824 1460604 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 14 00:22 /usr/share/ca-certificates/minikubeCA.pem
I0914 00:22:23.226901 1460604 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0914 00:22:23.234000 1460604 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0914 00:22:23.243695 1460604 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0914 00:22:23.247078 1460604 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0914 00:22:23.247142 1460604 kubeadm.go:392] StartCluster: {Name:addons-131319 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-131319 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom
QemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0914 00:22:23.247234 1460604 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0914 00:22:23.247356 1460604 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0914 00:22:23.293164 1460604 cri.go:89] found id: ""
I0914 00:22:23.293241 1460604 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0914 00:22:23.303780 1460604 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0914 00:22:23.313157 1460604 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0914 00:22:23.313224 1460604 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0914 00:22:23.323547 1460604 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0914 00:22:23.323565 1460604 kubeadm.go:157] found existing configuration files:
I0914 00:22:23.323620 1460604 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0914 00:22:23.332950 1460604 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0914 00:22:23.333017 1460604 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0914 00:22:23.342745 1460604 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0914 00:22:23.351739 1460604 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0914 00:22:23.351828 1460604 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0914 00:22:23.360655 1460604 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0914 00:22:23.369456 1460604 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0914 00:22:23.369517 1460604 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0914 00:22:23.377867 1460604 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0914 00:22:23.386384 1460604 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0914 00:22:23.386449 1460604 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0914 00:22:23.395699 1460604 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0914 00:22:23.436878 1460604 kubeadm.go:310] [init] Using Kubernetes version: v1.31.1
I0914 00:22:23.436940 1460604 kubeadm.go:310] [preflight] Running pre-flight checks
I0914 00:22:23.454653 1460604 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0914 00:22:23.454733 1460604 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1069-aws[0m
I0914 00:22:23.454774 1460604 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0914 00:22:23.454828 1460604 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0914 00:22:23.454885 1460604 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0914 00:22:23.454936 1460604 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0914 00:22:23.454988 1460604 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0914 00:22:23.455040 1460604 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0914 00:22:23.455091 1460604 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0914 00:22:23.455141 1460604 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0914 00:22:23.455192 1460604 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0914 00:22:23.455242 1460604 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0914 00:22:23.521892 1460604 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0914 00:22:23.522010 1460604 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0914 00:22:23.522107 1460604 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0914 00:22:23.536198 1460604 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0914 00:22:23.539909 1460604 out.go:235] - Generating certificates and keys ...
I0914 00:22:23.540137 1460604 kubeadm.go:310] [certs] Using existing ca certificate authority
I0914 00:22:23.540250 1460604 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0914 00:22:24.127547 1460604 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0914 00:22:24.304999 1460604 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0914 00:22:24.562360 1460604 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0914 00:22:25.841722 1460604 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0914 00:22:26.824143 1460604 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0914 00:22:26.824297 1460604 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-131319 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0914 00:22:28.670345 1460604 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0914 00:22:28.670684 1460604 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-131319 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0914 00:22:28.895643 1460604 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0914 00:22:29.553790 1460604 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0914 00:22:30.087798 1460604 kubeadm.go:310] [certs] Generating "sa" key and public key
I0914 00:22:30.088406 1460604 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0914 00:22:30.338888 1460604 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0914 00:22:31.249662 1460604 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0914 00:22:32.237570 1460604 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0914 00:22:32.577559 1460604 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0914 00:22:32.870601 1460604 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0914 00:22:32.871435 1460604 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0914 00:22:32.874653 1460604 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0914 00:22:32.877184 1460604 out.go:235] - Booting up control plane ...
I0914 00:22:32.877302 1460604 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0914 00:22:32.877401 1460604 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0914 00:22:32.878721 1460604 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0914 00:22:32.890448 1460604 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0914 00:22:32.896818 1460604 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0914 00:22:32.899753 1460604 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0914 00:22:33.010900 1460604 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0914 00:22:33.011025 1460604 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0914 00:22:34.511550 1460604 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.500785069s
I0914 00:22:34.511639 1460604 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0914 00:22:40.514065 1460604 kubeadm.go:310] [api-check] The API server is healthy after 6.002476886s
I0914 00:22:40.533313 1460604 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0914 00:22:40.546934 1460604 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0914 00:22:40.576634 1460604 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0914 00:22:40.576833 1460604 kubeadm.go:310] [mark-control-plane] Marking the node addons-131319 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0914 00:22:40.596835 1460604 kubeadm.go:310] [bootstrap-token] Using token: undrax.q2k685wtq571urxh
I0914 00:22:40.598763 1460604 out.go:235] - Configuring RBAC rules ...
I0914 00:22:40.598891 1460604 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0914 00:22:40.609198 1460604 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0914 00:22:40.619027 1460604 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0914 00:22:40.624048 1460604 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0914 00:22:40.631107 1460604 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0914 00:22:40.635048 1460604 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0914 00:22:40.921149 1460604 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0914 00:22:41.346479 1460604 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0914 00:22:41.920828 1460604 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0914 00:22:41.921975 1460604 kubeadm.go:310]
I0914 00:22:41.922061 1460604 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0914 00:22:41.922073 1460604 kubeadm.go:310]
I0914 00:22:41.922152 1460604 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0914 00:22:41.922162 1460604 kubeadm.go:310]
I0914 00:22:41.922188 1460604 kubeadm.go:310] mkdir -p $HOME/.kube
I0914 00:22:41.922251 1460604 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0914 00:22:41.922307 1460604 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0914 00:22:41.922314 1460604 kubeadm.go:310]
I0914 00:22:41.922370 1460604 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0914 00:22:41.922377 1460604 kubeadm.go:310]
I0914 00:22:41.922426 1460604 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0914 00:22:41.922434 1460604 kubeadm.go:310]
I0914 00:22:41.922486 1460604 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0914 00:22:41.922566 1460604 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0914 00:22:41.922640 1460604 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0914 00:22:41.922648 1460604 kubeadm.go:310]
I0914 00:22:41.922733 1460604 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0914 00:22:41.922815 1460604 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0914 00:22:41.922824 1460604 kubeadm.go:310]
I0914 00:22:41.922909 1460604 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token undrax.q2k685wtq571urxh \
I0914 00:22:41.923016 1460604 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:293204f33a45133f182fdacfd2c933cd65b2ce5eca026bc573a790bbd3fda2af \
I0914 00:22:41.923041 1460604 kubeadm.go:310] --control-plane
I0914 00:22:41.923049 1460604 kubeadm.go:310]
I0914 00:22:41.923135 1460604 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0914 00:22:41.923141 1460604 kubeadm.go:310]
I0914 00:22:41.923224 1460604 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token undrax.q2k685wtq571urxh \
I0914 00:22:41.923336 1460604 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:293204f33a45133f182fdacfd2c933cd65b2ce5eca026bc573a790bbd3fda2af
I0914 00:22:41.927785 1460604 kubeadm.go:310] W0914 00:22:23.432674 1020 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0914 00:22:41.928145 1460604 kubeadm.go:310] W0914 00:22:23.434349 1020 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0914 00:22:41.928416 1460604 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1069-aws\n", err: exit status 1
I0914 00:22:41.928562 1460604 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0914 00:22:41.928589 1460604 cni.go:84] Creating CNI manager for ""
I0914 00:22:41.928602 1460604 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0914 00:22:41.931536 1460604 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0914 00:22:41.933182 1460604 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0914 00:22:41.936936 1460604 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.1/kubectl ...
I0914 00:22:41.936958 1460604 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I0914 00:22:41.956904 1460604 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0914 00:22:42.283933 1460604 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0914 00:22:42.284003 1460604 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 00:22:42.284088 1460604 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-131319 minikube.k8s.io/updated_at=2024_09_14T00_22_42_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=7ca96ba7bd97af6e0063398921096f1cca785d18 minikube.k8s.io/name=addons-131319 minikube.k8s.io/primary=true
I0914 00:22:42.497100 1460604 ops.go:34] apiserver oom_adj: -16
I0914 00:22:42.497213 1460604 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 00:22:42.997373 1460604 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 00:22:43.497275 1460604 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 00:22:43.997775 1460604 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 00:22:44.498177 1460604 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 00:22:44.998115 1460604 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 00:22:45.497362 1460604 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 00:22:45.997685 1460604 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 00:22:46.498301 1460604 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 00:22:46.603973 1460604 kubeadm.go:1113] duration metric: took 4.320027579s to wait for elevateKubeSystemPrivileges
I0914 00:22:46.604007 1460604 kubeadm.go:394] duration metric: took 23.356888137s to StartCluster
I0914 00:22:46.604025 1460604 settings.go:142] acquiring lock: {Name:mk71d0962f5f4196c9fea75fe9a601467858166a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 00:22:46.604154 1460604 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19640-1454467/kubeconfig
I0914 00:22:46.604534 1460604 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-1454467/kubeconfig: {Name:mk9726361d7deb93fbb6dba7857cc3f0a8a02233 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 00:22:46.604730 1460604 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0914 00:22:46.604878 1460604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0914 00:22:46.605118 1460604 config.go:182] Loaded profile config "addons-131319": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I0914 00:22:46.605157 1460604 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I0914 00:22:46.605239 1460604 addons.go:69] Setting yakd=true in profile "addons-131319"
I0914 00:22:46.605255 1460604 addons.go:234] Setting addon yakd=true in "addons-131319"
I0914 00:22:46.605278 1460604 host.go:66] Checking if "addons-131319" exists ...
I0914 00:22:46.605772 1460604 cli_runner.go:164] Run: docker container inspect addons-131319 --format={{.State.Status}}
I0914 00:22:46.606353 1460604 addons.go:69] Setting metrics-server=true in profile "addons-131319"
I0914 00:22:46.606374 1460604 addons.go:234] Setting addon metrics-server=true in "addons-131319"
I0914 00:22:46.606410 1460604 host.go:66] Checking if "addons-131319" exists ...
I0914 00:22:46.606418 1460604 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-131319"
I0914 00:22:46.606435 1460604 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-131319"
I0914 00:22:46.606457 1460604 host.go:66] Checking if "addons-131319" exists ...
I0914 00:22:46.606851 1460604 cli_runner.go:164] Run: docker container inspect addons-131319 --format={{.State.Status}}
I0914 00:22:46.606896 1460604 cli_runner.go:164] Run: docker container inspect addons-131319 --format={{.State.Status}}
I0914 00:22:46.609209 1460604 addons.go:69] Setting registry=true in profile "addons-131319"
I0914 00:22:46.609245 1460604 addons.go:234] Setting addon registry=true in "addons-131319"
I0914 00:22:46.609284 1460604 host.go:66] Checking if "addons-131319" exists ...
I0914 00:22:46.609745 1460604 cli_runner.go:164] Run: docker container inspect addons-131319 --format={{.State.Status}}
I0914 00:22:46.610647 1460604 addons.go:69] Setting cloud-spanner=true in profile "addons-131319"
I0914 00:22:46.610716 1460604 addons.go:234] Setting addon cloud-spanner=true in "addons-131319"
I0914 00:22:46.610809 1460604 host.go:66] Checking if "addons-131319" exists ...
I0914 00:22:46.610951 1460604 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-131319"
I0914 00:22:46.613084 1460604 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-131319"
I0914 00:22:46.613125 1460604 host.go:66] Checking if "addons-131319" exists ...
I0914 00:22:46.613528 1460604 cli_runner.go:164] Run: docker container inspect addons-131319 --format={{.State.Status}}
I0914 00:22:46.615280 1460604 addons.go:69] Setting storage-provisioner=true in profile "addons-131319"
I0914 00:22:46.615354 1460604 addons.go:234] Setting addon storage-provisioner=true in "addons-131319"
I0914 00:22:46.615405 1460604 host.go:66] Checking if "addons-131319" exists ...
I0914 00:22:46.615985 1460604 cli_runner.go:164] Run: docker container inspect addons-131319 --format={{.State.Status}}
I0914 00:22:46.610961 1460604 addons.go:69] Setting default-storageclass=true in profile "addons-131319"
I0914 00:22:46.622378 1460604 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-131319"
I0914 00:22:46.622720 1460604 cli_runner.go:164] Run: docker container inspect addons-131319 --format={{.State.Status}}
I0914 00:22:46.635497 1460604 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-131319"
I0914 00:22:46.635593 1460604 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-131319"
I0914 00:22:46.636143 1460604 cli_runner.go:164] Run: docker container inspect addons-131319 --format={{.State.Status}}
I0914 00:22:46.610966 1460604 addons.go:69] Setting gcp-auth=true in profile "addons-131319"
I0914 00:22:46.638358 1460604 mustload.go:65] Loading cluster: addons-131319
I0914 00:22:46.638558 1460604 config.go:182] Loaded profile config "addons-131319": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I0914 00:22:46.638809 1460604 cli_runner.go:164] Run: docker container inspect addons-131319 --format={{.State.Status}}
I0914 00:22:46.610970 1460604 addons.go:69] Setting ingress=true in profile "addons-131319"
I0914 00:22:46.667833 1460604 addons.go:234] Setting addon ingress=true in "addons-131319"
I0914 00:22:46.667950 1460604 host.go:66] Checking if "addons-131319" exists ...
I0914 00:22:46.671592 1460604 cli_runner.go:164] Run: docker container inspect addons-131319 --format={{.State.Status}}
I0914 00:22:46.681920 1460604 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2
I0914 00:22:46.684336 1460604 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0914 00:22:46.684423 1460604 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0914 00:22:46.684523 1460604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-131319
I0914 00:22:46.610973 1460604 addons.go:69] Setting ingress-dns=true in profile "addons-131319"
I0914 00:22:46.704865 1460604 addons.go:234] Setting addon ingress-dns=true in "addons-131319"
I0914 00:22:46.704975 1460604 host.go:66] Checking if "addons-131319" exists ...
I0914 00:22:46.705525 1460604 cli_runner.go:164] Run: docker container inspect addons-131319 --format={{.State.Status}}
I0914 00:22:46.610976 1460604 addons.go:69] Setting inspektor-gadget=true in profile "addons-131319"
I0914 00:22:46.712310 1460604 addons.go:234] Setting addon inspektor-gadget=true in "addons-131319"
I0914 00:22:46.712366 1460604 host.go:66] Checking if "addons-131319" exists ...
I0914 00:22:46.610985 1460604 out.go:177] * Verifying Kubernetes components...
I0914 00:22:46.652323 1460604 cli_runner.go:164] Run: docker container inspect addons-131319 --format={{.State.Status}}
I0914 00:22:46.657770 1460604 addons.go:69] Setting volcano=true in profile "addons-131319"
I0914 00:22:46.726793 1460604 addons.go:234] Setting addon volcano=true in "addons-131319"
I0914 00:22:46.726834 1460604 host.go:66] Checking if "addons-131319" exists ...
I0914 00:22:46.727321 1460604 cli_runner.go:164] Run: docker container inspect addons-131319 --format={{.State.Status}}
I0914 00:22:46.732603 1460604 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I0914 00:22:46.735501 1460604 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
I0914 00:22:46.735527 1460604 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0914 00:22:46.735608 1460604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-131319
I0914 00:22:46.657789 1460604 addons.go:69] Setting volumesnapshots=true in profile "addons-131319"
I0914 00:22:46.746177 1460604 addons.go:234] Setting addon volumesnapshots=true in "addons-131319"
I0914 00:22:46.746307 1460604 host.go:66] Checking if "addons-131319" exists ...
I0914 00:22:46.747024 1460604 cli_runner.go:164] Run: docker container inspect addons-131319 --format={{.State.Status}}
I0914 00:22:46.752039 1460604 addons.go:234] Setting addon default-storageclass=true in "addons-131319"
I0914 00:22:46.752088 1460604 host.go:66] Checking if "addons-131319" exists ...
I0914 00:22:46.752635 1460604 cli_runner.go:164] Run: docker container inspect addons-131319 --format={{.State.Status}}
I0914 00:22:46.759555 1460604 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0914 00:22:46.760187 1460604 cli_runner.go:164] Run: docker container inspect addons-131319 --format={{.State.Status}}
I0914 00:22:46.774453 1460604 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0914 00:22:46.776177 1460604 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0914 00:22:46.784813 1460604 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0914 00:22:46.787623 1460604 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
I0914 00:22:46.787828 1460604 out.go:177] - Using image docker.io/registry:2.8.3
I0914 00:22:46.788280 1460604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0914 00:22:46.821226 1460604 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0914 00:22:46.824220 1460604 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0914 00:22:46.824755 1460604 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0914 00:22:46.824865 1460604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-131319
I0914 00:22:46.834374 1460604 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0914 00:22:46.868327 1460604 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0914 00:22:46.868394 1460604 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0914 00:22:46.868479 1460604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-131319
I0914 00:22:46.873723 1460604 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
I0914 00:22:46.875216 1460604 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0914 00:22:46.882460 1460604 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0914 00:22:46.885147 1460604 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0914 00:22:46.878995 1460604 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
I0914 00:22:46.885908 1460604 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I0914 00:22:46.885987 1460604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-131319
I0914 00:22:46.891512 1460604 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2
I0914 00:22:46.893845 1460604 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0914 00:22:46.896352 1460604 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0914 00:22:46.900230 1460604 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0914 00:22:46.900288 1460604 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I0914 00:22:46.900389 1460604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-131319
I0914 00:22:46.916204 1460604 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I0914 00:22:46.918014 1460604 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0914 00:22:46.918038 1460604 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0914 00:22:46.918106 1460604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-131319
I0914 00:22:46.924444 1460604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34624 SSHKeyPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/machines/addons-131319/id_rsa Username:docker}
I0914 00:22:46.879982 1460604 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-131319"
I0914 00:22:46.926776 1460604 host.go:66] Checking if "addons-131319" exists ...
I0914 00:22:46.927248 1460604 cli_runner.go:164] Run: docker container inspect addons-131319 --format={{.State.Status}}
I0914 00:22:46.928248 1460604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34624 SSHKeyPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/machines/addons-131319/id_rsa Username:docker}
I0914 00:22:46.936687 1460604 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0914 00:22:46.939280 1460604 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.23
I0914 00:22:46.939460 1460604 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0914 00:22:46.939491 1460604 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0914 00:22:46.939562 1460604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-131319
I0914 00:22:46.943068 1460604 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
I0914 00:22:46.943091 1460604 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0914 00:22:46.943161 1460604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-131319
I0914 00:22:46.957008 1460604 host.go:66] Checking if "addons-131319" exists ...
I0914 00:22:46.970563 1460604 out.go:177] - Using image docker.io/volcanosh/vc-webhook-manager:v1.9.0
I0914 00:22:46.976235 1460604 out.go:177] - Using image docker.io/volcanosh/vc-controller-manager:v1.9.0
I0914 00:22:46.983482 1460604 out.go:177] - Using image docker.io/volcanosh/vc-scheduler:v1.9.0
I0914 00:22:46.991746 1460604 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0
I0914 00:22:47.018420 1460604 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml
I0914 00:22:47.018505 1460604 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (434001 bytes)
I0914 00:22:47.018624 1460604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-131319
I0914 00:22:47.027339 1460604 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
I0914 00:22:47.027410 1460604 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I0914 00:22:47.027513 1460604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-131319
I0914 00:22:47.051515 1460604 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0914 00:22:47.051543 1460604 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0914 00:22:47.051623 1460604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-131319
I0914 00:22:47.082635 1460604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34624 SSHKeyPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/machines/addons-131319/id_rsa Username:docker}
I0914 00:22:47.105990 1460604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34624 SSHKeyPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/machines/addons-131319/id_rsa Username:docker}
I0914 00:22:47.108784 1460604 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0914 00:22:47.113577 1460604 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0914 00:22:47.116034 1460604 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0914 00:22:47.116069 1460604 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0914 00:22:47.116146 1460604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-131319
I0914 00:22:47.126154 1460604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34624 SSHKeyPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/machines/addons-131319/id_rsa Username:docker}
I0914 00:22:47.143526 1460604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34624 SSHKeyPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/machines/addons-131319/id_rsa Username:docker}
I0914 00:22:47.155588 1460604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34624 SSHKeyPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/machines/addons-131319/id_rsa Username:docker}
I0914 00:22:47.180280 1460604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34624 SSHKeyPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/machines/addons-131319/id_rsa Username:docker}
I0914 00:22:47.192741 1460604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34624 SSHKeyPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/machines/addons-131319/id_rsa Username:docker}
I0914 00:22:47.212057 1460604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34624 SSHKeyPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/machines/addons-131319/id_rsa Username:docker}
I0914 00:22:47.217771 1460604 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0914 00:22:47.220100 1460604 out.go:177] - Using image docker.io/busybox:stable
I0914 00:22:47.221482 1460604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34624 SSHKeyPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/machines/addons-131319/id_rsa Username:docker}
I0914 00:22:47.223054 1460604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34624 SSHKeyPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/machines/addons-131319/id_rsa Username:docker}
I0914 00:22:47.231529 1460604 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0914 00:22:47.231554 1460604 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0914 00:22:47.231619 1460604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-131319
I0914 00:22:47.243125 1460604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34624 SSHKeyPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/machines/addons-131319/id_rsa Username:docker}
I0914 00:22:47.262207 1460604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34624 SSHKeyPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/machines/addons-131319/id_rsa Username:docker}
W0914 00:22:47.263587 1460604 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0914 00:22:47.263613 1460604 retry.go:31] will retry after 129.332635ms: ssh: handshake failed: EOF
I0914 00:22:47.737420 1460604 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
I0914 00:22:47.766714 1460604 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0914 00:22:47.766738 1460604 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0914 00:22:47.831080 1460604 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0914 00:22:47.857168 1460604 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0914 00:22:47.857241 1460604 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0914 00:22:47.866827 1460604 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
I0914 00:22:47.866894 1460604 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0914 00:22:47.896881 1460604 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0914 00:22:47.901685 1460604 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0914 00:22:47.901712 1460604 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0914 00:22:47.927595 1460604 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0914 00:22:47.933644 1460604 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
I0914 00:22:47.933671 1460604 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0914 00:22:48.011533 1460604 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0914 00:22:48.011567 1460604 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0914 00:22:48.031892 1460604 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0914 00:22:48.080425 1460604 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0914 00:22:48.080466 1460604 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0914 00:22:48.084435 1460604 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0914 00:22:48.107782 1460604 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
I0914 00:22:48.107819 1460604 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0914 00:22:48.154714 1460604 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
I0914 00:22:48.154748 1460604 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0914 00:22:48.171233 1460604 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0914 00:22:48.260920 1460604 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0914 00:22:48.287072 1460604 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I0914 00:22:48.287116 1460604 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I0914 00:22:48.302205 1460604 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
I0914 00:22:48.302225 1460604 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0914 00:22:48.313691 1460604 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0914 00:22:48.313735 1460604 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0914 00:22:48.319198 1460604 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0914 00:22:48.319225 1460604 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0914 00:22:48.342843 1460604 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0914 00:22:48.342877 1460604 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0914 00:22:48.450666 1460604 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
I0914 00:22:48.450703 1460604 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0914 00:22:48.514625 1460604 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
I0914 00:22:48.514658 1460604 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I0914 00:22:48.526540 1460604 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0914 00:22:48.526578 1460604 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0914 00:22:48.590759 1460604 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0914 00:22:48.603866 1460604 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0914 00:22:48.603890 1460604 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0914 00:22:48.607459 1460604 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0914 00:22:48.644255 1460604 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (1.535440465s)
I0914 00:22:48.644390 1460604 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (1.856089371s)
I0914 00:22:48.644441 1460604 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I0914 00:22:48.645264 1460604 node_ready.go:35] waiting up to 6m0s for node "addons-131319" to be "Ready" ...
I0914 00:22:48.649750 1460604 node_ready.go:49] node "addons-131319" has status "Ready":"True"
I0914 00:22:48.649778 1460604 node_ready.go:38] duration metric: took 4.485113ms for node "addons-131319" to be "Ready" ...
I0914 00:22:48.649789 1460604 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0914 00:22:48.667631 1460604 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-dc7c8" in "kube-system" namespace to be "Ready" ...
I0914 00:22:48.772961 1460604 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0914 00:22:48.775986 1460604 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I0914 00:22:48.776057 1460604 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I0914 00:22:48.780664 1460604 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0914 00:22:48.780734 1460604 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0914 00:22:48.944987 1460604 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0914 00:22:48.945052 1460604 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0914 00:22:49.087841 1460604 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I0914 00:22:49.087939 1460604 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I0914 00:22:49.148592 1460604 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-131319" context rescaled to 1 replicas
I0914 00:22:49.152848 1460604 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0914 00:22:49.152919 1460604 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0914 00:22:49.277624 1460604 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0914 00:22:49.377624 1460604 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0914 00:22:49.377701 1460604 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0914 00:22:49.498729 1460604 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I0914 00:22:49.498804 1460604 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I0914 00:22:49.710253 1460604 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0914 00:22:49.710320 1460604 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0914 00:22:49.801053 1460604 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
I0914 00:22:49.801079 1460604 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I0914 00:22:49.886309 1460604 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0914 00:22:49.886332 1460604 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0914 00:22:49.956717 1460604 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
I0914 00:22:49.956740 1460604 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
I0914 00:22:50.124305 1460604 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0914 00:22:50.124335 1460604 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0914 00:22:50.299183 1460604 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I0914 00:22:50.506114 1460604 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0914 00:22:50.506143 1460604 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0914 00:22:50.684740 1460604 pod_ready.go:103] pod "coredns-7c65d6cfc9-dc7c8" in "kube-system" namespace has status "Ready":"False"
I0914 00:22:50.808385 1460604 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0914 00:22:53.190040 1460604 pod_ready.go:103] pod "coredns-7c65d6cfc9-dc7c8" in "kube-system" namespace has status "Ready":"False"
I0914 00:22:54.168068 1460604 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0914 00:22:54.168232 1460604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-131319
I0914 00:22:54.190717 1460604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34624 SSHKeyPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/machines/addons-131319/id_rsa Username:docker}
I0914 00:22:54.576223 1460604 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0914 00:22:54.602513 1460604 addons.go:234] Setting addon gcp-auth=true in "addons-131319"
I0914 00:22:54.602573 1460604 host.go:66] Checking if "addons-131319" exists ...
I0914 00:22:54.603078 1460604 cli_runner.go:164] Run: docker container inspect addons-131319 --format={{.State.Status}}
I0914 00:22:54.634363 1460604 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0914 00:22:54.634443 1460604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-131319
I0914 00:22:54.659140 1460604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34624 SSHKeyPath:/home/jenkins/minikube-integration/19640-1454467/.minikube/machines/addons-131319/id_rsa Username:docker}
I0914 00:22:55.728752 1460604 pod_ready.go:103] pod "coredns-7c65d6cfc9-dc7c8" in "kube-system" namespace has status "Ready":"False"
I0914 00:22:56.705967 1460604 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (8.968456146s)
I0914 00:22:56.706113 1460604 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (8.87495453s)
I0914 00:22:56.706274 1460604 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (8.809365309s)
I0914 00:22:56.706296 1460604 addons.go:475] Verifying addon ingress=true in "addons-131319"
I0914 00:22:56.706704 1460604 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (8.77903707s)
I0914 00:22:56.706804 1460604 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (8.674882182s)
I0914 00:22:56.706880 1460604 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (8.622412899s)
I0914 00:22:56.706979 1460604 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (8.53572589s)
I0914 00:22:56.707033 1460604 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (8.446087932s)
I0914 00:22:56.707404 1460604 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.116613366s)
I0914 00:22:56.707434 1460604 addons.go:475] Verifying addon metrics-server=true in "addons-131319"
I0914 00:22:56.707481 1460604 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (8.09998537s)
I0914 00:22:56.707504 1460604 addons.go:475] Verifying addon registry=true in "addons-131319"
I0914 00:22:56.707995 1460604 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (7.934985836s)
I0914 00:22:56.708112 1460604 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (7.430411489s)
W0914 00:22:56.708144 1460604 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0914 00:22:56.708165 1460604 retry.go:31] will retry after 284.653202ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0914 00:22:56.708231 1460604 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (6.409018873s)
I0914 00:22:56.709677 1460604 out.go:177] * Verifying registry addon...
I0914 00:22:56.709744 1460604 out.go:177] * Verifying ingress addon...
I0914 00:22:56.711096 1460604 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-131319 service yakd-dashboard -n yakd-dashboard
I0914 00:22:56.713409 1460604 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0914 00:22:56.714739 1460604 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0914 00:22:56.747837 1460604 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0914 00:22:56.747956 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:22:56.753824 1460604 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0914 00:22:56.753884 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
W0914 00:22:56.804793 1460604 out.go:270] ! Enabling 'storage-provisioner-rancher' returned an error: running callbacks: [Error making local-path the default storage class: Error while marking storage class local-path as default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]
I0914 00:22:56.993721 1460604 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0914 00:22:57.225206 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:22:57.225929 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:22:57.549457 1460604 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (6.741025253s)
I0914 00:22:57.549533 1460604 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-131319"
I0914 00:22:57.549753 1460604 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (2.915357869s)
I0914 00:22:57.553163 1460604 out.go:177] * Verifying csi-hostpath-driver addon...
I0914 00:22:57.553290 1460604 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0914 00:22:57.556095 1460604 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0914 00:22:57.558845 1460604 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
I0914 00:22:57.561535 1460604 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0914 00:22:57.561592 1460604 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0914 00:22:57.563916 1460604 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0914 00:22:57.563941 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:22:57.618992 1460604 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0914 00:22:57.619019 1460604 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0914 00:22:57.714935 1460604 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0914 00:22:57.714967 1460604 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I0914 00:22:57.720010 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:22:57.720089 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:22:57.785127 1460604 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0914 00:22:58.062879 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:22:58.175503 1460604 pod_ready.go:103] pod "coredns-7c65d6cfc9-dc7c8" in "kube-system" namespace has status "Ready":"False"
I0914 00:22:58.219390 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:22:58.219685 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:22:58.512420 1460604 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.518635601s)
I0914 00:22:58.562219 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:22:58.721954 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:22:58.723274 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:22:58.816741 1460604 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.031525259s)
I0914 00:22:58.820448 1460604 addons.go:475] Verifying addon gcp-auth=true in "addons-131319"
I0914 00:22:58.822978 1460604 out.go:177] * Verifying gcp-auth addon...
I0914 00:22:58.825746 1460604 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0914 00:22:58.828340 1460604 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0914 00:22:59.061449 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:22:59.217473 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:22:59.220881 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:22:59.561389 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:22:59.718173 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:22:59.720009 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:00.093266 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:00.180761 1460604 pod_ready.go:103] pod "coredns-7c65d6cfc9-dc7c8" in "kube-system" namespace has status "Ready":"False"
I0914 00:23:00.259284 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:00.333619 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:00.563567 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:00.719666 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:00.722232 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:01.061336 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:01.220503 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:01.221552 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:01.562293 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:01.720664 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:01.722177 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:02.062701 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:02.219605 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:02.220827 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:02.561890 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:02.705590 1460604 pod_ready.go:103] pod "coredns-7c65d6cfc9-dc7c8" in "kube-system" namespace has status "Ready":"False"
I0914 00:23:02.720174 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:02.721648 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:03.062423 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:03.217219 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:03.220247 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:03.561337 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:03.674573 1460604 pod_ready.go:93] pod "coredns-7c65d6cfc9-dc7c8" in "kube-system" namespace has status "Ready":"True"
I0914 00:23:03.674646 1460604 pod_ready.go:82] duration metric: took 15.006979986s for pod "coredns-7c65d6cfc9-dc7c8" in "kube-system" namespace to be "Ready" ...
I0914 00:23:03.674685 1460604 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-vhmnt" in "kube-system" namespace to be "Ready" ...
I0914 00:23:03.677077 1460604 pod_ready.go:98] error getting pod "coredns-7c65d6cfc9-vhmnt" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-vhmnt" not found
I0914 00:23:03.677142 1460604 pod_ready.go:82] duration metric: took 2.429284ms for pod "coredns-7c65d6cfc9-vhmnt" in "kube-system" namespace to be "Ready" ...
E0914 00:23:03.677178 1460604 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-7c65d6cfc9-vhmnt" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-vhmnt" not found
I0914 00:23:03.677211 1460604 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-131319" in "kube-system" namespace to be "Ready" ...
I0914 00:23:03.682980 1460604 pod_ready.go:93] pod "etcd-addons-131319" in "kube-system" namespace has status "Ready":"True"
I0914 00:23:03.683016 1460604 pod_ready.go:82] duration metric: took 5.778581ms for pod "etcd-addons-131319" in "kube-system" namespace to be "Ready" ...
I0914 00:23:03.683037 1460604 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-131319" in "kube-system" namespace to be "Ready" ...
I0914 00:23:03.688987 1460604 pod_ready.go:93] pod "kube-apiserver-addons-131319" in "kube-system" namespace has status "Ready":"True"
I0914 00:23:03.689012 1460604 pod_ready.go:82] duration metric: took 5.965157ms for pod "kube-apiserver-addons-131319" in "kube-system" namespace to be "Ready" ...
I0914 00:23:03.689025 1460604 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-131319" in "kube-system" namespace to be "Ready" ...
I0914 00:23:03.697538 1460604 pod_ready.go:93] pod "kube-controller-manager-addons-131319" in "kube-system" namespace has status "Ready":"True"
I0914 00:23:03.697563 1460604 pod_ready.go:82] duration metric: took 8.528815ms for pod "kube-controller-manager-addons-131319" in "kube-system" namespace to be "Ready" ...
I0914 00:23:03.697576 1460604 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-g7jvd" in "kube-system" namespace to be "Ready" ...
I0914 00:23:03.721154 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:03.721932 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:03.871797 1460604 pod_ready.go:93] pod "kube-proxy-g7jvd" in "kube-system" namespace has status "Ready":"True"
I0914 00:23:03.871825 1460604 pod_ready.go:82] duration metric: took 174.239018ms for pod "kube-proxy-g7jvd" in "kube-system" namespace to be "Ready" ...
I0914 00:23:03.871837 1460604 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-131319" in "kube-system" namespace to be "Ready" ...
I0914 00:23:04.064186 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:04.218033 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:04.219784 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:04.284926 1460604 pod_ready.go:93] pod "kube-scheduler-addons-131319" in "kube-system" namespace has status "Ready":"True"
I0914 00:23:04.285029 1460604 pod_ready.go:82] duration metric: took 413.171358ms for pod "kube-scheduler-addons-131319" in "kube-system" namespace to be "Ready" ...
I0914 00:23:04.285057 1460604 pod_ready.go:39] duration metric: took 15.635228195s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0914 00:23:04.285107 1460604 api_server.go:52] waiting for apiserver process to appear ...
I0914 00:23:04.285228 1460604 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0914 00:23:04.325233 1460604 api_server.go:72] duration metric: took 17.720469082s to wait for apiserver process to appear ...
I0914 00:23:04.325325 1460604 api_server.go:88] waiting for apiserver healthz status ...
I0914 00:23:04.325362 1460604 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I0914 00:23:04.336331 1460604 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I0914 00:23:04.337573 1460604 api_server.go:141] control plane version: v1.31.1
I0914 00:23:04.337598 1460604 api_server.go:131] duration metric: took 12.252962ms to wait for apiserver health ...
I0914 00:23:04.337608 1460604 system_pods.go:43] waiting for kube-system pods to appear ...
I0914 00:23:04.487490 1460604 system_pods.go:59] 18 kube-system pods found
I0914 00:23:04.487539 1460604 system_pods.go:61] "coredns-7c65d6cfc9-dc7c8" [f382f521-0e1f-4364-a700-a7a7508f2be9] Running
I0914 00:23:04.487574 1460604 system_pods.go:61] "csi-hostpath-attacher-0" [54b9b4ab-4266-4f4a-a756-cea3af895d01] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0914 00:23:04.487595 1460604 system_pods.go:61] "csi-hostpath-resizer-0" [9a3a0a5f-6bfd-45c6-bf8b-e2b26f464523] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0914 00:23:04.487605 1460604 system_pods.go:61] "csi-hostpathplugin-f7rhq" [f9dcc47e-53f5-4d04-a45c-27b884956379] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0914 00:23:04.487615 1460604 system_pods.go:61] "etcd-addons-131319" [0890cf79-9024-4b26-9b79-a58e59a7de3d] Running
I0914 00:23:04.487623 1460604 system_pods.go:61] "kindnet-sshwv" [2901683e-8722-41d1-8ba0-02d7a59421e2] Running
I0914 00:23:04.487627 1460604 system_pods.go:61] "kube-apiserver-addons-131319" [5b68c9d0-3ac0-4d14-a978-5a5a76a0e2c7] Running
I0914 00:23:04.487650 1460604 system_pods.go:61] "kube-controller-manager-addons-131319" [a169ad4c-eeb2-4720-9b96-d559f8a82b1d] Running
I0914 00:23:04.487660 1460604 system_pods.go:61] "kube-ingress-dns-minikube" [d5e68c79-97b7-4709-a57e-70c7998c0956] Running
I0914 00:23:04.487664 1460604 system_pods.go:61] "kube-proxy-g7jvd" [fbb9c82c-6967-4c99-8fa7-74443e67ceb5] Running
I0914 00:23:04.487668 1460604 system_pods.go:61] "kube-scheduler-addons-131319" [28d6802f-2792-46de-ae45-4f9349e77b69] Running
I0914 00:23:04.487681 1460604 system_pods.go:61] "metrics-server-84c5f94fbc-ltmw6" [8091786a-c4c2-4358-bc15-288b7232a51f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0914 00:23:04.487689 1460604 system_pods.go:61] "nvidia-device-plugin-daemonset-88zhs" [72d14544-2ba6-426a-8bed-2ae9afb79959] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I0914 00:23:04.487699 1460604 system_pods.go:61] "registry-66c9cd494c-xcfqw" [2e57b878-f2f9-4d80-a055-4ca334d60419] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0914 00:23:04.487706 1460604 system_pods.go:61] "registry-proxy-thrrk" [505e6aed-b3d3-4b91-aaf7-d36064f56137] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0914 00:23:04.487737 1460604 system_pods.go:61] "snapshot-controller-56fcc65765-fvdpn" [0d0d0432-4d26-4386-85f3-3b35a1b001b2] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0914 00:23:04.487752 1460604 system_pods.go:61] "snapshot-controller-56fcc65765-knqhg" [6696ce31-48df-461f-bef7-9b39c21ddcc1] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0914 00:23:04.487761 1460604 system_pods.go:61] "storage-provisioner" [d8b157bc-0742-4773-a7e1-c5d81cf40dbc] Running
I0914 00:23:04.487773 1460604 system_pods.go:74] duration metric: took 150.158921ms to wait for pod list to return data ...
I0914 00:23:04.487782 1460604 default_sa.go:34] waiting for default service account to be created ...
I0914 00:23:04.568859 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:04.671236 1460604 default_sa.go:45] found service account: "default"
I0914 00:23:04.671266 1460604 default_sa.go:55] duration metric: took 183.473062ms for default service account to be created ...
I0914 00:23:04.671277 1460604 system_pods.go:116] waiting for k8s-apps to be running ...
I0914 00:23:04.731175 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:04.732182 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:04.881623 1460604 system_pods.go:86] 18 kube-system pods found
I0914 00:23:04.881723 1460604 system_pods.go:89] "coredns-7c65d6cfc9-dc7c8" [f382f521-0e1f-4364-a700-a7a7508f2be9] Running
I0914 00:23:04.881761 1460604 system_pods.go:89] "csi-hostpath-attacher-0" [54b9b4ab-4266-4f4a-a756-cea3af895d01] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0914 00:23:04.881790 1460604 system_pods.go:89] "csi-hostpath-resizer-0" [9a3a0a5f-6bfd-45c6-bf8b-e2b26f464523] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0914 00:23:04.881838 1460604 system_pods.go:89] "csi-hostpathplugin-f7rhq" [f9dcc47e-53f5-4d04-a45c-27b884956379] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0914 00:23:04.881870 1460604 system_pods.go:89] "etcd-addons-131319" [0890cf79-9024-4b26-9b79-a58e59a7de3d] Running
I0914 00:23:04.881893 1460604 system_pods.go:89] "kindnet-sshwv" [2901683e-8722-41d1-8ba0-02d7a59421e2] Running
I0914 00:23:04.881916 1460604 system_pods.go:89] "kube-apiserver-addons-131319" [5b68c9d0-3ac0-4d14-a978-5a5a76a0e2c7] Running
I0914 00:23:04.881938 1460604 system_pods.go:89] "kube-controller-manager-addons-131319" [a169ad4c-eeb2-4720-9b96-d559f8a82b1d] Running
I0914 00:23:04.881977 1460604 system_pods.go:89] "kube-ingress-dns-minikube" [d5e68c79-97b7-4709-a57e-70c7998c0956] Running
I0914 00:23:04.882008 1460604 system_pods.go:89] "kube-proxy-g7jvd" [fbb9c82c-6967-4c99-8fa7-74443e67ceb5] Running
I0914 00:23:04.882032 1460604 system_pods.go:89] "kube-scheduler-addons-131319" [28d6802f-2792-46de-ae45-4f9349e77b69] Running
I0914 00:23:04.882056 1460604 system_pods.go:89] "metrics-server-84c5f94fbc-ltmw6" [8091786a-c4c2-4358-bc15-288b7232a51f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0914 00:23:04.882083 1460604 system_pods.go:89] "nvidia-device-plugin-daemonset-88zhs" [72d14544-2ba6-426a-8bed-2ae9afb79959] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I0914 00:23:04.882117 1460604 system_pods.go:89] "registry-66c9cd494c-xcfqw" [2e57b878-f2f9-4d80-a055-4ca334d60419] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0914 00:23:04.882141 1460604 system_pods.go:89] "registry-proxy-thrrk" [505e6aed-b3d3-4b91-aaf7-d36064f56137] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0914 00:23:04.882164 1460604 system_pods.go:89] "snapshot-controller-56fcc65765-fvdpn" [0d0d0432-4d26-4386-85f3-3b35a1b001b2] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0914 00:23:04.882188 1460604 system_pods.go:89] "snapshot-controller-56fcc65765-knqhg" [6696ce31-48df-461f-bef7-9b39c21ddcc1] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0914 00:23:04.882218 1460604 system_pods.go:89] "storage-provisioner" [d8b157bc-0742-4773-a7e1-c5d81cf40dbc] Running
I0914 00:23:04.882250 1460604 system_pods.go:126] duration metric: took 210.964126ms to wait for k8s-apps to be running ...
I0914 00:23:04.882282 1460604 system_svc.go:44] waiting for kubelet service to be running ....
I0914 00:23:04.882364 1460604 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0914 00:23:04.905257 1460604 system_svc.go:56] duration metric: took 22.965443ms WaitForService to wait for kubelet
I0914 00:23:04.905326 1460604 kubeadm.go:582] duration metric: took 18.300565802s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0914 00:23:04.905360 1460604 node_conditions.go:102] verifying NodePressure condition ...
I0914 00:23:05.062756 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:05.072375 1460604 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0914 00:23:05.072410 1460604 node_conditions.go:123] node cpu capacity is 2
I0914 00:23:05.072424 1460604 node_conditions.go:105] duration metric: took 167.040996ms to run NodePressure ...
I0914 00:23:05.072437 1460604 start.go:241] waiting for startup goroutines ...
I0914 00:23:05.220416 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:05.221721 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:05.579169 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:05.720463 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:05.721267 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:06.062138 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:06.221544 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:06.223187 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:06.594379 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:06.723041 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:06.724406 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:07.063028 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:07.218191 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:07.220211 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:07.560877 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:07.723241 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:07.724798 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:08.060717 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:08.220593 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:08.220935 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:08.562162 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:08.719953 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:08.720656 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:09.062281 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:09.219425 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:09.220958 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:09.561498 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:09.718954 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:09.720263 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:10.060902 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:10.218625 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:10.219575 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:10.561267 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:10.717306 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:10.720021 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:11.067728 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:11.218251 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:11.222118 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:11.564469 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:11.719542 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:11.720681 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:12.061828 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:12.221440 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:12.222393 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:12.564162 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:12.717885 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:12.721524 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:13.062030 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:13.221199 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:13.222476 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:13.561420 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:13.717558 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:13.719884 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:14.061349 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:14.217927 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:14.220131 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:14.561916 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:14.720662 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:14.721737 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:15.062382 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:15.219517 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:15.220558 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:15.561373 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:15.717393 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:15.720324 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:16.061842 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:16.219640 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:16.221007 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:16.561063 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:16.720127 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:16.720909 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:17.062431 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:17.222122 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:17.223158 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:17.561476 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:17.720178 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:17.722360 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:18.062145 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:18.218817 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:18.219786 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:18.561023 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:18.718895 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:18.719957 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:19.061650 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:19.221864 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:19.222571 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:19.564544 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:19.723092 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:19.724509 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:20.062078 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:20.226610 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:20.227595 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:20.567204 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:20.736784 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:20.737685 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:21.062166 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:21.232135 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:21.233283 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:21.562696 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:21.721058 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:21.722463 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:22.062316 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:22.217079 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:22.220585 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:22.561314 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:22.720806 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:22.722575 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:23.060638 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:23.223168 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:23.224798 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:23.561273 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:23.718852 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:23.719361 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:24.061900 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:24.218078 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:24.219823 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:24.561646 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:24.719702 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:24.720829 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:25.062236 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:25.218667 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:25.220374 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:25.561204 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:25.718886 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:25.719249 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:26.061932 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:26.218765 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:26.220585 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:26.561758 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:26.720330 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:26.723193 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:27.062101 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:27.218059 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:27.221713 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:27.562389 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:27.722289 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:27.723987 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:28.061532 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:28.221239 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:28.223910 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:28.561642 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:28.718515 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:28.721649 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:29.061684 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:29.219483 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:29.220765 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:29.562837 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:29.722828 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:29.727134 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:30.063553 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:30.221399 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:30.222536 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:30.561702 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:30.729433 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:30.730400 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:31.062901 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:31.221211 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:31.221819 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:31.561231 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:31.719332 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:31.720555 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:32.061841 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:32.218255 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:32.222638 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:32.562204 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:32.719836 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:32.720278 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:33.063548 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:33.219773 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:33.220562 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:33.561493 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:33.719054 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:33.719634 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 00:23:34.065830 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:34.218281 1460604 kapi.go:107] duration metric: took 37.504880689s to wait for kubernetes.io/minikube-addons=registry ...
I0914 00:23:34.219836 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:34.562344 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:34.719700 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:35.061911 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:35.219886 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:35.563207 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:35.719832 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:36.066304 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:36.222137 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:36.561244 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:36.719039 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:37.061023 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:37.219929 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:37.561930 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:37.720453 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:38.062318 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:38.218951 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:38.560902 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:38.719380 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:39.061709 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:39.220257 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:39.560677 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:39.719565 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:40.061820 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:40.220317 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:40.562297 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:40.721702 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:41.062039 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:41.225485 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:41.561381 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:41.719665 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:42.061749 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:42.219465 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:42.561135 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:42.719994 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:43.062113 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:43.220103 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:43.561512 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:43.720297 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:44.061748 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:44.226373 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:44.563734 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:44.722127 1460604 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 00:23:45.064971 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:45.223225 1460604 kapi.go:107] duration metric: took 48.508480327s to wait for app.kubernetes.io/name=ingress-nginx ...
I0914 00:23:45.562799 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:46.061502 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:46.569700 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:47.062300 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:47.561826 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:48.062667 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:48.561368 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:49.061446 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:49.561776 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:50.060941 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:50.560882 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:51.061210 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:51.564926 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:52.060432 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:52.560738 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 00:23:53.061653 1460604 kapi.go:107] duration metric: took 55.505559996s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0914 00:24:22.329485 1460604 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0914 00:24:22.329521 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:22.829899 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:23.329843 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:23.830462 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:24.329582 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:24.829934 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:25.329609 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:25.831204 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:26.329651 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:26.830044 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:27.330038 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:27.830953 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:28.329290 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:28.830296 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:29.330039 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:29.829539 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:30.329313 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:30.829778 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:31.328882 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:31.829799 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:32.329189 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:32.829736 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:33.329762 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:33.830312 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:34.329633 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:34.829838 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:35.329821 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:35.829960 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:36.329218 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:36.829891 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:37.329669 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:37.829842 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:38.329906 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:38.829820 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:39.329905 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:39.830870 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:40.330550 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:40.829816 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:41.329989 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:41.829988 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:42.329787 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:42.829842 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:43.329875 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:43.830617 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:44.329852 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:44.829973 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:45.330265 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:45.830596 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:46.329192 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:46.830328 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:47.329285 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:47.829873 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:48.329641 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:48.829867 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:49.330408 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:49.830446 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:50.329768 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:50.830149 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:51.329604 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:51.830276 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:52.330061 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:52.829922 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:53.329575 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:53.830806 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:54.329231 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:54.829501 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:55.330042 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:55.830183 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:56.329570 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:56.830152 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:57.329967 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:57.829883 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:58.328938 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:58.831777 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:59.329745 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:24:59.829911 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:00.367296 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:00.829141 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:01.330395 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:01.845985 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:02.330691 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:02.829931 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:03.330195 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:03.830415 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:04.329741 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:04.829606 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:05.336000 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:05.831711 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:06.329667 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:06.829422 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:07.329284 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:07.829859 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:08.329870 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:08.829523 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:09.329328 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:09.829828 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:10.329791 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:10.830448 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:11.330228 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:11.829514 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:12.329741 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:12.829575 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:13.330163 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:13.830484 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:14.330636 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:14.829053 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:15.329666 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:15.829780 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:16.328977 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:16.830390 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:17.328793 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:17.830050 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:18.329882 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:18.829313 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:19.329096 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:19.830391 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:20.329989 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:20.829687 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:21.329058 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:21.831278 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:22.328845 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:22.829546 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:23.331415 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:23.829877 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:24.330244 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:24.830067 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:25.329946 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:25.829864 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:26.329729 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:26.829484 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:27.329976 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:27.829462 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:28.329302 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:28.829425 1460604 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 00:25:29.329395 1460604 kapi.go:107] duration metric: took 2m30.50364767s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0914 00:25:29.331722 1460604 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-131319 cluster.
I0914 00:25:29.333351 1460604 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0914 00:25:29.335145 1460604 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0914 00:25:29.337087 1460604 out.go:177] * Enabled addons: volcano, storage-provisioner, nvidia-device-plugin, ingress-dns, cloud-spanner, metrics-server, inspektor-gadget, yakd, default-storageclass, volumesnapshots, registry, ingress, csi-hostpath-driver, gcp-auth
I0914 00:25:29.338877 1460604 addons.go:510] duration metric: took 2m42.733711257s for enable addons: enabled=[volcano storage-provisioner nvidia-device-plugin ingress-dns cloud-spanner metrics-server inspektor-gadget yakd default-storageclass volumesnapshots registry ingress csi-hostpath-driver gcp-auth]
I0914 00:25:29.338930 1460604 start.go:246] waiting for cluster config update ...
I0914 00:25:29.338951 1460604 start.go:255] writing updated cluster config ...
I0914 00:25:29.339745 1460604 ssh_runner.go:195] Run: rm -f paused
I0914 00:25:29.675558 1460604 start.go:600] kubectl: 1.31.0, cluster: 1.31.1 (minor skew: 0)
I0914 00:25:29.677509 1460604 out.go:177] * Done! kubectl is now configured to use "addons-131319" cluster and "default" namespace by default
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
108b7f75da8ea 4f725bf50aaa5 2 minutes ago Exited gadget 5 de44d19e07013 gadget-b9bjg
74d0946366e2e 6ef582f3ec844 3 minutes ago Running gcp-auth 0 de73d4db0924b gcp-auth-89d5ffd79-kk2v5
88e428d747c98 8b46b1cd48760 4 minutes ago Running admission 0 2be4cd59d0a1f volcano-admission-77d7d48b68-spsmg
c4896bd718553 ee6d597e62dc8 4 minutes ago Running csi-snapshotter 0 405ca1e3ecd30 csi-hostpathplugin-f7rhq
b9171e5c8d21a 642ded511e141 4 minutes ago Running csi-provisioner 0 405ca1e3ecd30 csi-hostpathplugin-f7rhq
02b4145f17cb5 922312104da8a 5 minutes ago Running liveness-probe 0 405ca1e3ecd30 csi-hostpathplugin-f7rhq
3be6826d2fcd6 08f6b2990811a 5 minutes ago Running hostpath 0 405ca1e3ecd30 csi-hostpathplugin-f7rhq
99d17f11c4e1f 0107d56dbc0be 5 minutes ago Running node-driver-registrar 0 405ca1e3ecd30 csi-hostpathplugin-f7rhq
33ecd942767b0 289a818c8d9c5 5 minutes ago Running controller 0 4e4dddb5916c0 ingress-nginx-controller-bc57996ff-hwbq4
6fe010a1c6421 487fa743e1e22 5 minutes ago Running csi-resizer 0 06b3635d1b33f csi-hostpath-resizer-0
4c187c63839f1 1505f556b3a7b 5 minutes ago Running volcano-controllers 0 36f8ff5c62a68 volcano-controllers-56675bb4d5-7cvvq
44711f8016161 1461903ec4fe9 5 minutes ago Running csi-external-health-monitor-controller 0 405ca1e3ecd30 csi-hostpathplugin-f7rhq
1b9d6b3ea6acc 9a80d518f102c 5 minutes ago Running csi-attacher 0 03a81566076de csi-hostpath-attacher-0
e52a3d3549513 c9cf76bb104e1 5 minutes ago Running registry 0 da56f8e4b51c7 registry-66c9cd494c-xcfqw
2a8301c12071a 420193b27261a 5 minutes ago Exited patch 0 2b9270c673f56 ingress-nginx-admission-patch-6x4vs
c3e3df4dc49f5 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 18fded48ba9d7 snapshot-controller-56fcc65765-knqhg
47610afe825af 3410e1561990a 5 minutes ago Running registry-proxy 0 78df62aa03393 registry-proxy-thrrk
9720d9bb49947 7ce2150c8929b 5 minutes ago Running local-path-provisioner 0 23fa04c664209 local-path-provisioner-86d989889c-d7dnn
331bd580804b6 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 6d593daf47e79 snapshot-controller-56fcc65765-fvdpn
891e7b6f9bdc1 420193b27261a 5 minutes ago Exited create 0 c0d700512212e ingress-nginx-admission-create-h4ssl
8789c36f6ec1f 5548a49bb60ba 5 minutes ago Running metrics-server 0 0ea7a55596632 metrics-server-84c5f94fbc-ltmw6
beeec4a56c138 8be4bcf8ec607 5 minutes ago Running cloud-spanner-emulator 0 a8fc47f839bb7 cloud-spanner-emulator-769b77f747-7qcsk
a62dc2e18abef a9bac31a5be8d 5 minutes ago Running nvidia-device-plugin-ctr 0 df9ac4886250b nvidia-device-plugin-daemonset-88zhs
978afd77bb4d1 77bdba588b953 5 minutes ago Running yakd 0 507bca89b0462 yakd-dashboard-67d98fc6b-fn4qh
ce5d8255ca4e9 d9c7ad4c226bf 5 minutes ago Running volcano-scheduler 0 f52d053271600 volcano-scheduler-576bc46687-dj5ch
b6cd0934c237b 2f6c962e7b831 5 minutes ago Running coredns 0 3b28aef783143 coredns-7c65d6cfc9-dc7c8
f3e2770051789 35508c2f890c4 5 minutes ago Running minikube-ingress-dns 0 a1effe5d972cc kube-ingress-dns-minikube
8e4d3c8ad3a1e ba04bb24b9575 5 minutes ago Running storage-provisioner 0 0b0d5c4cf427c storage-provisioner
f133c3aa865ad 6a23fa8fd2b78 6 minutes ago Running kindnet-cni 0 db10826d0f633 kindnet-sshwv
964775faf6059 24a140c548c07 6 minutes ago Running kube-proxy 0 47fdd7b6507e5 kube-proxy-g7jvd
53568138a0177 279f381cb3736 6 minutes ago Running kube-controller-manager 0 2daaad2600387 kube-controller-manager-addons-131319
4ba9b8f45896a 7f8aa378bb47d 6 minutes ago Running kube-scheduler 0 a68f7b01d52c0 kube-scheduler-addons-131319
9089dc82f69c6 27e3830e14027 6 minutes ago Running etcd 0 32b0cdcf31f9d etcd-addons-131319
d1f5b9ef5bfa0 d3f53a98c0a9d 6 minutes ago Running kube-apiserver 0 a601370270c66 kube-apiserver-addons-131319
==> containerd <==
Sep 14 00:25:41 addons-131319 containerd[813]: time="2024-09-14T00:25:41.415472808Z" level=info msg="RemovePodSandbox \"107e8500aa37845a89e5f374ee59781f3de320659d4d4301b90552db6d52b14c\" returns successfully"
Sep 14 00:26:25 addons-131319 containerd[813]: time="2024-09-14T00:26:25.265739062Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\""
Sep 14 00:26:25 addons-131319 containerd[813]: time="2024-09-14T00:26:25.381360348Z" level=info msg="ImageUpdate event name:\"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}"
Sep 14 00:26:25 addons-131319 containerd[813]: time="2024-09-14T00:26:25.390978128Z" level=info msg="stop pulling image ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec: active requests=0, bytes read=89"
Sep 14 00:26:25 addons-131319 containerd[813]: time="2024-09-14T00:26:25.394257042Z" level=info msg="Pulled image \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\" with image id \"sha256:4f725bf50aaa5c697fbb84c107e9c7a3766f0f85f514ffce712d03ee5f62e8dd\", repo tag \"\", repo digest \"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\", size \"72524105\" in 128.469947ms"
Sep 14 00:26:25 addons-131319 containerd[813]: time="2024-09-14T00:26:25.394306322Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\" returns image reference \"sha256:4f725bf50aaa5c697fbb84c107e9c7a3766f0f85f514ffce712d03ee5f62e8dd\""
Sep 14 00:26:25 addons-131319 containerd[813]: time="2024-09-14T00:26:25.396756389Z" level=info msg="CreateContainer within sandbox \"de44d19e07013fd1fb43267d52b5499c4a3d6d5716b7ee4954006312a5672723\" for container &ContainerMetadata{Name:gadget,Attempt:5,}"
Sep 14 00:26:25 addons-131319 containerd[813]: time="2024-09-14T00:26:25.414029347Z" level=info msg="CreateContainer within sandbox \"de44d19e07013fd1fb43267d52b5499c4a3d6d5716b7ee4954006312a5672723\" for &ContainerMetadata{Name:gadget,Attempt:5,} returns container id \"108b7f75da8ea443242bab77e3434854cbf274bbb2af21111179638a7a7b131c\""
Sep 14 00:26:25 addons-131319 containerd[813]: time="2024-09-14T00:26:25.414718838Z" level=info msg="StartContainer for \"108b7f75da8ea443242bab77e3434854cbf274bbb2af21111179638a7a7b131c\""
Sep 14 00:26:25 addons-131319 containerd[813]: time="2024-09-14T00:26:25.469317960Z" level=info msg="StartContainer for \"108b7f75da8ea443242bab77e3434854cbf274bbb2af21111179638a7a7b131c\" returns successfully"
Sep 14 00:26:26 addons-131319 containerd[813]: time="2024-09-14T00:26:26.975837495Z" level=info msg="shim disconnected" id=108b7f75da8ea443242bab77e3434854cbf274bbb2af21111179638a7a7b131c namespace=k8s.io
Sep 14 00:26:26 addons-131319 containerd[813]: time="2024-09-14T00:26:26.975971205Z" level=warning msg="cleaning up after shim disconnected" id=108b7f75da8ea443242bab77e3434854cbf274bbb2af21111179638a7a7b131c namespace=k8s.io
Sep 14 00:26:26 addons-131319 containerd[813]: time="2024-09-14T00:26:26.975982914Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Sep 14 00:26:27 addons-131319 containerd[813]: time="2024-09-14T00:26:27.374256571Z" level=info msg="RemoveContainer for \"36b97ad0ea110724c3456b6108bc5d0621d8cb1afac74756e5bff2368fee29f8\""
Sep 14 00:26:27 addons-131319 containerd[813]: time="2024-09-14T00:26:27.381691138Z" level=info msg="RemoveContainer for \"36b97ad0ea110724c3456b6108bc5d0621d8cb1afac74756e5bff2368fee29f8\" returns successfully"
Sep 14 00:26:41 addons-131319 containerd[813]: time="2024-09-14T00:26:41.419824179Z" level=info msg="RemoveContainer for \"4f7cdcddc5bf22e2e05fa81c5f60a5b6f2065f35472bff040f40336e76736e6a\""
Sep 14 00:26:41 addons-131319 containerd[813]: time="2024-09-14T00:26:41.427602368Z" level=info msg="RemoveContainer for \"4f7cdcddc5bf22e2e05fa81c5f60a5b6f2065f35472bff040f40336e76736e6a\" returns successfully"
Sep 14 00:26:41 addons-131319 containerd[813]: time="2024-09-14T00:26:41.431954230Z" level=info msg="StopPodSandbox for \"673f90123f851ff664968138832c5843ca183c14aa75e72c5f1b516f96b5ff78\""
Sep 14 00:26:41 addons-131319 containerd[813]: time="2024-09-14T00:26:41.441177787Z" level=info msg="TearDown network for sandbox \"673f90123f851ff664968138832c5843ca183c14aa75e72c5f1b516f96b5ff78\" successfully"
Sep 14 00:26:41 addons-131319 containerd[813]: time="2024-09-14T00:26:41.441217910Z" level=info msg="StopPodSandbox for \"673f90123f851ff664968138832c5843ca183c14aa75e72c5f1b516f96b5ff78\" returns successfully"
Sep 14 00:26:41 addons-131319 containerd[813]: time="2024-09-14T00:26:41.441708198Z" level=info msg="RemovePodSandbox for \"673f90123f851ff664968138832c5843ca183c14aa75e72c5f1b516f96b5ff78\""
Sep 14 00:26:41 addons-131319 containerd[813]: time="2024-09-14T00:26:41.441757822Z" level=info msg="Forcibly stopping sandbox \"673f90123f851ff664968138832c5843ca183c14aa75e72c5f1b516f96b5ff78\""
Sep 14 00:26:41 addons-131319 containerd[813]: time="2024-09-14T00:26:41.449906881Z" level=info msg="TearDown network for sandbox \"673f90123f851ff664968138832c5843ca183c14aa75e72c5f1b516f96b5ff78\" successfully"
Sep 14 00:26:41 addons-131319 containerd[813]: time="2024-09-14T00:26:41.457375984Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"673f90123f851ff664968138832c5843ca183c14aa75e72c5f1b516f96b5ff78\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus."
Sep 14 00:26:41 addons-131319 containerd[813]: time="2024-09-14T00:26:41.457496984Z" level=info msg="RemovePodSandbox \"673f90123f851ff664968138832c5843ca183c14aa75e72c5f1b516f96b5ff78\" returns successfully"
==> coredns [b6cd0934c237b612e42e84be7571250f808d19083ad528df10aaa8aea3e6d1db] <==
[INFO] 10.244.0.8:55648 - 14140 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000039081s
[INFO] 10.244.0.8:54885 - 1528 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001627383s
[INFO] 10.244.0.8:54885 - 6906 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001849077s
[INFO] 10.244.0.8:38923 - 27202 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000055664s
[INFO] 10.244.0.8:38923 - 30016 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000037465s
[INFO] 10.244.0.8:36250 - 58725 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000146757s
[INFO] 10.244.0.8:36250 - 65377 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000036119s
[INFO] 10.244.0.8:41080 - 47214 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000059307s
[INFO] 10.244.0.8:41080 - 60259 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000034223s
[INFO] 10.244.0.8:51163 - 58644 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000038958s
[INFO] 10.244.0.8:51163 - 53270 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000043512s
[INFO] 10.244.0.8:37387 - 4232 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.009740118s
[INFO] 10.244.0.8:37387 - 9350 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.010484353s
[INFO] 10.244.0.8:32918 - 15857 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000048188s
[INFO] 10.244.0.8:32918 - 11508 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000038876s
[INFO] 10.244.0.24:60777 - 36020 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.00032269s
[INFO] 10.244.0.24:52759 - 55462 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.00025746s
[INFO] 10.244.0.24:57641 - 16333 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.00019314s
[INFO] 10.244.0.24:57550 - 43973 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.00011771s
[INFO] 10.244.0.24:35114 - 11496 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000138674s
[INFO] 10.244.0.24:56302 - 33754 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000094925s
[INFO] 10.244.0.24:42107 - 50909 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002746346s
[INFO] 10.244.0.24:47569 - 56000 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002876388s
[INFO] 10.244.0.24:45818 - 23619 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.001572212s
[INFO] 10.244.0.24:38865 - 59979 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 648 0.001723908s
==> describe nodes <==
Name: addons-131319
Roles: control-plane
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=addons-131319
kubernetes.io/os=linux
minikube.k8s.io/commit=7ca96ba7bd97af6e0063398921096f1cca785d18
minikube.k8s.io/name=addons-131319
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_09_14T00_22_42_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-131319
Annotations: csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-131319"}
kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 14 Sep 2024 00:22:38 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-131319
AcquireTime: <unset>
RenewTime: Sat, 14 Sep 2024 00:28:48 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 14 Sep 2024 00:25:44 +0000 Sat, 14 Sep 2024 00:22:35 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 14 Sep 2024 00:25:44 +0000 Sat, 14 Sep 2024 00:22:35 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 14 Sep 2024 00:25:44 +0000 Sat, 14 Sep 2024 00:22:35 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sat, 14 Sep 2024 00:25:44 +0000 Sat, 14 Sep 2024 00:22:39 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-131319
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022296Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022296Ki
pods: 110
System Info:
Machine ID: 90f06a4a5d3a40ecbdee7641d80edad0
System UUID: 8dedbe16-f400-409f-9a74-40bad6de1869
Boot ID: 31d76137-2e5d-4866-b75b-16f7e69e7ff6
Kernel Version: 5.15.0-1069-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.22
Kubelet Version: v1.31.1
Kube-Proxy Version: v1.31.1
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (27 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default cloud-spanner-emulator-769b77f747-7qcsk 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m59s
gadget gadget-b9bjg 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
gcp-auth gcp-auth-89d5ffd79-kk2v5 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m28s
ingress-nginx ingress-nginx-controller-bc57996ff-hwbq4 100m (5%) 0 (0%) 90Mi (1%) 0 (0%) 5m55s
kube-system coredns-7c65d6cfc9-dc7c8 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 6m3s
kube-system csi-hostpath-attacher-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
kube-system csi-hostpath-resizer-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
kube-system csi-hostpathplugin-f7rhq 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
kube-system etcd-addons-131319 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 6m8s
kube-system kindnet-sshwv 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 6m4s
kube-system kube-apiserver-addons-131319 250m (12%) 0 (0%) 0 (0%) 0 (0%) 6m8s
kube-system kube-controller-manager-addons-131319 200m (10%) 0 (0%) 0 (0%) 0 (0%) 6m9s
kube-system kube-ingress-dns-minikube 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m59s
kube-system kube-proxy-g7jvd 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m4s
kube-system kube-scheduler-addons-131319 100m (5%) 0 (0%) 0 (0%) 0 (0%) 6m10s
kube-system metrics-server-84c5f94fbc-ltmw6 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 5m58s
kube-system nvidia-device-plugin-daemonset-88zhs 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m
kube-system registry-66c9cd494c-xcfqw 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
kube-system registry-proxy-thrrk 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
kube-system snapshot-controller-56fcc65765-fvdpn 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
kube-system snapshot-controller-56fcc65765-knqhg 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
local-path-storage local-path-provisioner-86d989889c-d7dnn 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
volcano-system volcano-admission-77d7d48b68-spsmg 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m54s
volcano-system volcano-controllers-56675bb4d5-7cvvq 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m54s
volcano-system volcano-scheduler-576bc46687-dj5ch 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m53s
yakd-dashboard yakd-dashboard-67d98fc6b-fn4qh 0 (0%) 0 (0%) 128Mi (1%) 256Mi (3%) 5m58s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 1050m (52%) 100m (5%)
memory 638Mi (8%) 476Mi (6%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 6m1s kube-proxy
Normal Starting 6m8s kubelet Starting kubelet.
Warning CgroupV1 6m8s kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeAllocatableEnforced 6m8s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 6m8s kubelet Node addons-131319 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m8s kubelet Node addons-131319 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m8s kubelet Node addons-131319 status is now: NodeHasSufficientPID
Normal RegisteredNode 6m4s node-controller Node addons-131319 event: Registered Node addons-131319 in Controller
==> dmesg <==
==> etcd [9089dc82f69c668d9f6f7c3aa3a61bfbf8fe4899afe3d714436a0638df4f3cd0] <==
{"level":"info","ts":"2024-09-14T00:22:35.170007Z","caller":"embed/etcd.go:728","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
{"level":"info","ts":"2024-09-14T00:22:35.170245Z","caller":"embed/etcd.go:279","msg":"now serving peer/client/metrics","local-member-id":"aec36adc501070cc","initial-advertise-peer-urls":["https://192.168.49.2:2380"],"listen-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.49.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
{"level":"info","ts":"2024-09-14T00:22:35.170273Z","caller":"embed/etcd.go:870","msg":"serving metrics","address":"http://127.0.0.1:2381"}
{"level":"info","ts":"2024-09-14T00:22:35.176655Z","caller":"embed/etcd.go:599","msg":"serving peer traffic","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-09-14T00:22:35.176686Z","caller":"embed/etcd.go:571","msg":"cmux::serve","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-09-14T00:22:35.234790Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
{"level":"info","ts":"2024-09-14T00:22:35.234865Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
{"level":"info","ts":"2024-09-14T00:22:35.234911Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
{"level":"info","ts":"2024-09-14T00:22:35.234934Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
{"level":"info","ts":"2024-09-14T00:22:35.234942Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-14T00:22:35.234953Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
{"level":"info","ts":"2024-09-14T00:22:35.234974Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-14T00:22:35.235813Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-14T00:22:35.236119Z","caller":"etcdserver/server.go:2629","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-14T00:22:35.235787Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-131319 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
{"level":"info","ts":"2024-09-14T00:22:35.237500Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-14T00:22:35.243616Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-14T00:22:35.244651Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
{"level":"info","ts":"2024-09-14T00:22:35.244939Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-14T00:22:35.245177Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-14T00:22:35.245275Z","caller":"etcdserver/server.go:2653","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-14T00:22:35.246571Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-14T00:22:35.247884Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-09-14T00:22:35.248013Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-09-14T00:22:35.252793Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
==> gcp-auth [74d0946366e2e0e98ee81d93789e9a51aacab98320087546ac10bf339a5dcbdf] <==
2024/09/14 00:25:29 GCP Auth Webhook started!
2024/09/14 00:25:47 Ready to marshal response ...
2024/09/14 00:25:47 Ready to write response ...
2024/09/14 00:25:47 Ready to marshal response ...
2024/09/14 00:25:47 Ready to write response ...
==> kernel <==
00:28:49 up 8:11, 0 users, load average: 0.42, 1.12, 1.93
Linux addons-131319 5.15.0-1069-aws #75~20.04.1-Ubuntu SMP Mon Aug 19 16:22:47 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [f133c3aa865ada398faab5ba5c9622ab842c01f127b5eb4e41db89dd7b0fa0ff] <==
I0914 00:26:47.937604 1 main.go:299] handling current node
I0914 00:26:57.944391 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0914 00:26:57.944428 1 main.go:299] handling current node
I0914 00:27:07.944263 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0914 00:27:07.944300 1 main.go:299] handling current node
I0914 00:27:17.943977 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0914 00:27:17.944012 1 main.go:299] handling current node
I0914 00:27:27.944076 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0914 00:27:27.944112 1 main.go:299] handling current node
I0914 00:27:37.940153 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0914 00:27:37.940256 1 main.go:299] handling current node
I0914 00:27:47.937165 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0914 00:27:47.937202 1 main.go:299] handling current node
I0914 00:27:57.944000 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0914 00:27:57.944040 1 main.go:299] handling current node
I0914 00:28:07.942279 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0914 00:28:07.942485 1 main.go:299] handling current node
I0914 00:28:17.946212 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0914 00:28:17.946250 1 main.go:299] handling current node
I0914 00:28:27.944098 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0914 00:28:27.944135 1 main.go:299] handling current node
I0914 00:28:37.943619 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0914 00:28:37.943655 1 main.go:299] handling current node
I0914 00:28:47.937054 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0914 00:28:47.937096 1 main.go:299] handling current node
==> kube-apiserver [d1f5b9ef5bfa066787a6c775722496e2a1dc7a4b2f115d878a90f0c9754a6386] <==
W0914 00:23:56.216070 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.98.89.59:443: connect: connection refused
W0914 00:23:57.261920 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.98.89.59:443: connect: connection refused
W0914 00:23:58.342619 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.98.89.59:443: connect: connection refused
W0914 00:23:59.375877 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.98.89.59:443: connect: connection refused
W0914 00:24:00.449717 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.98.89.59:443: connect: connection refused
W0914 00:24:01.507068 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.98.89.59:443: connect: connection refused
W0914 00:24:01.801224 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.104.150.67:443: connect: connection refused
E0914 00:24:01.801261 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.104.150.67:443: connect: connection refused" logger="UnhandledError"
W0914 00:24:01.803158 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.98.89.59:443: connect: connection refused
W0914 00:24:01.855366 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.104.150.67:443: connect: connection refused
E0914 00:24:01.855424 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.104.150.67:443: connect: connection refused" logger="UnhandledError"
W0914 00:24:01.857106 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.98.89.59:443: connect: connection refused
W0914 00:24:02.570028 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.98.89.59:443: connect: connection refused
W0914 00:24:03.667636 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.98.89.59:443: connect: connection refused
W0914 00:24:04.739605 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.98.89.59:443: connect: connection refused
W0914 00:24:05.818963 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.98.89.59:443: connect: connection refused
W0914 00:24:06.856669 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.98.89.59:443: connect: connection refused
W0914 00:24:21.834609 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.104.150.67:443: connect: connection refused
E0914 00:24:21.834651 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.104.150.67:443: connect: connection refused" logger="UnhandledError"
W0914 00:25:01.813968 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.104.150.67:443: connect: connection refused
E0914 00:25:01.814010 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.104.150.67:443: connect: connection refused" logger="UnhandledError"
W0914 00:25:01.863083 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.104.150.67:443: connect: connection refused
E0914 00:25:01.863128 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.104.150.67:443: connect: connection refused" logger="UnhandledError"
I0914 00:25:47.187194 1 controller.go:615] quota admission added evaluator for: jobs.batch.volcano.sh
I0914 00:25:47.229865 1 controller.go:615] quota admission added evaluator for: podgroups.scheduling.volcano.sh
==> kube-controller-manager [53568138a017764dc6f802a284d64a686a04947f679e556c770cfe0277740a84] <==
I0914 00:25:01.832271 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0914 00:25:01.840633 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0914 00:25:01.858535 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0914 00:25:01.873283 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0914 00:25:01.885596 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0914 00:25:01.889265 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0914 00:25:01.903094 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0914 00:25:03.083395 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0914 00:25:03.099016 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0914 00:25:04.286439 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0914 00:25:04.309583 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0914 00:25:05.292079 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0914 00:25:05.302912 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0914 00:25:05.317882 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0914 00:25:05.321516 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0914 00:25:05.334600 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0914 00:25:05.342931 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0914 00:25:29.201108 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="7.955213ms"
I0914 00:25:29.201403 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="73.862µs"
I0914 00:25:35.033470 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0914 00:25:35.037587 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0914 00:25:35.102204 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0914 00:25:35.102392 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0914 00:25:44.595071 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-131319"
I0914 00:25:46.920467 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="volcano-system/volcano-admission-init" delay="0s"
==> kube-proxy [964775faf605959f1ba5da1801a5937e9d1741e10dc4a9f3ef9ef2c052851941] <==
I0914 00:22:47.650022 1 server_linux.go:66] "Using iptables proxy"
I0914 00:22:47.753654 1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
E0914 00:22:47.753717 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I0914 00:22:47.794189 1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I0914 00:22:47.794256 1 server_linux.go:169] "Using iptables Proxier"
I0914 00:22:47.797524 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I0914 00:22:47.797800 1 server.go:483] "Version info" version="v1.31.1"
I0914 00:22:47.797815 1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0914 00:22:47.812097 1 config.go:199] "Starting service config controller"
I0914 00:22:47.812143 1 shared_informer.go:313] Waiting for caches to sync for service config
I0914 00:22:47.812181 1 config.go:105] "Starting endpoint slice config controller"
I0914 00:22:47.812186 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0914 00:22:47.812716 1 config.go:328] "Starting node config controller"
I0914 00:22:47.812724 1 shared_informer.go:313] Waiting for caches to sync for node config
I0914 00:22:47.913131 1 shared_informer.go:320] Caches are synced for service config
I0914 00:22:47.913206 1 shared_informer.go:320] Caches are synced for endpoint slice config
I0914 00:22:47.913435 1 shared_informer.go:320] Caches are synced for node config
==> kube-scheduler [4ba9b8f45896a6445789235b1630f5df1d05e270f1e275e7e649ca03399c90bb] <==
W0914 00:22:38.609049 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0914 00:22:38.609349 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0914 00:22:38.609116 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0914 00:22:38.609452 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0914 00:22:39.471338 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0914 00:22:39.471591 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0914 00:22:39.482913 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
E0914 00:22:39.483183 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0914 00:22:39.487378 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0914 00:22:39.487619 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0914 00:22:39.505439 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0914 00:22:39.505493 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0914 00:22:39.576166 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0914 00:22:39.576400 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0914 00:22:39.646432 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0914 00:22:39.646762 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0914 00:22:39.654984 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0914 00:22:39.655219 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0914 00:22:39.785809 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0914 00:22:39.785934 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0914 00:22:39.790943 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0914 00:22:39.791150 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0914 00:22:39.844014 1 reflector.go:561] runtime/asm_arm64.s:1222: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0914 00:22:39.844258 1 reflector.go:158] "Unhandled Error" err="runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"
I0914 00:22:41.984866 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Sep 14 00:26:42 addons-131319 kubelet[1497]: E0914 00:26:42.264977 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b9bjg_gadget(ae425b35-7f17-4690-9b72-1a07b89405a6)\"" pod="gadget/gadget-b9bjg" podUID="ae425b35-7f17-4690-9b72-1a07b89405a6"
Sep 14 00:26:55 addons-131319 kubelet[1497]: I0914 00:26:55.264771 1497 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-88zhs" secret="" err="secret \"gcp-auth\" not found"
Sep 14 00:26:55 addons-131319 kubelet[1497]: I0914 00:26:55.266487 1497 scope.go:117] "RemoveContainer" containerID="108b7f75da8ea443242bab77e3434854cbf274bbb2af21111179638a7a7b131c"
Sep 14 00:26:55 addons-131319 kubelet[1497]: E0914 00:26:55.266845 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b9bjg_gadget(ae425b35-7f17-4690-9b72-1a07b89405a6)\"" pod="gadget/gadget-b9bjg" podUID="ae425b35-7f17-4690-9b72-1a07b89405a6"
Sep 14 00:27:07 addons-131319 kubelet[1497]: I0914 00:27:07.264423 1497 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-66c9cd494c-xcfqw" secret="" err="secret \"gcp-auth\" not found"
Sep 14 00:27:07 addons-131319 kubelet[1497]: I0914 00:27:07.265366 1497 scope.go:117] "RemoveContainer" containerID="108b7f75da8ea443242bab77e3434854cbf274bbb2af21111179638a7a7b131c"
Sep 14 00:27:07 addons-131319 kubelet[1497]: E0914 00:27:07.265519 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b9bjg_gadget(ae425b35-7f17-4690-9b72-1a07b89405a6)\"" pod="gadget/gadget-b9bjg" podUID="ae425b35-7f17-4690-9b72-1a07b89405a6"
Sep 14 00:27:16 addons-131319 kubelet[1497]: I0914 00:27:16.264924 1497 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-thrrk" secret="" err="secret \"gcp-auth\" not found"
Sep 14 00:27:18 addons-131319 kubelet[1497]: I0914 00:27:18.264108 1497 scope.go:117] "RemoveContainer" containerID="108b7f75da8ea443242bab77e3434854cbf274bbb2af21111179638a7a7b131c"
Sep 14 00:27:18 addons-131319 kubelet[1497]: E0914 00:27:18.264323 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b9bjg_gadget(ae425b35-7f17-4690-9b72-1a07b89405a6)\"" pod="gadget/gadget-b9bjg" podUID="ae425b35-7f17-4690-9b72-1a07b89405a6"
Sep 14 00:27:33 addons-131319 kubelet[1497]: I0914 00:27:33.264791 1497 scope.go:117] "RemoveContainer" containerID="108b7f75da8ea443242bab77e3434854cbf274bbb2af21111179638a7a7b131c"
Sep 14 00:27:33 addons-131319 kubelet[1497]: E0914 00:27:33.265486 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b9bjg_gadget(ae425b35-7f17-4690-9b72-1a07b89405a6)\"" pod="gadget/gadget-b9bjg" podUID="ae425b35-7f17-4690-9b72-1a07b89405a6"
Sep 14 00:27:48 addons-131319 kubelet[1497]: I0914 00:27:48.264448 1497 scope.go:117] "RemoveContainer" containerID="108b7f75da8ea443242bab77e3434854cbf274bbb2af21111179638a7a7b131c"
Sep 14 00:27:48 addons-131319 kubelet[1497]: E0914 00:27:48.265104 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b9bjg_gadget(ae425b35-7f17-4690-9b72-1a07b89405a6)\"" pod="gadget/gadget-b9bjg" podUID="ae425b35-7f17-4690-9b72-1a07b89405a6"
Sep 14 00:27:57 addons-131319 kubelet[1497]: I0914 00:27:57.264944 1497 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-88zhs" secret="" err="secret \"gcp-auth\" not found"
Sep 14 00:28:01 addons-131319 kubelet[1497]: I0914 00:28:01.271541 1497 scope.go:117] "RemoveContainer" containerID="108b7f75da8ea443242bab77e3434854cbf274bbb2af21111179638a7a7b131c"
Sep 14 00:28:01 addons-131319 kubelet[1497]: E0914 00:28:01.272282 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b9bjg_gadget(ae425b35-7f17-4690-9b72-1a07b89405a6)\"" pod="gadget/gadget-b9bjg" podUID="ae425b35-7f17-4690-9b72-1a07b89405a6"
Sep 14 00:28:12 addons-131319 kubelet[1497]: I0914 00:28:12.264519 1497 scope.go:117] "RemoveContainer" containerID="108b7f75da8ea443242bab77e3434854cbf274bbb2af21111179638a7a7b131c"
Sep 14 00:28:12 addons-131319 kubelet[1497]: E0914 00:28:12.264723 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b9bjg_gadget(ae425b35-7f17-4690-9b72-1a07b89405a6)\"" pod="gadget/gadget-b9bjg" podUID="ae425b35-7f17-4690-9b72-1a07b89405a6"
Sep 14 00:28:26 addons-131319 kubelet[1497]: I0914 00:28:26.264497 1497 scope.go:117] "RemoveContainer" containerID="108b7f75da8ea443242bab77e3434854cbf274bbb2af21111179638a7a7b131c"
Sep 14 00:28:26 addons-131319 kubelet[1497]: E0914 00:28:26.264704 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b9bjg_gadget(ae425b35-7f17-4690-9b72-1a07b89405a6)\"" pod="gadget/gadget-b9bjg" podUID="ae425b35-7f17-4690-9b72-1a07b89405a6"
Sep 14 00:28:36 addons-131319 kubelet[1497]: I0914 00:28:36.264071 1497 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-66c9cd494c-xcfqw" secret="" err="secret \"gcp-auth\" not found"
Sep 14 00:28:41 addons-131319 kubelet[1497]: I0914 00:28:41.265244 1497 scope.go:117] "RemoveContainer" containerID="108b7f75da8ea443242bab77e3434854cbf274bbb2af21111179638a7a7b131c"
Sep 14 00:28:41 addons-131319 kubelet[1497]: E0914 00:28:41.265460 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b9bjg_gadget(ae425b35-7f17-4690-9b72-1a07b89405a6)\"" pod="gadget/gadget-b9bjg" podUID="ae425b35-7f17-4690-9b72-1a07b89405a6"
Sep 14 00:28:44 addons-131319 kubelet[1497]: I0914 00:28:44.264124 1497 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-thrrk" secret="" err="secret \"gcp-auth\" not found"
==> storage-provisioner [8e4d3c8ad3a1e1b71e56b2501b8a3a1141385f3e2b602bfd2046b589348b7411] <==
I0914 00:22:52.691917 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0914 00:22:52.708691 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0914 00:22:52.708746 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0914 00:22:52.720448 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0914 00:22:52.720619 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-131319_edfa33ad-d3ea-4663-8ade-7d30f437aa40!
I0914 00:22:52.721580 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"c66e31fd-742a-472f-ad13-c49d32e2f5bb", APIVersion:"v1", ResourceVersion:"579", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-131319_edfa33ad-d3ea-4663-8ade-7d30f437aa40 became leader
I0914 00:22:52.823179 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-131319_edfa33ad-d3ea-4663-8ade-7d30f437aa40!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-131319 -n addons-131319
helpers_test.go:261: (dbg) Run: kubectl --context addons-131319 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: ingress-nginx-admission-create-h4ssl ingress-nginx-admission-patch-6x4vs test-job-nginx-0
helpers_test.go:274: ======> post-mortem[TestAddons/serial/Volcano]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-131319 describe pod ingress-nginx-admission-create-h4ssl ingress-nginx-admission-patch-6x4vs test-job-nginx-0
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-131319 describe pod ingress-nginx-admission-create-h4ssl ingress-nginx-admission-patch-6x4vs test-job-nginx-0: exit status 1 (89.993871ms)
** stderr **
Error from server (NotFound): pods "ingress-nginx-admission-create-h4ssl" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-6x4vs" not found
Error from server (NotFound): pods "test-job-nginx-0" not found
** /stderr **
helpers_test.go:279: kubectl --context addons-131319 describe pod ingress-nginx-admission-create-h4ssl ingress-nginx-admission-patch-6x4vs test-job-nginx-0: exit status 1
--- FAIL: TestAddons/serial/Volcano (200.82s)