=== RUN TestAddons/serial/Volcano
addons_test.go:913: volcano-controller stabilized in 47.00594ms
addons_test.go:897: volcano-scheduler stabilized in 47.118784ms
addons_test.go:905: volcano-admission stabilized in 47.170427ms
addons_test.go:919: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-scheduler-576bc46687-7x7qn" [816fa8f8-1192-45b5-9bed-7252105431b6] Running
addons_test.go:919: (dbg) TestAddons/serial/Volcano: app=volcano-scheduler healthy within 6.003498141s
addons_test.go:923: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-admission-77d7d48b68-vnlcw" [263b789a-9c92-4d3f-a989-44233f263bc6] Running
addons_test.go:923: (dbg) TestAddons/serial/Volcano: app=volcano-admission healthy within 5.003684328s
addons_test.go:927: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-controllers-56675bb4d5-kmkm9" [3bd9f8b8-0fca-4ca3-805c-bef2a8ff9000] Running
addons_test.go:927: (dbg) TestAddons/serial/Volcano: app=volcano-controller healthy within 5.00338406s
addons_test.go:932: (dbg) Run: kubectl --context addons-827965 delete -n volcano-system job volcano-admission-init
addons_test.go:938: (dbg) Run: kubectl --context addons-827965 create -f testdata/vcjob.yaml
addons_test.go:946: (dbg) Run: kubectl --context addons-827965 get vcjob -n my-volcano
addons_test.go:964: (dbg) TestAddons/serial/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...
helpers_test.go:344: "test-job-nginx-0" [518e9363-0a78-41b9-a2da-1a6878f3064c] Pending
helpers_test.go:344: "test-job-nginx-0" [518e9363-0a78-41b9-a2da-1a6878f3064c] Pending: PodScheduled:Unschedulable (0/1 nodes are unavailable: 1 Insufficient cpu.)
helpers_test.go:329: TestAddons/serial/Volcano: WARNING: pod list for "my-volcano" "volcano.sh/job-name=test-job" returned: client rate limiter Wait returned an error: context deadline exceeded
addons_test.go:964: ***** TestAddons/serial/Volcano: pod "volcano.sh/job-name=test-job" failed to start within 3m0s: context deadline exceeded ****
addons_test.go:964: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-827965 -n addons-827965
addons_test.go:964: TestAddons/serial/Volcano: showing logs for failed pods as of 2024-09-10 18:28:57.820944653 +0000 UTC m=+437.483810952
addons_test.go:964: (dbg) Run: kubectl --context addons-827965 describe po test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-827965 describe po test-job-nginx-0 -n my-volcano:
Name: test-job-nginx-0
Namespace: my-volcano
Priority: 0
Service Account: default
Node: <none>
Labels: volcano.sh/job-name=test-job
volcano.sh/job-namespace=my-volcano
volcano.sh/queue-name=test
volcano.sh/task-index=0
volcano.sh/task-spec=nginx
Annotations: scheduling.k8s.io/group-name: test-job-67e30741-7f56-4366-8e9b-afe851782951
volcano.sh/job-name: test-job
volcano.sh/job-version: 0
volcano.sh/queue-name: test
volcano.sh/task-index: 0
volcano.sh/task-spec: nginx
volcano.sh/template-uid: test-job-nginx
Status: Pending
IP:
IPs: <none>
Controlled By: Job/test-job
Containers:
nginx:
Image: nginx:latest
Port: <none>
Host Port: <none>
Command:
sleep
10m
Limits:
cpu: 1
Requests:
cpu: 1
Environment:
GOOGLE_APPLICATION_CREDENTIALS: /google-app-creds.json
PROJECT_ID: this_is_fake
GCP_PROJECT: this_is_fake
GCLOUD_PROJECT: this_is_fake
GOOGLE_CLOUD_PROJECT: this_is_fake
CLOUDSDK_CORE_PROJECT: this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-x8d4x (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
kube-api-access-x8d4x:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
gcp-creds:
Type: HostPath (bare host directory volume)
Path: /var/lib/minikube/google_application_credentials.json
HostPathType: File
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling 2m58s volcano 0/1 nodes are unavailable: 1 Insufficient cpu.
addons_test.go:964: (dbg) Run: kubectl --context addons-827965 logs test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-827965 logs test-job-nginx-0 -n my-volcano:
addons_test.go:965: failed waiting for test-local-path pod: volcano.sh/job-name=test-job within 3m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestAddons/serial/Volcano]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect addons-827965
helpers_test.go:235: (dbg) docker inspect addons-827965:
-- stdout --
[
{
"Id": "bf446859967f3bdfb7006b4de6b6d33899631b0c0c446cb6b1d3bf743086d547",
"Created": "2024-09-10T18:22:25.143614829Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 299907,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-09-10T18:22:25.290404508Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:a4261f15fdf40db09c0b78a1feabe6bd85433327166d5c98909d23a556dff45f",
"ResolvConfPath": "/var/lib/docker/containers/bf446859967f3bdfb7006b4de6b6d33899631b0c0c446cb6b1d3bf743086d547/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/bf446859967f3bdfb7006b4de6b6d33899631b0c0c446cb6b1d3bf743086d547/hostname",
"HostsPath": "/var/lib/docker/containers/bf446859967f3bdfb7006b4de6b6d33899631b0c0c446cb6b1d3bf743086d547/hosts",
"LogPath": "/var/lib/docker/containers/bf446859967f3bdfb7006b4de6b6d33899631b0c0c446cb6b1d3bf743086d547/bf446859967f3bdfb7006b4de6b6d33899631b0c0c446cb6b1d3bf743086d547-json.log",
"Name": "/addons-827965",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"addons-827965:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "addons-827965",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4194304000,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8388608000,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/136d97dff90f7e72975c374bafec6856bc4d3c77c9180362c545946716b3f254-init/diff:/var/lib/docker/overlay2/3154bb76135996f30b899383b0ddcba9ada28aba984fcbfc04c25722b32d40d6/diff",
"MergedDir": "/var/lib/docker/overlay2/136d97dff90f7e72975c374bafec6856bc4d3c77c9180362c545946716b3f254/merged",
"UpperDir": "/var/lib/docker/overlay2/136d97dff90f7e72975c374bafec6856bc4d3c77c9180362c545946716b3f254/diff",
"WorkDir": "/var/lib/docker/overlay2/136d97dff90f7e72975c374bafec6856bc4d3c77c9180362c545946716b3f254/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "addons-827965",
"Source": "/var/lib/docker/volumes/addons-827965/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "addons-827965",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-827965",
"name.minikube.sigs.k8s.io": "addons-827965",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "7494f1acf54448e1778f99c7d4dba157d491c7b7b6d3797b964ee2645690dac6",
"SandboxKey": "/var/run/docker/netns/7494f1acf544",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33138"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33139"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33142"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33140"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33141"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"addons-827965": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:31:02",
"DriverOpts": null,
"NetworkID": "a1701273ceeaf465994dac02434fbb3e2e0f3e3793c5eaddb136dae8f2cbd8e6",
"EndpointID": "4dd375e9535fe32efd4aced7caab2288de86d68393dc2736518f9d64403d2bb0",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-827965",
"bf446859967f"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p addons-827965 -n addons-827965
helpers_test.go:244: <<< TestAddons/serial/Volcano FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/serial/Volcano]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p addons-827965 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-827965 logs -n 25: (1.76935201s)
helpers_test.go:252: TestAddons/serial/Volcano logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| start | -o=json --download-only | download-only-154248 | jenkins | v1.34.0 | 10 Sep 24 18:21 UTC | |
| | -p download-only-154248 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 10 Sep 24 18:21 UTC | 10 Sep 24 18:21 UTC |
| delete | -p download-only-154248 | download-only-154248 | jenkins | v1.34.0 | 10 Sep 24 18:21 UTC | 10 Sep 24 18:21 UTC |
| start | -o=json --download-only | download-only-256966 | jenkins | v1.34.0 | 10 Sep 24 18:21 UTC | |
| | -p download-only-256966 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.31.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 10 Sep 24 18:21 UTC | 10 Sep 24 18:21 UTC |
| delete | -p download-only-256966 | download-only-256966 | jenkins | v1.34.0 | 10 Sep 24 18:21 UTC | 10 Sep 24 18:21 UTC |
| delete | -p download-only-154248 | download-only-154248 | jenkins | v1.34.0 | 10 Sep 24 18:21 UTC | 10 Sep 24 18:21 UTC |
| delete | -p download-only-256966 | download-only-256966 | jenkins | v1.34.0 | 10 Sep 24 18:21 UTC | 10 Sep 24 18:21 UTC |
| start | --download-only -p | download-docker-096745 | jenkins | v1.34.0 | 10 Sep 24 18:21 UTC | |
| | download-docker-096745 | | | | | |
| | --alsologtostderr | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p download-docker-096745 | download-docker-096745 | jenkins | v1.34.0 | 10 Sep 24 18:21 UTC | 10 Sep 24 18:21 UTC |
| start | --download-only -p | binary-mirror-811787 | jenkins | v1.34.0 | 10 Sep 24 18:21 UTC | |
| | binary-mirror-811787 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:43871 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p binary-mirror-811787 | binary-mirror-811787 | jenkins | v1.34.0 | 10 Sep 24 18:22 UTC | 10 Sep 24 18:22 UTC |
| addons | enable dashboard -p | addons-827965 | jenkins | v1.34.0 | 10 Sep 24 18:22 UTC | |
| | addons-827965 | | | | | |
| addons | disable dashboard -p | addons-827965 | jenkins | v1.34.0 | 10 Sep 24 18:22 UTC | |
| | addons-827965 | | | | | |
| start | -p addons-827965 --wait=true | addons-827965 | jenkins | v1.34.0 | 10 Sep 24 18:22 UTC | 10 Sep 24 18:25 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/09/10 18:22:00
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.22.5 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0910 18:22:00.670298 299416 out.go:345] Setting OutFile to fd 1 ...
I0910 18:22:00.670536 299416 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0910 18:22:00.670568 299416 out.go:358] Setting ErrFile to fd 2...
I0910 18:22:00.670589 299416 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0910 18:22:00.670869 299416 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19598-293262/.minikube/bin
I0910 18:22:00.671372 299416 out.go:352] Setting JSON to false
I0910 18:22:00.672318 299416 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":7471,"bootTime":1725985050,"procs":170,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1068-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0910 18:22:00.672415 299416 start.go:139] virtualization:
I0910 18:22:00.675247 299416 out.go:177] * [addons-827965] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I0910 18:22:00.678117 299416 out.go:177] - MINIKUBE_LOCATION=19598
I0910 18:22:00.678180 299416 notify.go:220] Checking for updates...
I0910 18:22:00.682482 299416 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0910 18:22:00.684876 299416 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19598-293262/kubeconfig
I0910 18:22:00.687124 299416 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19598-293262/.minikube
I0910 18:22:00.689206 299416 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0910 18:22:00.691933 299416 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0910 18:22:00.694225 299416 driver.go:394] Setting default libvirt URI to qemu:///system
I0910 18:22:00.724898 299416 docker.go:123] docker version: linux-27.2.1:Docker Engine - Community
I0910 18:22:00.725002 299416 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0910 18:22:00.781435 299416 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-10 18:22:00.771840441 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1068-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214839296 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.2.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:472731909fa34bd7bc9c087e4c27943f9835f111 Expected:472731909fa34bd7bc9c087e4c27943f9835f111} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0910 18:22:00.781547 299416 docker.go:318] overlay module found
I0910 18:22:00.784586 299416 out.go:177] * Using the docker driver based on user configuration
I0910 18:22:00.786900 299416 start.go:297] selected driver: docker
I0910 18:22:00.786921 299416 start.go:901] validating driver "docker" against <nil>
I0910 18:22:00.786937 299416 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0910 18:22:00.787581 299416 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0910 18:22:00.841907 299416 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-10 18:22:00.832157114 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1068-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214839296 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.2.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:472731909fa34bd7bc9c087e4c27943f9835f111 Expected:472731909fa34bd7bc9c087e4c27943f9835f111} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0910 18:22:00.842071 299416 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0910 18:22:00.842304 299416 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0910 18:22:00.844559 299416 out.go:177] * Using Docker driver with root privileges
I0910 18:22:00.846502 299416 cni.go:84] Creating CNI manager for ""
I0910 18:22:00.846529 299416 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0910 18:22:00.846542 299416 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0910 18:22:00.846641 299416 start.go:340] cluster config:
{Name:addons-827965 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-827965 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHA
uthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0910 18:22:00.850020 299416 out.go:177] * Starting "addons-827965" primary control-plane node in "addons-827965" cluster
I0910 18:22:00.851944 299416 cache.go:121] Beginning downloading kic base image for docker with containerd
I0910 18:22:00.853711 299416 out.go:177] * Pulling base image v0.0.45-1725963390-19606 ...
I0910 18:22:00.855879 299416 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0910 18:22:00.855915 299416 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 in local docker daemon
I0910 18:22:00.855971 299416 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19598-293262/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4
I0910 18:22:00.855980 299416 cache.go:56] Caching tarball of preloaded images
I0910 18:22:00.856067 299416 preload.go:172] Found /home/jenkins/minikube-integration/19598-293262/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0910 18:22:00.856077 299416 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on containerd
I0910 18:22:00.856433 299416 profile.go:143] Saving config to /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/config.json ...
I0910 18:22:00.856464 299416 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/config.json: {Name:mk7ea9a9f70c5ead3a7ad7cd1e33a021f1259c3e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 18:22:00.871471 299416 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 to local cache
I0910 18:22:00.871591 299416 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 in local cache directory
I0910 18:22:00.871611 299416 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 in local cache directory, skipping pull
I0910 18:22:00.871616 299416 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 exists in cache, skipping pull
I0910 18:22:00.871625 299416 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 as a tarball
I0910 18:22:00.871630 299416 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 from local cache
I0910 18:22:18.353402 299416 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 from cached tarball
I0910 18:22:18.353444 299416 cache.go:194] Successfully downloaded all kic artifacts
I0910 18:22:18.353486 299416 start.go:360] acquireMachinesLock for addons-827965: {Name:mk046a56ae66d1ad75141faf6c2114110c689ecc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0910 18:22:18.354087 299416 start.go:364] duration metric: took 574.595µs to acquireMachinesLock for "addons-827965"
I0910 18:22:18.354124 299416 start.go:93] Provisioning new machine with config: &{Name:addons-827965 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-827965 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fa
lse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0910 18:22:18.354212 299416 start.go:125] createHost starting for "" (driver="docker")
I0910 18:22:18.356450 299416 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
I0910 18:22:18.356703 299416 start.go:159] libmachine.API.Create for "addons-827965" (driver="docker")
I0910 18:22:18.356741 299416 client.go:168] LocalClient.Create starting
I0910 18:22:18.356889 299416 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19598-293262/.minikube/certs/ca.pem
I0910 18:22:18.674631 299416 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19598-293262/.minikube/certs/cert.pem
I0910 18:22:19.101615 299416 cli_runner.go:164] Run: docker network inspect addons-827965 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0910 18:22:19.116611 299416 cli_runner.go:211] docker network inspect addons-827965 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0910 18:22:19.116708 299416 network_create.go:284] running [docker network inspect addons-827965] to gather additional debugging logs...
I0910 18:22:19.116730 299416 cli_runner.go:164] Run: docker network inspect addons-827965
W0910 18:22:19.131802 299416 cli_runner.go:211] docker network inspect addons-827965 returned with exit code 1
I0910 18:22:19.131836 299416 network_create.go:287] error running [docker network inspect addons-827965]: docker network inspect addons-827965: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-827965 not found
I0910 18:22:19.131849 299416 network_create.go:289] output of [docker network inspect addons-827965]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-827965 not found
** /stderr **
I0910 18:22:19.131953 299416 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0910 18:22:19.148198 299416 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x400178dd00}
I0910 18:22:19.148237 299416 network_create.go:124] attempt to create docker network addons-827965 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0910 18:22:19.148299 299416 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-827965 addons-827965
I0910 18:22:19.220475 299416 network_create.go:108] docker network addons-827965 192.168.49.0/24 created
I0910 18:22:19.220505 299416 kic.go:121] calculated static IP "192.168.49.2" for the "addons-827965" container
I0910 18:22:19.220592 299416 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0910 18:22:19.235784 299416 cli_runner.go:164] Run: docker volume create addons-827965 --label name.minikube.sigs.k8s.io=addons-827965 --label created_by.minikube.sigs.k8s.io=true
I0910 18:22:19.252975 299416 oci.go:103] Successfully created a docker volume addons-827965
I0910 18:22:19.253073 299416 cli_runner.go:164] Run: docker run --rm --name addons-827965-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-827965 --entrypoint /usr/bin/test -v addons-827965:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 -d /var/lib
I0910 18:22:20.846203 299416 cli_runner.go:217] Completed: docker run --rm --name addons-827965-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-827965 --entrypoint /usr/bin/test -v addons-827965:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 -d /var/lib: (1.593083812s)
I0910 18:22:20.846233 299416 oci.go:107] Successfully prepared a docker volume addons-827965
I0910 18:22:20.846260 299416 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0910 18:22:20.846280 299416 kic.go:194] Starting extracting preloaded images to volume ...
I0910 18:22:20.846365 299416 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19598-293262/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-827965:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 -I lz4 -xf /preloaded.tar -C /extractDir
I0910 18:22:25.069400 299416 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19598-293262/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-827965:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 -I lz4 -xf /preloaded.tar -C /extractDir: (4.222995837s)
I0910 18:22:25.069434 299416 kic.go:203] duration metric: took 4.223151004s to extract preloaded images to volume ...
W0910 18:22:25.069589 299416 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0910 18:22:25.069701 299416 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0910 18:22:25.125001 299416 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-827965 --name addons-827965 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-827965 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-827965 --network addons-827965 --ip 192.168.49.2 --volume addons-827965:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9
I0910 18:22:25.465653 299416 cli_runner.go:164] Run: docker container inspect addons-827965 --format={{.State.Running}}
I0910 18:22:25.482921 299416 cli_runner.go:164] Run: docker container inspect addons-827965 --format={{.State.Status}}
I0910 18:22:25.502161 299416 cli_runner.go:164] Run: docker exec addons-827965 stat /var/lib/dpkg/alternatives/iptables
I0910 18:22:25.578018 299416 oci.go:144] the created container "addons-827965" has a running status.
I0910 18:22:25.578052 299416 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19598-293262/.minikube/machines/addons-827965/id_rsa...
I0910 18:22:26.012846 299416 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19598-293262/.minikube/machines/addons-827965/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0910 18:22:26.035678 299416 cli_runner.go:164] Run: docker container inspect addons-827965 --format={{.State.Status}}
I0910 18:22:26.066542 299416 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0910 18:22:26.066567 299416 kic_runner.go:114] Args: [docker exec --privileged addons-827965 chown docker:docker /home/docker/.ssh/authorized_keys]
I0910 18:22:26.147091 299416 cli_runner.go:164] Run: docker container inspect addons-827965 --format={{.State.Status}}
I0910 18:22:26.178384 299416 machine.go:93] provisionDockerMachine start ...
I0910 18:22:26.178474 299416 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-827965
I0910 18:22:26.207325 299416 main.go:141] libmachine: Using SSH client type: native
I0910 18:22:26.207589 299416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3ebfd0] 0x3ee830 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0910 18:22:26.207597 299416 main.go:141] libmachine: About to run SSH command:
hostname
I0910 18:22:26.353481 299416 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-827965
I0910 18:22:26.353575 299416 ubuntu.go:169] provisioning hostname "addons-827965"
I0910 18:22:26.353673 299416 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-827965
I0910 18:22:26.373682 299416 main.go:141] libmachine: Using SSH client type: native
I0910 18:22:26.373916 299416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3ebfd0] 0x3ee830 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0910 18:22:26.373927 299416 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-827965 && echo "addons-827965" | sudo tee /etc/hostname
I0910 18:22:26.524097 299416 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-827965
I0910 18:22:26.524177 299416 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-827965
I0910 18:22:26.545365 299416 main.go:141] libmachine: Using SSH client type: native
I0910 18:22:26.545675 299416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3ebfd0] 0x3ee830 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0910 18:22:26.545701 299416 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-827965' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-827965/g' /etc/hosts;
else
echo '127.0.1.1 addons-827965' | sudo tee -a /etc/hosts;
fi
fi
I0910 18:22:26.676623 299416 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0910 18:22:26.676649 299416 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19598-293262/.minikube CaCertPath:/home/jenkins/minikube-integration/19598-293262/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19598-293262/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19598-293262/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19598-293262/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19598-293262/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19598-293262/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19598-293262/.minikube}
I0910 18:22:26.676678 299416 ubuntu.go:177] setting up certificates
I0910 18:22:26.676687 299416 provision.go:84] configureAuth start
I0910 18:22:26.676747 299416 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-827965
I0910 18:22:26.694351 299416 provision.go:143] copyHostCerts
I0910 18:22:26.694446 299416 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19598-293262/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19598-293262/.minikube/ca.pem (1078 bytes)
I0910 18:22:26.694564 299416 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19598-293262/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19598-293262/.minikube/cert.pem (1123 bytes)
I0910 18:22:26.694620 299416 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19598-293262/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19598-293262/.minikube/key.pem (1675 bytes)
I0910 18:22:26.694667 299416 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19598-293262/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19598-293262/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19598-293262/.minikube/certs/ca-key.pem org=jenkins.addons-827965 san=[127.0.0.1 192.168.49.2 addons-827965 localhost minikube]
I0910 18:22:27.443909 299416 provision.go:177] copyRemoteCerts
I0910 18:22:27.443977 299416 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0910 18:22:27.444022 299416 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-827965
I0910 18:22:27.461047 299416 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19598-293262/.minikube/machines/addons-827965/id_rsa Username:docker}
I0910 18:22:27.553459 299416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-293262/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0910 18:22:27.576640 299416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-293262/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0910 18:22:27.600203 299416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-293262/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0910 18:22:27.625122 299416 provision.go:87] duration metric: took 948.41522ms to configureAuth
I0910 18:22:27.625155 299416 ubuntu.go:193] setting minikube options for container-runtime
I0910 18:22:27.625377 299416 config.go:182] Loaded profile config "addons-827965": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0910 18:22:27.625399 299416 machine.go:96] duration metric: took 1.446997373s to provisionDockerMachine
I0910 18:22:27.625407 299416 client.go:171] duration metric: took 9.268655605s to LocalClient.Create
I0910 18:22:27.625425 299416 start.go:167] duration metric: took 9.268723732s to libmachine.API.Create "addons-827965"
I0910 18:22:27.625438 299416 start.go:293] postStartSetup for "addons-827965" (driver="docker")
I0910 18:22:27.625450 299416 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0910 18:22:27.625523 299416 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0910 18:22:27.625568 299416 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-827965
I0910 18:22:27.641578 299416 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19598-293262/.minikube/machines/addons-827965/id_rsa Username:docker}
I0910 18:22:27.736031 299416 ssh_runner.go:195] Run: cat /etc/os-release
I0910 18:22:27.739727 299416 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0910 18:22:27.739775 299416 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0910 18:22:27.739811 299416 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0910 18:22:27.739824 299416 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0910 18:22:27.739843 299416 filesync.go:126] Scanning /home/jenkins/minikube-integration/19598-293262/.minikube/addons for local assets ...
I0910 18:22:27.739936 299416 filesync.go:126] Scanning /home/jenkins/minikube-integration/19598-293262/.minikube/files for local assets ...
I0910 18:22:27.739974 299416 start.go:296] duration metric: took 114.530158ms for postStartSetup
I0910 18:22:27.740495 299416 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-827965
I0910 18:22:27.765177 299416 profile.go:143] Saving config to /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/config.json ...
I0910 18:22:27.765464 299416 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0910 18:22:27.765507 299416 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-827965
I0910 18:22:27.781638 299416 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19598-293262/.minikube/machines/addons-827965/id_rsa Username:docker}
I0910 18:22:27.869876 299416 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0910 18:22:27.874643 299416 start.go:128] duration metric: took 9.520415102s to createHost
I0910 18:22:27.874668 299416 start.go:83] releasing machines lock for "addons-827965", held for 9.520564099s
I0910 18:22:27.874740 299416 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-827965
I0910 18:22:27.891097 299416 ssh_runner.go:195] Run: cat /version.json
I0910 18:22:27.891151 299416 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-827965
I0910 18:22:27.891273 299416 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0910 18:22:27.891328 299416 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-827965
I0910 18:22:27.914156 299416 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19598-293262/.minikube/machines/addons-827965/id_rsa Username:docker}
I0910 18:22:27.915793 299416 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19598-293262/.minikube/machines/addons-827965/id_rsa Username:docker}
I0910 18:22:28.000568 299416 ssh_runner.go:195] Run: systemctl --version
I0910 18:22:28.133548 299416 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0910 18:22:28.137907 299416 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0910 18:22:28.162760 299416 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0910 18:22:28.162922 299416 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0910 18:22:28.192346 299416 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0910 18:22:28.192419 299416 start.go:495] detecting cgroup driver to use...
I0910 18:22:28.192468 299416 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0910 18:22:28.192545 299416 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0910 18:22:28.205018 299416 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0910 18:22:28.216306 299416 docker.go:217] disabling cri-docker service (if available) ...
I0910 18:22:28.216370 299416 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0910 18:22:28.229884 299416 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0910 18:22:28.244254 299416 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0910 18:22:28.332355 299416 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0910 18:22:28.425464 299416 docker.go:233] disabling docker service ...
I0910 18:22:28.425532 299416 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0910 18:22:28.449972 299416 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0910 18:22:28.462051 299416 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0910 18:22:28.545530 299416 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0910 18:22:28.645773 299416 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0910 18:22:28.657017 299416 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0910 18:22:28.673085 299416 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0910 18:22:28.682881 299416 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0910 18:22:28.692509 299416 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0910 18:22:28.692599 299416 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0910 18:22:28.702615 299416 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0910 18:22:28.717552 299416 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0910 18:22:28.727183 299416 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0910 18:22:28.736768 299416 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0910 18:22:28.745857 299416 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0910 18:22:28.755611 299416 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0910 18:22:28.765267 299416 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0910 18:22:28.775335 299416 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0910 18:22:28.784228 299416 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0910 18:22:28.793127 299416 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0910 18:22:28.878446 299416 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0910 18:22:29.022339 299416 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0910 18:22:29.022582 299416 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0910 18:22:29.027133 299416 start.go:563] Will wait 60s for crictl version
I0910 18:22:29.027260 299416 ssh_runner.go:195] Run: which crictl
I0910 18:22:29.031604 299416 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0910 18:22:29.079260 299416 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.21
RuntimeApiVersion: v1
I0910 18:22:29.079404 299416 ssh_runner.go:195] Run: containerd --version
I0910 18:22:29.101682 299416 ssh_runner.go:195] Run: containerd --version
I0910 18:22:29.125885 299416 out.go:177] * Preparing Kubernetes v1.31.0 on containerd 1.7.21 ...
I0910 18:22:29.127843 299416 cli_runner.go:164] Run: docker network inspect addons-827965 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0910 18:22:29.142979 299416 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I0910 18:22:29.146438 299416 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0910 18:22:29.157189 299416 kubeadm.go:883] updating cluster {Name:addons-827965 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-827965 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cus
tomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0910 18:22:29.157325 299416 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0910 18:22:29.157392 299416 ssh_runner.go:195] Run: sudo crictl images --output json
I0910 18:22:29.193264 299416 containerd.go:627] all images are preloaded for containerd runtime.
I0910 18:22:29.193290 299416 containerd.go:534] Images already preloaded, skipping extraction
I0910 18:22:29.193355 299416 ssh_runner.go:195] Run: sudo crictl images --output json
I0910 18:22:29.231011 299416 containerd.go:627] all images are preloaded for containerd runtime.
I0910 18:22:29.231036 299416 cache_images.go:84] Images are preloaded, skipping loading
I0910 18:22:29.231045 299416 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.0 containerd true true} ...
I0910 18:22:29.231181 299416 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-827965 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.31.0 ClusterName:addons-827965 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0910 18:22:29.231264 299416 ssh_runner.go:195] Run: sudo crictl info
I0910 18:22:29.271441 299416 cni.go:84] Creating CNI manager for ""
I0910 18:22:29.271465 299416 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0910 18:22:29.271476 299416 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0910 18:22:29.271501 299416 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-827965 NodeName:addons-827965 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc
/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0910 18:22:29.271650 299416 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "addons-827965"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0910 18:22:29.271727 299416 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.0
I0910 18:22:29.280741 299416 binaries.go:44] Found k8s binaries, skipping transfer
I0910 18:22:29.280841 299416 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0910 18:22:29.289701 299416 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (317 bytes)
I0910 18:22:29.307948 299416 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0910 18:22:29.325880 299416 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2167 bytes)
I0910 18:22:29.343829 299416 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0910 18:22:29.347330 299416 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0910 18:22:29.358164 299416 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0910 18:22:29.435800 299416 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0910 18:22:29.449768 299416 certs.go:68] Setting up /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965 for IP: 192.168.49.2
I0910 18:22:29.449792 299416 certs.go:194] generating shared ca certs ...
I0910 18:22:29.449809 299416 certs.go:226] acquiring lock for ca certs: {Name:mkeeaf8ea92dd449043c729cd08a2925979003d5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 18:22:29.450635 299416 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19598-293262/.minikube/ca.key
I0910 18:22:29.937410 299416 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19598-293262/.minikube/ca.crt ...
I0910 18:22:29.937446 299416 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19598-293262/.minikube/ca.crt: {Name:mk84d02cf844c2d3f97b5d7456bc1659bb326c9f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 18:22:29.938126 299416 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19598-293262/.minikube/ca.key ...
I0910 18:22:29.938143 299416 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19598-293262/.minikube/ca.key: {Name:mkeb3f86d25fd661119099d0e2b01d52176fe398 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 18:22:29.938951 299416 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19598-293262/.minikube/proxy-client-ca.key
I0910 18:22:30.407112 299416 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19598-293262/.minikube/proxy-client-ca.crt ...
I0910 18:22:30.407142 299416 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19598-293262/.minikube/proxy-client-ca.crt: {Name:mkb833f366e5e5a750d863d27b9969c6bee2fc89 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 18:22:30.407332 299416 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19598-293262/.minikube/proxy-client-ca.key ...
I0910 18:22:30.407345 299416 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19598-293262/.minikube/proxy-client-ca.key: {Name:mkd59beb92c74f3ac7cf89d83a99b2f296824c5a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 18:22:30.407430 299416 certs.go:256] generating profile certs ...
I0910 18:22:30.407494 299416 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/client.key
I0910 18:22:30.407512 299416 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/client.crt with IP's: []
I0910 18:22:30.980239 299416 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/client.crt ...
I0910 18:22:30.980324 299416 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/client.crt: {Name:mk0fedcd0d0b4cc44f4ff64ef2fbbc301ee5b787 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 18:22:30.980543 299416 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/client.key ...
I0910 18:22:30.980583 299416 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/client.key: {Name:mk635bbce4b9ca6899cb8b133ecee6bfde54cc25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 18:22:30.980717 299416 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/apiserver.key.210385aa
I0910 18:22:30.980761 299416 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/apiserver.crt.210385aa with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I0910 18:22:31.177200 299416 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/apiserver.crt.210385aa ...
I0910 18:22:31.177236 299416 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/apiserver.crt.210385aa: {Name:mk1bfe80bfcfca859766ac63100fb75ddec43760 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 18:22:31.177983 299416 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/apiserver.key.210385aa ...
I0910 18:22:31.178003 299416 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/apiserver.key.210385aa: {Name:mk9fa0c557cd76459f8eac22228bd8e73f19f6d8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 18:22:31.178097 299416 certs.go:381] copying /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/apiserver.crt.210385aa -> /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/apiserver.crt
I0910 18:22:31.178178 299416 certs.go:385] copying /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/apiserver.key.210385aa -> /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/apiserver.key
I0910 18:22:31.178233 299416 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/proxy-client.key
I0910 18:22:31.178254 299416 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/proxy-client.crt with IP's: []
I0910 18:22:32.022049 299416 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/proxy-client.crt ...
I0910 18:22:32.022083 299416 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/proxy-client.crt: {Name:mk5d02b236131f86ce088abc42c62af2b05215d5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 18:22:32.023088 299416 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/proxy-client.key ...
I0910 18:22:32.023115 299416 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/proxy-client.key: {Name:mk6197c26e333e3842e0a6a6f6c11fa2b7406c7f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 18:22:32.024678 299416 certs.go:484] found cert: /home/jenkins/minikube-integration/19598-293262/.minikube/certs/ca-key.pem (1675 bytes)
I0910 18:22:32.024726 299416 certs.go:484] found cert: /home/jenkins/minikube-integration/19598-293262/.minikube/certs/ca.pem (1078 bytes)
I0910 18:22:32.024754 299416 certs.go:484] found cert: /home/jenkins/minikube-integration/19598-293262/.minikube/certs/cert.pem (1123 bytes)
I0910 18:22:32.024808 299416 certs.go:484] found cert: /home/jenkins/minikube-integration/19598-293262/.minikube/certs/key.pem (1675 bytes)
I0910 18:22:32.025461 299416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-293262/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0910 18:22:32.052488 299416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-293262/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0910 18:22:32.077568 299416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-293262/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0910 18:22:32.102253 299416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-293262/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0910 18:22:32.127231 299416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0910 18:22:32.152312 299416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0910 18:22:32.177318 299416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0910 18:22:32.201302 299416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-293262/.minikube/profiles/addons-827965/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0910 18:22:32.225554 299416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-293262/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0910 18:22:32.250316 299416 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0910 18:22:32.268974 299416 ssh_runner.go:195] Run: openssl version
I0910 18:22:32.274490 299416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0910 18:22:32.284078 299416 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0910 18:22:32.287659 299416 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 10 18:22 /usr/share/ca-certificates/minikubeCA.pem
I0910 18:22:32.287725 299416 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0910 18:22:32.294694 299416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0910 18:22:32.304192 299416 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0910 18:22:32.307551 299416 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0910 18:22:32.307610 299416 kubeadm.go:392] StartCluster: {Name:addons-827965 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-827965 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom
QemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0910 18:22:32.307702 299416 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0910 18:22:32.307775 299416 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0910 18:22:32.350333 299416 cri.go:89] found id: ""
I0910 18:22:32.350404 299416 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0910 18:22:32.359258 299416 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0910 18:22:32.372388 299416 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0910 18:22:32.372460 299416 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0910 18:22:32.381760 299416 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0910 18:22:32.381778 299416 kubeadm.go:157] found existing configuration files:
I0910 18:22:32.381835 299416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0910 18:22:32.390737 299416 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0910 18:22:32.390834 299416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0910 18:22:32.399586 299416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0910 18:22:32.408676 299416 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0910 18:22:32.408761 299416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0910 18:22:32.417406 299416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0910 18:22:32.426628 299416 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0910 18:22:32.426697 299416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0910 18:22:32.435464 299416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0910 18:22:32.444436 299416 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0910 18:22:32.444530 299416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0910 18:22:32.453067 299416 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0910 18:22:32.512405 299416 kubeadm.go:310] [init] Using Kubernetes version: v1.31.0
I0910 18:22:32.512715 299416 kubeadm.go:310] [preflight] Running pre-flight checks
I0910 18:22:32.542222 299416 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0910 18:22:32.542337 299416 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1068-aws[0m
I0910 18:22:32.542399 299416 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0910 18:22:32.542463 299416 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0910 18:22:32.542537 299416 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0910 18:22:32.542605 299416 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0910 18:22:32.542666 299416 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0910 18:22:32.542737 299416 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0910 18:22:32.542804 299416 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0910 18:22:32.542872 299416 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0910 18:22:32.542946 299416 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0910 18:22:32.543013 299416 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0910 18:22:32.604156 299416 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0910 18:22:32.604337 299416 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0910 18:22:32.604463 299416 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0910 18:22:32.610257 299416 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0910 18:22:32.613706 299416 out.go:235] - Generating certificates and keys ...
I0910 18:22:32.613816 299416 kubeadm.go:310] [certs] Using existing ca certificate authority
I0910 18:22:32.613895 299416 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0910 18:22:33.021560 299416 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0910 18:22:33.582978 299416 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0910 18:22:33.992290 299416 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0910 18:22:34.567013 299416 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0910 18:22:35.511529 299416 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0910 18:22:35.511869 299416 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-827965 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0910 18:22:36.751941 299416 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0910 18:22:36.752357 299416 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-827965 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0910 18:22:37.938221 299416 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0910 18:22:38.162969 299416 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0910 18:22:38.423453 299416 kubeadm.go:310] [certs] Generating "sa" key and public key
I0910 18:22:38.423773 299416 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0910 18:22:38.969902 299416 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0910 18:22:39.202596 299416 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0910 18:22:39.552956 299416 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0910 18:22:40.287869 299416 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0910 18:22:40.894298 299416 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0910 18:22:40.895008 299416 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0910 18:22:40.900003 299416 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0910 18:22:40.902465 299416 out.go:235] - Booting up control plane ...
I0910 18:22:40.902576 299416 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0910 18:22:40.902659 299416 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0910 18:22:40.902732 299416 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0910 18:22:40.912503 299416 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0910 18:22:40.919495 299416 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0910 18:22:40.919555 299416 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0910 18:22:41.035296 299416 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0910 18:22:41.035420 299416 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0910 18:22:42.536933 299416 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.501645683s
I0910 18:22:42.537028 299416 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0910 18:22:50.540583 299416 kubeadm.go:310] [api-check] The API server is healthy after 8.002001587s
I0910 18:22:50.558096 299416 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0910 18:22:50.570896 299416 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0910 18:22:50.595440 299416 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0910 18:22:50.595633 299416 kubeadm.go:310] [mark-control-plane] Marking the node addons-827965 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0910 18:22:50.605617 299416 kubeadm.go:310] [bootstrap-token] Using token: tlh1yp.c3h404ph8ae7ygxh
I0910 18:22:50.607655 299416 out.go:235] - Configuring RBAC rules ...
I0910 18:22:50.607771 299416 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0910 18:22:50.612037 299416 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0910 18:22:50.620547 299416 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0910 18:22:50.624000 299416 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0910 18:22:50.627911 299416 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0910 18:22:50.631422 299416 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0910 18:22:50.947151 299416 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0910 18:22:51.379177 299416 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0910 18:22:51.945130 299416 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0910 18:22:51.946334 299416 kubeadm.go:310]
I0910 18:22:51.946406 299416 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0910 18:22:51.946417 299416 kubeadm.go:310]
I0910 18:22:51.946499 299416 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0910 18:22:51.946508 299416 kubeadm.go:310]
I0910 18:22:51.946533 299416 kubeadm.go:310] mkdir -p $HOME/.kube
I0910 18:22:51.946594 299416 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0910 18:22:51.946648 299416 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0910 18:22:51.946657 299416 kubeadm.go:310]
I0910 18:22:51.946709 299416 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0910 18:22:51.946717 299416 kubeadm.go:310]
I0910 18:22:51.946763 299416 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0910 18:22:51.946772 299416 kubeadm.go:310]
I0910 18:22:51.946823 299416 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0910 18:22:51.946899 299416 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0910 18:22:51.946990 299416 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0910 18:22:51.946999 299416 kubeadm.go:310]
I0910 18:22:51.947080 299416 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0910 18:22:51.947157 299416 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0910 18:22:51.947166 299416 kubeadm.go:310]
I0910 18:22:51.947247 299416 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token tlh1yp.c3h404ph8ae7ygxh \
I0910 18:22:51.947352 299416 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:ac6f0834de3397ba52f09337798e82c84fd816350eb2fc30df2ddfe9ce1bbe29 \
I0910 18:22:51.947376 299416 kubeadm.go:310] --control-plane
I0910 18:22:51.947380 299416 kubeadm.go:310]
I0910 18:22:51.947462 299416 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0910 18:22:51.947466 299416 kubeadm.go:310]
I0910 18:22:51.947545 299416 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token tlh1yp.c3h404ph8ae7ygxh \
I0910 18:22:51.947647 299416 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:ac6f0834de3397ba52f09337798e82c84fd816350eb2fc30df2ddfe9ce1bbe29
I0910 18:22:51.951602 299416 kubeadm.go:310] W0910 18:22:32.508865 1025 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0910 18:22:51.951900 299416 kubeadm.go:310] W0910 18:22:32.509864 1025 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0910 18:22:51.952115 299416 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1068-aws\n", err: exit status 1
I0910 18:22:51.952219 299416 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0910 18:22:51.952239 299416 cni.go:84] Creating CNI manager for ""
I0910 18:22:51.952250 299416 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0910 18:22:51.954432 299416 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0910 18:22:51.956327 299416 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0910 18:22:51.960082 299416 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.0/kubectl ...
I0910 18:22:51.960103 299416 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I0910 18:22:51.980618 299416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0910 18:22:52.253309 299416 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0910 18:22:52.253445 299416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0910 18:22:52.253528 299416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-827965 minikube.k8s.io/updated_at=2024_09_10T18_22_52_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=37b4bace07cd53444288cad630e4db4b688b8c18 minikube.k8s.io/name=addons-827965 minikube.k8s.io/primary=true
I0910 18:22:52.260658 299416 ops.go:34] apiserver oom_adj: -16
I0910 18:22:52.413945 299416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0910 18:22:52.914622 299416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0910 18:22:53.414091 299416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0910 18:22:53.914642 299416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0910 18:22:54.414220 299416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0910 18:22:54.914477 299416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0910 18:22:55.414275 299416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0910 18:22:55.914752 299416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0910 18:22:56.414645 299416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0910 18:22:56.914474 299416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0910 18:22:57.012634 299416 kubeadm.go:1113] duration metric: took 4.759236637s to wait for elevateKubeSystemPrivileges
I0910 18:22:57.012664 299416 kubeadm.go:394] duration metric: took 24.705057428s to StartCluster
I0910 18:22:57.012683 299416 settings.go:142] acquiring lock: {Name:mkbaf7b7b9fd07785bd3a33aa83f50c0af67b1cb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 18:22:57.012955 299416 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19598-293262/kubeconfig
I0910 18:22:57.013470 299416 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19598-293262/kubeconfig: {Name:mkaebf1ab3a7e58e0c8806a841f61cbcd05c876a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 18:22:57.013750 299416 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0910 18:22:57.013892 299416 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0910 18:22:57.014168 299416 config.go:182] Loaded profile config "addons-827965": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0910 18:22:57.014202 299416 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I0910 18:22:57.014286 299416 addons.go:69] Setting yakd=true in profile "addons-827965"
I0910 18:22:57.014307 299416 addons.go:234] Setting addon yakd=true in "addons-827965"
I0910 18:22:57.014332 299416 host.go:66] Checking if "addons-827965" exists ...
I0910 18:22:57.014981 299416 cli_runner.go:164] Run: docker container inspect addons-827965 --format={{.State.Status}}
I0910 18:22:57.017500 299416 out.go:177] * Verifying Kubernetes components...
I0910 18:22:57.018130 299416 addons.go:69] Setting inspektor-gadget=true in profile "addons-827965"
I0910 18:22:57.018163 299416 addons.go:234] Setting addon inspektor-gadget=true in "addons-827965"
I0910 18:22:57.018198 299416 host.go:66] Checking if "addons-827965" exists ...
I0910 18:22:57.018233 299416 addons.go:69] Setting metrics-server=true in profile "addons-827965"
I0910 18:22:57.018283 299416 addons.go:234] Setting addon metrics-server=true in "addons-827965"
I0910 18:22:57.018328 299416 host.go:66] Checking if "addons-827965" exists ...
I0910 18:22:57.018726 299416 cli_runner.go:164] Run: docker container inspect addons-827965 --format={{.State.Status}}
I0910 18:22:57.018900 299416 cli_runner.go:164] Run: docker container inspect addons-827965 --format={{.State.Status}}
I0910 18:22:57.024160 299416 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-827965"
I0910 18:22:57.024874 299416 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-827965"
I0910 18:22:57.024993 299416 host.go:66] Checking if "addons-827965" exists ...
I0910 18:22:57.025525 299416 cli_runner.go:164] Run: docker container inspect addons-827965 --format={{.State.Status}}
I0910 18:22:57.032434 299416 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0910 18:22:57.024179 299416 addons.go:69] Setting registry=true in profile "addons-827965"
I0910 18:22:57.035974 299416 addons.go:234] Setting addon registry=true in "addons-827965"
I0910 18:22:57.036048 299416 host.go:66] Checking if "addons-827965" exists ...
I0910 18:22:57.036722 299416 cli_runner.go:164] Run: docker container inspect addons-827965 --format={{.State.Status}}
I0910 18:22:57.038447 299416 addons.go:69] Setting cloud-spanner=true in profile "addons-827965"
I0910 18:22:57.038502 299416 addons.go:234] Setting addon cloud-spanner=true in "addons-827965"
I0910 18:22:57.038546 299416 host.go:66] Checking if "addons-827965" exists ...
I0910 18:22:57.038997 299416 cli_runner.go:164] Run: docker container inspect addons-827965 --format={{.State.Status}}
I0910 18:22:57.041202 299416 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-827965"
I0910 18:22:57.041291 299416 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-827965"
I0910 18:22:57.041326 299416 host.go:66] Checking if "addons-827965" exists ...
I0910 18:22:57.041774 299416 cli_runner.go:164] Run: docker container inspect addons-827965 --format={{.State.Status}}
I0910 18:22:57.024191 299416 addons.go:69] Setting storage-provisioner=true in profile "addons-827965"
I0910 18:22:57.042673 299416 addons.go:234] Setting addon storage-provisioner=true in "addons-827965"
I0910 18:22:57.042715 299416 host.go:66] Checking if "addons-827965" exists ...
I0910 18:22:57.043132 299416 cli_runner.go:164] Run: docker container inspect addons-827965 --format={{.State.Status}}
I0910 18:22:57.045892 299416 addons.go:69] Setting default-storageclass=true in profile "addons-827965"
I0910 18:22:57.045928 299416 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-827965"
I0910 18:22:57.046248 299416 cli_runner.go:164] Run: docker container inspect addons-827965 --format={{.State.Status}}
I0910 18:22:57.024205 299416 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-827965"
I0910 18:22:57.052230 299416 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-827965"
I0910 18:22:57.052551 299416 cli_runner.go:164] Run: docker container inspect addons-827965 --format={{.State.Status}}
I0910 18:22:57.068298 299416 addons.go:69] Setting gcp-auth=true in profile "addons-827965"
I0910 18:22:57.068366 299416 mustload.go:65] Loading cluster: addons-827965
I0910 18:22:57.068609 299416 config.go:182] Loaded profile config "addons-827965": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0910 18:22:57.069005 299416 cli_runner.go:164] Run: docker container inspect addons-827965 --format={{.State.Status}}
I0910 18:22:57.024212 299416 addons.go:69] Setting volcano=true in profile "addons-827965"
I0910 18:22:57.072918 299416 addons.go:234] Setting addon volcano=true in "addons-827965"
I0910 18:22:57.072966 299416 host.go:66] Checking if "addons-827965" exists ...
I0910 18:22:57.073432 299416 cli_runner.go:164] Run: docker container inspect addons-827965 --format={{.State.Status}}
I0910 18:22:57.024218 299416 addons.go:69] Setting volumesnapshots=true in profile "addons-827965"
I0910 18:22:57.077087 299416 addons.go:234] Setting addon volumesnapshots=true in "addons-827965"
I0910 18:22:57.077135 299416 host.go:66] Checking if "addons-827965" exists ...
I0910 18:22:57.077590 299416 cli_runner.go:164] Run: docker container inspect addons-827965 --format={{.State.Status}}
I0910 18:22:57.095387 299416 addons.go:69] Setting ingress=true in profile "addons-827965"
I0910 18:22:57.095450 299416 addons.go:234] Setting addon ingress=true in "addons-827965"
I0910 18:22:57.095516 299416 host.go:66] Checking if "addons-827965" exists ...
I0910 18:22:57.096258 299416 cli_runner.go:164] Run: docker container inspect addons-827965 --format={{.State.Status}}
I0910 18:22:57.118578 299416 addons.go:69] Setting ingress-dns=true in profile "addons-827965"
I0910 18:22:57.118622 299416 addons.go:234] Setting addon ingress-dns=true in "addons-827965"
I0910 18:22:57.118673 299416 host.go:66] Checking if "addons-827965" exists ...
I0910 18:22:57.119132 299416 cli_runner.go:164] Run: docker container inspect addons-827965 --format={{.State.Status}}
I0910 18:22:57.178563 299416 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I0910 18:22:57.187321 299416 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
I0910 18:22:57.187407 299416 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0910 18:22:57.187495 299416 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-827965
I0910 18:22:57.192113 299416 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
I0910 18:22:57.194277 299416 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0910 18:22:57.194299 299416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0910 18:22:57.194359 299416 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-827965
I0910 18:22:57.194531 299416 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0910 18:22:57.204513 299416 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0910 18:22:57.204661 299416 out.go:177] - Using image docker.io/registry:2.8.3
I0910 18:22:57.219246 299416 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0910 18:22:57.221848 299416 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0910 18:22:57.224063 299416 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0910 18:22:57.226059 299416 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0910 18:22:57.227924 299416 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0910 18:22:57.231691 299416 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0910 18:22:57.238165 299416 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
I0910 18:22:57.238244 299416 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0910 18:22:57.238255 299416 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0910 18:22:57.238321 299416 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-827965
I0910 18:22:57.240552 299416 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0
I0910 18:22:57.241367 299416 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0910 18:22:57.245222 299416 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
I0910 18:22:57.245361 299416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I0910 18:22:57.245438 299416 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-827965
I0910 18:22:57.261065 299416 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
I0910 18:22:57.261090 299416 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I0910 18:22:57.261158 299416 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-827965
I0910 18:22:57.269965 299416 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0910 18:22:57.269988 299416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0910 18:22:57.270053 299416 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-827965
I0910 18:22:57.283016 299416 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2
I0910 18:22:57.303334 299416 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0910 18:22:57.303498 299416 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0910 18:22:57.303514 299416 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0910 18:22:57.303593 299416 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-827965
I0910 18:22:57.303791 299416 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.23
I0910 18:22:57.317307 299416 addons.go:234] Setting addon default-storageclass=true in "addons-827965"
I0910 18:22:57.317352 299416 host.go:66] Checking if "addons-827965" exists ...
I0910 18:22:57.317800 299416 cli_runner.go:164] Run: docker container inspect addons-827965 --format={{.State.Status}}
I0910 18:22:57.329507 299416 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0910 18:22:57.329530 299416 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0910 18:22:57.329604 299416 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-827965
I0910 18:22:57.347167 299416 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
I0910 18:22:57.347188 299416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0910 18:22:57.347253 299416 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-827965
I0910 18:22:57.362823 299416 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-827965"
I0910 18:22:57.362865 299416 host.go:66] Checking if "addons-827965" exists ...
I0910 18:22:57.363302 299416 cli_runner.go:164] Run: docker container inspect addons-827965 --format={{.State.Status}}
I0910 18:22:57.396684 299416 out.go:177] - Using image docker.io/volcanosh/vc-webhook-manager:v1.9.0
I0910 18:22:57.398479 299416 out.go:177] - Using image docker.io/volcanosh/vc-controller-manager:v1.9.0
I0910 18:22:57.404413 299416 out.go:177] - Using image docker.io/volcanosh/vc-scheduler:v1.9.0
I0910 18:22:57.407077 299416 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml
I0910 18:22:57.407098 299416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (434001 bytes)
I0910 18:22:57.407168 299416 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-827965
I0910 18:22:57.411770 299416 host.go:66] Checking if "addons-827965" exists ...
I0910 18:22:57.415601 299416 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19598-293262/.minikube/machines/addons-827965/id_rsa Username:docker}
I0910 18:22:57.419155 299416 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I0910 18:22:57.419350 299416 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0910 18:22:57.422617 299416 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0910 18:22:57.422639 299416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0910 18:22:57.422722 299416 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-827965
I0910 18:22:57.442961 299416 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0910 18:22:57.444853 299416 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2
I0910 18:22:57.447011 299416 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0910 18:22:57.447032 299416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I0910 18:22:57.447100 299416 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-827965
I0910 18:22:57.482282 299416 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19598-293262/.minikube/machines/addons-827965/id_rsa Username:docker}
I0910 18:22:57.482751 299416 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19598-293262/.minikube/machines/addons-827965/id_rsa Username:docker}
I0910 18:22:57.499113 299416 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19598-293262/.minikube/machines/addons-827965/id_rsa Username:docker}
I0910 18:22:57.522583 299416 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19598-293262/.minikube/machines/addons-827965/id_rsa Username:docker}
I0910 18:22:57.548208 299416 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19598-293262/.minikube/machines/addons-827965/id_rsa Username:docker}
I0910 18:22:57.548692 299416 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19598-293262/.minikube/machines/addons-827965/id_rsa Username:docker}
I0910 18:22:57.557741 299416 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0910 18:22:57.558046 299416 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0910 18:22:57.559242 299416 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0910 18:22:57.561168 299416 out.go:177] - Using image docker.io/busybox:stable
I0910 18:22:57.564377 299416 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0910 18:22:57.564396 299416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0910 18:22:57.564459 299416 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-827965
I0910 18:22:57.580956 299416 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0910 18:22:57.580981 299416 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0910 18:22:57.581048 299416 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-827965
I0910 18:22:57.589229 299416 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19598-293262/.minikube/machines/addons-827965/id_rsa Username:docker}
I0910 18:22:57.603836 299416 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19598-293262/.minikube/machines/addons-827965/id_rsa Username:docker}
I0910 18:22:57.604320 299416 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19598-293262/.minikube/machines/addons-827965/id_rsa Username:docker}
I0910 18:22:57.631594 299416 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19598-293262/.minikube/machines/addons-827965/id_rsa Username:docker}
I0910 18:22:57.647514 299416 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19598-293262/.minikube/machines/addons-827965/id_rsa Username:docker}
W0910 18:22:57.650932 299416 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0910 18:22:57.650963 299416 retry.go:31] will retry after 195.448515ms: ssh: handshake failed: EOF
I0910 18:22:57.664721 299416 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19598-293262/.minikube/machines/addons-827965/id_rsa Username:docker}
I0910 18:22:57.674425 299416 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19598-293262/.minikube/machines/addons-827965/id_rsa Username:docker}
W0910 18:22:57.675356 299416 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0910 18:22:57.675385 299416 retry.go:31] will retry after 235.730808ms: ssh: handshake failed: EOF
I0910 18:22:57.948426 299416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0910 18:22:57.994801 299416 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0910 18:22:57.994865 299416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0910 18:22:58.044900 299416 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I0910 18:22:58.044967 299416 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I0910 18:22:58.093914 299416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
I0910 18:22:58.186737 299416 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0910 18:22:58.186815 299416 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0910 18:22:58.196425 299416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0910 18:22:58.222699 299416 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
I0910 18:22:58.222721 299416 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0910 18:22:58.276665 299416 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
I0910 18:22:58.276751 299416 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0910 18:22:58.311839 299416 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0910 18:22:58.311908 299416 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0910 18:22:58.333785 299416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0910 18:22:58.339730 299416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0910 18:22:58.347838 299416 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
I0910 18:22:58.347909 299416 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I0910 18:22:58.374554 299416 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0910 18:22:58.374631 299416 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0910 18:22:58.399886 299416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0910 18:22:58.514131 299416 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
I0910 18:22:58.514207 299416 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0910 18:22:58.534299 299416 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
I0910 18:22:58.534365 299416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0910 18:22:58.583744 299416 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0910 18:22:58.583839 299416 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0910 18:22:58.687134 299416 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I0910 18:22:58.687213 299416 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I0910 18:22:58.722083 299416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0910 18:22:58.730996 299416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0910 18:22:58.751195 299416 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0910 18:22:58.751268 299416 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0910 18:22:58.823048 299416 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0910 18:22:58.823116 299416 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0910 18:22:58.837666 299416 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
I0910 18:22:58.837734 299416 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0910 18:22:58.894317 299416 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0910 18:22:58.894397 299416 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0910 18:22:58.986632 299416 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I0910 18:22:58.986706 299416 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I0910 18:22:59.000441 299416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0910 18:22:59.095564 299416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0910 18:22:59.144249 299416 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0910 18:22:59.144314 299416 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0910 18:22:59.332683 299416 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0910 18:22:59.332755 299416 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0910 18:22:59.340890 299416 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I0910 18:22:59.340956 299416 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I0910 18:22:59.341335 299416 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
I0910 18:22:59.341377 299416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0910 18:22:59.513712 299416 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0910 18:22:59.513795 299416 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0910 18:22:59.679023 299416 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
I0910 18:22:59.679109 299416 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I0910 18:22:59.849579 299416 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (2.291495229s)
I0910 18:22:59.850537 299416 node_ready.go:35] waiting up to 6m0s for node "addons-827965" to be "Ready" ...
I0910 18:22:59.849669 299416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (1.901170636s)
I0910 18:22:59.850991 299416 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.292824446s)
I0910 18:22:59.851010 299416 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I0910 18:22:59.855371 299416 node_ready.go:49] node "addons-827965" has status "Ready":"True"
I0910 18:22:59.855396 299416 node_ready.go:38] duration metric: took 4.794837ms for node "addons-827965" to be "Ready" ...
I0910 18:22:59.855406 299416 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0910 18:22:59.882074 299416 pod_ready.go:79] waiting up to 6m0s for pod "coredns-6f6b679f8f-bjn88" in "kube-system" namespace to be "Ready" ...
I0910 18:22:59.931260 299416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0910 18:23:00.006387 299416 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0910 18:23:00.006462 299416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0910 18:23:00.031306 299416 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0910 18:23:00.031395 299416 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0910 18:23:00.109086 299416 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
I0910 18:23:00.109175 299416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
I0910 18:23:00.284559 299416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0910 18:23:00.356670 299416 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-827965" context rescaled to 1 replicas
I0910 18:23:00.380745 299416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I0910 18:23:00.585501 299416 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0910 18:23:00.585569 299416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0910 18:23:00.770646 299416 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0910 18:23:00.770720 299416 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0910 18:23:01.254588 299416 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0910 18:23:01.254669 299416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0910 18:23:01.629919 299416 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0910 18:23:01.629984 299416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0910 18:23:01.890162 299416 pod_ready.go:103] pod "coredns-6f6b679f8f-bjn88" in "kube-system" namespace has status "Ready":"False"
I0910 18:23:02.090901 299416 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0910 18:23:02.090970 299416 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0910 18:23:02.353948 299416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0910 18:23:03.911898 299416 pod_ready.go:103] pod "coredns-6f6b679f8f-bjn88" in "kube-system" namespace has status "Ready":"False"
I0910 18:23:04.621178 299416 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0910 18:23:04.621324 299416 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-827965
I0910 18:23:04.654596 299416 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19598-293262/.minikube/machines/addons-827965/id_rsa Username:docker}
I0910 18:23:04.949279 299416 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0910 18:23:04.997724 299416 addons.go:234] Setting addon gcp-auth=true in "addons-827965"
I0910 18:23:04.997822 299416 host.go:66] Checking if "addons-827965" exists ...
I0910 18:23:04.998373 299416 cli_runner.go:164] Run: docker container inspect addons-827965 --format={{.State.Status}}
I0910 18:23:05.024909 299416 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0910 18:23:05.024968 299416 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-827965
I0910 18:23:05.068087 299416 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19598-293262/.minikube/machines/addons-827965/id_rsa Username:docker}
I0910 18:23:06.408626 299416 pod_ready.go:103] pod "coredns-6f6b679f8f-bjn88" in "kube-system" namespace has status "Ready":"False"
I0910 18:23:07.245536 299416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (9.151539546s)
I0910 18:23:07.245688 299416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (9.049200044s)
I0910 18:23:07.245706 299416 addons.go:475] Verifying addon ingress=true in "addons-827965"
I0910 18:23:07.245877 299416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (8.912027124s)
I0910 18:23:07.246066 299416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (8.906267516s)
I0910 18:23:07.246123 299416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (8.846164365s)
I0910 18:23:07.246169 299416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (8.524020397s)
I0910 18:23:07.246273 299416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (8.245756662s)
I0910 18:23:07.246262 299416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (8.515190466s)
I0910 18:23:07.246286 299416 addons.go:475] Verifying addon registry=true in "addons-827965"
I0910 18:23:07.246366 299416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.150726078s)
I0910 18:23:07.246379 299416 addons.go:475] Verifying addon metrics-server=true in "addons-827965"
I0910 18:23:07.246426 299416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (7.315097651s)
I0910 18:23:07.246688 299416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (6.962041299s)
W0910 18:23:07.246730 299416 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0910 18:23:07.246748 299416 retry.go:31] will retry after 364.741165ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0910 18:23:07.246813 299416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (6.865953226s)
I0910 18:23:07.248012 299416 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-827965 service yakd-dashboard -n yakd-dashboard
I0910 18:23:07.248031 299416 out.go:177] * Verifying registry addon...
I0910 18:23:07.248041 299416 out.go:177] * Verifying ingress addon...
I0910 18:23:07.251868 299416 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0910 18:23:07.251875 299416 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0910 18:23:07.299412 299416 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0910 18:23:07.299486 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:07.300074 299416 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0910 18:23:07.300124 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
W0910 18:23:07.319586 299416 out.go:270] ! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error while marking storage class local-path as non-default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]
I0910 18:23:07.611619 299416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0910 18:23:07.782393 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:07.789561 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:07.995005 299416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (5.640961294s)
I0910 18:23:07.995038 299416 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-827965"
I0910 18:23:07.995237 299416 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (2.970305516s)
I0910 18:23:07.997341 299416 out.go:177] * Verifying csi-hostpath-driver addon...
I0910 18:23:07.997343 299416 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
I0910 18:23:07.998973 299416 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0910 18:23:07.999732 299416 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0910 18:23:08.000543 299416 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0910 18:23:08.000604 299416 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0910 18:23:08.018924 299416 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0910 18:23:08.019017 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:08.101746 299416 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0910 18:23:08.101903 299416 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0910 18:23:08.125403 299416 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0910 18:23:08.125475 299416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I0910 18:23:08.145818 299416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0910 18:23:08.260097 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:08.261903 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:08.506271 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:08.772959 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:08.773072 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:08.889820 299416 pod_ready.go:103] pod "coredns-6f6b679f8f-bjn88" in "kube-system" namespace has status "Ready":"False"
I0910 18:23:09.005541 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:09.256873 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:09.257730 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:09.383003 299416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.23710411s)
I0910 18:23:09.383080 299416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.771367898s)
I0910 18:23:09.386109 299416 addons.go:475] Verifying addon gcp-auth=true in "addons-827965"
I0910 18:23:09.391600 299416 out.go:177] * Verifying gcp-auth addon...
I0910 18:23:09.394553 299416 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0910 18:23:09.396808 299416 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0910 18:23:09.504900 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:09.757898 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:09.758488 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:10.005322 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:10.257822 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:10.259967 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:10.521297 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:10.757297 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:10.758258 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:11.005354 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:11.258174 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:11.260245 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:11.388694 299416 pod_ready.go:103] pod "coredns-6f6b679f8f-bjn88" in "kube-system" namespace has status "Ready":"False"
I0910 18:23:11.505622 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:11.757376 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:11.758559 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:12.013776 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:12.257371 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:12.258210 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:12.505438 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:12.767789 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:12.769138 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:13.005569 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:13.258781 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:13.260130 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:13.506281 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:13.762342 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:13.764584 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:13.889259 299416 pod_ready.go:103] pod "coredns-6f6b679f8f-bjn88" in "kube-system" namespace has status "Ready":"False"
I0910 18:23:14.005442 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:14.257352 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:14.258211 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:14.508838 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:14.760091 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:14.760999 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:14.889056 299416 pod_ready.go:93] pod "coredns-6f6b679f8f-bjn88" in "kube-system" namespace has status "Ready":"True"
I0910 18:23:14.889084 299416 pod_ready.go:82] duration metric: took 15.00693585s for pod "coredns-6f6b679f8f-bjn88" in "kube-system" namespace to be "Ready" ...
I0910 18:23:14.889105 299416 pod_ready.go:79] waiting up to 6m0s for pod "coredns-6f6b679f8f-w4scb" in "kube-system" namespace to be "Ready" ...
I0910 18:23:14.891965 299416 pod_ready.go:98] error getting pod "coredns-6f6b679f8f-w4scb" in "kube-system" namespace (skipping!): pods "coredns-6f6b679f8f-w4scb" not found
I0910 18:23:14.891993 299416 pod_ready.go:82] duration metric: took 2.878717ms for pod "coredns-6f6b679f8f-w4scb" in "kube-system" namespace to be "Ready" ...
E0910 18:23:14.892004 299416 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-6f6b679f8f-w4scb" in "kube-system" namespace (skipping!): pods "coredns-6f6b679f8f-w4scb" not found
I0910 18:23:14.892012 299416 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-827965" in "kube-system" namespace to be "Ready" ...
I0910 18:23:14.900624 299416 pod_ready.go:93] pod "etcd-addons-827965" in "kube-system" namespace has status "Ready":"True"
I0910 18:23:14.900666 299416 pod_ready.go:82] duration metric: took 8.63702ms for pod "etcd-addons-827965" in "kube-system" namespace to be "Ready" ...
I0910 18:23:14.900681 299416 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-827965" in "kube-system" namespace to be "Ready" ...
I0910 18:23:14.907496 299416 pod_ready.go:93] pod "kube-apiserver-addons-827965" in "kube-system" namespace has status "Ready":"True"
I0910 18:23:14.907533 299416 pod_ready.go:82] duration metric: took 6.844083ms for pod "kube-apiserver-addons-827965" in "kube-system" namespace to be "Ready" ...
I0910 18:23:14.907544 299416 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-827965" in "kube-system" namespace to be "Ready" ...
I0910 18:23:14.914136 299416 pod_ready.go:93] pod "kube-controller-manager-addons-827965" in "kube-system" namespace has status "Ready":"True"
I0910 18:23:14.914163 299416 pod_ready.go:82] duration metric: took 6.610411ms for pod "kube-controller-manager-addons-827965" in "kube-system" namespace to be "Ready" ...
I0910 18:23:14.914176 299416 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-nrtn6" in "kube-system" namespace to be "Ready" ...
I0910 18:23:15.005839 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:15.091526 299416 pod_ready.go:93] pod "kube-proxy-nrtn6" in "kube-system" namespace has status "Ready":"True"
I0910 18:23:15.091601 299416 pod_ready.go:82] duration metric: took 177.409682ms for pod "kube-proxy-nrtn6" in "kube-system" namespace to be "Ready" ...
I0910 18:23:15.091629 299416 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-827965" in "kube-system" namespace to be "Ready" ...
I0910 18:23:15.258290 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:15.258857 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:15.485666 299416 pod_ready.go:93] pod "kube-scheduler-addons-827965" in "kube-system" namespace has status "Ready":"True"
I0910 18:23:15.485703 299416 pod_ready.go:82] duration metric: took 394.049393ms for pod "kube-scheduler-addons-827965" in "kube-system" namespace to be "Ready" ...
I0910 18:23:15.485716 299416 pod_ready.go:79] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-cjl9w" in "kube-system" namespace to be "Ready" ...
I0910 18:23:15.515253 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:15.756316 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:15.757362 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:16.010753 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:16.258373 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:16.259348 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:16.505025 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:16.758420 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:16.759733 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:17.014021 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:17.258681 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:17.259384 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:17.503604 299416 pod_ready.go:103] pod "nvidia-device-plugin-daemonset-cjl9w" in "kube-system" namespace has status "Ready":"False"
I0910 18:23:17.506650 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:17.759174 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:17.759744 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:18.005657 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:18.257039 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:18.258726 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:18.505561 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:18.758396 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:18.759945 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:19.006624 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:19.257431 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:19.258366 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:19.504856 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:19.756866 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:19.758105 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:19.994124 299416 pod_ready.go:103] pod "nvidia-device-plugin-daemonset-cjl9w" in "kube-system" namespace has status "Ready":"False"
I0910 18:23:20.007974 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:20.257807 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:20.259261 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:20.513622 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:20.757395 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:20.758852 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:21.005226 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:21.258822 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:21.260498 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:21.504338 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:21.757067 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:21.757876 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:21.992293 299416 pod_ready.go:93] pod "nvidia-device-plugin-daemonset-cjl9w" in "kube-system" namespace has status "Ready":"True"
I0910 18:23:21.992319 299416 pod_ready.go:82] duration metric: took 6.506594745s for pod "nvidia-device-plugin-daemonset-cjl9w" in "kube-system" namespace to be "Ready" ...
I0910 18:23:21.992329 299416 pod_ready.go:39] duration metric: took 22.136911397s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0910 18:23:21.992347 299416 api_server.go:52] waiting for apiserver process to appear ...
I0910 18:23:21.992419 299416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0910 18:23:22.006393 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:22.007259 299416 api_server.go:72] duration metric: took 24.993471604s to wait for apiserver process to appear ...
I0910 18:23:22.007334 299416 api_server.go:88] waiting for apiserver healthz status ...
I0910 18:23:22.007373 299416 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I0910 18:23:22.024344 299416 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I0910 18:23:22.030559 299416 api_server.go:141] control plane version: v1.31.0
I0910 18:23:22.030597 299416 api_server.go:131] duration metric: took 23.241473ms to wait for apiserver health ...
I0910 18:23:22.030930 299416 system_pods.go:43] waiting for kube-system pods to appear ...
I0910 18:23:22.045988 299416 system_pods.go:59] 18 kube-system pods found
I0910 18:23:22.046032 299416 system_pods.go:61] "coredns-6f6b679f8f-bjn88" [594b662a-f2ef-45a8-a039-06f27308d125] Running
I0910 18:23:22.046043 299416 system_pods.go:61] "csi-hostpath-attacher-0" [3c9510d4-8a21-4316-bbb1-7e572354faa4] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0910 18:23:22.046052 299416 system_pods.go:61] "csi-hostpath-resizer-0" [2a2cefaf-593c-481c-837e-785a4a3aa902] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0910 18:23:22.046084 299416 system_pods.go:61] "csi-hostpathplugin-4542j" [9d65e2b3-0bad-4cf4-bec5-7ded0c55f0b3] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0910 18:23:22.046097 299416 system_pods.go:61] "etcd-addons-827965" [1cc28570-1d7f-48a7-9760-dc5ab8dcd733] Running
I0910 18:23:22.046102 299416 system_pods.go:61] "kindnet-c4t7q" [2841bfba-e43f-43ef-8b88-0435ea3e41d5] Running
I0910 18:23:22.046106 299416 system_pods.go:61] "kube-apiserver-addons-827965" [aa353b05-b2fc-4125-aad8-6ccef41f62ab] Running
I0910 18:23:22.046115 299416 system_pods.go:61] "kube-controller-manager-addons-827965" [9cf0b7df-79fd-49fe-bc84-a0f5506f0335] Running
I0910 18:23:22.046119 299416 system_pods.go:61] "kube-ingress-dns-minikube" [3d4d6b38-95c2-40de-ab8f-823163389480] Running
I0910 18:23:22.046126 299416 system_pods.go:61] "kube-proxy-nrtn6" [59483753-2db2-4234-a203-802954ec5861] Running
I0910 18:23:22.046132 299416 system_pods.go:61] "kube-scheduler-addons-827965" [72918edd-a98c-4eeb-85fa-c3cfcbaed1e6] Running
I0910 18:23:22.046138 299416 system_pods.go:61] "metrics-server-84c5f94fbc-57b72" [52cb36ea-2cee-4a6c-a843-050157ac918f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0910 18:23:22.046145 299416 system_pods.go:61] "nvidia-device-plugin-daemonset-cjl9w" [cf6a3aee-788b-4415-a203-22cbc57cda34] Running
I0910 18:23:22.046177 299416 system_pods.go:61] "registry-66c9cd494c-7t72n" [8fb774f6-bb57-4fa6-b59f-756cfe1a578c] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0910 18:23:22.046195 299416 system_pods.go:61] "registry-proxy-z6m52" [b1b42e77-8421-4f88-b61b-d3f2d3e35d90] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0910 18:23:22.046209 299416 system_pods.go:61] "snapshot-controller-56fcc65765-6zrwq" [1746b7ce-4dd9-4183-b370-c9116076a8d1] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0910 18:23:22.046217 299416 system_pods.go:61] "snapshot-controller-56fcc65765-z7nt4" [020d5a48-27e2-45cc-a6c4-9810352d5986] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0910 18:23:22.046226 299416 system_pods.go:61] "storage-provisioner" [d0fae042-74da-4edc-85df-c318851b7cb1] Running
I0910 18:23:22.046234 299416 system_pods.go:74] duration metric: took 15.289375ms to wait for pod list to return data ...
I0910 18:23:22.046247 299416 default_sa.go:34] waiting for default service account to be created ...
I0910 18:23:22.049369 299416 default_sa.go:45] found service account: "default"
I0910 18:23:22.049397 299416 default_sa.go:55] duration metric: took 3.143175ms for default service account to be created ...
I0910 18:23:22.049408 299416 system_pods.go:116] waiting for k8s-apps to be running ...
I0910 18:23:22.058643 299416 system_pods.go:86] 18 kube-system pods found
I0910 18:23:22.058681 299416 system_pods.go:89] "coredns-6f6b679f8f-bjn88" [594b662a-f2ef-45a8-a039-06f27308d125] Running
I0910 18:23:22.058692 299416 system_pods.go:89] "csi-hostpath-attacher-0" [3c9510d4-8a21-4316-bbb1-7e572354faa4] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0910 18:23:22.058700 299416 system_pods.go:89] "csi-hostpath-resizer-0" [2a2cefaf-593c-481c-837e-785a4a3aa902] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0910 18:23:22.058708 299416 system_pods.go:89] "csi-hostpathplugin-4542j" [9d65e2b3-0bad-4cf4-bec5-7ded0c55f0b3] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0910 18:23:22.058713 299416 system_pods.go:89] "etcd-addons-827965" [1cc28570-1d7f-48a7-9760-dc5ab8dcd733] Running
I0910 18:23:22.058718 299416 system_pods.go:89] "kindnet-c4t7q" [2841bfba-e43f-43ef-8b88-0435ea3e41d5] Running
I0910 18:23:22.058722 299416 system_pods.go:89] "kube-apiserver-addons-827965" [aa353b05-b2fc-4125-aad8-6ccef41f62ab] Running
I0910 18:23:22.058732 299416 system_pods.go:89] "kube-controller-manager-addons-827965" [9cf0b7df-79fd-49fe-bc84-a0f5506f0335] Running
I0910 18:23:22.058737 299416 system_pods.go:89] "kube-ingress-dns-minikube" [3d4d6b38-95c2-40de-ab8f-823163389480] Running
I0910 18:23:22.058741 299416 system_pods.go:89] "kube-proxy-nrtn6" [59483753-2db2-4234-a203-802954ec5861] Running
I0910 18:23:22.058745 299416 system_pods.go:89] "kube-scheduler-addons-827965" [72918edd-a98c-4eeb-85fa-c3cfcbaed1e6] Running
I0910 18:23:22.058761 299416 system_pods.go:89] "metrics-server-84c5f94fbc-57b72" [52cb36ea-2cee-4a6c-a843-050157ac918f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0910 18:23:22.058766 299416 system_pods.go:89] "nvidia-device-plugin-daemonset-cjl9w" [cf6a3aee-788b-4415-a203-22cbc57cda34] Running
I0910 18:23:22.058775 299416 system_pods.go:89] "registry-66c9cd494c-7t72n" [8fb774f6-bb57-4fa6-b59f-756cfe1a578c] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0910 18:23:22.058781 299416 system_pods.go:89] "registry-proxy-z6m52" [b1b42e77-8421-4f88-b61b-d3f2d3e35d90] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0910 18:23:22.058795 299416 system_pods.go:89] "snapshot-controller-56fcc65765-6zrwq" [1746b7ce-4dd9-4183-b370-c9116076a8d1] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0910 18:23:22.058809 299416 system_pods.go:89] "snapshot-controller-56fcc65765-z7nt4" [020d5a48-27e2-45cc-a6c4-9810352d5986] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0910 18:23:22.058814 299416 system_pods.go:89] "storage-provisioner" [d0fae042-74da-4edc-85df-c318851b7cb1] Running
I0910 18:23:22.058821 299416 system_pods.go:126] duration metric: took 9.407568ms to wait for k8s-apps to be running ...
I0910 18:23:22.058839 299416 system_svc.go:44] waiting for kubelet service to be running ....
I0910 18:23:22.058905 299416 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0910 18:23:22.072947 299416 system_svc.go:56] duration metric: took 14.098856ms WaitForService to wait for kubelet
I0910 18:23:22.072979 299416 kubeadm.go:582] duration metric: took 25.059197673s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0910 18:23:22.073001 299416 node_conditions.go:102] verifying NodePressure condition ...
I0910 18:23:22.076265 299416 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0910 18:23:22.076311 299416 node_conditions.go:123] node cpu capacity is 2
I0910 18:23:22.076324 299416 node_conditions.go:105] duration metric: took 3.317189ms to run NodePressure ...
I0910 18:23:22.076336 299416 start.go:241] waiting for startup goroutines ...
I0910 18:23:22.259146 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:22.260044 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:22.505009 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:22.758431 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:22.759533 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:23.004934 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:23.259378 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:23.261547 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:23.504655 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:23.759350 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:23.762276 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:24.005634 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:24.259257 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:24.260628 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:24.505083 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:24.757125 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:24.758082 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:25.027783 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:25.257026 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:25.257685 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:25.505279 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:25.755996 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:25.757476 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:26.015083 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:26.257362 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:26.257682 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:26.504336 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:26.760918 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:26.762092 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:27.005341 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:27.263524 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:27.264446 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:27.521055 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:27.759794 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:27.761215 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:28.007474 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:28.258697 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:28.259622 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:28.504525 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:28.767083 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:28.767464 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:29.006708 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:29.262597 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:29.264097 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:29.507739 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:29.761501 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:29.763823 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:30.017918 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:30.257587 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:30.259781 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:30.508249 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:30.758966 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:30.759385 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:31.007344 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:31.257593 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:31.259142 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:31.504716 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:31.759434 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:31.760724 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:32.006877 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:32.257162 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:32.259338 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:32.505710 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:32.757352 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:32.758471 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:33.005477 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:33.257423 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:33.258307 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:33.504989 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:33.759593 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:33.760852 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:34.005418 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:34.256685 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:34.257952 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:34.505221 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:34.756910 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:34.757944 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:35.014384 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:35.257152 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:35.257695 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:35.506194 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:35.759979 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:35.762172 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:36.007098 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:36.257916 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:36.258833 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:36.504188 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:36.758047 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:36.759508 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:37.005967 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:37.258656 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:37.260269 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:37.504699 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:37.756406 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:37.757371 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:38.005764 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:38.256540 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0910 18:23:38.258323 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:38.504419 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:38.758192 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:38.758703 299416 kapi.go:107] duration metric: took 31.506826794s to wait for kubernetes.io/minikube-addons=registry ...
I0910 18:23:39.022879 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:39.257076 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:39.506229 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:39.757259 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:40.007060 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:40.257098 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:40.504983 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:40.757191 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:41.005979 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:41.256475 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:41.505180 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:41.758080 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:42.025876 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:42.257002 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:42.505799 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:42.756631 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:43.005227 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:43.257014 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:43.504756 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:43.756201 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:44.006294 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:44.260680 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:44.506335 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:44.757885 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:45.010139 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:45.293050 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:45.505276 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:45.756576 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:46.014404 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:46.256380 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:46.505025 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:46.757084 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:47.006740 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:47.256533 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:47.504303 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:47.756401 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:48.005630 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:48.256668 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:48.505124 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:48.756954 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:49.057157 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:49.257568 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:49.504759 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:49.760546 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:50.005373 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:50.257415 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:50.506458 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:50.756946 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:51.010203 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:51.257339 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:51.505127 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:51.757321 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:52.007194 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:52.257210 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:52.505427 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:52.758143 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:53.007840 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:53.256879 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:53.506509 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:53.756525 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:54.005627 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:54.256880 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:54.504976 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:54.757035 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:55.009587 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:55.257714 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:55.505139 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:55.756619 299416 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0910 18:23:56.010895 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:56.256216 299416 kapi.go:107] duration metric: took 49.004345741s to wait for app.kubernetes.io/name=ingress-nginx ...
I0910 18:23:56.507180 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:57.007709 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:57.506349 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:58.013391 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:58.504898 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:59.006009 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:23:59.504223 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:24:00.049725 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:24:00.522545 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:24:01.005938 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:24:01.504878 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:24:02.011170 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:24:02.504427 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:24:03.019315 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:24:03.506135 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0910 18:24:04.041881 299416 kapi.go:107] duration metric: took 56.042145024s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0910 18:24:32.398879 299416 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0910 18:24:32.398904 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:32.898081 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:33.398182 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:33.897856 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:34.398771 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:34.898469 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:35.398308 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:35.897949 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:36.398200 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:36.897914 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:37.398858 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:37.899315 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:38.399082 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:38.897910 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:39.399268 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:39.897643 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:40.398972 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:40.898174 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:41.397793 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:41.898309 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:42.398445 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:42.897967 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:43.399145 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:43.898506 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:44.398656 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:44.898437 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:45.399329 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:45.898487 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:46.398611 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:46.897795 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:47.399031 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:47.898209 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:48.398679 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:48.898326 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:49.398596 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:49.898398 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:50.398084 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:50.898221 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:51.397839 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:51.899123 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:52.399037 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:52.898483 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:53.398195 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:53.898369 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:54.399096 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:54.898183 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:55.397948 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:55.898559 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:56.398455 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:56.898596 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:57.398146 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:57.898184 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:58.397949 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:58.899100 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:59.398658 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:24:59.898237 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:00.406399 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:00.898395 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:01.397931 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:01.898212 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:02.398845 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:02.898383 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:03.398009 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:03.899247 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:04.398227 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:04.897793 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:05.398614 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:05.898749 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:06.398918 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:06.897839 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:07.399009 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:07.899047 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:08.398668 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:08.897957 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:09.398918 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:09.899002 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:10.399042 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:10.898456 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:11.398452 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:11.898675 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:12.398681 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:12.899601 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:13.398409 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:13.899049 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:14.397722 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:14.898633 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:15.407390 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:15.898579 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:16.400898 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:16.898449 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:17.398139 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:17.897922 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:18.398545 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:18.898403 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:19.398963 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:19.897726 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:20.398151 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:20.898165 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:21.398310 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:21.897884 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:22.399326 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:22.898981 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:23.398582 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:23.898494 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:24.398364 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:24.898003 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:25.397734 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:25.898840 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:26.400269 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:26.898281 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:27.398416 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:27.898799 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:28.400481 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:28.898028 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:29.398615 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:29.898380 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:30.397794 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:30.898667 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:31.398847 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:31.898774 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:32.398185 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:32.897951 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:33.398537 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:33.898760 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:34.398886 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:34.898238 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:35.398003 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:35.898553 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:36.398069 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:36.899083 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:37.398198 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:37.898008 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:38.398293 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:38.899324 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:39.398367 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:39.898886 299416 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0910 18:25:40.398588 299416 kapi.go:107] duration metric: took 2m31.004031506s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0910 18:25:40.400407 299416 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-827965 cluster.
I0910 18:25:40.402274 299416 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0910 18:25:40.404143 299416 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0910 18:25:40.406163 299416 out.go:177] * Enabled addons: nvidia-device-plugin, volcano, cloud-spanner, storage-provisioner, ingress-dns, metrics-server, inspektor-gadget, yakd, storage-provisioner-rancher, volumesnapshots, registry, ingress, csi-hostpath-driver, gcp-auth
I0910 18:25:40.408119 299416 addons.go:510] duration metric: took 2m43.393900584s for enable addons: enabled=[nvidia-device-plugin volcano cloud-spanner storage-provisioner ingress-dns metrics-server inspektor-gadget yakd storage-provisioner-rancher volumesnapshots registry ingress csi-hostpath-driver gcp-auth]
I0910 18:25:40.408183 299416 start.go:246] waiting for cluster config update ...
I0910 18:25:40.408209 299416 start.go:255] writing updated cluster config ...
I0910 18:25:40.408597 299416 ssh_runner.go:195] Run: rm -f paused
I0910 18:25:40.751947 299416 start.go:600] kubectl: 1.31.0, cluster: 1.31.0 (minor skew: 0)
I0910 18:25:40.753922 299416 out.go:177] * Done! kubectl is now configured to use "addons-827965" cluster and "default" namespace by default
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
29e3310f7554c 4f725bf50aaa5 2 minutes ago Exited gadget 5 8a0ef8807fc06 gadget-b2s4d
7f8b429bc316c 6ef582f3ec844 3 minutes ago Running gcp-auth 0 ffe9f9fdfec8d gcp-auth-89d5ffd79-4lffn
3346edf2bdd1d 8b46b1cd48760 4 minutes ago Running admission 0 cdac0d3fd94d9 volcano-admission-77d7d48b68-vnlcw
26f7c4e5b6561 ee6d597e62dc8 4 minutes ago Running csi-snapshotter 0 3218353a12935 csi-hostpathplugin-4542j
14941ec7bb872 642ded511e141 4 minutes ago Running csi-provisioner 0 3218353a12935 csi-hostpathplugin-4542j
71c2c39d87177 922312104da8a 4 minutes ago Running liveness-probe 0 3218353a12935 csi-hostpathplugin-4542j
f6a6d031f11b5 08f6b2990811a 5 minutes ago Running hostpath 0 3218353a12935 csi-hostpathplugin-4542j
81f1d288b9d17 0107d56dbc0be 5 minutes ago Running node-driver-registrar 0 3218353a12935 csi-hostpathplugin-4542j
40ec33c24cf0f 289a818c8d9c5 5 minutes ago Running controller 0 e8b8334a6ea5b ingress-nginx-controller-bc57996ff-kk8jh
26d007e8263ee 9a80d518f102c 5 minutes ago Running csi-attacher 0 f46319bb56d20 csi-hostpath-attacher-0
936bb8f99f1fa 1505f556b3a7b 5 minutes ago Running volcano-controllers 0 64af32c29e359 volcano-controllers-56675bb4d5-kmkm9
a04eac86bdad6 d9c7ad4c226bf 5 minutes ago Running volcano-scheduler 0 59533b36c6140 volcano-scheduler-576bc46687-7x7qn
96a45dd439741 487fa743e1e22 5 minutes ago Running csi-resizer 0 d16257de31353 csi-hostpath-resizer-0
f1ed1c7b0bdc4 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 9a7a26d2d85a5 snapshot-controller-56fcc65765-z7nt4
5ad24f13a546f 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 5f4bfb2198aa5 snapshot-controller-56fcc65765-6zrwq
b54031ac7936e 420193b27261a 5 minutes ago Exited patch 0 1e8ec58bfe6d9 ingress-nginx-admission-patch-4qnbd
7bbffa222e102 1461903ec4fe9 5 minutes ago Running csi-external-health-monitor-controller 0 3218353a12935 csi-hostpathplugin-4542j
2287a7ce9fb26 3410e1561990a 5 minutes ago Running registry-proxy 0 afa5c8e9a9755 registry-proxy-z6m52
6ee3cd6338b69 77bdba588b953 5 minutes ago Running yakd 0 2bb8fdfb4e916 yakd-dashboard-67d98fc6b-62hjp
15972f694a938 420193b27261a 5 minutes ago Exited create 0 63afcaaaed182 ingress-nginx-admission-create-qvwfp
06b27e4869924 5548a49bb60ba 5 minutes ago Running metrics-server 0 d0bd4fa6c158f metrics-server-84c5f94fbc-57b72
ee6cb725c120a 7ce2150c8929b 5 minutes ago Running local-path-provisioner 0 e9f7bcdec87f6 local-path-provisioner-86d989889c-b4bx6
f69e8c0f18a6a c9cf76bb104e1 5 minutes ago Running registry 0 a9c3fb3f6492e registry-66c9cd494c-7t72n
dd1d2db0bd5bf 8be4bcf8ec607 5 minutes ago Running cloud-spanner-emulator 0 5248e82a8f0de cloud-spanner-emulator-769b77f747-lb4q4
b6b8e6d1d58cc a9bac31a5be8d 5 minutes ago Running nvidia-device-plugin-ctr 0 5c40e3a3d0397 nvidia-device-plugin-daemonset-cjl9w
09dcb88574ee8 2437cf7621777 5 minutes ago Running coredns 0 23ab9d1001cbc coredns-6f6b679f8f-bjn88
a6b29df2818d8 35508c2f890c4 5 minutes ago Running minikube-ingress-dns 0 b2ddf2ceb48f2 kube-ingress-dns-minikube
a832fed128df0 ba04bb24b9575 5 minutes ago Running storage-provisioner 0 e91aa5dea26e7 storage-provisioner
c3cf0e6bff461 6a23fa8fd2b78 5 minutes ago Running kindnet-cni 0 0ef75dd572b82 kindnet-c4t7q
cf0193a7cab5f 71d55d66fd4ee 6 minutes ago Running kube-proxy 0 31de72fb38311 kube-proxy-nrtn6
baac9a2acec95 fbbbd428abb4d 6 minutes ago Running kube-scheduler 0 9d46a5b66c075 kube-scheduler-addons-827965
a291cd7f20381 27e3830e14027 6 minutes ago Running etcd 0 a540bc020523b etcd-addons-827965
072fd68238f64 cd0f0ae0ec9e0 6 minutes ago Running kube-apiserver 0 d436f8b2a99f9 kube-apiserver-addons-827965
c17982cd96cf6 fcb0683e6bdbd 6 minutes ago Running kube-controller-manager 0 771a19251b846 kube-controller-manager-addons-827965
==> containerd <==
Sep 10 18:26:43 addons-827965 containerd[815]: time="2024-09-10T18:26:43.390131118Z" level=info msg="CreateContainer within sandbox \"8a0ef8807fc0672094b7bbb3827f906af19997b9c5f9c13b7e6045cb5e7bafe8\" for container &ContainerMetadata{Name:gadget,Attempt:5,}"
Sep 10 18:26:43 addons-827965 containerd[815]: time="2024-09-10T18:26:43.412539068Z" level=info msg="CreateContainer within sandbox \"8a0ef8807fc0672094b7bbb3827f906af19997b9c5f9c13b7e6045cb5e7bafe8\" for &ContainerMetadata{Name:gadget,Attempt:5,} returns container id \"29e3310f7554cc1026e2e028e1999467827eead4267143ac054b1d22ccc5fe2d\""
Sep 10 18:26:43 addons-827965 containerd[815]: time="2024-09-10T18:26:43.413285059Z" level=info msg="StartContainer for \"29e3310f7554cc1026e2e028e1999467827eead4267143ac054b1d22ccc5fe2d\""
Sep 10 18:26:43 addons-827965 containerd[815]: time="2024-09-10T18:26:43.469449730Z" level=info msg="StartContainer for \"29e3310f7554cc1026e2e028e1999467827eead4267143ac054b1d22ccc5fe2d\" returns successfully"
Sep 10 18:26:44 addons-827965 containerd[815]: time="2024-09-10T18:26:44.864717084Z" level=error msg="ExecSync for \"29e3310f7554cc1026e2e028e1999467827eead4267143ac054b1d22ccc5fe2d\" failed" error="failed to exec in container: failed to start exec \"457b00553ee6f9cd4705bc920f818cc1de6f50c0dbe3352ee49f3702e2a18bf3\": OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown"
Sep 10 18:26:44 addons-827965 containerd[815]: time="2024-09-10T18:26:44.876284250Z" level=error msg="ExecSync for \"29e3310f7554cc1026e2e028e1999467827eead4267143ac054b1d22ccc5fe2d\" failed" error="failed to exec in container: failed to start exec \"4e397b77f795f820cd30df094019dd3e5620ffc14d2f76ecc2edf9751439641c\": OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown"
Sep 10 18:26:44 addons-827965 containerd[815]: time="2024-09-10T18:26:44.886041191Z" level=error msg="ExecSync for \"29e3310f7554cc1026e2e028e1999467827eead4267143ac054b1d22ccc5fe2d\" failed" error="failed to exec in container: failed to start exec \"fd9c0b6f34cbf60b938dc9fd1af1c139a74fba70ea584ee36b51b377933fec7d\": OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown"
Sep 10 18:26:44 addons-827965 containerd[815]: time="2024-09-10T18:26:44.897166955Z" level=error msg="ExecSync for \"29e3310f7554cc1026e2e028e1999467827eead4267143ac054b1d22ccc5fe2d\" failed" error="failed to exec in container: failed to start exec \"52a2a903d6e8e9065518dbe020ed61413157fd41632c0ef29956a0bb803f6ece\": OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown"
Sep 10 18:26:44 addons-827965 containerd[815]: time="2024-09-10T18:26:44.908331472Z" level=error msg="ExecSync for \"29e3310f7554cc1026e2e028e1999467827eead4267143ac054b1d22ccc5fe2d\" failed" error="failed to exec in container: failed to start exec \"fd9019d393e2e0239f48ae523836356f2d02b8803ee26481474015e54514664c\": OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown"
Sep 10 18:26:44 addons-827965 containerd[815]: time="2024-09-10T18:26:44.929698991Z" level=error msg="ExecSync for \"29e3310f7554cc1026e2e028e1999467827eead4267143ac054b1d22ccc5fe2d\" failed" error="failed to exec in container: failed to start exec \"1d85329c104859e630c4b6babccf38cc0fcc0e5e497996e328221a0636f4b34d\": OCI runtime exec failed: exec failed: cannot exec in a stopped container: unknown"
Sep 10 18:26:45 addons-827965 containerd[815]: time="2024-09-10T18:26:45.186050904Z" level=info msg="shim disconnected" id=29e3310f7554cc1026e2e028e1999467827eead4267143ac054b1d22ccc5fe2d namespace=k8s.io
Sep 10 18:26:45 addons-827965 containerd[815]: time="2024-09-10T18:26:45.186127958Z" level=warning msg="cleaning up after shim disconnected" id=29e3310f7554cc1026e2e028e1999467827eead4267143ac054b1d22ccc5fe2d namespace=k8s.io
Sep 10 18:26:45 addons-827965 containerd[815]: time="2024-09-10T18:26:45.186144894Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Sep 10 18:26:45 addons-827965 containerd[815]: time="2024-09-10T18:26:45.497144363Z" level=info msg="RemoveContainer for \"e04aa7b3735ea85c5de3ca1e9dfbdab7a9d634914d6f9bb87658db0f5f5186ea\""
Sep 10 18:26:45 addons-827965 containerd[815]: time="2024-09-10T18:26:45.505726622Z" level=info msg="RemoveContainer for \"e04aa7b3735ea85c5de3ca1e9dfbdab7a9d634914d6f9bb87658db0f5f5186ea\" returns successfully"
Sep 10 18:26:51 addons-827965 containerd[815]: time="2024-09-10T18:26:51.371830781Z" level=info msg="RemoveContainer for \"fa2c0c125a9a44b2cdea8a1cb4dd48e48175bb5e1da401c1fc7f5492c8b29b99\""
Sep 10 18:26:51 addons-827965 containerd[815]: time="2024-09-10T18:26:51.378544280Z" level=info msg="RemoveContainer for \"fa2c0c125a9a44b2cdea8a1cb4dd48e48175bb5e1da401c1fc7f5492c8b29b99\" returns successfully"
Sep 10 18:26:51 addons-827965 containerd[815]: time="2024-09-10T18:26:51.381923605Z" level=info msg="StopPodSandbox for \"024925c824c721cc5a64cfb3d02bd6ed52a3555459a5474eb6d9ade6bedd3acc\""
Sep 10 18:26:51 addons-827965 containerd[815]: time="2024-09-10T18:26:51.389419050Z" level=info msg="TearDown network for sandbox \"024925c824c721cc5a64cfb3d02bd6ed52a3555459a5474eb6d9ade6bedd3acc\" successfully"
Sep 10 18:26:51 addons-827965 containerd[815]: time="2024-09-10T18:26:51.389587509Z" level=info msg="StopPodSandbox for \"024925c824c721cc5a64cfb3d02bd6ed52a3555459a5474eb6d9ade6bedd3acc\" returns successfully"
Sep 10 18:26:51 addons-827965 containerd[815]: time="2024-09-10T18:26:51.390218636Z" level=info msg="RemovePodSandbox for \"024925c824c721cc5a64cfb3d02bd6ed52a3555459a5474eb6d9ade6bedd3acc\""
Sep 10 18:26:51 addons-827965 containerd[815]: time="2024-09-10T18:26:51.390271280Z" level=info msg="Forcibly stopping sandbox \"024925c824c721cc5a64cfb3d02bd6ed52a3555459a5474eb6d9ade6bedd3acc\""
Sep 10 18:26:51 addons-827965 containerd[815]: time="2024-09-10T18:26:51.399257008Z" level=info msg="TearDown network for sandbox \"024925c824c721cc5a64cfb3d02bd6ed52a3555459a5474eb6d9ade6bedd3acc\" successfully"
Sep 10 18:26:51 addons-827965 containerd[815]: time="2024-09-10T18:26:51.405686192Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"024925c824c721cc5a64cfb3d02bd6ed52a3555459a5474eb6d9ade6bedd3acc\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus."
Sep 10 18:26:51 addons-827965 containerd[815]: time="2024-09-10T18:26:51.405997912Z" level=info msg="RemovePodSandbox \"024925c824c721cc5a64cfb3d02bd6ed52a3555459a5474eb6d9ade6bedd3acc\" returns successfully"
==> coredns [09dcb88574ee891e6db9b92ecc6e85ebc730d7cd4f68581e0651d55dcb465cec] <==
[INFO] 10.244.0.7:52496 - 1405 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000215646s
[INFO] 10.244.0.7:45707 - 7025 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002207769s
[INFO] 10.244.0.7:45707 - 40812 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002263613s
[INFO] 10.244.0.7:47085 - 10847 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000143524s
[INFO] 10.244.0.7:47085 - 29273 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000071811s
[INFO] 10.244.0.7:40531 - 24606 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000127434s
[INFO] 10.244.0.7:40531 - 3345 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000073469s
[INFO] 10.244.0.7:40695 - 3517 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000062613s
[INFO] 10.244.0.7:40695 - 47546 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000071417s
[INFO] 10.244.0.7:35327 - 29786 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000051996s
[INFO] 10.244.0.7:35327 - 26968 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000083914s
[INFO] 10.244.0.7:49776 - 30823 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001414099s
[INFO] 10.244.0.7:49776 - 12137 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001010047s
[INFO] 10.244.0.7:42412 - 35900 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000053046s
[INFO] 10.244.0.7:42412 - 53050 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000124889s
[INFO] 10.244.0.24:46217 - 39871 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.001683546s
[INFO] 10.244.0.24:51975 - 47365 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.002727997s
[INFO] 10.244.0.24:36713 - 3656 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000110252s
[INFO] 10.244.0.24:48110 - 40034 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.0001658s
[INFO] 10.244.0.24:43835 - 45322 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000100323s
[INFO] 10.244.0.24:40347 - 48540 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.00011867s
[INFO] 10.244.0.24:53882 - 18602 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002674697s
[INFO] 10.244.0.24:38113 - 63146 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002676936s
[INFO] 10.244.0.24:38836 - 52999 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.001689487s
[INFO] 10.244.0.24:39683 - 5495 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 610 0.001785757s
==> describe nodes <==
Name: addons-827965
Roles: control-plane
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=addons-827965
kubernetes.io/os=linux
minikube.k8s.io/commit=37b4bace07cd53444288cad630e4db4b688b8c18
minikube.k8s.io/name=addons-827965
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_09_10T18_22_52_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-827965
Annotations: csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-827965"}
kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Tue, 10 Sep 2024 18:22:48 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-827965
AcquireTime: <unset>
RenewTime: Tue, 10 Sep 2024 18:28:58 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Tue, 10 Sep 2024 18:25:54 +0000 Tue, 10 Sep 2024 18:22:43 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Tue, 10 Sep 2024 18:25:54 +0000 Tue, 10 Sep 2024 18:22:43 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Tue, 10 Sep 2024 18:25:54 +0000 Tue, 10 Sep 2024 18:22:43 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Tue, 10 Sep 2024 18:25:54 +0000 Tue, 10 Sep 2024 18:22:49 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-827965
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022304Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022304Ki
pods: 110
System Info:
Machine ID: cfb7272f00454787a434848e7fb00326
System UUID: 0b3c83f9-4a36-4cd8-b12b-eef3a1fe4ab5
Boot ID: 7bf0ec17-776b-49a4-8976-7c252db50227
Kernel Version: 5.15.0-1068-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.21
Kubelet Version: v1.31.0
Kube-Proxy Version:
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (27 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default cloud-spanner-emulator-769b77f747-lb4q4 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
gadget gadget-b2s4d 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
gcp-auth gcp-auth-89d5ffd79-4lffn 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m27s
ingress-nginx ingress-nginx-controller-bc57996ff-kk8jh 100m (5%) 0 (0%) 90Mi (1%) 0 (0%) 5m54s
kube-system coredns-6f6b679f8f-bjn88 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 6m3s
kube-system csi-hostpath-attacher-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
kube-system csi-hostpath-resizer-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
kube-system csi-hostpathplugin-4542j 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
kube-system etcd-addons-827965 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 6m9s
kube-system kindnet-c4t7q 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 6m3s
kube-system kube-apiserver-addons-827965 250m (12%) 0 (0%) 0 (0%) 0 (0%) 6m8s
kube-system kube-controller-manager-addons-827965 200m (10%) 0 (0%) 0 (0%) 0 (0%) 6m8s
kube-system kube-ingress-dns-minikube 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
kube-system kube-proxy-nrtn6 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m3s
kube-system kube-scheduler-addons-827965 100m (5%) 0 (0%) 0 (0%) 0 (0%) 6m8s
kube-system metrics-server-84c5f94fbc-57b72 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 5m57s
kube-system nvidia-device-plugin-daemonset-cjl9w 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m
kube-system registry-66c9cd494c-7t72n 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
kube-system registry-proxy-z6m52 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
kube-system snapshot-controller-56fcc65765-6zrwq 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m55s
kube-system snapshot-controller-56fcc65765-z7nt4 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m55s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
local-path-storage local-path-provisioner-86d989889c-b4bx6 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
volcano-system volcano-admission-77d7d48b68-vnlcw 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m54s
volcano-system volcano-controllers-56675bb4d5-kmkm9 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m53s
volcano-system volcano-scheduler-576bc46687-7x7qn 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m53s
yakd-dashboard yakd-dashboard-67d98fc6b-62hjp 0 (0%) 0 (0%) 128Mi (1%) 256Mi (3%) 5m56s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 1050m (52%) 100m (5%)
memory 638Mi (8%) 476Mi (6%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 6m1s kube-proxy
Normal NodeHasSufficientMemory 6m17s (x8 over 6m17s) kubelet Node addons-827965 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m17s (x7 over 6m17s) kubelet Node addons-827965 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m17s (x7 over 6m17s) kubelet Node addons-827965 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 6m17s kubelet Updated Node Allocatable limit across pods
Normal Starting 6m8s kubelet Starting kubelet.
Warning CgroupV1 6m8s kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeAllocatableEnforced 6m8s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 6m8s kubelet Node addons-827965 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m8s kubelet Node addons-827965 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m8s kubelet Node addons-827965 status is now: NodeHasSufficientPID
Normal RegisteredNode 6m4s node-controller Node addons-827965 event: Registered Node addons-827965 in Controller
==> dmesg <==
[Sep10 16:17] ACPI: SRAT not present
[ +0.000000] ACPI: SRAT not present
[ +0.000000] SPI driver altr_a10sr has no spi_device_id for altr,a10sr
[ +0.016632] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[ +0.448339] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
[ +0.720885] ena 0000:00:05.0: LLQ is not supported Fallback to host mode policy.
[ +6.671385] kauditd_printk_skb: 36 callbacks suppressed
[Sep10 17:23] FS-Cache: Duplicate cookie detected
[ +0.000752] FS-Cache: O-cookie c=00000013 [p=00000002 fl=222 nc=0 na=1]
[ +0.001089] FS-Cache: O-cookie d=000000009363ae61{9P.session} n=00000000de87a977
[ +0.001185] FS-Cache: O-key=[10] '34323935383836303636'
[ +0.000825] FS-Cache: N-cookie c=00000014 [p=00000002 fl=2 nc=0 na=1]
[ +0.000998] FS-Cache: N-cookie d=000000009363ae61{9P.session} n=000000001d6c2bf4
[ +0.001208] FS-Cache: N-key=[10] '34323935383836303636'
[Sep10 17:28] hrtimer: interrupt took 15131239 ns
[Sep10 17:50] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
==> etcd [a291cd7f203819733af5b95e80a04b9c7f5c75cc164cb269c6baf9074f098a00] <==
{"level":"info","ts":"2024-09-10T18:22:43.376947Z","caller":"embed/etcd.go:728","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
{"level":"info","ts":"2024-09-10T18:22:43.377483Z","caller":"embed/etcd.go:279","msg":"now serving peer/client/metrics","local-member-id":"aec36adc501070cc","initial-advertise-peer-urls":["https://192.168.49.2:2380"],"listen-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.49.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
{"level":"info","ts":"2024-09-10T18:22:43.377272Z","caller":"embed/etcd.go:599","msg":"serving peer traffic","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-09-10T18:22:43.378702Z","caller":"embed/etcd.go:571","msg":"cmux::serve","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-09-10T18:22:43.378569Z","caller":"embed/etcd.go:870","msg":"serving metrics","address":"http://127.0.0.1:2381"}
{"level":"info","ts":"2024-09-10T18:22:44.332841Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
{"level":"info","ts":"2024-09-10T18:22:44.333059Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
{"level":"info","ts":"2024-09-10T18:22:44.333213Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
{"level":"info","ts":"2024-09-10T18:22:44.333354Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
{"level":"info","ts":"2024-09-10T18:22:44.333449Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-10T18:22:44.333546Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
{"level":"info","ts":"2024-09-10T18:22:44.333639Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-10T18:22:44.336384Z","caller":"etcdserver/server.go:2629","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-10T18:22:44.337559Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-827965 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
{"level":"info","ts":"2024-09-10T18:22:44.337676Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-10T18:22:44.338174Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-10T18:22:44.338597Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-10T18:22:44.338746Z","caller":"etcdserver/server.go:2653","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-10T18:22:44.338853Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-10T18:22:44.339695Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-10T18:22:44.345361Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
{"level":"info","ts":"2024-09-10T18:22:44.346476Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-10T18:22:44.350618Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-09-10T18:22:44.351810Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-09-10T18:22:44.351910Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
==> gcp-auth [7f8b429bc316c7d5e445f97cab14ebed788ef887084340b0d6105515a105511c] <==
2024/09/10 18:25:39 GCP Auth Webhook started!
2024/09/10 18:25:57 Ready to marshal response ...
2024/09/10 18:25:57 Ready to write response ...
2024/09/10 18:25:58 Ready to marshal response ...
2024/09/10 18:25:58 Ready to write response ...
==> kernel <==
18:28:59 up 2:11, 0 users, load average: 0.33, 1.42, 2.45
Linux addons-827965 5.15.0-1068-aws #74~20.04.1-Ubuntu SMP Tue Aug 6 19:45:17 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [c3cf0e6bff461f0f7829ccead4b987706dbf95433921f16d805d53b80cd47f6a] <==
I0910 18:26:50.694781 1 main.go:299] handling current node
I0910 18:27:00.693807 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0910 18:27:00.693839 1 main.go:299] handling current node
I0910 18:27:10.701158 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0910 18:27:10.701195 1 main.go:299] handling current node
I0910 18:27:20.698984 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0910 18:27:20.699018 1 main.go:299] handling current node
I0910 18:27:30.697655 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0910 18:27:30.697693 1 main.go:299] handling current node
I0910 18:27:40.693739 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0910 18:27:40.694729 1 main.go:299] handling current node
I0910 18:27:50.694907 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0910 18:27:50.694941 1 main.go:299] handling current node
I0910 18:28:00.693934 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0910 18:28:00.693966 1 main.go:299] handling current node
I0910 18:28:10.698325 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0910 18:28:10.698360 1 main.go:299] handling current node
I0910 18:28:20.703185 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0910 18:28:20.703436 1 main.go:299] handling current node
I0910 18:28:30.700872 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0910 18:28:30.700908 1 main.go:299] handling current node
I0910 18:28:40.696638 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0910 18:28:40.696672 1 main.go:299] handling current node
I0910 18:28:50.700893 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0910 18:28:50.700928 1 main.go:299] handling current node
==> kube-apiserver [072fd68238f645dd18058ab1e5d8a5db591c71f941bea6c1e532f4502cbeed8e] <==
W0910 18:24:06.335689 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.37.14:443: connect: connection refused
W0910 18:24:07.340306 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.37.14:443: connect: connection refused
W0910 18:24:08.381625 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.37.14:443: connect: connection refused
W0910 18:24:09.444317 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.37.14:443: connect: connection refused
W0910 18:24:10.500319 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.37.14:443: connect: connection refused
W0910 18:24:11.599564 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.37.14:443: connect: connection refused
W0910 18:24:12.170672 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.110.246.53:443: connect: connection refused
E0910 18:24:12.170711 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.110.246.53:443: connect: connection refused" logger="UnhandledError"
W0910 18:24:12.172516 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.106.37.14:443: connect: connection refused
W0910 18:24:12.223742 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.110.246.53:443: connect: connection refused
E0910 18:24:12.223778 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.110.246.53:443: connect: connection refused" logger="UnhandledError"
W0910 18:24:12.225444 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.106.37.14:443: connect: connection refused
W0910 18:24:12.655119 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.37.14:443: connect: connection refused
W0910 18:24:13.750928 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.37.14:443: connect: connection refused
W0910 18:24:14.757382 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.37.14:443: connect: connection refused
W0910 18:24:15.801628 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.37.14:443: connect: connection refused
W0910 18:24:16.847846 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.37.14:443: connect: connection refused
W0910 18:24:32.158371 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.110.246.53:443: connect: connection refused
E0910 18:24:32.158411 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.110.246.53:443: connect: connection refused" logger="UnhandledError"
W0910 18:25:12.182145 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.110.246.53:443: connect: connection refused
E0910 18:25:12.182189 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.110.246.53:443: connect: connection refused" logger="UnhandledError"
W0910 18:25:12.232256 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.110.246.53:443: connect: connection refused
E0910 18:25:12.232307 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.110.246.53:443: connect: connection refused" logger="UnhandledError"
I0910 18:25:57.333594 1 controller.go:615] quota admission added evaluator for: jobs.batch.volcano.sh
I0910 18:25:57.370956 1 controller.go:615] quota admission added evaluator for: podgroups.scheduling.volcano.sh
==> kube-controller-manager [c17982cd96cf63abd423c19144c240dfee253efc845260dc9c2aec21b61ab249] <==
I0910 18:25:12.208346 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0910 18:25:12.208532 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0910 18:25:12.225553 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0910 18:25:12.242334 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0910 18:25:12.256319 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0910 18:25:12.256498 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0910 18:25:12.268770 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0910 18:25:13.240688 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0910 18:25:13.252951 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0910 18:25:14.365541 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0910 18:25:14.386246 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0910 18:25:15.372060 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0910 18:25:15.379581 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0910 18:25:15.390726 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0910 18:25:15.398819 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0910 18:25:15.413280 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0910 18:25:15.419376 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0910 18:25:40.338223 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="11.087447ms"
I0910 18:25:40.338434 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="71.523µs"
I0910 18:25:45.088679 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0910 18:25:45.093205 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0910 18:25:45.194292 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0910 18:25:45.194748 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0910 18:25:54.597143 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-827965"
I0910 18:25:57.016697 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="volcano-system/volcano-admission-init" delay="0s"
==> kube-proxy [cf0193a7cab5f78844e2776c88a344098adea88b1467578fecee3949c17f711c] <==
I0910 18:22:58.152867 1 server_linux.go:66] "Using iptables proxy"
I0910 18:22:58.270297 1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
E0910 18:22:58.270364 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I0910 18:22:58.310442 1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I0910 18:22:58.310509 1 server_linux.go:169] "Using iptables Proxier"
I0910 18:22:58.314379 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I0910 18:22:58.317120 1 server.go:483] "Version info" version="v1.31.0"
I0910 18:22:58.317143 1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0910 18:22:58.321021 1 config.go:197] "Starting service config controller"
I0910 18:22:58.321054 1 shared_informer.go:313] Waiting for caches to sync for service config
I0910 18:22:58.321082 1 config.go:104] "Starting endpoint slice config controller"
I0910 18:22:58.321087 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0910 18:22:58.321704 1 config.go:326] "Starting node config controller"
I0910 18:22:58.321722 1 shared_informer.go:313] Waiting for caches to sync for node config
I0910 18:22:58.421432 1 shared_informer.go:320] Caches are synced for endpoint slice config
I0910 18:22:58.421497 1 shared_informer.go:320] Caches are synced for service config
I0910 18:22:58.421797 1 shared_informer.go:320] Caches are synced for node config
==> kube-scheduler [baac9a2acec95c84458ff384924631579252810601ea21eed26c7e3eafa87e6c] <==
W0910 18:22:48.897892 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0910 18:22:48.900994 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0910 18:22:48.898274 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0910 18:22:48.901091 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0910 18:22:49.724210 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0910 18:22:49.724319 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0910 18:22:49.824759 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
E0910 18:22:49.824928 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0910 18:22:49.912025 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0910 18:22:49.912288 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0910 18:22:49.966260 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0910 18:22:49.966621 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0910 18:22:49.977779 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0910 18:22:49.978042 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError"
W0910 18:22:49.989529 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0910 18:22:49.989573 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0910 18:22:50.061329 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0910 18:22:50.064875 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0910 18:22:50.113173 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0910 18:22:50.113410 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0910 18:22:50.123379 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0910 18:22:50.123426 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0910 18:22:50.154623 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0910 18:22:50.154866 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError"
I0910 18:22:50.474110 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Sep 10 18:26:51 addons-827965 kubelet[1499]: I0910 18:26:51.370399 1499 scope.go:117] "RemoveContainer" containerID="fa2c0c125a9a44b2cdea8a1cb4dd48e48175bb5e1da401c1fc7f5492c8b29b99"
Sep 10 18:27:03 addons-827965 kubelet[1499]: I0910 18:27:03.257785 1499 scope.go:117] "RemoveContainer" containerID="29e3310f7554cc1026e2e028e1999467827eead4267143ac054b1d22ccc5fe2d"
Sep 10 18:27:03 addons-827965 kubelet[1499]: E0910 18:27:03.258173 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b2s4d_gadget(42586159-83ee-4fc6-8f18-fdeb15adfcde)\"" pod="gadget/gadget-b2s4d" podUID="42586159-83ee-4fc6-8f18-fdeb15adfcde"
Sep 10 18:27:12 addons-827965 kubelet[1499]: I0910 18:27:12.257694 1499 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-cjl9w" secret="" err="secret \"gcp-auth\" not found"
Sep 10 18:27:13 addons-827965 kubelet[1499]: I0910 18:27:13.258192 1499 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-66c9cd494c-7t72n" secret="" err="secret \"gcp-auth\" not found"
Sep 10 18:27:18 addons-827965 kubelet[1499]: I0910 18:27:18.257787 1499 scope.go:117] "RemoveContainer" containerID="29e3310f7554cc1026e2e028e1999467827eead4267143ac054b1d22ccc5fe2d"
Sep 10 18:27:18 addons-827965 kubelet[1499]: E0910 18:27:18.257991 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b2s4d_gadget(42586159-83ee-4fc6-8f18-fdeb15adfcde)\"" pod="gadget/gadget-b2s4d" podUID="42586159-83ee-4fc6-8f18-fdeb15adfcde"
Sep 10 18:27:29 addons-827965 kubelet[1499]: I0910 18:27:29.258108 1499 scope.go:117] "RemoveContainer" containerID="29e3310f7554cc1026e2e028e1999467827eead4267143ac054b1d22ccc5fe2d"
Sep 10 18:27:29 addons-827965 kubelet[1499]: E0910 18:27:29.258309 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b2s4d_gadget(42586159-83ee-4fc6-8f18-fdeb15adfcde)\"" pod="gadget/gadget-b2s4d" podUID="42586159-83ee-4fc6-8f18-fdeb15adfcde"
Sep 10 18:27:41 addons-827965 kubelet[1499]: I0910 18:27:41.259121 1499 scope.go:117] "RemoveContainer" containerID="29e3310f7554cc1026e2e028e1999467827eead4267143ac054b1d22ccc5fe2d"
Sep 10 18:27:41 addons-827965 kubelet[1499]: E0910 18:27:41.259375 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b2s4d_gadget(42586159-83ee-4fc6-8f18-fdeb15adfcde)\"" pod="gadget/gadget-b2s4d" podUID="42586159-83ee-4fc6-8f18-fdeb15adfcde"
Sep 10 18:27:41 addons-827965 kubelet[1499]: I0910 18:27:41.260454 1499 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-z6m52" secret="" err="secret \"gcp-auth\" not found"
Sep 10 18:27:52 addons-827965 kubelet[1499]: I0910 18:27:52.258211 1499 scope.go:117] "RemoveContainer" containerID="29e3310f7554cc1026e2e028e1999467827eead4267143ac054b1d22ccc5fe2d"
Sep 10 18:27:52 addons-827965 kubelet[1499]: E0910 18:27:52.258434 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b2s4d_gadget(42586159-83ee-4fc6-8f18-fdeb15adfcde)\"" pod="gadget/gadget-b2s4d" podUID="42586159-83ee-4fc6-8f18-fdeb15adfcde"
Sep 10 18:28:04 addons-827965 kubelet[1499]: I0910 18:28:04.257945 1499 scope.go:117] "RemoveContainer" containerID="29e3310f7554cc1026e2e028e1999467827eead4267143ac054b1d22ccc5fe2d"
Sep 10 18:28:04 addons-827965 kubelet[1499]: E0910 18:28:04.258178 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b2s4d_gadget(42586159-83ee-4fc6-8f18-fdeb15adfcde)\"" pod="gadget/gadget-b2s4d" podUID="42586159-83ee-4fc6-8f18-fdeb15adfcde"
Sep 10 18:28:17 addons-827965 kubelet[1499]: I0910 18:28:17.258335 1499 scope.go:117] "RemoveContainer" containerID="29e3310f7554cc1026e2e028e1999467827eead4267143ac054b1d22ccc5fe2d"
Sep 10 18:28:17 addons-827965 kubelet[1499]: E0910 18:28:17.258551 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b2s4d_gadget(42586159-83ee-4fc6-8f18-fdeb15adfcde)\"" pod="gadget/gadget-b2s4d" podUID="42586159-83ee-4fc6-8f18-fdeb15adfcde"
Sep 10 18:28:21 addons-827965 kubelet[1499]: I0910 18:28:21.259245 1499 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-cjl9w" secret="" err="secret \"gcp-auth\" not found"
Sep 10 18:28:32 addons-827965 kubelet[1499]: I0910 18:28:32.258164 1499 scope.go:117] "RemoveContainer" containerID="29e3310f7554cc1026e2e028e1999467827eead4267143ac054b1d22ccc5fe2d"
Sep 10 18:28:32 addons-827965 kubelet[1499]: E0910 18:28:32.258389 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b2s4d_gadget(42586159-83ee-4fc6-8f18-fdeb15adfcde)\"" pod="gadget/gadget-b2s4d" podUID="42586159-83ee-4fc6-8f18-fdeb15adfcde"
Sep 10 18:28:43 addons-827965 kubelet[1499]: I0910 18:28:43.257349 1499 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-66c9cd494c-7t72n" secret="" err="secret \"gcp-auth\" not found"
Sep 10 18:28:44 addons-827965 kubelet[1499]: I0910 18:28:44.257932 1499 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-z6m52" secret="" err="secret \"gcp-auth\" not found"
Sep 10 18:28:45 addons-827965 kubelet[1499]: I0910 18:28:45.257850 1499 scope.go:117] "RemoveContainer" containerID="29e3310f7554cc1026e2e028e1999467827eead4267143ac054b1d22ccc5fe2d"
Sep 10 18:28:45 addons-827965 kubelet[1499]: E0910 18:28:45.258306 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b2s4d_gadget(42586159-83ee-4fc6-8f18-fdeb15adfcde)\"" pod="gadget/gadget-b2s4d" podUID="42586159-83ee-4fc6-8f18-fdeb15adfcde"
==> storage-provisioner [a832fed128df0e7f5080d3db93c753f2977500f0c4125eabbeb5193f80d39b9f] <==
I0910 18:23:03.201073 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0910 18:23:03.221478 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0910 18:23:03.226941 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0910 18:23:03.239747 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0910 18:23:03.239993 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-827965_a97348ad-fe76-486f-94ba-9b9890d4f883!
I0910 18:23:03.249327 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"801a2741-a9b2-4c5a-8eb1-90ee32368a9f", APIVersion:"v1", ResourceVersion:"575", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-827965_a97348ad-fe76-486f-94ba-9b9890d4f883 became leader
I0910 18:23:03.342211 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-827965_a97348ad-fe76-486f-94ba-9b9890d4f883!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-827965 -n addons-827965
helpers_test.go:261: (dbg) Run: kubectl --context addons-827965 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: ingress-nginx-admission-create-qvwfp ingress-nginx-admission-patch-4qnbd test-job-nginx-0
helpers_test.go:274: ======> post-mortem[TestAddons/serial/Volcano]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-827965 describe pod ingress-nginx-admission-create-qvwfp ingress-nginx-admission-patch-4qnbd test-job-nginx-0
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-827965 describe pod ingress-nginx-admission-create-qvwfp ingress-nginx-admission-patch-4qnbd test-job-nginx-0: exit status 1 (88.423033ms)
** stderr **
Error from server (NotFound): pods "ingress-nginx-admission-create-qvwfp" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-4qnbd" not found
Error from server (NotFound): pods "test-job-nginx-0" not found
** /stderr **
helpers_test.go:279: kubectl --context addons-827965 describe pod ingress-nginx-admission-create-qvwfp ingress-nginx-admission-patch-4qnbd test-job-nginx-0: exit status 1
--- FAIL: TestAddons/serial/Volcano (200.25s)