=== RUN TestAddons/serial/Volcano
addons_test.go:897: volcano-scheduler stabilized in 51.384472ms
addons_test.go:913: volcano-controller stabilized in 51.448021ms
addons_test.go:905: volcano-admission stabilized in 51.488431ms
addons_test.go:919: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-scheduler-576bc46687-jz6d7" [ea029345-e710-4825-8a86-b6c0f9cb46e0] Running
addons_test.go:919: (dbg) TestAddons/serial/Volcano: app=volcano-scheduler healthy within 6.003921634s
addons_test.go:923: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-admission-77d7d48b68-2f46h" [46c1ba7a-40de-43a6-ab4d-8c4404c2d657] Running
addons_test.go:923: (dbg) TestAddons/serial/Volcano: app=volcano-admission healthy within 5.003448601s
addons_test.go:927: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-controllers-56675bb4d5-kdtv4" [ed91c8d5-bb6a-41df-9bdc-9fb0822860d5] Running
addons_test.go:927: (dbg) TestAddons/serial/Volcano: app=volcano-controller healthy within 5.003388105s
addons_test.go:932: (dbg) Run: kubectl --context addons-864899 delete -n volcano-system job volcano-admission-init
addons_test.go:938: (dbg) Run: kubectl --context addons-864899 create -f testdata/vcjob.yaml
addons_test.go:946: (dbg) Run: kubectl --context addons-864899 get vcjob -n my-volcano
addons_test.go:964: (dbg) TestAddons/serial/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...
helpers_test.go:344: "test-job-nginx-0" [c5d24db8-3cb9-478b-820b-39f6f4f0001f] Pending: PodScheduled:Unschedulable (0/1 nodes are unavailable: 1 Insufficient cpu.)
helpers_test.go:329: TestAddons/serial/Volcano: WARNING: pod list for "my-volcano" "volcano.sh/job-name=test-job" returned: client rate limiter Wait returned an error: context deadline exceeded
addons_test.go:964: ***** TestAddons/serial/Volcano: pod "volcano.sh/job-name=test-job" failed to start within 3m0s: context deadline exceeded ****
addons_test.go:964: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-864899 -n addons-864899
addons_test.go:964: TestAddons/serial/Volcano: showing logs for failed pods as of 2024-08-16 17:49:30.838252215 +0000 UTC m=+435.259701610
addons_test.go:964: (dbg) Run: kubectl --context addons-864899 describe po test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-864899 describe po test-job-nginx-0 -n my-volcano:
Name: test-job-nginx-0
Namespace: my-volcano
Priority: 0
Service Account: default
Node: <none>
Labels: volcano.sh/job-name=test-job
volcano.sh/job-namespace=my-volcano
volcano.sh/queue-name=test
volcano.sh/task-index=0
volcano.sh/task-spec=nginx
Annotations: scheduling.k8s.io/group-name: test-job-b7d0f83f-e438-4786-b6cc-3b628c489a28
volcano.sh/job-name: test-job
volcano.sh/job-version: 0
volcano.sh/queue-name: test
volcano.sh/task-index: 0
volcano.sh/task-spec: nginx
volcano.sh/template-uid: test-job-nginx
Status: Pending
IP:
IPs: <none>
Controlled By: Job/test-job
Containers:
nginx:
Image: nginx:latest
Port: <none>
Host Port: <none>
Command:
sleep
10m
Limits:
cpu: 1
Requests:
cpu: 1
Environment:
GOOGLE_APPLICATION_CREDENTIALS: /google-app-creds.json
PROJECT_ID: this_is_fake
GCP_PROJECT: this_is_fake
GCLOUD_PROJECT: this_is_fake
GOOGLE_CLOUD_PROJECT: this_is_fake
CLOUDSDK_CORE_PROJECT: this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-jwbs2 (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
kube-api-access-jwbs2:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
gcp-creds:
Type: HostPath (bare host directory volume)
Path: /var/lib/minikube/google_application_credentials.json
HostPathType: File
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling 2m59s volcano 0/1 nodes are unavailable: 1 Insufficient cpu.
addons_test.go:964: (dbg) Run: kubectl --context addons-864899 logs test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-864899 logs test-job-nginx-0 -n my-volcano:
addons_test.go:965: failed waiting for test-local-path pod: volcano.sh/job-name=test-job within 3m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestAddons/serial/Volcano]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect addons-864899
helpers_test.go:235: (dbg) docker inspect addons-864899:
-- stdout --
[
{
"Id": "8b98e662b4abf10d6c84b39c3d5cba0b2b9dfa26678fa7659c49f3a412c593d1",
"Created": "2024-08-16T17:43:00.698888511Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 294622,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-08-16T17:43:00.833425764Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:decdd59746a9dba10062a73f6cd4b910c7b4e60613660b1022f8357747681c4d",
"ResolvConfPath": "/var/lib/docker/containers/8b98e662b4abf10d6c84b39c3d5cba0b2b9dfa26678fa7659c49f3a412c593d1/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/8b98e662b4abf10d6c84b39c3d5cba0b2b9dfa26678fa7659c49f3a412c593d1/hostname",
"HostsPath": "/var/lib/docker/containers/8b98e662b4abf10d6c84b39c3d5cba0b2b9dfa26678fa7659c49f3a412c593d1/hosts",
"LogPath": "/var/lib/docker/containers/8b98e662b4abf10d6c84b39c3d5cba0b2b9dfa26678fa7659c49f3a412c593d1/8b98e662b4abf10d6c84b39c3d5cba0b2b9dfa26678fa7659c49f3a412c593d1-json.log",
"Name": "/addons-864899",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"addons-864899:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "addons-864899",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4194304000,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8388608000,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/e5e575b9a0f0ae530ccd3d10aa660e19acdcf6cf5a099a5c652b607ad15344e2-init/diff:/var/lib/docker/overlay2/6d9ca87c64683da0141fe1f37bb6088cb89212b329dea26763f56ee455e7f801/diff",
"MergedDir": "/var/lib/docker/overlay2/e5e575b9a0f0ae530ccd3d10aa660e19acdcf6cf5a099a5c652b607ad15344e2/merged",
"UpperDir": "/var/lib/docker/overlay2/e5e575b9a0f0ae530ccd3d10aa660e19acdcf6cf5a099a5c652b607ad15344e2/diff",
"WorkDir": "/var/lib/docker/overlay2/e5e575b9a0f0ae530ccd3d10aa660e19acdcf6cf5a099a5c652b607ad15344e2/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "volume",
"Name": "addons-864899",
"Source": "/var/lib/docker/volumes/addons-864899/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
},
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
}
],
"Config": {
"Hostname": "addons-864899",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-864899",
"name.minikube.sigs.k8s.io": "addons-864899",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "dc4246ded2294fa241800b1823023d6bf7ac166943f6cc8065d09f0a70048a89",
"SandboxKey": "/var/run/docker/netns/dc4246ded229",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33140"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33141"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33144"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33142"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33143"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"addons-864899": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:31:02",
"DriverOpts": null,
"NetworkID": "0c0db5072b449bb2448037002039fc2e60a9a7fba094a1ed44533b8777782133",
"EndpointID": "2f42ed6a15bc15bb308aa35c0ee5f9b3350fd1549d35b6af0f8333994b369642",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-864899",
"8b98e662b4ab"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p addons-864899 -n addons-864899
helpers_test.go:244: <<< TestAddons/serial/Volcano FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/serial/Volcano]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p addons-864899 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-864899 logs -n 25: (1.571636041s)
helpers_test.go:252: TestAddons/serial/Volcano logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| start | -o=json --download-only | download-only-778826 | jenkins | v1.33.1 | 16 Aug 24 17:42 UTC | |
| | -p download-only-778826 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.33.1 | 16 Aug 24 17:42 UTC | 16 Aug 24 17:42 UTC |
| delete | -p download-only-778826 | download-only-778826 | jenkins | v1.33.1 | 16 Aug 24 17:42 UTC | 16 Aug 24 17:42 UTC |
| start | -o=json --download-only | download-only-528021 | jenkins | v1.33.1 | 16 Aug 24 17:42 UTC | |
| | -p download-only-528021 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.31.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.33.1 | 16 Aug 24 17:42 UTC | 16 Aug 24 17:42 UTC |
| delete | -p download-only-528021 | download-only-528021 | jenkins | v1.33.1 | 16 Aug 24 17:42 UTC | 16 Aug 24 17:42 UTC |
| delete | -p download-only-778826 | download-only-778826 | jenkins | v1.33.1 | 16 Aug 24 17:42 UTC | 16 Aug 24 17:42 UTC |
| delete | -p download-only-528021 | download-only-528021 | jenkins | v1.33.1 | 16 Aug 24 17:42 UTC | 16 Aug 24 17:42 UTC |
| start | --download-only -p | download-docker-792554 | jenkins | v1.33.1 | 16 Aug 24 17:42 UTC | |
| | download-docker-792554 | | | | | |
| | --alsologtostderr | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p download-docker-792554 | download-docker-792554 | jenkins | v1.33.1 | 16 Aug 24 17:42 UTC | 16 Aug 24 17:42 UTC |
| start | --download-only -p | binary-mirror-779675 | jenkins | v1.33.1 | 16 Aug 24 17:42 UTC | |
| | binary-mirror-779675 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:46441 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p binary-mirror-779675 | binary-mirror-779675 | jenkins | v1.33.1 | 16 Aug 24 17:42 UTC | 16 Aug 24 17:42 UTC |
| addons | disable dashboard -p | addons-864899 | jenkins | v1.33.1 | 16 Aug 24 17:42 UTC | |
| | addons-864899 | | | | | |
| addons | enable dashboard -p | addons-864899 | jenkins | v1.33.1 | 16 Aug 24 17:42 UTC | |
| | addons-864899 | | | | | |
| start | -p addons-864899 --wait=true | addons-864899 | jenkins | v1.33.1 | 16 Aug 24 17:42 UTC | 16 Aug 24 17:46 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/08/16 17:42:36
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.22.5 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0816 17:42:36.595958 294136 out.go:345] Setting OutFile to fd 1 ...
I0816 17:42:36.596114 294136 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0816 17:42:36.596125 294136 out.go:358] Setting ErrFile to fd 2...
I0816 17:42:36.596130 294136 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0816 17:42:36.596381 294136 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19461-287979/.minikube/bin
I0816 17:42:36.596842 294136 out.go:352] Setting JSON to false
I0816 17:42:36.597806 294136 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":5086,"bootTime":1723825070,"procs":173,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1067-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0816 17:42:36.597888 294136 start.go:139] virtualization:
I0816 17:42:36.600407 294136 out.go:177] * [addons-864899] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0816 17:42:36.602362 294136 out.go:177] - MINIKUBE_LOCATION=19461
I0816 17:42:36.602472 294136 notify.go:220] Checking for updates...
I0816 17:42:36.605799 294136 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0816 17:42:36.607617 294136 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19461-287979/kubeconfig
I0816 17:42:36.609691 294136 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19461-287979/.minikube
I0816 17:42:36.611328 294136 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0816 17:42:36.613017 294136 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0816 17:42:36.615354 294136 driver.go:392] Setting default libvirt URI to qemu:///system
I0816 17:42:36.640221 294136 docker.go:123] docker version: linux-27.1.2:Docker Engine - Community
I0816 17:42:36.640334 294136 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0816 17:42:36.696849 294136 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-08-16 17:42:36.687404536 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1067-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8fc6bcff51318944179630522a095cc9dbf9f353 Expected:8fc6bcff51318944179630522a095cc9dbf9f353} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0816 17:42:36.696958 294136 docker.go:307] overlay module found
I0816 17:42:36.699401 294136 out.go:177] * Using the docker driver based on user configuration
I0816 17:42:36.700982 294136 start.go:297] selected driver: docker
I0816 17:42:36.701002 294136 start.go:901] validating driver "docker" against <nil>
I0816 17:42:36.701026 294136 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0816 17:42:36.701692 294136 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0816 17:42:36.755152 294136 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-08-16 17:42:36.745637626 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1067-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8fc6bcff51318944179630522a095cc9dbf9f353 Expected:8fc6bcff51318944179630522a095cc9dbf9f353} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0816 17:42:36.755317 294136 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0816 17:42:36.755549 294136 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0816 17:42:36.757750 294136 out.go:177] * Using Docker driver with root privileges
I0816 17:42:36.759791 294136 cni.go:84] Creating CNI manager for ""
I0816 17:42:36.759817 294136 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0816 17:42:36.759840 294136 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0816 17:42:36.759933 294136 start.go:340] cluster config:
{Name:addons-864899 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-864899 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHA
uthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0816 17:42:36.762027 294136 out.go:177] * Starting "addons-864899" primary control-plane node in "addons-864899" cluster
I0816 17:42:36.764061 294136 cache.go:121] Beginning downloading kic base image for docker with containerd
I0816 17:42:36.766414 294136 out.go:177] * Pulling base image v0.0.44-1723740748-19452 ...
I0816 17:42:36.768389 294136 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0816 17:42:36.768434 294136 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d in local docker daemon
I0816 17:42:36.768446 294136 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19461-287979/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4
I0816 17:42:36.768457 294136 cache.go:56] Caching tarball of preloaded images
I0816 17:42:36.768554 294136 preload.go:172] Found /home/jenkins/minikube-integration/19461-287979/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0816 17:42:36.768565 294136 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on containerd
I0816 17:42:36.768907 294136 profile.go:143] Saving config to /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/config.json ...
I0816 17:42:36.768969 294136 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/config.json: {Name:mk0242e859bbbe181b21be9134ca1e5ab1d8feae Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 17:42:36.784029 294136 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d to local cache
I0816 17:42:36.784132 294136 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d in local cache directory
I0816 17:42:36.784156 294136 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d in local cache directory, skipping pull
I0816 17:42:36.784163 294136 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d exists in cache, skipping pull
I0816 17:42:36.784177 294136 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d as a tarball
I0816 17:42:36.784183 294136 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d from local cache
I0816 17:42:53.685212 294136 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d from cached tarball
I0816 17:42:53.685256 294136 cache.go:194] Successfully downloaded all kic artifacts
I0816 17:42:53.685299 294136 start.go:360] acquireMachinesLock for addons-864899: {Name:mk7f96bc04aac37db43e0cae118b2e5114ac4f15 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0816 17:42:53.685416 294136 start.go:364] duration metric: took 93.817µs to acquireMachinesLock for "addons-864899"
I0816 17:42:53.685447 294136 start.go:93] Provisioning new machine with config: &{Name:addons-864899 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-864899 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fa
lse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0816 17:42:53.685539 294136 start.go:125] createHost starting for "" (driver="docker")
I0816 17:42:53.688325 294136 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
I0816 17:42:53.688586 294136 start.go:159] libmachine.API.Create for "addons-864899" (driver="docker")
I0816 17:42:53.688623 294136 client.go:168] LocalClient.Create starting
I0816 17:42:53.688749 294136 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19461-287979/.minikube/certs/ca.pem
I0816 17:42:54.495578 294136 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19461-287979/.minikube/certs/cert.pem
I0816 17:42:55.048432 294136 cli_runner.go:164] Run: docker network inspect addons-864899 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0816 17:42:55.063727 294136 cli_runner.go:211] docker network inspect addons-864899 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0816 17:42:55.063808 294136 network_create.go:284] running [docker network inspect addons-864899] to gather additional debugging logs...
I0816 17:42:55.063831 294136 cli_runner.go:164] Run: docker network inspect addons-864899
W0816 17:42:55.079400 294136 cli_runner.go:211] docker network inspect addons-864899 returned with exit code 1
I0816 17:42:55.079431 294136 network_create.go:287] error running [docker network inspect addons-864899]: docker network inspect addons-864899: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-864899 not found
I0816 17:42:55.079446 294136 network_create.go:289] output of [docker network inspect addons-864899]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-864899 not found
** /stderr **
I0816 17:42:55.079573 294136 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0816 17:42:55.096783 294136 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40000fe820}
I0816 17:42:55.096831 294136 network_create.go:124] attempt to create docker network addons-864899 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0816 17:42:55.096891 294136 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-864899 addons-864899
I0816 17:42:55.163087 294136 network_create.go:108] docker network addons-864899 192.168.49.0/24 created
I0816 17:42:55.163128 294136 kic.go:121] calculated static IP "192.168.49.2" for the "addons-864899" container
I0816 17:42:55.163207 294136 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0816 17:42:55.178502 294136 cli_runner.go:164] Run: docker volume create addons-864899 --label name.minikube.sigs.k8s.io=addons-864899 --label created_by.minikube.sigs.k8s.io=true
I0816 17:42:55.194839 294136 oci.go:103] Successfully created a docker volume addons-864899
I0816 17:42:55.194937 294136 cli_runner.go:164] Run: docker run --rm --name addons-864899-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-864899 --entrypoint /usr/bin/test -v addons-864899:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d -d /var/lib
I0816 17:42:56.518109 294136 cli_runner.go:217] Completed: docker run --rm --name addons-864899-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-864899 --entrypoint /usr/bin/test -v addons-864899:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d -d /var/lib: (1.323116207s)
I0816 17:42:56.518143 294136 oci.go:107] Successfully prepared a docker volume addons-864899
I0816 17:42:56.518164 294136 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0816 17:42:56.518185 294136 kic.go:194] Starting extracting preloaded images to volume ...
I0816 17:42:56.518292 294136 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19461-287979/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-864899:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d -I lz4 -xf /preloaded.tar -C /extractDir
I0816 17:43:00.631122 294136 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19461-287979/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-864899:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d -I lz4 -xf /preloaded.tar -C /extractDir: (4.112780233s)
I0816 17:43:00.631156 294136 kic.go:203] duration metric: took 4.112967735s to extract preloaded images to volume ...
W0816 17:43:00.631291 294136 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0816 17:43:00.631426 294136 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0816 17:43:00.682386 294136 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-864899 --name addons-864899 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-864899 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-864899 --network addons-864899 --ip 192.168.49.2 --volume addons-864899:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d
I0816 17:43:00.994890 294136 cli_runner.go:164] Run: docker container inspect addons-864899 --format={{.State.Running}}
I0816 17:43:01.027976 294136 cli_runner.go:164] Run: docker container inspect addons-864899 --format={{.State.Status}}
I0816 17:43:01.049111 294136 cli_runner.go:164] Run: docker exec addons-864899 stat /var/lib/dpkg/alternatives/iptables
I0816 17:43:01.098661 294136 oci.go:144] the created container "addons-864899" has a running status.
I0816 17:43:01.098692 294136 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19461-287979/.minikube/machines/addons-864899/id_rsa...
I0816 17:43:01.481816 294136 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19461-287979/.minikube/machines/addons-864899/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0816 17:43:01.510125 294136 cli_runner.go:164] Run: docker container inspect addons-864899 --format={{.State.Status}}
I0816 17:43:01.539094 294136 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0816 17:43:01.539119 294136 kic_runner.go:114] Args: [docker exec --privileged addons-864899 chown docker:docker /home/docker/.ssh/authorized_keys]
I0816 17:43:01.627172 294136 cli_runner.go:164] Run: docker container inspect addons-864899 --format={{.State.Status}}
I0816 17:43:01.650284 294136 machine.go:93] provisionDockerMachine start ...
I0816 17:43:01.650379 294136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-864899
I0816 17:43:01.675730 294136 main.go:141] libmachine: Using SSH client type: native
I0816 17:43:01.676010 294136 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 33140 <nil> <nil>}
I0816 17:43:01.676028 294136 main.go:141] libmachine: About to run SSH command:
hostname
I0816 17:43:01.676579 294136 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:55136->127.0.0.1:33140: read: connection reset by peer
I0816 17:43:04.808360 294136 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-864899
I0816 17:43:04.808386 294136 ubuntu.go:169] provisioning hostname "addons-864899"
I0816 17:43:04.808453 294136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-864899
I0816 17:43:04.824864 294136 main.go:141] libmachine: Using SSH client type: native
I0816 17:43:04.825255 294136 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 33140 <nil> <nil>}
I0816 17:43:04.825276 294136 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-864899 && echo "addons-864899" | sudo tee /etc/hostname
I0816 17:43:04.968536 294136 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-864899
I0816 17:43:04.968613 294136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-864899
I0816 17:43:04.985125 294136 main.go:141] libmachine: Using SSH client type: native
I0816 17:43:04.985367 294136 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 33140 <nil> <nil>}
I0816 17:43:04.985386 294136 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-864899' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-864899/g' /etc/hosts;
else
echo '127.0.1.1 addons-864899' | sudo tee -a /etc/hosts;
fi
fi
I0816 17:43:05.117064 294136 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0816 17:43:05.117108 294136 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19461-287979/.minikube CaCertPath:/home/jenkins/minikube-integration/19461-287979/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19461-287979/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19461-287979/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19461-287979/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19461-287979/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19461-287979/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19461-287979/.minikube}
I0816 17:43:05.117136 294136 ubuntu.go:177] setting up certificates
I0816 17:43:05.117145 294136 provision.go:84] configureAuth start
I0816 17:43:05.117210 294136 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-864899
I0816 17:43:05.134037 294136 provision.go:143] copyHostCerts
I0816 17:43:05.134130 294136 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19461-287979/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19461-287979/.minikube/key.pem (1679 bytes)
I0816 17:43:05.134287 294136 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19461-287979/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19461-287979/.minikube/ca.pem (1078 bytes)
I0816 17:43:05.134347 294136 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19461-287979/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19461-287979/.minikube/cert.pem (1123 bytes)
I0816 17:43:05.134400 294136 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19461-287979/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19461-287979/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19461-287979/.minikube/certs/ca-key.pem org=jenkins.addons-864899 san=[127.0.0.1 192.168.49.2 addons-864899 localhost minikube]
I0816 17:43:05.386869 294136 provision.go:177] copyRemoteCerts
I0816 17:43:05.386963 294136 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0816 17:43:05.387007 294136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-864899
I0816 17:43:05.404835 294136 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33140 SSHKeyPath:/home/jenkins/minikube-integration/19461-287979/.minikube/machines/addons-864899/id_rsa Username:docker}
I0816 17:43:05.497539 294136 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-287979/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0816 17:43:05.522022 294136 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-287979/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0816 17:43:05.545267 294136 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-287979/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0816 17:43:05.569478 294136 provision.go:87] duration metric: took 452.315515ms to configureAuth
I0816 17:43:05.569557 294136 ubuntu.go:193] setting minikube options for container-runtime
I0816 17:43:05.569780 294136 config.go:182] Loaded profile config "addons-864899": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0816 17:43:05.569798 294136 machine.go:96] duration metric: took 3.919493937s to provisionDockerMachine
I0816 17:43:05.569806 294136 client.go:171] duration metric: took 11.88117312s to LocalClient.Create
I0816 17:43:05.569828 294136 start.go:167] duration metric: took 11.881240723s to libmachine.API.Create "addons-864899"
I0816 17:43:05.569836 294136 start.go:293] postStartSetup for "addons-864899" (driver="docker")
I0816 17:43:05.569845 294136 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0816 17:43:05.569900 294136 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0816 17:43:05.569957 294136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-864899
I0816 17:43:05.587494 294136 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33140 SSHKeyPath:/home/jenkins/minikube-integration/19461-287979/.minikube/machines/addons-864899/id_rsa Username:docker}
I0816 17:43:05.683310 294136 ssh_runner.go:195] Run: cat /etc/os-release
I0816 17:43:05.686637 294136 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0816 17:43:05.686672 294136 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0816 17:43:05.686687 294136 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0816 17:43:05.686699 294136 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0816 17:43:05.686710 294136 filesync.go:126] Scanning /home/jenkins/minikube-integration/19461-287979/.minikube/addons for local assets ...
I0816 17:43:05.686782 294136 filesync.go:126] Scanning /home/jenkins/minikube-integration/19461-287979/.minikube/files for local assets ...
I0816 17:43:05.686808 294136 start.go:296] duration metric: took 116.966798ms for postStartSetup
I0816 17:43:05.687124 294136 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-864899
I0816 17:43:05.704038 294136 profile.go:143] Saving config to /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/config.json ...
I0816 17:43:05.704332 294136 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0816 17:43:05.704384 294136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-864899
I0816 17:43:05.721433 294136 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33140 SSHKeyPath:/home/jenkins/minikube-integration/19461-287979/.minikube/machines/addons-864899/id_rsa Username:docker}
I0816 17:43:05.810052 294136 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0816 17:43:05.814344 294136 start.go:128] duration metric: took 12.128788943s to createHost
I0816 17:43:05.814365 294136 start.go:83] releasing machines lock for "addons-864899", held for 12.128935305s
I0816 17:43:05.814436 294136 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-864899
I0816 17:43:05.831123 294136 ssh_runner.go:195] Run: cat /version.json
I0816 17:43:05.831176 294136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-864899
I0816 17:43:05.831477 294136 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0816 17:43:05.831541 294136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-864899
I0816 17:43:05.862808 294136 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33140 SSHKeyPath:/home/jenkins/minikube-integration/19461-287979/.minikube/machines/addons-864899/id_rsa Username:docker}
I0816 17:43:05.874792 294136 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33140 SSHKeyPath:/home/jenkins/minikube-integration/19461-287979/.minikube/machines/addons-864899/id_rsa Username:docker}
I0816 17:43:05.952655 294136 ssh_runner.go:195] Run: systemctl --version
I0816 17:43:06.086446 294136 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0816 17:43:06.091157 294136 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0816 17:43:06.117542 294136 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0816 17:43:06.117651 294136 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0816 17:43:06.147281 294136 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0816 17:43:06.147311 294136 start.go:495] detecting cgroup driver to use...
I0816 17:43:06.147346 294136 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0816 17:43:06.147401 294136 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0816 17:43:06.160181 294136 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0816 17:43:06.171334 294136 docker.go:217] disabling cri-docker service (if available) ...
I0816 17:43:06.171395 294136 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0816 17:43:06.184949 294136 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0816 17:43:06.199125 294136 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0816 17:43:06.277778 294136 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0816 17:43:06.372606 294136 docker.go:233] disabling docker service ...
I0816 17:43:06.372673 294136 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0816 17:43:06.393037 294136 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0816 17:43:06.405133 294136 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0816 17:43:06.494148 294136 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0816 17:43:06.582127 294136 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0816 17:43:06.593666 294136 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0816 17:43:06.610164 294136 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0816 17:43:06.619646 294136 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0816 17:43:06.629259 294136 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0816 17:43:06.629375 294136 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0816 17:43:06.638897 294136 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0816 17:43:06.648412 294136 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0816 17:43:06.658247 294136 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0816 17:43:06.667740 294136 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0816 17:43:06.676912 294136 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0816 17:43:06.687541 294136 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0816 17:43:06.697311 294136 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0816 17:43:06.707267 294136 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0816 17:43:06.716046 294136 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0816 17:43:06.724872 294136 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0816 17:43:06.802215 294136 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0816 17:43:06.938103 294136 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0816 17:43:06.938240 294136 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0816 17:43:06.941890 294136 start.go:563] Will wait 60s for crictl version
I0816 17:43:06.941998 294136 ssh_runner.go:195] Run: which crictl
I0816 17:43:06.945264 294136 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0816 17:43:06.984882 294136 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.20
RuntimeApiVersion: v1
I0816 17:43:06.985022 294136 ssh_runner.go:195] Run: containerd --version
I0816 17:43:07.010874 294136 ssh_runner.go:195] Run: containerd --version
I0816 17:43:07.034865 294136 out.go:177] * Preparing Kubernetes v1.31.0 on containerd 1.7.20 ...
I0816 17:43:07.036945 294136 cli_runner.go:164] Run: docker network inspect addons-864899 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0816 17:43:07.055165 294136 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I0816 17:43:07.058831 294136 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0816 17:43:07.069785 294136 kubeadm.go:883] updating cluster {Name:addons-864899 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-864899 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cus
tomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0816 17:43:07.069922 294136 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0816 17:43:07.069997 294136 ssh_runner.go:195] Run: sudo crictl images --output json
I0816 17:43:07.108615 294136 containerd.go:627] all images are preloaded for containerd runtime.
I0816 17:43:07.108639 294136 containerd.go:534] Images already preloaded, skipping extraction
I0816 17:43:07.108700 294136 ssh_runner.go:195] Run: sudo crictl images --output json
I0816 17:43:07.146089 294136 containerd.go:627] all images are preloaded for containerd runtime.
I0816 17:43:07.146111 294136 cache_images.go:84] Images are preloaded, skipping loading
I0816 17:43:07.146120 294136 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.0 containerd true true} ...
I0816 17:43:07.146228 294136 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-864899 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.31.0 ClusterName:addons-864899 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0816 17:43:07.146299 294136 ssh_runner.go:195] Run: sudo crictl info
I0816 17:43:07.183127 294136 cni.go:84] Creating CNI manager for ""
I0816 17:43:07.183156 294136 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0816 17:43:07.183168 294136 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0816 17:43:07.183190 294136 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-864899 NodeName:addons-864899 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc
/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0816 17:43:07.183320 294136 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "addons-864899"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0816 17:43:07.183390 294136 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.0
I0816 17:43:07.192080 294136 binaries.go:44] Found k8s binaries, skipping transfer
I0816 17:43:07.192149 294136 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0816 17:43:07.200837 294136 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (317 bytes)
I0816 17:43:07.218669 294136 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0816 17:43:07.236767 294136 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2167 bytes)
I0816 17:43:07.254594 294136 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0816 17:43:07.258044 294136 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0816 17:43:07.268825 294136 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0816 17:43:07.348624 294136 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0816 17:43:07.362920 294136 certs.go:68] Setting up /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899 for IP: 192.168.49.2
I0816 17:43:07.362946 294136 certs.go:194] generating shared ca certs ...
I0816 17:43:07.362963 294136 certs.go:226] acquiring lock for ca certs: {Name:mkc2317239a75a145c30b6075675eef6239ccdc8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 17:43:07.363648 294136 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19461-287979/.minikube/ca.key
I0816 17:43:08.464424 294136 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19461-287979/.minikube/ca.crt ...
I0816 17:43:08.464472 294136 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19461-287979/.minikube/ca.crt: {Name:mk537dc62942709e2029b74f613a82975406f674 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 17:43:08.465399 294136 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19461-287979/.minikube/ca.key ...
I0816 17:43:08.465433 294136 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19461-287979/.minikube/ca.key: {Name:mk3b384f9849db1d7bb6be0e305b1034636ab660 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 17:43:08.465619 294136 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19461-287979/.minikube/proxy-client-ca.key
I0816 17:43:08.996463 294136 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19461-287979/.minikube/proxy-client-ca.crt ...
I0816 17:43:08.996499 294136 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19461-287979/.minikube/proxy-client-ca.crt: {Name:mk34e488d0c29c8baa7ba5595bc2af030e5331ca Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 17:43:08.996689 294136 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19461-287979/.minikube/proxy-client-ca.key ...
I0816 17:43:08.996704 294136 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19461-287979/.minikube/proxy-client-ca.key: {Name:mk46d42a41602bac1e156fc92c642b11d98ecb2d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 17:43:08.996790 294136 certs.go:256] generating profile certs ...
I0816 17:43:08.996857 294136 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/client.key
I0816 17:43:08.996878 294136 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/client.crt with IP's: []
I0816 17:43:09.350123 294136 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/client.crt ...
I0816 17:43:09.350157 294136 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/client.crt: {Name:mk4a7b9e9e1e36e9f37d968a6780d05b80656677 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 17:43:09.350348 294136 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/client.key ...
I0816 17:43:09.350361 294136 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/client.key: {Name:mk64bec3fe5b7ab5767edbf4755815fb8beeb424 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 17:43:09.351059 294136 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/apiserver.key.0339c74d
I0816 17:43:09.351085 294136 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/apiserver.crt.0339c74d with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I0816 17:43:09.708651 294136 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/apiserver.crt.0339c74d ...
I0816 17:43:09.708685 294136 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/apiserver.crt.0339c74d: {Name:mk97c4a9dccda18eeb751d32e8af120b2867143b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 17:43:09.708894 294136 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/apiserver.key.0339c74d ...
I0816 17:43:09.708912 294136 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/apiserver.key.0339c74d: {Name:mk20fe521e0a983f42638e04d6364a13c63dbb4e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 17:43:09.709019 294136 certs.go:381] copying /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/apiserver.crt.0339c74d -> /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/apiserver.crt
I0816 17:43:09.709113 294136 certs.go:385] copying /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/apiserver.key.0339c74d -> /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/apiserver.key
I0816 17:43:09.709177 294136 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/proxy-client.key
I0816 17:43:09.709198 294136 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/proxy-client.crt with IP's: []
I0816 17:43:11.428494 294136 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/proxy-client.crt ...
I0816 17:43:11.428535 294136 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/proxy-client.crt: {Name:mk6f0edee45cc01f1ec1d626bbe68f00eac3f078 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 17:43:11.428733 294136 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/proxy-client.key ...
I0816 17:43:11.428749 294136 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/proxy-client.key: {Name:mk8fa2114be03f08c832d5c0480ec7c384df9f52 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 17:43:11.429527 294136 certs.go:484] found cert: /home/jenkins/minikube-integration/19461-287979/.minikube/certs/ca-key.pem (1675 bytes)
I0816 17:43:11.429577 294136 certs.go:484] found cert: /home/jenkins/minikube-integration/19461-287979/.minikube/certs/ca.pem (1078 bytes)
I0816 17:43:11.429603 294136 certs.go:484] found cert: /home/jenkins/minikube-integration/19461-287979/.minikube/certs/cert.pem (1123 bytes)
I0816 17:43:11.429637 294136 certs.go:484] found cert: /home/jenkins/minikube-integration/19461-287979/.minikube/certs/key.pem (1679 bytes)
I0816 17:43:11.430236 294136 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-287979/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0816 17:43:11.456716 294136 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-287979/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0816 17:43:11.482160 294136 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-287979/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0816 17:43:11.506427 294136 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-287979/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0816 17:43:11.530426 294136 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0816 17:43:11.554299 294136 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0816 17:43:11.578433 294136 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0816 17:43:11.602661 294136 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-287979/.minikube/profiles/addons-864899/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0816 17:43:11.626976 294136 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-287979/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0816 17:43:11.650911 294136 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0816 17:43:11.668401 294136 ssh_runner.go:195] Run: openssl version
I0816 17:43:11.673779 294136 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0816 17:43:11.683212 294136 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0816 17:43:11.686751 294136 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 16 17:43 /usr/share/ca-certificates/minikubeCA.pem
I0816 17:43:11.686815 294136 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0816 17:43:11.693691 294136 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0816 17:43:11.703143 294136 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0816 17:43:11.706669 294136 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0816 17:43:11.706717 294136 kubeadm.go:392] StartCluster: {Name:addons-864899 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-864899 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom
QemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0816 17:43:11.706803 294136 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0816 17:43:11.706860 294136 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0816 17:43:11.743100 294136 cri.go:89] found id: ""
I0816 17:43:11.743209 294136 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0816 17:43:11.751900 294136 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0816 17:43:11.761407 294136 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0816 17:43:11.761477 294136 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0816 17:43:11.770868 294136 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0816 17:43:11.770890 294136 kubeadm.go:157] found existing configuration files:
I0816 17:43:11.770957 294136 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0816 17:43:11.780894 294136 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0816 17:43:11.780966 294136 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0816 17:43:11.789494 294136 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0816 17:43:11.798436 294136 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0816 17:43:11.798500 294136 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0816 17:43:11.806897 294136 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0816 17:43:11.815503 294136 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0816 17:43:11.815592 294136 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0816 17:43:11.824008 294136 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0816 17:43:11.832583 294136 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0816 17:43:11.832648 294136 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0816 17:43:11.841123 294136 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0816 17:43:11.883802 294136 kubeadm.go:310] [init] Using Kubernetes version: v1.31.0
I0816 17:43:11.884016 294136 kubeadm.go:310] [preflight] Running pre-flight checks
I0816 17:43:11.911784 294136 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0816 17:43:11.911898 294136 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1067-aws[0m
I0816 17:43:11.911957 294136 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0816 17:43:11.912020 294136 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0816 17:43:11.912092 294136 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0816 17:43:11.912195 294136 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0816 17:43:11.912279 294136 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0816 17:43:11.912357 294136 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0816 17:43:11.912436 294136 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0816 17:43:11.912514 294136 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0816 17:43:11.912593 294136 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0816 17:43:11.912671 294136 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0816 17:43:11.989706 294136 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0816 17:43:11.989876 294136 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0816 17:43:11.990009 294136 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0816 17:43:11.995029 294136 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0816 17:43:11.997602 294136 out.go:235] - Generating certificates and keys ...
I0816 17:43:11.997733 294136 kubeadm.go:310] [certs] Using existing ca certificate authority
I0816 17:43:11.997810 294136 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0816 17:43:12.337805 294136 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0816 17:43:12.819617 294136 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0816 17:43:12.977397 294136 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0816 17:43:13.331177 294136 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0816 17:43:13.595515 294136 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0816 17:43:13.595692 294136 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-864899 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0816 17:43:14.148832 294136 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0816 17:43:14.149173 294136 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-864899 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0816 17:43:14.577318 294136 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0816 17:43:15.591455 294136 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0816 17:43:16.102932 294136 kubeadm.go:310] [certs] Generating "sa" key and public key
I0816 17:43:16.103302 294136 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0816 17:43:16.585985 294136 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0816 17:43:16.827199 294136 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0816 17:43:17.106656 294136 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0816 17:43:17.753847 294136 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0816 17:43:18.455712 294136 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0816 17:43:18.456402 294136 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0816 17:43:18.459480 294136 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0816 17:43:18.461874 294136 out.go:235] - Booting up control plane ...
I0816 17:43:18.461970 294136 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0816 17:43:18.462051 294136 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0816 17:43:18.462776 294136 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0816 17:43:18.473694 294136 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0816 17:43:18.480476 294136 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0816 17:43:18.480667 294136 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0816 17:43:18.581496 294136 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0816 17:43:18.581618 294136 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0816 17:43:19.583385 294136 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.003730789s
I0816 17:43:19.583476 294136 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0816 17:43:25.584730 294136 kubeadm.go:310] [api-check] The API server is healthy after 6.001349821s
I0816 17:43:25.604653 294136 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0816 17:43:25.617125 294136 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0816 17:43:25.640612 294136 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0816 17:43:25.640804 294136 kubeadm.go:310] [mark-control-plane] Marking the node addons-864899 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0816 17:43:25.653642 294136 kubeadm.go:310] [bootstrap-token] Using token: fa8lgr.akictnhapdddpt18
I0816 17:43:25.655792 294136 out.go:235] - Configuring RBAC rules ...
I0816 17:43:25.655920 294136 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0816 17:43:25.660750 294136 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0816 17:43:25.670899 294136 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0816 17:43:25.674405 294136 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0816 17:43:25.677725 294136 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0816 17:43:25.681319 294136 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0816 17:43:25.991672 294136 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0816 17:43:26.418076 294136 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0816 17:43:26.991728 294136 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0816 17:43:26.992820 294136 kubeadm.go:310]
I0816 17:43:26.992891 294136 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0816 17:43:26.992898 294136 kubeadm.go:310]
I0816 17:43:26.992973 294136 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0816 17:43:26.992978 294136 kubeadm.go:310]
I0816 17:43:26.993023 294136 kubeadm.go:310] mkdir -p $HOME/.kube
I0816 17:43:26.993081 294136 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0816 17:43:26.993131 294136 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0816 17:43:26.993136 294136 kubeadm.go:310]
I0816 17:43:26.993196 294136 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0816 17:43:26.993201 294136 kubeadm.go:310]
I0816 17:43:26.993247 294136 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0816 17:43:26.993251 294136 kubeadm.go:310]
I0816 17:43:26.993300 294136 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0816 17:43:26.993372 294136 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0816 17:43:26.993437 294136 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0816 17:43:26.993442 294136 kubeadm.go:310]
I0816 17:43:26.993523 294136 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0816 17:43:26.993596 294136 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0816 17:43:26.993600 294136 kubeadm.go:310]
I0816 17:43:26.993681 294136 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token fa8lgr.akictnhapdddpt18 \
I0816 17:43:26.993780 294136 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:5d30401e9108382eeb8fe5c377a6500b3dde6e64fdfafc41c12fd0988d4703e6 \
I0816 17:43:26.993800 294136 kubeadm.go:310] --control-plane
I0816 17:43:26.993804 294136 kubeadm.go:310]
I0816 17:43:26.993886 294136 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0816 17:43:26.993890 294136 kubeadm.go:310]
I0816 17:43:26.993969 294136 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token fa8lgr.akictnhapdddpt18 \
I0816 17:43:26.994066 294136 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:5d30401e9108382eeb8fe5c377a6500b3dde6e64fdfafc41c12fd0988d4703e6
I0816 17:43:26.998705 294136 kubeadm.go:310] W0816 17:43:11.880260 1040 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0816 17:43:26.999008 294136 kubeadm.go:310] W0816 17:43:11.881312 1040 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0816 17:43:26.999213 294136 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1067-aws\n", err: exit status 1
I0816 17:43:26.999315 294136 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0816 17:43:26.999331 294136 cni.go:84] Creating CNI manager for ""
I0816 17:43:26.999340 294136 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0816 17:43:27.003170 294136 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0816 17:43:27.005705 294136 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0816 17:43:27.010473 294136 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.0/kubectl ...
I0816 17:43:27.010496 294136 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
I0816 17:43:27.031077 294136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0816 17:43:27.314475 294136 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0816 17:43:27.314551 294136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0816 17:43:27.314614 294136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-864899 minikube.k8s.io/updated_at=2024_08_16T17_43_27_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=8789c54b9bc6db8e66c461a83302d5a0be0abbdd minikube.k8s.io/name=addons-864899 minikube.k8s.io/primary=true
I0816 17:43:27.331163 294136 ops.go:34] apiserver oom_adj: -16
I0816 17:43:27.463722 294136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0816 17:43:27.963885 294136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0816 17:43:28.464809 294136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0816 17:43:28.964820 294136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0816 17:43:29.464096 294136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0816 17:43:29.963867 294136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0816 17:43:30.463971 294136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0816 17:43:30.963899 294136 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0816 17:43:31.104686 294136 kubeadm.go:1113] duration metric: took 3.790207614s to wait for elevateKubeSystemPrivileges
I0816 17:43:31.104720 294136 kubeadm.go:394] duration metric: took 19.398006301s to StartCluster
I0816 17:43:31.104739 294136 settings.go:142] acquiring lock: {Name:mke5f8bb0a9e0ea5bfe13ebba62cb869c1a95955 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 17:43:31.104875 294136 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19461-287979/kubeconfig
I0816 17:43:31.105277 294136 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19461-287979/kubeconfig: {Name:mkf88e71d9d88c4917ceda8d8c4a2c6c3a01b716 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 17:43:31.105493 294136 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0816 17:43:31.105637 294136 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0816 17:43:31.105918 294136 config.go:182] Loaded profile config "addons-864899": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0816 17:43:31.105957 294136 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I0816 17:43:31.106080 294136 addons.go:69] Setting yakd=true in profile "addons-864899"
I0816 17:43:31.106104 294136 addons.go:234] Setting addon yakd=true in "addons-864899"
I0816 17:43:31.106135 294136 host.go:66] Checking if "addons-864899" exists ...
I0816 17:43:31.106619 294136 cli_runner.go:164] Run: docker container inspect addons-864899 --format={{.State.Status}}
I0816 17:43:31.107154 294136 addons.go:69] Setting metrics-server=true in profile "addons-864899"
I0816 17:43:31.107192 294136 addons.go:234] Setting addon metrics-server=true in "addons-864899"
I0816 17:43:31.107225 294136 host.go:66] Checking if "addons-864899" exists ...
I0816 17:43:31.107658 294136 cli_runner.go:164] Run: docker container inspect addons-864899 --format={{.State.Status}}
I0816 17:43:31.107834 294136 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-864899"
I0816 17:43:31.107857 294136 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-864899"
I0816 17:43:31.107892 294136 host.go:66] Checking if "addons-864899" exists ...
I0816 17:43:31.108372 294136 cli_runner.go:164] Run: docker container inspect addons-864899 --format={{.State.Status}}
I0816 17:43:31.110492 294136 addons.go:69] Setting cloud-spanner=true in profile "addons-864899"
I0816 17:43:31.110539 294136 addons.go:234] Setting addon cloud-spanner=true in "addons-864899"
I0816 17:43:31.110573 294136 host.go:66] Checking if "addons-864899" exists ...
I0816 17:43:31.110841 294136 addons.go:69] Setting registry=true in profile "addons-864899"
I0816 17:43:31.110911 294136 addons.go:234] Setting addon registry=true in "addons-864899"
I0816 17:43:31.110987 294136 host.go:66] Checking if "addons-864899" exists ...
I0816 17:43:31.111051 294136 addons.go:69] Setting gcp-auth=true in profile "addons-864899"
I0816 17:43:31.111087 294136 mustload.go:65] Loading cluster: addons-864899
I0816 17:43:31.111242 294136 config.go:182] Loaded profile config "addons-864899": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0816 17:43:31.111452 294136 cli_runner.go:164] Run: docker container inspect addons-864899 --format={{.State.Status}}
I0816 17:43:31.111034 294136 cli_runner.go:164] Run: docker container inspect addons-864899 --format={{.State.Status}}
I0816 17:43:31.121078 294136 addons.go:69] Setting storage-provisioner=true in profile "addons-864899"
I0816 17:43:31.121184 294136 addons.go:234] Setting addon storage-provisioner=true in "addons-864899"
I0816 17:43:31.121264 294136 host.go:66] Checking if "addons-864899" exists ...
I0816 17:43:31.121832 294136 cli_runner.go:164] Run: docker container inspect addons-864899 --format={{.State.Status}}
I0816 17:43:31.122126 294136 addons.go:69] Setting ingress=true in profile "addons-864899"
I0816 17:43:31.122160 294136 addons.go:234] Setting addon ingress=true in "addons-864899"
I0816 17:43:31.122196 294136 host.go:66] Checking if "addons-864899" exists ...
I0816 17:43:31.122580 294136 cli_runner.go:164] Run: docker container inspect addons-864899 --format={{.State.Status}}
I0816 17:43:31.134235 294136 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-864899"
I0816 17:43:31.134279 294136 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-864899"
I0816 17:43:31.134612 294136 cli_runner.go:164] Run: docker container inspect addons-864899 --format={{.State.Status}}
I0816 17:43:31.154073 294136 addons.go:69] Setting ingress-dns=true in profile "addons-864899"
I0816 17:43:31.154173 294136 addons.go:234] Setting addon ingress-dns=true in "addons-864899"
I0816 17:43:31.154251 294136 host.go:66] Checking if "addons-864899" exists ...
I0816 17:43:31.154696 294136 addons.go:69] Setting volcano=true in profile "addons-864899"
I0816 17:43:31.154720 294136 addons.go:234] Setting addon volcano=true in "addons-864899"
I0816 17:43:31.154747 294136 host.go:66] Checking if "addons-864899" exists ...
I0816 17:43:31.155257 294136 cli_runner.go:164] Run: docker container inspect addons-864899 --format={{.State.Status}}
I0816 17:43:31.166178 294136 cli_runner.go:164] Run: docker container inspect addons-864899 --format={{.State.Status}}
I0816 17:43:31.168520 294136 addons.go:69] Setting volumesnapshots=true in profile "addons-864899"
I0816 17:43:31.168608 294136 addons.go:234] Setting addon volumesnapshots=true in "addons-864899"
I0816 17:43:31.168685 294136 host.go:66] Checking if "addons-864899" exists ...
I0816 17:43:31.169359 294136 cli_runner.go:164] Run: docker container inspect addons-864899 --format={{.State.Status}}
I0816 17:43:31.183865 294136 addons.go:69] Setting inspektor-gadget=true in profile "addons-864899"
I0816 17:43:31.183967 294136 addons.go:234] Setting addon inspektor-gadget=true in "addons-864899"
I0816 17:43:31.184048 294136 host.go:66] Checking if "addons-864899" exists ...
I0816 17:43:31.184782 294136 cli_runner.go:164] Run: docker container inspect addons-864899 --format={{.State.Status}}
I0816 17:43:31.111041 294136 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-864899"
I0816 17:43:31.202007 294136 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-864899"
I0816 17:43:31.202082 294136 host.go:66] Checking if "addons-864899" exists ...
I0816 17:43:31.202700 294136 cli_runner.go:164] Run: docker container inspect addons-864899 --format={{.State.Status}}
I0816 17:43:31.208934 294136 out.go:177] * Verifying Kubernetes components...
I0816 17:43:31.213078 294136 cli_runner.go:164] Run: docker container inspect addons-864899 --format={{.State.Status}}
I0816 17:43:31.111047 294136 addons.go:69] Setting default-storageclass=true in profile "addons-864899"
I0816 17:43:31.217313 294136 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-864899"
I0816 17:43:31.217650 294136 cli_runner.go:164] Run: docker container inspect addons-864899 --format={{.State.Status}}
I0816 17:43:31.302501 294136 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0816 17:43:31.302598 294136 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
I0816 17:43:31.305043 294136 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0816 17:43:31.305064 294136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0816 17:43:31.305142 294136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-864899
I0816 17:43:31.316077 294136 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0816 17:43:31.330913 294136 host.go:66] Checking if "addons-864899" exists ...
I0816 17:43:31.335342 294136 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0816 17:43:31.335361 294136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0816 17:43:31.335421 294136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-864899
I0816 17:43:31.343315 294136 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.1
I0816 17:43:31.360237 294136 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I0816 17:43:31.362579 294136 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
I0816 17:43:31.362625 294136 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0816 17:43:31.362716 294136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-864899
I0816 17:43:31.380793 294136 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2
I0816 17:43:31.386791 294136 out.go:177] - Using image docker.io/volcanosh/vc-controller-manager:v1.9.0
I0816 17:43:31.390054 294136 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-864899"
I0816 17:43:31.390105 294136 host.go:66] Checking if "addons-864899" exists ...
I0816 17:43:31.390531 294136 cli_runner.go:164] Run: docker container inspect addons-864899 --format={{.State.Status}}
I0816 17:43:31.395849 294136 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0816 17:43:31.398398 294136 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0816 17:43:31.398419 294136 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0816 17:43:31.398509 294136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-864899
I0816 17:43:31.398517 294136 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.22
I0816 17:43:31.399831 294136 addons.go:234] Setting addon default-storageclass=true in "addons-864899"
I0816 17:43:31.399910 294136 out.go:177] - Using image docker.io/registry:2.8.3
I0816 17:43:31.404669 294136 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.31.0
I0816 17:43:31.418024 294136 host.go:66] Checking if "addons-864899" exists ...
I0816 17:43:31.418679 294136 cli_runner.go:164] Run: docker container inspect addons-864899 --format={{.State.Status}}
I0816 17:43:31.423508 294136 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
I0816 17:43:31.423528 294136 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I0816 17:43:31.423596 294136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-864899
I0816 17:43:31.435626 294136 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
I0816 17:43:31.440700 294136 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
I0816 17:43:31.440767 294136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I0816 17:43:31.440877 294136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-864899
I0816 17:43:31.455052 294136 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
I0816 17:43:31.455075 294136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0816 17:43:31.455143 294136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-864899
I0816 17:43:31.457495 294136 out.go:177] - Using image docker.io/volcanosh/vc-scheduler:v1.9.0
I0816 17:43:31.480515 294136 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I0816 17:43:31.489816 294136 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0816 17:43:31.514883 294136 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33140 SSHKeyPath:/home/jenkins/minikube-integration/19461-287979/.minikube/machines/addons-864899/id_rsa Username:docker}
I0816 17:43:31.515097 294136 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0816 17:43:31.515353 294136 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0816 17:43:31.515405 294136 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0816 17:43:31.523988 294136 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0816 17:43:31.529353 294136 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0816 17:43:31.529380 294136 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0816 17:43:31.529455 294136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-864899
I0816 17:43:31.529631 294136 out.go:177] - Using image docker.io/volcanosh/vc-webhook-manager:v1.9.0
I0816 17:43:31.532522 294136 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml
I0816 17:43:31.542713 294136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (434001 bytes)
I0816 17:43:31.540601 294136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I0816 17:43:31.540612 294136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0816 17:43:31.543151 294136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-864899
I0816 17:43:31.542936 294136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-864899
I0816 17:43:31.543079 294136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-864899
I0816 17:43:31.546898 294136 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0816 17:43:31.563514 294136 out.go:177] - Using image docker.io/busybox:stable
I0816 17:43:31.569084 294136 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0816 17:43:31.569335 294136 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0816 17:43:31.569348 294136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0816 17:43:31.569414 294136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-864899
I0816 17:43:31.569877 294136 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33140 SSHKeyPath:/home/jenkins/minikube-integration/19461-287979/.minikube/machines/addons-864899/id_rsa Username:docker}
I0816 17:43:31.571128 294136 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33140 SSHKeyPath:/home/jenkins/minikube-integration/19461-287979/.minikube/machines/addons-864899/id_rsa Username:docker}
I0816 17:43:31.573393 294136 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0816 17:43:31.573409 294136 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0816 17:43:31.573461 294136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-864899
I0816 17:43:31.595774 294136 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0816 17:43:31.600072 294136 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0816 17:43:31.602092 294136 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0816 17:43:31.605091 294136 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0816 17:43:31.607264 294136 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0816 17:43:31.609082 294136 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0816 17:43:31.612950 294136 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33140 SSHKeyPath:/home/jenkins/minikube-integration/19461-287979/.minikube/machines/addons-864899/id_rsa Username:docker}
I0816 17:43:31.613780 294136 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0816 17:43:31.613795 294136 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0816 17:43:31.613866 294136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-864899
I0816 17:43:31.621969 294136 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33140 SSHKeyPath:/home/jenkins/minikube-integration/19461-287979/.minikube/machines/addons-864899/id_rsa Username:docker}
I0816 17:43:31.681445 294136 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33140 SSHKeyPath:/home/jenkins/minikube-integration/19461-287979/.minikube/machines/addons-864899/id_rsa Username:docker}
I0816 17:43:31.682029 294136 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33140 SSHKeyPath:/home/jenkins/minikube-integration/19461-287979/.minikube/machines/addons-864899/id_rsa Username:docker}
I0816 17:43:31.697071 294136 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33140 SSHKeyPath:/home/jenkins/minikube-integration/19461-287979/.minikube/machines/addons-864899/id_rsa Username:docker}
I0816 17:43:31.728411 294136 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33140 SSHKeyPath:/home/jenkins/minikube-integration/19461-287979/.minikube/machines/addons-864899/id_rsa Username:docker}
I0816 17:43:31.751321 294136 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33140 SSHKeyPath:/home/jenkins/minikube-integration/19461-287979/.minikube/machines/addons-864899/id_rsa Username:docker}
I0816 17:43:31.756252 294136 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33140 SSHKeyPath:/home/jenkins/minikube-integration/19461-287979/.minikube/machines/addons-864899/id_rsa Username:docker}
I0816 17:43:31.761734 294136 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33140 SSHKeyPath:/home/jenkins/minikube-integration/19461-287979/.minikube/machines/addons-864899/id_rsa Username:docker}
I0816 17:43:31.768642 294136 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33140 SSHKeyPath:/home/jenkins/minikube-integration/19461-287979/.minikube/machines/addons-864899/id_rsa Username:docker}
I0816 17:43:31.770473 294136 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33140 SSHKeyPath:/home/jenkins/minikube-integration/19461-287979/.minikube/machines/addons-864899/id_rsa Username:docker}
W0816 17:43:31.782161 294136 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0816 17:43:31.782199 294136 retry.go:31] will retry after 307.654354ms: ssh: handshake failed: EOF
W0816 17:43:31.782649 294136 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0816 17:43:31.782671 294136 retry.go:31] will retry after 210.677735ms: ssh: handshake failed: EOF
I0816 17:43:31.950727 294136 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0816 17:43:31.950847 294136 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0816 17:43:32.326972 294136 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0816 17:43:32.479325 294136 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
I0816 17:43:32.479354 294136 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0816 17:43:32.492625 294136 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0816 17:43:32.492660 294136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0816 17:43:32.499702 294136 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
I0816 17:43:32.499730 294136 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0816 17:43:32.530845 294136 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0816 17:43:32.575057 294136 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0816 17:43:32.591694 294136 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I0816 17:43:32.591721 294136 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I0816 17:43:32.609532 294136 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0816 17:43:32.609560 294136 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0816 17:43:32.611918 294136 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0816 17:43:32.635751 294136 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0816 17:43:32.722343 294136 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0816 17:43:32.731298 294136 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0816 17:43:32.731324 294136 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0816 17:43:32.745561 294136 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0816 17:43:32.745589 294136 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0816 17:43:32.761957 294136 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
I0816 17:43:32.761984 294136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0816 17:43:32.764783 294136 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
I0816 17:43:32.764819 294136 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0816 17:43:32.796776 294136 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
I0816 17:43:32.802575 294136 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0816 17:43:32.802611 294136 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0816 17:43:32.913765 294136 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
I0816 17:43:32.913803 294136 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0816 17:43:32.952138 294136 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
I0816 17:43:32.952175 294136 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I0816 17:43:32.956822 294136 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0816 17:43:32.963898 294136 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0816 17:43:32.963939 294136 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0816 17:43:33.089246 294136 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0816 17:43:33.089272 294136 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0816 17:43:33.098808 294136 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0816 17:43:33.194453 294136 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0816 17:43:33.194530 294136 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0816 17:43:33.259001 294136 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0816 17:43:33.314859 294136 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0816 17:43:33.314936 294136 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0816 17:43:33.382779 294136 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
I0816 17:43:33.382849 294136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0816 17:43:33.451000 294136 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I0816 17:43:33.451066 294136 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I0816 17:43:33.637428 294136 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0816 17:43:33.637503 294136 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0816 17:43:33.755737 294136 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0816 17:43:33.755813 294136 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0816 17:43:33.817693 294136 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I0816 17:43:33.817771 294136 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I0816 17:43:33.853296 294136 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0816 17:43:34.122673 294136 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0816 17:43:34.122758 294136 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0816 17:43:34.198305 294136 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (2.247344259s)
I0816 17:43:34.198390 294136 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.247507655s)
I0816 17:43:34.198561 294136 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I0816 17:43:34.198456 294136 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.871461949s)
I0816 17:43:34.200341 294136 node_ready.go:35] waiting up to 6m0s for node "addons-864899" to be "Ready" ...
I0816 17:43:34.205263 294136 node_ready.go:49] node "addons-864899" has status "Ready":"True"
I0816 17:43:34.205287 294136 node_ready.go:38] duration metric: took 4.801914ms for node "addons-864899" to be "Ready" ...
I0816 17:43:34.205295 294136 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0816 17:43:34.219297 294136 pod_ready.go:79] waiting up to 6m0s for pod "coredns-6f6b679f8f-lls4v" in "kube-system" namespace to be "Ready" ...
I0816 17:43:34.299357 294136 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0816 17:43:34.299428 294136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0816 17:43:34.351555 294136 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I0816 17:43:34.351634 294136 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I0816 17:43:34.663238 294136 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0816 17:43:34.663310 294136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0816 17:43:34.702813 294136 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-864899" context rescaled to 1 replicas
I0816 17:43:34.776486 294136 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
I0816 17:43:34.776562 294136 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I0816 17:43:34.814176 294136 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0816 17:43:34.979480 294136 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0816 17:43:34.979562 294136 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0816 17:43:35.158634 294136 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
I0816 17:43:35.158712 294136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
I0816 17:43:35.368604 294136 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I0816 17:43:35.418496 294136 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0816 17:43:35.418559 294136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0816 17:43:35.653236 294136 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0816 17:43:35.653256 294136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0816 17:43:36.004333 294136 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0816 17:43:36.004429 294136 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0816 17:43:36.266959 294136 pod_ready.go:103] pod "coredns-6f6b679f8f-lls4v" in "kube-system" namespace has status "Ready":"False"
I0816 17:43:36.474710 294136 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0816 17:43:38.555431 294136 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0816 17:43:38.555563 294136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-864899
I0816 17:43:38.589211 294136 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33140 SSHKeyPath:/home/jenkins/minikube-integration/19461-287979/.minikube/machines/addons-864899/id_rsa Username:docker}
I0816 17:43:38.777941 294136 pod_ready.go:103] pod "coredns-6f6b679f8f-lls4v" in "kube-system" namespace has status "Ready":"False"
I0816 17:43:39.302783 294136 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0816 17:43:39.421836 294136 addons.go:234] Setting addon gcp-auth=true in "addons-864899"
I0816 17:43:39.421927 294136 host.go:66] Checking if "addons-864899" exists ...
I0816 17:43:39.422395 294136 cli_runner.go:164] Run: docker container inspect addons-864899 --format={{.State.Status}}
I0816 17:43:39.445214 294136 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0816 17:43:39.445273 294136 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-864899
I0816 17:43:39.467643 294136 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33140 SSHKeyPath:/home/jenkins/minikube-integration/19461-287979/.minikube/machines/addons-864899/id_rsa Username:docker}
I0816 17:43:40.219149 294136 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (7.688264503s)
I0816 17:43:40.219224 294136 addons.go:475] Verifying addon ingress=true in "addons-864899"
I0816 17:43:40.219432 294136 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (7.644348518s)
I0816 17:43:40.219515 294136 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (7.607576327s)
I0816 17:43:40.219585 294136 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (7.583811405s)
I0816 17:43:40.219763 294136 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (7.497394623s)
I0816 17:43:40.222254 294136 out.go:177] * Verifying ingress addon...
I0816 17:43:40.225641 294136 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0816 17:43:40.236059 294136 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0816 17:43:40.236122 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:40.731177 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:41.293578 294136 pod_ready.go:103] pod "coredns-6f6b679f8f-lls4v" in "kube-system" namespace has status "Ready":"False"
I0816 17:43:41.300918 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:41.810955 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:42.274759 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:42.291744 294136 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (9.494931677s)
I0816 17:43:42.291829 294136 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (9.334981017s)
I0816 17:43:42.291922 294136 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (9.193035059s)
I0816 17:43:42.291940 294136 addons.go:475] Verifying addon registry=true in "addons-864899"
I0816 17:43:42.292116 294136 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (9.033036923s)
I0816 17:43:42.292142 294136 addons.go:475] Verifying addon metrics-server=true in "addons-864899"
I0816 17:43:42.292187 294136 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (8.438815869s)
I0816 17:43:42.292455 294136 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (7.478194226s)
W0816 17:43:42.292500 294136 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0816 17:43:42.292521 294136 retry.go:31] will retry after 221.089603ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0816 17:43:42.292595 294136 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (6.923915366s)
I0816 17:43:42.293998 294136 out.go:177] * Verifying registry addon...
I0816 17:43:42.294190 294136 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-864899 service yakd-dashboard -n yakd-dashboard
I0816 17:43:42.296905 294136 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0816 17:43:42.353574 294136 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0816 17:43:42.353603 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:42.514540 294136 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0816 17:43:42.755119 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:42.819672 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:43.025158 294136 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (6.55035348s)
I0816 17:43:43.025311 294136 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-864899"
I0816 17:43:43.025262 294136 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (3.580026199s)
I0816 17:43:43.028470 294136 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
I0816 17:43:43.028485 294136 out.go:177] * Verifying csi-hostpath-driver addon...
I0816 17:43:43.031564 294136 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0816 17:43:43.032376 294136 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0816 17:43:43.033767 294136 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0816 17:43:43.033796 294136 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0816 17:43:43.062014 294136 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0816 17:43:43.062098 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:43.156214 294136 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0816 17:43:43.156281 294136 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0816 17:43:43.225408 294136 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0816 17:43:43.225480 294136 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I0816 17:43:43.231087 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:43.309495 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:43.318760 294136 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0816 17:43:43.538953 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:43.736103 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:43.738962 294136 pod_ready.go:103] pod "coredns-6f6b679f8f-lls4v" in "kube-system" namespace has status "Ready":"False"
I0816 17:43:43.801650 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:44.039059 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:44.255778 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:44.342664 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:44.353083 294136 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.83849176s)
I0816 17:43:44.353206 294136 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.034419143s)
I0816 17:43:44.356685 294136 addons.go:475] Verifying addon gcp-auth=true in "addons-864899"
I0816 17:43:44.359391 294136 out.go:177] * Verifying gcp-auth addon...
I0816 17:43:44.362121 294136 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0816 17:43:44.364654 294136 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0816 17:43:44.538306 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:44.731368 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:44.801344 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:45.044169 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:45.236902 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:45.337866 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:45.538263 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:45.733021 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:45.800746 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:46.038197 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:46.234904 294136 pod_ready.go:103] pod "coredns-6f6b679f8f-lls4v" in "kube-system" namespace has status "Ready":"False"
I0816 17:43:46.237846 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:46.301524 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:46.538609 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:46.734366 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:46.803654 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:47.037415 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:47.241789 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:47.337513 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:47.546535 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:47.725964 294136 pod_ready.go:93] pod "coredns-6f6b679f8f-lls4v" in "kube-system" namespace has status "Ready":"True"
I0816 17:43:47.726029 294136 pod_ready.go:82] duration metric: took 13.506645446s for pod "coredns-6f6b679f8f-lls4v" in "kube-system" namespace to be "Ready" ...
I0816 17:43:47.726056 294136 pod_ready.go:79] waiting up to 6m0s for pod "coredns-6f6b679f8f-mrpg2" in "kube-system" namespace to be "Ready" ...
I0816 17:43:47.729407 294136 pod_ready.go:98] error getting pod "coredns-6f6b679f8f-mrpg2" in "kube-system" namespace (skipping!): pods "coredns-6f6b679f8f-mrpg2" not found
I0816 17:43:47.729482 294136 pod_ready.go:82] duration metric: took 3.404965ms for pod "coredns-6f6b679f8f-mrpg2" in "kube-system" namespace to be "Ready" ...
E0816 17:43:47.729508 294136 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-6f6b679f8f-mrpg2" in "kube-system" namespace (skipping!): pods "coredns-6f6b679f8f-mrpg2" not found
I0816 17:43:47.729528 294136 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-864899" in "kube-system" namespace to be "Ready" ...
I0816 17:43:47.734422 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:47.736873 294136 pod_ready.go:93] pod "etcd-addons-864899" in "kube-system" namespace has status "Ready":"True"
I0816 17:43:47.736934 294136 pod_ready.go:82] duration metric: took 7.366293ms for pod "etcd-addons-864899" in "kube-system" namespace to be "Ready" ...
I0816 17:43:47.736963 294136 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-864899" in "kube-system" namespace to be "Ready" ...
I0816 17:43:47.742232 294136 pod_ready.go:93] pod "kube-apiserver-addons-864899" in "kube-system" namespace has status "Ready":"True"
I0816 17:43:47.742297 294136 pod_ready.go:82] duration metric: took 5.313641ms for pod "kube-apiserver-addons-864899" in "kube-system" namespace to be "Ready" ...
I0816 17:43:47.742321 294136 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-864899" in "kube-system" namespace to be "Ready" ...
I0816 17:43:47.748345 294136 pod_ready.go:93] pod "kube-controller-manager-addons-864899" in "kube-system" namespace has status "Ready":"True"
I0816 17:43:47.748414 294136 pod_ready.go:82] duration metric: took 6.071316ms for pod "kube-controller-manager-addons-864899" in "kube-system" namespace to be "Ready" ...
I0816 17:43:47.748439 294136 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-kjxrw" in "kube-system" namespace to be "Ready" ...
I0816 17:43:47.801153 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:47.923437 294136 pod_ready.go:93] pod "kube-proxy-kjxrw" in "kube-system" namespace has status "Ready":"True"
I0816 17:43:47.923509 294136 pod_ready.go:82] duration metric: took 175.049529ms for pod "kube-proxy-kjxrw" in "kube-system" namespace to be "Ready" ...
I0816 17:43:47.923533 294136 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-864899" in "kube-system" namespace to be "Ready" ...
I0816 17:43:48.037819 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:48.231380 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:48.301118 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:48.323548 294136 pod_ready.go:93] pod "kube-scheduler-addons-864899" in "kube-system" namespace has status "Ready":"True"
I0816 17:43:48.323621 294136 pod_ready.go:82] duration metric: took 400.067407ms for pod "kube-scheduler-addons-864899" in "kube-system" namespace to be "Ready" ...
I0816 17:43:48.323647 294136 pod_ready.go:39] duration metric: took 14.118338873s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0816 17:43:48.323689 294136 api_server.go:52] waiting for apiserver process to appear ...
I0816 17:43:48.323766 294136 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0816 17:43:48.336515 294136 api_server.go:72] duration metric: took 17.230981892s to wait for apiserver process to appear ...
I0816 17:43:48.336579 294136 api_server.go:88] waiting for apiserver healthz status ...
I0816 17:43:48.336613 294136 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I0816 17:43:48.344266 294136 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I0816 17:43:48.345501 294136 api_server.go:141] control plane version: v1.31.0
I0816 17:43:48.345555 294136 api_server.go:131] duration metric: took 8.955857ms to wait for apiserver health ...
I0816 17:43:48.345579 294136 system_pods.go:43] waiting for kube-system pods to appear ...
I0816 17:43:48.530009 294136 system_pods.go:59] 18 kube-system pods found
I0816 17:43:48.530046 294136 system_pods.go:61] "coredns-6f6b679f8f-lls4v" [4d9b5208-3f7d-4748-9b64-d0d51b8a759b] Running
I0816 17:43:48.530057 294136 system_pods.go:61] "csi-hostpath-attacher-0" [c78df4bb-8609-488d-ada2-9f65b23d5b99] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0816 17:43:48.530066 294136 system_pods.go:61] "csi-hostpath-resizer-0" [b540c0f9-77a8-4718-aec9-fc87bc84aa2f] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0816 17:43:48.530075 294136 system_pods.go:61] "csi-hostpathplugin-qtzcx" [a668f80d-6b61-4306-8db0-6820fd445cee] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0816 17:43:48.530081 294136 system_pods.go:61] "etcd-addons-864899" [aa4a09f3-6eff-400e-a840-29260e895a0c] Running
I0816 17:43:48.530094 294136 system_pods.go:61] "kindnet-mcs5f" [78fe4c47-0645-40bf-9c17-5b60270e7389] Running
I0816 17:43:48.530099 294136 system_pods.go:61] "kube-apiserver-addons-864899" [b3da2fd2-d299-4c50-abe3-1b6780c5b123] Running
I0816 17:43:48.530111 294136 system_pods.go:61] "kube-controller-manager-addons-864899" [9476c8af-7528-4161-ad0d-216e6daa7240] Running
I0816 17:43:48.530115 294136 system_pods.go:61] "kube-ingress-dns-minikube" [d970ac4a-dd4d-49ec-8143-b1efc71394e5] Running
I0816 17:43:48.530119 294136 system_pods.go:61] "kube-proxy-kjxrw" [0ecc5e80-8d3c-49d5-9778-836dce762e8d] Running
I0816 17:43:48.530125 294136 system_pods.go:61] "kube-scheduler-addons-864899" [6630df07-6718-4b66-b945-db63c48e8b12] Running
I0816 17:43:48.530131 294136 system_pods.go:61] "metrics-server-8988944d9-7x26w" [b9b0a4cd-3c28-4e65-bf08-6b2a89a4fdde] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0816 17:43:48.530141 294136 system_pods.go:61] "nvidia-device-plugin-daemonset-k9vv2" [1abed4b9-c96b-4ed0-9de5-2035c284afa5] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I0816 17:43:48.530147 294136 system_pods.go:61] "registry-6fb4cdfc84-pvhcl" [67686d20-79b3-4c3c-b120-f96dfea3fa24] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0816 17:43:48.530156 294136 system_pods.go:61] "registry-proxy-hftrd" [0e434063-8781-41ea-8c5b-c43130270841] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0816 17:43:48.530165 294136 system_pods.go:61] "snapshot-controller-56fcc65765-6m9j4" [80ee8b08-425f-45ff-978a-d895f79970a3] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0816 17:43:48.530174 294136 system_pods.go:61] "snapshot-controller-56fcc65765-hblt6" [ebf55a1e-84cd-4f98-b07a-bef356a479f4] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0816 17:43:48.530180 294136 system_pods.go:61] "storage-provisioner" [ee16551c-4e29-4d38-860c-ec4637547833] Running
I0816 17:43:48.530187 294136 system_pods.go:74] duration metric: took 184.590647ms to wait for pod list to return data ...
I0816 17:43:48.530196 294136 default_sa.go:34] waiting for default service account to be created ...
I0816 17:43:48.537452 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:48.723937 294136 default_sa.go:45] found service account: "default"
I0816 17:43:48.724002 294136 default_sa.go:55] duration metric: took 193.797719ms for default service account to be created ...
I0816 17:43:48.724027 294136 system_pods.go:116] waiting for k8s-apps to be running ...
I0816 17:43:48.731189 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:48.831720 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:48.934481 294136 system_pods.go:86] 18 kube-system pods found
I0816 17:43:48.934566 294136 system_pods.go:89] "coredns-6f6b679f8f-lls4v" [4d9b5208-3f7d-4748-9b64-d0d51b8a759b] Running
I0816 17:43:48.934593 294136 system_pods.go:89] "csi-hostpath-attacher-0" [c78df4bb-8609-488d-ada2-9f65b23d5b99] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0816 17:43:48.934629 294136 system_pods.go:89] "csi-hostpath-resizer-0" [b540c0f9-77a8-4718-aec9-fc87bc84aa2f] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0816 17:43:48.934655 294136 system_pods.go:89] "csi-hostpathplugin-qtzcx" [a668f80d-6b61-4306-8db0-6820fd445cee] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0816 17:43:48.934674 294136 system_pods.go:89] "etcd-addons-864899" [aa4a09f3-6eff-400e-a840-29260e895a0c] Running
I0816 17:43:48.934691 294136 system_pods.go:89] "kindnet-mcs5f" [78fe4c47-0645-40bf-9c17-5b60270e7389] Running
I0816 17:43:48.934709 294136 system_pods.go:89] "kube-apiserver-addons-864899" [b3da2fd2-d299-4c50-abe3-1b6780c5b123] Running
I0816 17:43:48.934736 294136 system_pods.go:89] "kube-controller-manager-addons-864899" [9476c8af-7528-4161-ad0d-216e6daa7240] Running
I0816 17:43:48.934761 294136 system_pods.go:89] "kube-ingress-dns-minikube" [d970ac4a-dd4d-49ec-8143-b1efc71394e5] Running
I0816 17:43:48.934778 294136 system_pods.go:89] "kube-proxy-kjxrw" [0ecc5e80-8d3c-49d5-9778-836dce762e8d] Running
I0816 17:43:48.934810 294136 system_pods.go:89] "kube-scheduler-addons-864899" [6630df07-6718-4b66-b945-db63c48e8b12] Running
I0816 17:43:48.934835 294136 system_pods.go:89] "metrics-server-8988944d9-7x26w" [b9b0a4cd-3c28-4e65-bf08-6b2a89a4fdde] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0816 17:43:48.934856 294136 system_pods.go:89] "nvidia-device-plugin-daemonset-k9vv2" [1abed4b9-c96b-4ed0-9de5-2035c284afa5] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I0816 17:43:48.934874 294136 system_pods.go:89] "registry-6fb4cdfc84-pvhcl" [67686d20-79b3-4c3c-b120-f96dfea3fa24] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0816 17:43:48.934907 294136 system_pods.go:89] "registry-proxy-hftrd" [0e434063-8781-41ea-8c5b-c43130270841] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0816 17:43:48.934931 294136 system_pods.go:89] "snapshot-controller-56fcc65765-6m9j4" [80ee8b08-425f-45ff-978a-d895f79970a3] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0816 17:43:48.934951 294136 system_pods.go:89] "snapshot-controller-56fcc65765-hblt6" [ebf55a1e-84cd-4f98-b07a-bef356a479f4] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0816 17:43:48.934966 294136 system_pods.go:89] "storage-provisioner" [ee16551c-4e29-4d38-860c-ec4637547833] Running
I0816 17:43:48.934985 294136 system_pods.go:126] duration metric: took 210.941486ms to wait for k8s-apps to be running ...
I0816 17:43:48.935017 294136 system_svc.go:44] waiting for kubelet service to be running ....
I0816 17:43:48.935125 294136 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0816 17:43:48.955452 294136 system_svc.go:56] duration metric: took 20.428986ms WaitForService to wait for kubelet
I0816 17:43:48.955478 294136 kubeadm.go:582] duration metric: took 17.84994891s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0816 17:43:48.955506 294136 node_conditions.go:102] verifying NodePressure condition ...
I0816 17:43:49.037793 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:49.124140 294136 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0816 17:43:49.124175 294136 node_conditions.go:123] node cpu capacity is 2
I0816 17:43:49.124187 294136 node_conditions.go:105] duration metric: took 168.675256ms to run NodePressure ...
I0816 17:43:49.124216 294136 start.go:241] waiting for startup goroutines ...
I0816 17:43:49.230259 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:49.301166 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:49.538233 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:49.730727 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:49.801718 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:50.037951 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:50.230422 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:50.301247 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:50.540813 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:50.730756 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:50.819609 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:51.039021 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:51.231833 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:51.302242 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:51.537625 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:51.730834 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:51.800340 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:52.038231 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:52.236023 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:52.300472 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:52.538308 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:52.730192 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:52.800515 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:53.037674 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:53.229907 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:53.300092 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:53.537569 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:53.730303 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:53.800827 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:54.038676 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:54.230874 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:54.300617 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:54.538831 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:54.730599 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:54.801263 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:55.037958 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:55.231182 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:55.300759 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:55.537939 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:55.730818 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:55.802053 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:56.038905 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:56.231053 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:56.300480 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:56.538338 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:56.730829 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:56.800527 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:57.041919 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:57.230858 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:57.301434 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:57.537727 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:57.731978 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:57.831688 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:58.037989 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:58.231092 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:58.300640 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:58.538164 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:58.730862 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:58.831156 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:59.037547 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:59.230099 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:59.300672 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:43:59.536861 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:43:59.730273 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:43:59.800809 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:44:00.062269 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:00.265642 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:00.329858 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:44:00.541270 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:00.743629 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:00.820105 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:44:01.038961 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:01.232003 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:01.301436 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:44:01.537918 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:01.730899 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:01.800661 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:44:02.037703 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:02.230939 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:02.301267 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:44:02.537760 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:02.730907 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:02.800685 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:44:03.038994 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:03.233252 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:03.332560 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0816 17:44:03.537885 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:03.731632 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:03.801063 294136 kapi.go:107] duration metric: took 21.504156599s to wait for kubernetes.io/minikube-addons=registry ...
I0816 17:44:04.037943 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:04.232775 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:04.537348 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:04.730724 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:05.040927 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:05.231364 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:05.538307 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:05.730972 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:06.038788 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:06.230309 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:06.537926 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:06.731231 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:07.038237 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:07.231101 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:07.539512 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:07.731553 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:08.038640 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:08.233740 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:08.537788 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:08.729900 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:09.039130 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:09.231886 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:09.537610 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:09.730429 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:10.038713 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:10.230947 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:10.537229 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:10.730577 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:11.037084 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:11.230634 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:11.536936 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:11.730597 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:12.039590 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:12.234408 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:12.541692 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:12.733606 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:13.039129 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:13.238371 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:13.537513 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:13.732113 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:14.054471 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:14.230920 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:14.538533 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:14.739422 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:15.047045 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:15.231474 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:15.537563 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:15.735776 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:16.037204 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:16.231317 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:16.538223 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:16.730699 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:17.038333 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:17.233710 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:17.537560 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:17.734170 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:18.066178 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:18.234418 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:18.539051 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:18.731365 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:19.037116 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:19.229873 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:19.537440 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:19.730419 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:20.037683 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:20.232838 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:20.537527 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:20.730309 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:21.037416 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:21.231144 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:21.538962 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:21.730431 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:22.037111 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:22.231170 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:22.537224 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:22.729858 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:23.037605 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:23.230970 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:23.537851 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:23.731619 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:24.037495 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:24.231308 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:24.537623 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:24.730905 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:25.037230 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:25.231567 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:25.538209 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:25.731112 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:26.037789 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:26.230953 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:26.539014 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:26.731208 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:27.038048 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:27.231124 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:27.537938 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:27.731159 294136 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0816 17:44:28.038269 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:28.235328 294136 kapi.go:107] duration metric: took 48.00968743s to wait for app.kubernetes.io/name=ingress-nginx ...
I0816 17:44:28.539313 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:29.037753 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:29.539287 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:30.043644 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:30.538429 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:31.038649 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:31.537907 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:32.038378 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:32.538210 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:33.037684 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:33.537341 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:34.038028 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:34.537450 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:35.038446 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:35.538154 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0816 17:44:36.037486 294136 kapi.go:107] duration metric: took 53.005104813s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0816 17:45:06.370191 294136 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0816 17:45:06.370221 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:06.866370 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:07.365833 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:07.865542 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:08.366802 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:08.865898 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:09.366712 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:09.865595 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:10.366611 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:10.866756 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:11.365855 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:11.865475 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:12.365609 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:12.866293 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:13.365253 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:13.865844 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:14.366526 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:14.866453 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:15.366271 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:15.865466 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:16.366195 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:16.866072 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:17.366737 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:17.865711 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:18.365701 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:18.865715 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:19.366651 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:19.865757 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:20.365963 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:20.866068 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:21.366025 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:21.866098 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:22.365879 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:22.865955 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:23.365663 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:23.866272 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:24.365989 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:24.866393 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:25.365816 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:25.865197 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:26.366138 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:26.866961 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:27.365859 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:27.866105 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:28.365300 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:28.866540 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:29.400127 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:29.866010 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:30.366528 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:30.866042 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:31.366351 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:31.866223 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:32.366015 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:32.865807 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:33.365612 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:33.866772 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:34.365656 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:34.865613 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:35.366858 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:35.866147 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:36.365513 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:36.865622 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:37.366181 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:37.865560 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:38.366831 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:38.865757 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:39.366775 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:39.865403 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:40.366159 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:40.866180 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:41.366232 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:41.865337 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:42.367621 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:42.866279 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:43.365473 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:43.866800 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:44.367860 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:44.866103 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:45.366539 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:45.866092 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:46.365454 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:46.866362 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:47.366066 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:47.866352 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:48.366643 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:48.866899 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:49.366047 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:49.865965 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:50.366003 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:50.866550 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:51.366172 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:51.866914 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:52.365948 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:52.865704 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:53.365778 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:53.866285 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:54.366004 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:54.866199 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:55.365865 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:55.865411 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:56.366853 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:56.866004 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:57.365676 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:57.865660 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:58.365417 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:58.866267 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:59.365484 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:45:59.866776 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:00.365615 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:00.865635 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:01.365418 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:01.866504 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:02.366101 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:02.866544 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:03.366303 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:03.866337 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:04.365525 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:04.866137 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:05.366426 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:05.865359 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:06.366372 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:06.866089 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:07.365653 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:07.866452 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:08.365531 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:08.866658 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:09.365469 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:09.865395 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:10.366349 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:10.867088 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:11.366742 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:11.865682 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:12.367211 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:12.866488 294136 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0816 17:46:13.365578 294136 kapi.go:107] duration metric: took 2m29.003455605s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0816 17:46:13.368494 294136 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-864899 cluster.
I0816 17:46:13.371462 294136 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0816 17:46:13.373615 294136 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0816 17:46:13.376400 294136 out.go:177] * Enabled addons: default-storageclass, nvidia-device-plugin, storage-provisioner, cloud-spanner, storage-provisioner-rancher, volcano, ingress-dns, metrics-server, inspektor-gadget, yakd, volumesnapshots, registry, ingress, csi-hostpath-driver, gcp-auth
I0816 17:46:13.379061 294136 addons.go:510] duration metric: took 2m42.273097924s for enable addons: enabled=[default-storageclass nvidia-device-plugin storage-provisioner cloud-spanner storage-provisioner-rancher volcano ingress-dns metrics-server inspektor-gadget yakd volumesnapshots registry ingress csi-hostpath-driver gcp-auth]
I0816 17:46:13.379106 294136 start.go:246] waiting for cluster config update ...
I0816 17:46:13.379128 294136 start.go:255] writing updated cluster config ...
I0816 17:46:13.379426 294136 ssh_runner.go:195] Run: rm -f paused
I0816 17:46:13.736266 294136 start.go:600] kubectl: 1.31.0, cluster: 1.31.0 (minor skew: 0)
I0816 17:46:13.739604 294136 out.go:177] * Done! kubectl is now configured to use "addons-864899" cluster and "default" namespace by default
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
0664fe9de8aae e2d3313f65753 2 minutes ago Exited gadget 5 11099b71bd022 gadget-tcnmn
14dc3f65e39e9 6ef582f3ec844 3 minutes ago Running gcp-auth 0 aba524e236596 gcp-auth-89d5ffd79-gpbrj
9f59dbfb8aace 8b46b1cd48760 4 minutes ago Running admission 0 997d8fc03ccf4 volcano-admission-77d7d48b68-2f46h
9e91dca7bd149 ee6d597e62dc8 4 minutes ago Running csi-snapshotter 0 1e2cf52520b88 csi-hostpathplugin-qtzcx
084dfd66ebaf4 642ded511e141 4 minutes ago Running csi-provisioner 0 1e2cf52520b88 csi-hostpathplugin-qtzcx
30b7b2b4c41f1 922312104da8a 5 minutes ago Running liveness-probe 0 1e2cf52520b88 csi-hostpathplugin-qtzcx
3edb9afe7c0e7 08f6b2990811a 5 minutes ago Running hostpath 0 1e2cf52520b88 csi-hostpathplugin-qtzcx
d1ebd253ec9fb 0107d56dbc0be 5 minutes ago Running node-driver-registrar 0 1e2cf52520b88 csi-hostpathplugin-qtzcx
22166e0d380de 289a818c8d9c5 5 minutes ago Running controller 0 0d5d8c504e29c ingress-nginx-controller-bc57996ff-w4vnd
827bb8260e8e9 1461903ec4fe9 5 minutes ago Running csi-external-health-monitor-controller 0 1e2cf52520b88 csi-hostpathplugin-qtzcx
9fc3d38fde586 487fa743e1e22 5 minutes ago Running csi-resizer 0 3c962879a3632 csi-hostpath-resizer-0
73d54c7c0d19e 9a80d518f102c 5 minutes ago Running csi-attacher 0 648d2f57ad065 csi-hostpath-attacher-0
40d976d38f80e 420193b27261a 5 minutes ago Exited patch 0 16b7d406f88a5 ingress-nginx-admission-patch-vd7pb
554881eceef49 1505f556b3a7b 5 minutes ago Running volcano-controllers 0 213e60007927d volcano-controllers-56675bb4d5-kdtv4
cbf6ba7565ad5 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 785b06e102bf7 snapshot-controller-56fcc65765-hblt6
da02c11fa4a73 d9c7ad4c226bf 5 minutes ago Running volcano-scheduler 0 db8b76fdb37ad volcano-scheduler-576bc46687-jz6d7
45f4148961806 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 e4d20e4cc6680 snapshot-controller-56fcc65765-6m9j4
59ea941bfedca 95dccb4df54ab 5 minutes ago Running metrics-server 0 b2854d6f88d3e metrics-server-8988944d9-7x26w
cabec07f39799 420193b27261a 5 minutes ago Exited create 0 bfee19d4febad ingress-nginx-admission-create-zpv9t
08763197ad44b 7ce2150c8929b 5 minutes ago Running local-path-provisioner 0 07ef3f5afce6b local-path-provisioner-86d989889c-2prk7
284418d05c49c 77bdba588b953 5 minutes ago Running yakd 0 2a50d870df250 yakd-dashboard-67d98fc6b-b44t7
b48234f8760b8 3410e1561990a 5 minutes ago Running registry-proxy 0 aa8b3ccc26384 registry-proxy-hftrd
252269d3b88b2 6fed88f43b276 5 minutes ago Running registry 0 6a5750ed5e86f registry-6fb4cdfc84-pvhcl
2cebe31aa30d0 53af6e2c4c343 5 minutes ago Running cloud-spanner-emulator 0 4bd02e3c34803 cloud-spanner-emulator-c4bc9b5f8-6np5w
0d5f70f0dfbae a9bac31a5be8d 5 minutes ago Running nvidia-device-plugin-ctr 0 fabb42d68be47 nvidia-device-plugin-daemonset-k9vv2
b0990e9e65a74 2437cf7621777 5 minutes ago Running coredns 0 7a53bc3da2d89 coredns-6f6b679f8f-lls4v
85fcab11f791c 35508c2f890c4 5 minutes ago Running minikube-ingress-dns 0 0e9073ef4dceb kube-ingress-dns-minikube
6aea42a6df509 ba04bb24b9575 5 minutes ago Running storage-provisioner 0 71ca8ef378a20 storage-provisioner
fc6344743ae93 6a23fa8fd2b78 5 minutes ago Running kindnet-cni 0 e1f16174e5ff1 kindnet-mcs5f
f7a1610f3e767 71d55d66fd4ee 6 minutes ago Running kube-proxy 0 5b13b590e7aac kube-proxy-kjxrw
4c5d7397adeba cd0f0ae0ec9e0 6 minutes ago Running kube-apiserver 0 e06936a6e95bc kube-apiserver-addons-864899
d082ca7c776dc 27e3830e14027 6 minutes ago Running etcd 0 a366f2ce67ec3 etcd-addons-864899
24f36c489fe04 fbbbd428abb4d 6 minutes ago Running kube-scheduler 0 a78b8cc50d266 kube-scheduler-addons-864899
682980ddf02ed fcb0683e6bdbd 6 minutes ago Running kube-controller-manager 0 5c7913c187df5 kube-controller-manager-addons-864899
==> containerd <==
Aug 16 17:46:26 addons-864899 containerd[818]: time="2024-08-16T17:46:26.422422143Z" level=info msg="RemovePodSandbox \"7fed21dc55d4447d296422fcb470416c3e6e42e514389499f1d410be66e604da\" returns successfully"
Aug 16 17:47:23 addons-864899 containerd[818]: time="2024-08-16T17:47:23.370069045Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.31.0@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc\""
Aug 16 17:47:23 addons-864899 containerd[818]: time="2024-08-16T17:47:23.501582985Z" level=info msg="ImageUpdate event name:\"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}"
Aug 16 17:47:23 addons-864899 containerd[818]: time="2024-08-16T17:47:23.502228398Z" level=info msg="stop pulling image ghcr.io/inspektor-gadget/inspektor-gadget@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc: active requests=0, bytes read=89"
Aug 16 17:47:23 addons-864899 containerd[818]: time="2024-08-16T17:47:23.508440677Z" level=info msg="Pulled image \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.31.0@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc\" with image id \"sha256:e2d3313f65753f82428cf312f6e4b9237983de19680bde57ca1c0935cadbe630\", repo tag \"\", repo digest \"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc\", size \"69907666\" in 138.316305ms"
Aug 16 17:47:23 addons-864899 containerd[818]: time="2024-08-16T17:47:23.508632324Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.31.0@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc\" returns image reference \"sha256:e2d3313f65753f82428cf312f6e4b9237983de19680bde57ca1c0935cadbe630\""
Aug 16 17:47:23 addons-864899 containerd[818]: time="2024-08-16T17:47:23.511089855Z" level=info msg="CreateContainer within sandbox \"11099b71bd022b272f753bc7df9caf0cd2660975ed762e62c3c1811b7fc1f8fc\" for container &ContainerMetadata{Name:gadget,Attempt:5,}"
Aug 16 17:47:23 addons-864899 containerd[818]: time="2024-08-16T17:47:23.532145316Z" level=info msg="CreateContainer within sandbox \"11099b71bd022b272f753bc7df9caf0cd2660975ed762e62c3c1811b7fc1f8fc\" for &ContainerMetadata{Name:gadget,Attempt:5,} returns container id \"0664fe9de8aae822ff0e67a02eb633ccfb6985e6f8f8209eb8ec1e91285f1c48\""
Aug 16 17:47:23 addons-864899 containerd[818]: time="2024-08-16T17:47:23.532860333Z" level=info msg="StartContainer for \"0664fe9de8aae822ff0e67a02eb633ccfb6985e6f8f8209eb8ec1e91285f1c48\""
Aug 16 17:47:23 addons-864899 containerd[818]: time="2024-08-16T17:47:23.595540820Z" level=info msg="StartContainer for \"0664fe9de8aae822ff0e67a02eb633ccfb6985e6f8f8209eb8ec1e91285f1c48\" returns successfully"
Aug 16 17:47:24 addons-864899 containerd[818]: time="2024-08-16T17:47:24.823968053Z" level=info msg="shim disconnected" id=0664fe9de8aae822ff0e67a02eb633ccfb6985e6f8f8209eb8ec1e91285f1c48 namespace=k8s.io
Aug 16 17:47:24 addons-864899 containerd[818]: time="2024-08-16T17:47:24.824036138Z" level=warning msg="cleaning up after shim disconnected" id=0664fe9de8aae822ff0e67a02eb633ccfb6985e6f8f8209eb8ec1e91285f1c48 namespace=k8s.io
Aug 16 17:47:24 addons-864899 containerd[818]: time="2024-08-16T17:47:24.824047560Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Aug 16 17:47:25 addons-864899 containerd[818]: time="2024-08-16T17:47:25.447995200Z" level=info msg="RemoveContainer for \"4480d96a13e531e7d8ffa69bbe5658f857e443a861cef88f168ad57f12e19ca9\""
Aug 16 17:47:25 addons-864899 containerd[818]: time="2024-08-16T17:47:25.454344989Z" level=info msg="RemoveContainer for \"4480d96a13e531e7d8ffa69bbe5658f857e443a861cef88f168ad57f12e19ca9\" returns successfully"
Aug 16 17:47:26 addons-864899 containerd[818]: time="2024-08-16T17:47:26.426002307Z" level=info msg="RemoveContainer for \"1a5023da9b9cd2c65dcea975878690f266e8cd1a2a24f1be640b3e42bdc580b9\""
Aug 16 17:47:26 addons-864899 containerd[818]: time="2024-08-16T17:47:26.431978994Z" level=info msg="RemoveContainer for \"1a5023da9b9cd2c65dcea975878690f266e8cd1a2a24f1be640b3e42bdc580b9\" returns successfully"
Aug 16 17:47:26 addons-864899 containerd[818]: time="2024-08-16T17:47:26.434071710Z" level=info msg="StopPodSandbox for \"d7ec72ba204553769d5724dd3a439bb5d66ea1327e6a22bef59fba233d3b68f4\""
Aug 16 17:47:26 addons-864899 containerd[818]: time="2024-08-16T17:47:26.441371206Z" level=info msg="TearDown network for sandbox \"d7ec72ba204553769d5724dd3a439bb5d66ea1327e6a22bef59fba233d3b68f4\" successfully"
Aug 16 17:47:26 addons-864899 containerd[818]: time="2024-08-16T17:47:26.441410450Z" level=info msg="StopPodSandbox for \"d7ec72ba204553769d5724dd3a439bb5d66ea1327e6a22bef59fba233d3b68f4\" returns successfully"
Aug 16 17:47:26 addons-864899 containerd[818]: time="2024-08-16T17:47:26.441823987Z" level=info msg="RemovePodSandbox for \"d7ec72ba204553769d5724dd3a439bb5d66ea1327e6a22bef59fba233d3b68f4\""
Aug 16 17:47:26 addons-864899 containerd[818]: time="2024-08-16T17:47:26.441858243Z" level=info msg="Forcibly stopping sandbox \"d7ec72ba204553769d5724dd3a439bb5d66ea1327e6a22bef59fba233d3b68f4\""
Aug 16 17:47:26 addons-864899 containerd[818]: time="2024-08-16T17:47:26.454454158Z" level=info msg="TearDown network for sandbox \"d7ec72ba204553769d5724dd3a439bb5d66ea1327e6a22bef59fba233d3b68f4\" successfully"
Aug 16 17:47:26 addons-864899 containerd[818]: time="2024-08-16T17:47:26.460414885Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"d7ec72ba204553769d5724dd3a439bb5d66ea1327e6a22bef59fba233d3b68f4\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus."
Aug 16 17:47:26 addons-864899 containerd[818]: time="2024-08-16T17:47:26.461078407Z" level=info msg="RemovePodSandbox \"d7ec72ba204553769d5724dd3a439bb5d66ea1327e6a22bef59fba233d3b68f4\" returns successfully"
==> coredns [b0990e9e65a7424bbe991114384db6df8ac06b8979e1cfaef3fdfbfb2a469047] <==
[INFO] 10.244.0.5:43105 - 53790 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000068997s
[INFO] 10.244.0.5:49432 - 26715 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002493199s
[INFO] 10.244.0.5:49432 - 32093 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002566495s
[INFO] 10.244.0.5:42253 - 53106 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000184984s
[INFO] 10.244.0.5:42253 - 24438 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000240934s
[INFO] 10.244.0.5:53065 - 17669 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000111671s
[INFO] 10.244.0.5:53065 - 22842 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000056558s
[INFO] 10.244.0.5:53947 - 14255 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000053259s
[INFO] 10.244.0.5:53947 - 51665 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000037948s
[INFO] 10.244.0.5:41194 - 18091 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000058125s
[INFO] 10.244.0.5:41194 - 31145 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000030285s
[INFO] 10.244.0.5:45465 - 2124 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001285344s
[INFO] 10.244.0.5:45465 - 27982 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001234333s
[INFO] 10.244.0.5:39252 - 9340 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000064418s
[INFO] 10.244.0.5:39252 - 52851 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000039679s
[INFO] 10.244.0.24:51694 - 2891 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.007366761s
[INFO] 10.244.0.24:56171 - 38150 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.007362978s
[INFO] 10.244.0.24:39824 - 7027 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000132742s
[INFO] 10.244.0.24:44041 - 64601 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000079852s
[INFO] 10.244.0.24:38592 - 53840 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.00029901s
[INFO] 10.244.0.24:37012 - 30718 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000119425s
[INFO] 10.244.0.24:36764 - 30594 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.00279472s
[INFO] 10.244.0.24:36146 - 61219 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.005011243s
[INFO] 10.244.0.24:45700 - 8487 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 648 0.001419883s
[INFO] 10.244.0.24:58241 - 28609 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.001405753s
==> describe nodes <==
Name: addons-864899
Roles: control-plane
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=addons-864899
kubernetes.io/os=linux
minikube.k8s.io/commit=8789c54b9bc6db8e66c461a83302d5a0be0abbdd
minikube.k8s.io/name=addons-864899
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_08_16T17_43_27_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-864899
Annotations: csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-864899"}
kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Fri, 16 Aug 2024 17:43:23 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-864899
AcquireTime: <unset>
RenewTime: Fri, 16 Aug 2024 17:49:23 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Fri, 16 Aug 2024 17:46:30 +0000 Fri, 16 Aug 2024 17:43:20 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Fri, 16 Aug 2024 17:46:30 +0000 Fri, 16 Aug 2024 17:43:20 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Fri, 16 Aug 2024 17:46:30 +0000 Fri, 16 Aug 2024 17:43:20 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Fri, 16 Aug 2024 17:46:30 +0000 Fri, 16 Aug 2024 17:43:23 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-864899
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022364Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022364Ki
pods: 110
System Info:
Machine ID: 5ac051db66494860961e2847297e84e1
System UUID: 2523c80a-07d5-4ab2-b049-b44f710bb48e
Boot ID: 6cf3c121-8478-4b33-820f-e176429c0afc
Kernel Version: 5.15.0-1067-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.20
Kubelet Version: v1.31.0
Kube-Proxy Version:
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (27 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default cloud-spanner-emulator-c4bc9b5f8-6np5w 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
gadget gadget-tcnmn 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m54s
gcp-auth gcp-auth-89d5ffd79-gpbrj 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m26s
ingress-nginx ingress-nginx-controller-bc57996ff-w4vnd 100m (5%) 0 (0%) 90Mi (1%) 0 (0%) 5m52s
kube-system coredns-6f6b679f8f-lls4v 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 6m1s
kube-system csi-hostpath-attacher-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m50s
kube-system csi-hostpath-resizer-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m49s
kube-system csi-hostpathplugin-qtzcx 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m50s
kube-system etcd-addons-864899 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 6m6s
kube-system kindnet-mcs5f 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 6m1s
kube-system kube-apiserver-addons-864899 250m (12%) 0 (0%) 0 (0%) 0 (0%) 6m6s
kube-system kube-controller-manager-addons-864899 200m (10%) 0 (0%) 0 (0%) 0 (0%) 6m6s
kube-system kube-ingress-dns-minikube 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
kube-system kube-proxy-kjxrw 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m1s
kube-system kube-scheduler-addons-864899 100m (5%) 0 (0%) 0 (0%) 0 (0%) 6m6s
kube-system metrics-server-8988944d9-7x26w 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 5m56s
kube-system nvidia-device-plugin-daemonset-k9vv2 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
kube-system registry-6fb4cdfc84-pvhcl 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
kube-system registry-proxy-hftrd 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
kube-system snapshot-controller-56fcc65765-6m9j4 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m54s
kube-system snapshot-controller-56fcc65765-hblt6 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m54s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
local-path-storage local-path-provisioner-86d989889c-2prk7 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m55s
volcano-system volcano-admission-77d7d48b68-2f46h 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
volcano-system volcano-controllers-56675bb4d5-kdtv4 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m51s
volcano-system volcano-scheduler-576bc46687-jz6d7 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m51s
yakd-dashboard yakd-dashboard-67d98fc6b-b44t7 0 (0%) 0 (0%) 128Mi (1%) 256Mi (3%) 5m55s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 1050m (52%) 100m (5%)
memory 638Mi (8%) 476Mi (6%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 5m59s kube-proxy
Normal Starting 6m6s kubelet Starting kubelet.
Warning CgroupV1 6m6s kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeAllocatableEnforced 6m6s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 6m6s kubelet Node addons-864899 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m6s kubelet Node addons-864899 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m6s kubelet Node addons-864899 status is now: NodeHasSufficientPID
Normal RegisteredNode 6m2s node-controller Node addons-864899 event: Registered Node addons-864899 in Controller
==> dmesg <==
[Aug16 16:17] ACPI: SRAT not present
[ +0.000000] ACPI: SRAT not present
[ +0.000000] SPI driver altr_a10sr has no spi_device_id for altr,a10sr
[ +0.014352] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[ +0.475030] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
[ +0.058285] systemd[1]: /lib/systemd/system/cloud-init-local.service:15: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
[ +0.002346] systemd[1]: /lib/systemd/system/cloud-init.service:19: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
[ +0.016108] systemd[1]: /lib/systemd/system/cloud-init.target:15: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
[ +0.003740] systemd[1]: /lib/systemd/system/cloud-final.service:9: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
[ +0.003933] systemd[1]: /lib/systemd/system/cloud-config.service:8: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
[ +0.648870] ena 0000:00:05.0: LLQ is not supported Fallback to host mode policy.
[ +6.745706] kauditd_printk_skb: 36 callbacks suppressed
[Aug16 16:39] hrtimer: interrupt took 17228644 ns
[Aug16 17:13] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
==> etcd [d082ca7c776dcea5d270d79ff6aa4eaa7c5286e8bd89c70f5d401979c6c6a774] <==
{"level":"info","ts":"2024-08-16T17:43:20.117723Z","caller":"embed/etcd.go:728","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
{"level":"info","ts":"2024-08-16T17:43:20.118083Z","caller":"embed/etcd.go:279","msg":"now serving peer/client/metrics","local-member-id":"aec36adc501070cc","initial-advertise-peer-urls":["https://192.168.49.2:2380"],"listen-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.49.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
{"level":"info","ts":"2024-08-16T17:43:20.118196Z","caller":"embed/etcd.go:870","msg":"serving metrics","address":"http://127.0.0.1:2381"}
{"level":"info","ts":"2024-08-16T17:43:20.118655Z","caller":"embed/etcd.go:599","msg":"serving peer traffic","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-08-16T17:43:20.118758Z","caller":"embed/etcd.go:571","msg":"cmux::serve","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-08-16T17:43:20.389040Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
{"level":"info","ts":"2024-08-16T17:43:20.389155Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
{"level":"info","ts":"2024-08-16T17:43:20.389191Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
{"level":"info","ts":"2024-08-16T17:43:20.389247Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
{"level":"info","ts":"2024-08-16T17:43:20.389317Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-08-16T17:43:20.389361Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
{"level":"info","ts":"2024-08-16T17:43:20.389451Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-08-16T17:43:20.397165Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-864899 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
{"level":"info","ts":"2024-08-16T17:43:20.397502Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-08-16T17:43:20.397920Z","caller":"etcdserver/server.go:2629","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-08-16T17:43:20.401007Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-08-16T17:43:20.405697Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-08-16T17:43:20.406787Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
{"level":"info","ts":"2024-08-16T17:43:20.417020Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-08-16T17:43:20.419100Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-08-16T17:43:20.417683Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-08-16T17:43:20.418454Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
{"level":"info","ts":"2024-08-16T17:43:20.421271Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-08-16T17:43:20.421373Z","caller":"etcdserver/server.go:2653","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2024-08-16T17:43:20.422385Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
==> gcp-auth [14dc3f65e39e999d9c177dadff522f415d951a46d892ca5505dac2485d76d3d9] <==
2024/08/16 17:46:12 GCP Auth Webhook started!
2024/08/16 17:46:30 Ready to marshal response ...
2024/08/16 17:46:30 Ready to write response ...
2024/08/16 17:46:30 Ready to marshal response ...
2024/08/16 17:46:30 Ready to write response ...
==> kernel <==
17:49:32 up 1:31, 0 users, load average: 0.15, 1.36, 2.25
Linux addons-864899 5.15.0-1067-aws #73~20.04.1-Ubuntu SMP Wed Jul 24 17:31:05 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [fc6344743ae93a80aefd619de373b5a7acb8e6c20f8ed1bcd1644991f542fe7d] <==
E0816 17:48:17.657732 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
W0816 17:48:24.497279 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0816 17:48:24.497312 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0816 17:48:24.717891 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0816 17:48:24.717928 1 main.go:299] handling current node
I0816 17:48:34.717480 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0816 17:48:34.717521 1 main.go:299] handling current node
W0816 17:48:38.831039 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0816 17:48:38.831074 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0816 17:48:44.717757 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0816 17:48:44.717794 1 main.go:299] handling current node
W0816 17:48:48.076737 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0816 17:48:48.076776 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
I0816 17:48:54.718386 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0816 17:48:54.718420 1 main.go:299] handling current node
I0816 17:49:04.717472 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0816 17:49:04.717519 1 main.go:299] handling current node
W0816 17:49:04.730429 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0816 17:49:04.730464 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0816 17:49:14.718169 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0816 17:49:14.718202 1 main.go:299] handling current node
W0816 17:49:17.365107 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0816 17:49:17.365143 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0816 17:49:24.717885 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0816 17:49:24.717920 1 main.go:299] handling current node
==> kube-apiserver [4c5d7397adebafc5943b82239314e534e5389254d5c041acc068912ff61d2e2f] <==
W0816 17:44:41.667004 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.216.16:443: connect: connection refused
W0816 17:44:42.688047 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.216.16:443: connect: connection refused
W0816 17:44:43.721574 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.216.16:443: connect: connection refused
W0816 17:44:44.814038 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.216.16:443: connect: connection refused
W0816 17:44:45.818601 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.216.16:443: connect: connection refused
W0816 17:44:46.857608 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.216.16:443: connect: connection refused
W0816 17:44:47.286471 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.107.161.163:443: connect: connection refused
E0816 17:44:47.286512 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.107.161.163:443: connect: connection refused" logger="UnhandledError"
W0816 17:44:47.288468 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.106.216.16:443: connect: connection refused
W0816 17:44:47.373999 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.107.161.163:443: connect: connection refused
E0816 17:44:47.374196 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.107.161.163:443: connect: connection refused" logger="UnhandledError"
W0816 17:44:47.375868 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.106.216.16:443: connect: connection refused
W0816 17:44:47.898955 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.216.16:443: connect: connection refused
W0816 17:44:48.989424 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.216.16:443: connect: connection refused
W0816 17:44:50.016733 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.216.16:443: connect: connection refused
W0816 17:44:51.057826 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.216.16:443: connect: connection refused
W0816 17:44:52.079892 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.216.16:443: connect: connection refused
W0816 17:45:06.303298 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.107.161.163:443: connect: connection refused
E0816 17:45:06.303339 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.107.161.163:443: connect: connection refused" logger="UnhandledError"
W0816 17:45:47.298024 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.107.161.163:443: connect: connection refused
E0816 17:45:47.298070 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.107.161.163:443: connect: connection refused" logger="UnhandledError"
W0816 17:45:47.381476 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.107.161.163:443: connect: connection refused
E0816 17:45:47.381522 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.107.161.163:443: connect: connection refused" logger="UnhandledError"
I0816 17:46:30.354205 1 controller.go:615] quota admission added evaluator for: jobs.batch.volcano.sh
I0816 17:46:30.395247 1 controller.go:615] quota admission added evaluator for: podgroups.scheduling.volcano.sh
==> kube-controller-manager [682980ddf02eda5b2c16bc4efe71f227b15278ef437c9c68701b9a03619d2c83] <==
I0816 17:45:47.406780 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0816 17:45:47.418145 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0816 17:45:48.168424 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0816 17:45:48.190278 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0816 17:45:48.319751 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0816 17:45:49.187263 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0816 17:45:49.199013 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0816 17:45:49.327528 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0816 17:45:50.194790 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0816 17:45:50.313466 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0816 17:45:50.333449 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0816 17:45:50.335734 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0816 17:45:50.347719 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0816 17:45:50.353996 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0816 17:45:51.200900 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0816 17:45:51.210528 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0816 17:45:51.218147 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0816 17:46:13.290053 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="17.094281ms"
I0816 17:46:13.290353 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="55.745µs"
I0816 17:46:20.026957 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0816 17:46:20.064604 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0816 17:46:21.011219 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0816 17:46:21.040720 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0816 17:46:29.995487 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="volcano-system/volcano-admission-init" delay="0s"
I0816 17:46:30.130101 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-864899"
==> kube-proxy [f7a1610f3e767e4782fa7d7517f2d01e8327bf5e1c63e00d5acfc258192d2904] <==
I0816 17:43:32.392859 1 server_linux.go:66] "Using iptables proxy"
I0816 17:43:32.525841 1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
E0816 17:43:32.525904 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I0816 17:43:32.570322 1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I0816 17:43:32.575187 1 server_linux.go:169] "Using iptables Proxier"
I0816 17:43:32.581764 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I0816 17:43:32.582083 1 server.go:483] "Version info" version="v1.31.0"
I0816 17:43:32.582100 1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0816 17:43:32.592269 1 config.go:197] "Starting service config controller"
I0816 17:43:32.592306 1 shared_informer.go:313] Waiting for caches to sync for service config
I0816 17:43:32.592431 1 config.go:104] "Starting endpoint slice config controller"
I0816 17:43:32.592438 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0816 17:43:32.593180 1 config.go:326] "Starting node config controller"
I0816 17:43:32.593191 1 shared_informer.go:313] Waiting for caches to sync for node config
I0816 17:43:32.693362 1 shared_informer.go:320] Caches are synced for node config
I0816 17:43:32.693424 1 shared_informer.go:320] Caches are synced for service config
I0816 17:43:32.693509 1 shared_informer.go:320] Caches are synced for endpoint slice config
==> kube-scheduler [24f36c489fe0409df147281d7eb860eaeaf99c2bf8e26aeeaecee79d50753a0b] <==
E0816 17:43:24.107851 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0816 17:43:24.106343 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0816 17:43:24.108034 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0816 17:43:24.106395 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0816 17:43:24.108199 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0816 17:43:24.106445 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0816 17:43:24.108354 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0816 17:43:24.106491 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0816 17:43:24.108509 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0816 17:43:24.106530 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0816 17:43:24.108662 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0816 17:43:24.106565 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0816 17:43:24.108840 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0816 17:43:24.106612 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0816 17:43:24.109015 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0816 17:43:24.106654 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0816 17:43:24.109209 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0816 17:43:24.106714 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0816 17:43:24.109379 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0816 17:43:24.106757 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0816 17:43:24.109618 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError"
W0816 17:43:24.109959 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0816 17:43:24.110115 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
E0816 17:43:24.110240 1 reflector.go:158] "Unhandled Error" err="runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"
I0816 17:43:25.599145 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Aug 16 17:47:29 addons-864899 kubelet[1499]: E0816 17:47:29.384944 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-tcnmn_gadget(0cc0b8e3-9aeb-405d-9f9c-4a37b75275cf)\"" pod="gadget/gadget-tcnmn" podUID="0cc0b8e3-9aeb-405d-9f9c-4a37b75275cf"
Aug 16 17:47:36 addons-864899 kubelet[1499]: I0816 17:47:36.368672 1499 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-6fb4cdfc84-pvhcl" secret="" err="secret \"gcp-auth\" not found"
Aug 16 17:47:40 addons-864899 kubelet[1499]: I0816 17:47:40.368194 1499 scope.go:117] "RemoveContainer" containerID="0664fe9de8aae822ff0e67a02eb633ccfb6985e6f8f8209eb8ec1e91285f1c48"
Aug 16 17:47:40 addons-864899 kubelet[1499]: E0816 17:47:40.368821 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-tcnmn_gadget(0cc0b8e3-9aeb-405d-9f9c-4a37b75275cf)\"" pod="gadget/gadget-tcnmn" podUID="0cc0b8e3-9aeb-405d-9f9c-4a37b75275cf"
Aug 16 17:47:46 addons-864899 kubelet[1499]: I0816 17:47:46.368938 1499 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-hftrd" secret="" err="secret \"gcp-auth\" not found"
Aug 16 17:47:51 addons-864899 kubelet[1499]: I0816 17:47:51.368417 1499 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-k9vv2" secret="" err="secret \"gcp-auth\" not found"
Aug 16 17:47:54 addons-864899 kubelet[1499]: I0816 17:47:54.368713 1499 scope.go:117] "RemoveContainer" containerID="0664fe9de8aae822ff0e67a02eb633ccfb6985e6f8f8209eb8ec1e91285f1c48"
Aug 16 17:47:54 addons-864899 kubelet[1499]: E0816 17:47:54.369544 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-tcnmn_gadget(0cc0b8e3-9aeb-405d-9f9c-4a37b75275cf)\"" pod="gadget/gadget-tcnmn" podUID="0cc0b8e3-9aeb-405d-9f9c-4a37b75275cf"
Aug 16 17:48:09 addons-864899 kubelet[1499]: I0816 17:48:09.369337 1499 scope.go:117] "RemoveContainer" containerID="0664fe9de8aae822ff0e67a02eb633ccfb6985e6f8f8209eb8ec1e91285f1c48"
Aug 16 17:48:09 addons-864899 kubelet[1499]: E0816 17:48:09.369543 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-tcnmn_gadget(0cc0b8e3-9aeb-405d-9f9c-4a37b75275cf)\"" pod="gadget/gadget-tcnmn" podUID="0cc0b8e3-9aeb-405d-9f9c-4a37b75275cf"
Aug 16 17:48:23 addons-864899 kubelet[1499]: I0816 17:48:23.367879 1499 scope.go:117] "RemoveContainer" containerID="0664fe9de8aae822ff0e67a02eb633ccfb6985e6f8f8209eb8ec1e91285f1c48"
Aug 16 17:48:23 addons-864899 kubelet[1499]: E0816 17:48:23.368113 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-tcnmn_gadget(0cc0b8e3-9aeb-405d-9f9c-4a37b75275cf)\"" pod="gadget/gadget-tcnmn" podUID="0cc0b8e3-9aeb-405d-9f9c-4a37b75275cf"
Aug 16 17:48:38 addons-864899 kubelet[1499]: I0816 17:48:38.368940 1499 scope.go:117] "RemoveContainer" containerID="0664fe9de8aae822ff0e67a02eb633ccfb6985e6f8f8209eb8ec1e91285f1c48"
Aug 16 17:48:38 addons-864899 kubelet[1499]: E0816 17:48:38.369187 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-tcnmn_gadget(0cc0b8e3-9aeb-405d-9f9c-4a37b75275cf)\"" pod="gadget/gadget-tcnmn" podUID="0cc0b8e3-9aeb-405d-9f9c-4a37b75275cf"
Aug 16 17:48:51 addons-864899 kubelet[1499]: I0816 17:48:51.368778 1499 scope.go:117] "RemoveContainer" containerID="0664fe9de8aae822ff0e67a02eb633ccfb6985e6f8f8209eb8ec1e91285f1c48"
Aug 16 17:48:51 addons-864899 kubelet[1499]: E0816 17:48:51.369041 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-tcnmn_gadget(0cc0b8e3-9aeb-405d-9f9c-4a37b75275cf)\"" pod="gadget/gadget-tcnmn" podUID="0cc0b8e3-9aeb-405d-9f9c-4a37b75275cf"
Aug 16 17:49:02 addons-864899 kubelet[1499]: I0816 17:49:02.368067 1499 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-k9vv2" secret="" err="secret \"gcp-auth\" not found"
Aug 16 17:49:03 addons-864899 kubelet[1499]: I0816 17:49:03.367854 1499 scope.go:117] "RemoveContainer" containerID="0664fe9de8aae822ff0e67a02eb633ccfb6985e6f8f8209eb8ec1e91285f1c48"
Aug 16 17:49:03 addons-864899 kubelet[1499]: E0816 17:49:03.368053 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-tcnmn_gadget(0cc0b8e3-9aeb-405d-9f9c-4a37b75275cf)\"" pod="gadget/gadget-tcnmn" podUID="0cc0b8e3-9aeb-405d-9f9c-4a37b75275cf"
Aug 16 17:49:06 addons-864899 kubelet[1499]: I0816 17:49:06.369910 1499 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-6fb4cdfc84-pvhcl" secret="" err="secret \"gcp-auth\" not found"
Aug 16 17:49:10 addons-864899 kubelet[1499]: I0816 17:49:10.368114 1499 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-hftrd" secret="" err="secret \"gcp-auth\" not found"
Aug 16 17:49:17 addons-864899 kubelet[1499]: I0816 17:49:17.368598 1499 scope.go:117] "RemoveContainer" containerID="0664fe9de8aae822ff0e67a02eb633ccfb6985e6f8f8209eb8ec1e91285f1c48"
Aug 16 17:49:17 addons-864899 kubelet[1499]: E0816 17:49:17.368813 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-tcnmn_gadget(0cc0b8e3-9aeb-405d-9f9c-4a37b75275cf)\"" pod="gadget/gadget-tcnmn" podUID="0cc0b8e3-9aeb-405d-9f9c-4a37b75275cf"
Aug 16 17:49:30 addons-864899 kubelet[1499]: I0816 17:49:30.368370 1499 scope.go:117] "RemoveContainer" containerID="0664fe9de8aae822ff0e67a02eb633ccfb6985e6f8f8209eb8ec1e91285f1c48"
Aug 16 17:49:30 addons-864899 kubelet[1499]: E0816 17:49:30.369068 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-tcnmn_gadget(0cc0b8e3-9aeb-405d-9f9c-4a37b75275cf)\"" pod="gadget/gadget-tcnmn" podUID="0cc0b8e3-9aeb-405d-9f9c-4a37b75275cf"
==> storage-provisioner [6aea42a6df509f2ebd7dfe76b3c1efade576609e1c47f60a59f73285c8a2e657] <==
I0816 17:43:37.592779 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0816 17:43:37.636311 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0816 17:43:37.636375 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0816 17:43:37.668240 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0816 17:43:37.668302 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"1c38b8ed-74e7-44d2-b8d3-ae26d5a66688", APIVersion:"v1", ResourceVersion:"570", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-864899_4d1bf025-ed0a-4c95-9177-27773af28af6 became leader
I0816 17:43:37.668814 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-864899_4d1bf025-ed0a-4c95-9177-27773af28af6!
I0816 17:43:37.769445 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-864899_4d1bf025-ed0a-4c95-9177-27773af28af6!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-864899 -n addons-864899
helpers_test.go:261: (dbg) Run: kubectl --context addons-864899 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: ingress-nginx-admission-create-zpv9t ingress-nginx-admission-patch-vd7pb test-job-nginx-0
helpers_test.go:274: ======> post-mortem[TestAddons/serial/Volcano]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-864899 describe pod ingress-nginx-admission-create-zpv9t ingress-nginx-admission-patch-vd7pb test-job-nginx-0
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-864899 describe pod ingress-nginx-admission-create-zpv9t ingress-nginx-admission-patch-vd7pb test-job-nginx-0: exit status 1 (86.414361ms)
** stderr **
Error from server (NotFound): pods "ingress-nginx-admission-create-zpv9t" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-vd7pb" not found
Error from server (NotFound): pods "test-job-nginx-0" not found
** /stderr **
helpers_test.go:279: kubectl --context addons-864899 describe pod ingress-nginx-admission-create-zpv9t ingress-nginx-admission-patch-vd7pb test-job-nginx-0: exit status 1
--- FAIL: TestAddons/serial/Volcano (199.84s)