=== RUN TestAddons/serial/Volcano
addons_test.go:897: volcano-scheduler stabilized in 41.719015ms
addons_test.go:913: volcano-controller stabilized in 41.883945ms
addons_test.go:905: volcano-admission stabilized in 41.930993ms
addons_test.go:919: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-scheduler-576bc46687-bbv4d" [43d20fb9-da3a-483b-bd83-f8b4f5170274] Running
addons_test.go:919: (dbg) TestAddons/serial/Volcano: app=volcano-scheduler healthy within 6.00452752s
addons_test.go:923: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-admission-77d7d48b68-kmj97" [7cf0731e-8d33-4380-9425-2f51db81929e] Running
addons_test.go:923: (dbg) TestAddons/serial/Volcano: app=volcano-admission healthy within 5.006052743s
addons_test.go:927: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-controllers-56675bb4d5-2pcjc" [e36a1ac7-31fd-49d5-a5ff-9f534a265247] Running
addons_test.go:927: (dbg) TestAddons/serial/Volcano: app=volcano-controller healthy within 5.004071564s
addons_test.go:932: (dbg) Run: kubectl --context addons-764717 delete -n volcano-system job volcano-admission-init
addons_test.go:938: (dbg) Run: kubectl --context addons-764717 create -f testdata/vcjob.yaml
addons_test.go:946: (dbg) Run: kubectl --context addons-764717 get vcjob -n my-volcano
addons_test.go:964: (dbg) TestAddons/serial/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...
helpers_test.go:344: "test-job-nginx-0" [5787faf1-7ab9-4f1f-8cb7-b22508fb8326] Pending
helpers_test.go:344: "test-job-nginx-0" [5787faf1-7ab9-4f1f-8cb7-b22508fb8326] Pending: PodScheduled:Unschedulable (0/1 nodes are unavailable: 1 Insufficient cpu.)
helpers_test.go:329: TestAddons/serial/Volcano: WARNING: pod list for "my-volcano" "volcano.sh/job-name=test-job" returned: client rate limiter Wait returned an error: context deadline exceeded
addons_test.go:964: ***** TestAddons/serial/Volcano: pod "volcano.sh/job-name=test-job" failed to start within 3m0s: context deadline exceeded ****
addons_test.go:964: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-764717 -n addons-764717
addons_test.go:964: TestAddons/serial/Volcano: showing logs for failed pods as of 2024-08-19 19:17:55.109317426 +0000 UTC m=+363.618326834
addons_test.go:964: (dbg) Run: kubectl --context addons-764717 describe po test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-764717 describe po test-job-nginx-0 -n my-volcano:
Name: test-job-nginx-0
Namespace: my-volcano
Priority: 0
Service Account: default
Node: <none>
Labels: volcano.sh/job-name=test-job
volcano.sh/job-namespace=my-volcano
volcano.sh/queue-name=test
volcano.sh/task-index=0
volcano.sh/task-spec=nginx
Annotations: scheduling.k8s.io/group-name: test-job-8c573cbf-3068-497d-aeb1-c6fa5c219843
volcano.sh/job-name: test-job
volcano.sh/job-version: 0
volcano.sh/queue-name: test
volcano.sh/task-index: 0
volcano.sh/task-spec: nginx
volcano.sh/template-uid: test-job-nginx
Status: Pending
IP:
IPs: <none>
Controlled By: Job/test-job
Containers:
nginx:
Image: nginx:latest
Port: <none>
Host Port: <none>
Command:
sleep
10m
Limits:
cpu: 1
Requests:
cpu: 1
Environment:
GOOGLE_APPLICATION_CREDENTIALS: /google-app-creds.json
PROJECT_ID: this_is_fake
GCP_PROJECT: this_is_fake
GCLOUD_PROJECT: this_is_fake
GOOGLE_CLOUD_PROJECT: this_is_fake
CLOUDSDK_CORE_PROJECT: this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-76wch (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
kube-api-access-76wch:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
gcp-creds:
Type: HostPath (bare host directory volume)
Path: /var/lib/minikube/google_application_credentials.json
HostPathType: File
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling 2m59s volcano 0/1 nodes are unavailable: 1 Insufficient cpu.
addons_test.go:964: (dbg) Run: kubectl --context addons-764717 logs test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-764717 logs test-job-nginx-0 -n my-volcano:
addons_test.go:965: failed waiting for test-local-path pod: volcano.sh/job-name=test-job within 3m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestAddons/serial/Volcano]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect addons-764717
helpers_test.go:235: (dbg) docker inspect addons-764717:
-- stdout --
[
{
"Id": "b9ad179f7ea78298879dc4d04a84f7a8d9ebb7b71ae69e5bfcb060df1a7f3da7",
"Created": "2024-08-19T19:12:31.711178327Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 720319,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-08-19T19:12:31.854850207Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:decdd59746a9dba10062a73f6cd4b910c7b4e60613660b1022f8357747681c4d",
"ResolvConfPath": "/var/lib/docker/containers/b9ad179f7ea78298879dc4d04a84f7a8d9ebb7b71ae69e5bfcb060df1a7f3da7/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/b9ad179f7ea78298879dc4d04a84f7a8d9ebb7b71ae69e5bfcb060df1a7f3da7/hostname",
"HostsPath": "/var/lib/docker/containers/b9ad179f7ea78298879dc4d04a84f7a8d9ebb7b71ae69e5bfcb060df1a7f3da7/hosts",
"LogPath": "/var/lib/docker/containers/b9ad179f7ea78298879dc4d04a84f7a8d9ebb7b71ae69e5bfcb060df1a7f3da7/b9ad179f7ea78298879dc4d04a84f7a8d9ebb7b71ae69e5bfcb060df1a7f3da7-json.log",
"Name": "/addons-764717",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"addons-764717:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "addons-764717",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4194304000,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8388608000,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/0a38acd88d185330ad804e1c1f92811e28e504e9da12edcc93d2a817048e7d01-init/diff:/var/lib/docker/overlay2/de9f36de956227ec2a8fa0009f2a1a4a1b7ddd9f6c0c9cd88d55102cc724f5b5/diff",
"MergedDir": "/var/lib/docker/overlay2/0a38acd88d185330ad804e1c1f92811e28e504e9da12edcc93d2a817048e7d01/merged",
"UpperDir": "/var/lib/docker/overlay2/0a38acd88d185330ad804e1c1f92811e28e504e9da12edcc93d2a817048e7d01/diff",
"WorkDir": "/var/lib/docker/overlay2/0a38acd88d185330ad804e1c1f92811e28e504e9da12edcc93d2a817048e7d01/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "volume",
"Name": "addons-764717",
"Source": "/var/lib/docker/volumes/addons-764717/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
},
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
}
],
"Config": {
"Hostname": "addons-764717",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-764717",
"name.minikube.sigs.k8s.io": "addons-764717",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "7f874f026b1c851e3226420df293e515838870bb66e4b73032808ad632e9c655",
"SandboxKey": "/var/run/docker/netns/7f874f026b1c",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33528"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33529"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33532"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33530"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33531"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"addons-764717": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:31:02",
"DriverOpts": null,
"NetworkID": "560fe9c2d8b19272f4983c4274569c39b90c027386d8546f432a4f79cc3c1e3b",
"EndpointID": "d58cd8a0e5189fa88a708ab82fba2dc44f86c56f75316942271bdbf4de643b3f",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-764717",
"b9ad179f7ea7"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p addons-764717 -n addons-764717
helpers_test.go:244: <<< TestAddons/serial/Volcano FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/serial/Volcano]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p addons-764717 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-764717 logs -n 25: (1.787191677s)
helpers_test.go:252: TestAddons/serial/Volcano logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| start | -o=json --download-only | download-only-477663 | jenkins | v1.33.1 | 19 Aug 24 19:11 UTC | |
| | -p download-only-477663 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.33.1 | 19 Aug 24 19:11 UTC | 19 Aug 24 19:11 UTC |
| delete | -p download-only-477663 | download-only-477663 | jenkins | v1.33.1 | 19 Aug 24 19:11 UTC | 19 Aug 24 19:11 UTC |
| start | -o=json --download-only | download-only-172961 | jenkins | v1.33.1 | 19 Aug 24 19:11 UTC | |
| | -p download-only-172961 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.31.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.33.1 | 19 Aug 24 19:12 UTC | 19 Aug 24 19:12 UTC |
| delete | -p download-only-172961 | download-only-172961 | jenkins | v1.33.1 | 19 Aug 24 19:12 UTC | 19 Aug 24 19:12 UTC |
| delete | -p download-only-477663 | download-only-477663 | jenkins | v1.33.1 | 19 Aug 24 19:12 UTC | 19 Aug 24 19:12 UTC |
| delete | -p download-only-172961 | download-only-172961 | jenkins | v1.33.1 | 19 Aug 24 19:12 UTC | 19 Aug 24 19:12 UTC |
| start | --download-only -p | download-docker-715450 | jenkins | v1.33.1 | 19 Aug 24 19:12 UTC | |
| | download-docker-715450 | | | | | |
| | --alsologtostderr | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p download-docker-715450 | download-docker-715450 | jenkins | v1.33.1 | 19 Aug 24 19:12 UTC | 19 Aug 24 19:12 UTC |
| start | --download-only -p | binary-mirror-918461 | jenkins | v1.33.1 | 19 Aug 24 19:12 UTC | |
| | binary-mirror-918461 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:33127 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p binary-mirror-918461 | binary-mirror-918461 | jenkins | v1.33.1 | 19 Aug 24 19:12 UTC | 19 Aug 24 19:12 UTC |
| addons | enable dashboard -p | addons-764717 | jenkins | v1.33.1 | 19 Aug 24 19:12 UTC | |
| | addons-764717 | | | | | |
| addons | disable dashboard -p | addons-764717 | jenkins | v1.33.1 | 19 Aug 24 19:12 UTC | |
| | addons-764717 | | | | | |
| start | -p addons-764717 --wait=true | addons-764717 | jenkins | v1.33.1 | 19 Aug 24 19:12 UTC | 19 Aug 24 19:14 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/08/19 19:12:07
Running on machine: ip-172-31-21-244
Binary: Built with gc go1.22.5 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0819 19:12:07.160758 719822 out.go:345] Setting OutFile to fd 1 ...
I0819 19:12:07.160951 719822 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0819 19:12:07.160963 719822 out.go:358] Setting ErrFile to fd 2...
I0819 19:12:07.160970 719822 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0819 19:12:07.161250 719822 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19468-713648/.minikube/bin
I0819 19:12:07.161768 719822 out.go:352] Setting JSON to false
I0819 19:12:07.162670 719822 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":10469,"bootTime":1724084259,"procs":175,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1067-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
I0819 19:12:07.162746 719822 start.go:139] virtualization:
I0819 19:12:07.164784 719822 out.go:177] * [addons-764717] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0819 19:12:07.166222 719822 out.go:177] - MINIKUBE_LOCATION=19468
I0819 19:12:07.166360 719822 notify.go:220] Checking for updates...
I0819 19:12:07.170240 719822 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0819 19:12:07.171941 719822 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19468-713648/kubeconfig
I0819 19:12:07.173487 719822 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19468-713648/.minikube
I0819 19:12:07.176274 719822 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0819 19:12:07.178755 719822 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0819 19:12:07.181111 719822 driver.go:392] Setting default libvirt URI to qemu:///system
I0819 19:12:07.203446 719822 docker.go:123] docker version: linux-27.1.2:Docker Engine - Community
I0819 19:12:07.203586 719822 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0819 19:12:07.270178 719822 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-08-19 19:12:07.260207398 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1067-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.1.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8fc6bcff51318944179630522a095cc9dbf9f353 Expected:8fc6bcff51318944179630522a095cc9dbf9f353} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0819 19:12:07.270295 719822 docker.go:307] overlay module found
I0819 19:12:07.273154 719822 out.go:177] * Using the docker driver based on user configuration
I0819 19:12:07.276717 719822 start.go:297] selected driver: docker
I0819 19:12:07.276741 719822 start.go:901] validating driver "docker" against <nil>
I0819 19:12:07.276756 719822 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0819 19:12:07.277399 719822 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0819 19:12:07.332193 719822 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-08-19 19:12:07.321245657 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1067-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.1.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8fc6bcff51318944179630522a095cc9dbf9f353 Expected:8fc6bcff51318944179630522a095cc9dbf9f353} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0819 19:12:07.332367 719822 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0819 19:12:07.332615 719822 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0819 19:12:07.334282 719822 out.go:177] * Using Docker driver with root privileges
I0819 19:12:07.335550 719822 cni.go:84] Creating CNI manager for ""
I0819 19:12:07.335586 719822 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0819 19:12:07.335599 719822 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0819 19:12:07.335691 719822 start.go:340] cluster config:
{Name:addons-764717 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-764717 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHA
uthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0819 19:12:07.337241 719822 out.go:177] * Starting "addons-764717" primary control-plane node in "addons-764717" cluster
I0819 19:12:07.338996 719822 cache.go:121] Beginning downloading kic base image for docker with containerd
I0819 19:12:07.340404 719822 out.go:177] * Pulling base image v0.0.44-1723740748-19452 ...
I0819 19:12:07.341814 719822 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0819 19:12:07.341895 719822 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19468-713648/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4
I0819 19:12:07.341915 719822 cache.go:56] Caching tarball of preloaded images
I0819 19:12:07.341921 719822 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d in local docker daemon
I0819 19:12:07.341995 719822 preload.go:172] Found /home/jenkins/minikube-integration/19468-713648/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0819 19:12:07.342006 719822 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on containerd
I0819 19:12:07.342332 719822 profile.go:143] Saving config to /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/config.json ...
I0819 19:12:07.342355 719822 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/config.json: {Name:mk1c5f88d5cf803a36077b84c7c4e4bea4298b7f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 19:12:07.357845 719822 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d to local cache
I0819 19:12:07.357981 719822 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d in local cache directory
I0819 19:12:07.358000 719822 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d in local cache directory, skipping pull
I0819 19:12:07.358005 719822 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d exists in cache, skipping pull
I0819 19:12:07.358014 719822 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d as a tarball
I0819 19:12:07.358019 719822 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d from local cache
I0819 19:12:24.445880 719822 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d from cached tarball
I0819 19:12:24.445922 719822 cache.go:194] Successfully downloaded all kic artifacts
I0819 19:12:24.445969 719822 start.go:360] acquireMachinesLock for addons-764717: {Name:mkfd7403f53eb1c04aef8faba3ec9c2f14f2196a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0819 19:12:24.446440 719822 start.go:364] duration metric: took 442.269µs to acquireMachinesLock for "addons-764717"
I0819 19:12:24.446480 719822 start.go:93] Provisioning new machine with config: &{Name:addons-764717 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-764717 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fa
lse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0819 19:12:24.446576 719822 start.go:125] createHost starting for "" (driver="docker")
I0819 19:12:24.448285 719822 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
I0819 19:12:24.448546 719822 start.go:159] libmachine.API.Create for "addons-764717" (driver="docker")
I0819 19:12:24.448580 719822 client.go:168] LocalClient.Create starting
I0819 19:12:24.448684 719822 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19468-713648/.minikube/certs/ca.pem
I0819 19:12:24.963594 719822 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19468-713648/.minikube/certs/cert.pem
I0819 19:12:25.342655 719822 cli_runner.go:164] Run: docker network inspect addons-764717 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0819 19:12:25.358483 719822 cli_runner.go:211] docker network inspect addons-764717 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0819 19:12:25.358595 719822 network_create.go:284] running [docker network inspect addons-764717] to gather additional debugging logs...
I0819 19:12:25.358618 719822 cli_runner.go:164] Run: docker network inspect addons-764717
W0819 19:12:25.375708 719822 cli_runner.go:211] docker network inspect addons-764717 returned with exit code 1
I0819 19:12:25.375742 719822 network_create.go:287] error running [docker network inspect addons-764717]: docker network inspect addons-764717: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-764717 not found
I0819 19:12:25.375756 719822 network_create.go:289] output of [docker network inspect addons-764717]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-764717 not found
** /stderr **
I0819 19:12:25.375857 719822 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0819 19:12:25.392405 719822 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40017b2ba0}
I0819 19:12:25.392452 719822 network_create.go:124] attempt to create docker network addons-764717 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0819 19:12:25.392512 719822 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-764717 addons-764717
I0819 19:12:25.464692 719822 network_create.go:108] docker network addons-764717 192.168.49.0/24 created
I0819 19:12:25.464721 719822 kic.go:121] calculated static IP "192.168.49.2" for the "addons-764717" container
I0819 19:12:25.464811 719822 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0819 19:12:25.481875 719822 cli_runner.go:164] Run: docker volume create addons-764717 --label name.minikube.sigs.k8s.io=addons-764717 --label created_by.minikube.sigs.k8s.io=true
I0819 19:12:25.497923 719822 oci.go:103] Successfully created a docker volume addons-764717
I0819 19:12:25.498032 719822 cli_runner.go:164] Run: docker run --rm --name addons-764717-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-764717 --entrypoint /usr/bin/test -v addons-764717:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d -d /var/lib
I0819 19:12:27.569307 719822 cli_runner.go:217] Completed: docker run --rm --name addons-764717-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-764717 --entrypoint /usr/bin/test -v addons-764717:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d -d /var/lib: (2.07122698s)
I0819 19:12:27.569340 719822 oci.go:107] Successfully prepared a docker volume addons-764717
I0819 19:12:27.569363 719822 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0819 19:12:27.569384 719822 kic.go:194] Starting extracting preloaded images to volume ...
I0819 19:12:27.569469 719822 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19468-713648/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-764717:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d -I lz4 -xf /preloaded.tar -C /extractDir
I0819 19:12:31.635370 719822 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19468-713648/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-764717:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d -I lz4 -xf /preloaded.tar -C /extractDir: (4.065860347s)
I0819 19:12:31.635405 719822 kic.go:203] duration metric: took 4.066018499s to extract preloaded images to volume ...
W0819 19:12:31.635557 719822 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0819 19:12:31.635670 719822 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0819 19:12:31.696198 719822 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-764717 --name addons-764717 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-764717 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-764717 --network addons-764717 --ip 192.168.49.2 --volume addons-764717:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d
I0819 19:12:32.024090 719822 cli_runner.go:164] Run: docker container inspect addons-764717 --format={{.State.Running}}
I0819 19:12:32.045894 719822 cli_runner.go:164] Run: docker container inspect addons-764717 --format={{.State.Status}}
I0819 19:12:32.081280 719822 cli_runner.go:164] Run: docker exec addons-764717 stat /var/lib/dpkg/alternatives/iptables
I0819 19:12:32.149792 719822 oci.go:144] the created container "addons-764717" has a running status.
I0819 19:12:32.149821 719822 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19468-713648/.minikube/machines/addons-764717/id_rsa...
I0819 19:12:32.498663 719822 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19468-713648/.minikube/machines/addons-764717/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0819 19:12:32.521179 719822 cli_runner.go:164] Run: docker container inspect addons-764717 --format={{.State.Status}}
I0819 19:12:32.547187 719822 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0819 19:12:32.547207 719822 kic_runner.go:114] Args: [docker exec --privileged addons-764717 chown docker:docker /home/docker/.ssh/authorized_keys]
I0819 19:12:32.631275 719822 cli_runner.go:164] Run: docker container inspect addons-764717 --format={{.State.Status}}
I0819 19:12:32.651969 719822 machine.go:93] provisionDockerMachine start ...
I0819 19:12:32.652063 719822 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-764717
I0819 19:12:32.678291 719822 main.go:141] libmachine: Using SSH client type: native
I0819 19:12:32.678557 719822 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 33528 <nil> <nil>}
I0819 19:12:32.678566 719822 main.go:141] libmachine: About to run SSH command:
hostname
I0819 19:12:32.839661 719822 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-764717
I0819 19:12:32.839735 719822 ubuntu.go:169] provisioning hostname "addons-764717"
I0819 19:12:32.839838 719822 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-764717
I0819 19:12:32.877848 719822 main.go:141] libmachine: Using SSH client type: native
I0819 19:12:32.878083 719822 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 33528 <nil> <nil>}
I0819 19:12:32.878096 719822 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-764717 && echo "addons-764717" | sudo tee /etc/hostname
I0819 19:12:33.029316 719822 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-764717
I0819 19:12:33.029423 719822 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-764717
I0819 19:12:33.052662 719822 main.go:141] libmachine: Using SSH client type: native
I0819 19:12:33.052921 719822 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 33528 <nil> <nil>}
I0819 19:12:33.052938 719822 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-764717' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-764717/g' /etc/hosts;
else
echo '127.0.1.1 addons-764717' | sudo tee -a /etc/hosts;
fi
fi
I0819 19:12:33.189961 719822 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0819 19:12:33.189991 719822 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19468-713648/.minikube CaCertPath:/home/jenkins/minikube-integration/19468-713648/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19468-713648/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19468-713648/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19468-713648/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19468-713648/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19468-713648/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19468-713648/.minikube}
I0819 19:12:33.190025 719822 ubuntu.go:177] setting up certificates
I0819 19:12:33.190040 719822 provision.go:84] configureAuth start
I0819 19:12:33.190136 719822 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-764717
I0819 19:12:33.209914 719822 provision.go:143] copyHostCerts
I0819 19:12:33.210006 719822 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19468-713648/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19468-713648/.minikube/ca.pem (1082 bytes)
I0819 19:12:33.210136 719822 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19468-713648/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19468-713648/.minikube/cert.pem (1123 bytes)
I0819 19:12:33.210206 719822 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19468-713648/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19468-713648/.minikube/key.pem (1679 bytes)
I0819 19:12:33.210295 719822 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19468-713648/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19468-713648/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19468-713648/.minikube/certs/ca-key.pem org=jenkins.addons-764717 san=[127.0.0.1 192.168.49.2 addons-764717 localhost minikube]
I0819 19:12:34.047265 719822 provision.go:177] copyRemoteCerts
I0819 19:12:34.047345 719822 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0819 19:12:34.047394 719822 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-764717
I0819 19:12:34.064703 719822 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33528 SSHKeyPath:/home/jenkins/minikube-integration/19468-713648/.minikube/machines/addons-764717/id_rsa Username:docker}
I0819 19:12:34.158733 719822 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-713648/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0819 19:12:34.184013 719822 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-713648/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0819 19:12:34.209795 719822 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-713648/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0819 19:12:34.234929 719822 provision.go:87] duration metric: took 1.044869285s to configureAuth
I0819 19:12:34.234955 719822 ubuntu.go:193] setting minikube options for container-runtime
I0819 19:12:34.235160 719822 config.go:182] Loaded profile config "addons-764717": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0819 19:12:34.235167 719822 machine.go:96] duration metric: took 1.583180671s to provisionDockerMachine
I0819 19:12:34.235174 719822 client.go:171] duration metric: took 9.786584851s to LocalClient.Create
I0819 19:12:34.235196 719822 start.go:167] duration metric: took 9.78665146s to libmachine.API.Create "addons-764717"
I0819 19:12:34.235206 719822 start.go:293] postStartSetup for "addons-764717" (driver="docker")
I0819 19:12:34.235216 719822 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0819 19:12:34.235268 719822 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0819 19:12:34.235308 719822 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-764717
I0819 19:12:34.251903 719822 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33528 SSHKeyPath:/home/jenkins/minikube-integration/19468-713648/.minikube/machines/addons-764717/id_rsa Username:docker}
I0819 19:12:34.351162 719822 ssh_runner.go:195] Run: cat /etc/os-release
I0819 19:12:34.354447 719822 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0819 19:12:34.354491 719822 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0819 19:12:34.354517 719822 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0819 19:12:34.354525 719822 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0819 19:12:34.354535 719822 filesync.go:126] Scanning /home/jenkins/minikube-integration/19468-713648/.minikube/addons for local assets ...
I0819 19:12:34.354606 719822 filesync.go:126] Scanning /home/jenkins/minikube-integration/19468-713648/.minikube/files for local assets ...
I0819 19:12:34.354634 719822 start.go:296] duration metric: took 119.422375ms for postStartSetup
I0819 19:12:34.354956 719822 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-764717
I0819 19:12:34.372427 719822 profile.go:143] Saving config to /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/config.json ...
I0819 19:12:34.372791 719822 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0819 19:12:34.372854 719822 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-764717
I0819 19:12:34.390486 719822 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33528 SSHKeyPath:/home/jenkins/minikube-integration/19468-713648/.minikube/machines/addons-764717/id_rsa Username:docker}
I0819 19:12:34.482578 719822 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0819 19:12:34.487233 719822 start.go:128] duration metric: took 10.040638855s to createHost
I0819 19:12:34.487261 719822 start.go:83] releasing machines lock for "addons-764717", held for 10.04080225s
I0819 19:12:34.487333 719822 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-764717
I0819 19:12:34.505463 719822 ssh_runner.go:195] Run: cat /version.json
I0819 19:12:34.505525 719822 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-764717
I0819 19:12:34.505805 719822 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0819 19:12:34.505875 719822 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-764717
I0819 19:12:34.529417 719822 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33528 SSHKeyPath:/home/jenkins/minikube-integration/19468-713648/.minikube/machines/addons-764717/id_rsa Username:docker}
I0819 19:12:34.530192 719822 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33528 SSHKeyPath:/home/jenkins/minikube-integration/19468-713648/.minikube/machines/addons-764717/id_rsa Username:docker}
I0819 19:12:34.768124 719822 ssh_runner.go:195] Run: systemctl --version
I0819 19:12:34.772645 719822 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0819 19:12:34.776854 719822 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0819 19:12:34.802962 719822 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0819 19:12:34.803089 719822 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0819 19:12:34.833185 719822 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0819 19:12:34.833221 719822 start.go:495] detecting cgroup driver to use...
I0819 19:12:34.833255 719822 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0819 19:12:34.833318 719822 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0819 19:12:34.846125 719822 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0819 19:12:34.858401 719822 docker.go:217] disabling cri-docker service (if available) ...
I0819 19:12:34.858496 719822 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0819 19:12:34.872594 719822 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0819 19:12:34.887527 719822 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0819 19:12:34.967724 719822 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0819 19:12:35.075534 719822 docker.go:233] disabling docker service ...
I0819 19:12:35.075614 719822 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0819 19:12:35.097120 719822 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0819 19:12:35.110156 719822 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0819 19:12:35.206789 719822 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0819 19:12:35.298966 719822 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0819 19:12:35.311059 719822 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0819 19:12:35.328452 719822 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0819 19:12:35.338490 719822 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0819 19:12:35.348348 719822 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0819 19:12:35.348438 719822 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0819 19:12:35.358911 719822 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0819 19:12:35.369659 719822 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0819 19:12:35.380029 719822 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0819 19:12:35.390151 719822 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0819 19:12:35.399414 719822 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0819 19:12:35.409420 719822 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0819 19:12:35.419446 719822 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0819 19:12:35.429337 719822 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0819 19:12:35.438400 719822 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0819 19:12:35.447043 719822 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0819 19:12:35.538411 719822 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0819 19:12:35.659000 719822 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0819 19:12:35.659088 719822 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0819 19:12:35.662730 719822 start.go:563] Will wait 60s for crictl version
I0819 19:12:35.662794 719822 ssh_runner.go:195] Run: which crictl
I0819 19:12:35.666080 719822 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0819 19:12:35.705242 719822 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.20
RuntimeApiVersion: v1
I0819 19:12:35.705323 719822 ssh_runner.go:195] Run: containerd --version
I0819 19:12:35.729073 719822 ssh_runner.go:195] Run: containerd --version
I0819 19:12:35.756032 719822 out.go:177] * Preparing Kubernetes v1.31.0 on containerd 1.7.20 ...
I0819 19:12:35.758656 719822 cli_runner.go:164] Run: docker network inspect addons-764717 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0819 19:12:35.774069 719822 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I0819 19:12:35.777779 719822 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0819 19:12:35.788607 719822 kubeadm.go:883] updating cluster {Name:addons-764717 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-764717 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cus
tomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0819 19:12:35.788735 719822 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0819 19:12:35.788802 719822 ssh_runner.go:195] Run: sudo crictl images --output json
I0819 19:12:35.825645 719822 containerd.go:627] all images are preloaded for containerd runtime.
I0819 19:12:35.825671 719822 containerd.go:534] Images already preloaded, skipping extraction
I0819 19:12:35.825733 719822 ssh_runner.go:195] Run: sudo crictl images --output json
I0819 19:12:35.861311 719822 containerd.go:627] all images are preloaded for containerd runtime.
I0819 19:12:35.861333 719822 cache_images.go:84] Images are preloaded, skipping loading
I0819 19:12:35.861343 719822 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.0 containerd true true} ...
I0819 19:12:35.861476 719822 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-764717 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.31.0 ClusterName:addons-764717 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0819 19:12:35.861566 719822 ssh_runner.go:195] Run: sudo crictl info
I0819 19:12:35.899897 719822 cni.go:84] Creating CNI manager for ""
I0819 19:12:35.899920 719822 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0819 19:12:35.899930 719822 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0819 19:12:35.899951 719822 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-764717 NodeName:addons-764717 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc
/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0819 19:12:35.900082 719822 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "addons-764717"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0819 19:12:35.900150 719822 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.0
I0819 19:12:35.908624 719822 binaries.go:44] Found k8s binaries, skipping transfer
I0819 19:12:35.908694 719822 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0819 19:12:35.917098 719822 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (317 bytes)
I0819 19:12:35.934931 719822 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0819 19:12:35.953299 719822 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2167 bytes)
I0819 19:12:35.971657 719822 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0819 19:12:35.975292 719822 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0819 19:12:35.987049 719822 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0819 19:12:36.084639 719822 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0819 19:12:36.099876 719822 certs.go:68] Setting up /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717 for IP: 192.168.49.2
I0819 19:12:36.099902 719822 certs.go:194] generating shared ca certs ...
I0819 19:12:36.099920 719822 certs.go:226] acquiring lock for ca certs: {Name:mkead9a504602001be031927c9caa2cd7d2088f6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 19:12:36.100534 719822 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19468-713648/.minikube/ca.key
I0819 19:12:36.348291 719822 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19468-713648/.minikube/ca.crt ...
I0819 19:12:36.348325 719822 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19468-713648/.minikube/ca.crt: {Name:mkcdd0c8bbe8a1341cfa935e788f1800c83f0433 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 19:12:36.348521 719822 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19468-713648/.minikube/ca.key ...
I0819 19:12:36.348534 719822 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19468-713648/.minikube/ca.key: {Name:mkce4ae3f85f5fdad67ee48033e30f491158adee Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 19:12:36.348627 719822 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19468-713648/.minikube/proxy-client-ca.key
I0819 19:12:37.231563 719822 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19468-713648/.minikube/proxy-client-ca.crt ...
I0819 19:12:37.231604 719822 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19468-713648/.minikube/proxy-client-ca.crt: {Name:mk184ac9cfee04fe72202c3fea73cf8bc9a033c4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 19:12:37.231819 719822 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19468-713648/.minikube/proxy-client-ca.key ...
I0819 19:12:37.231833 719822 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19468-713648/.minikube/proxy-client-ca.key: {Name:mk13aeff98c5a17a2a4f19b316633a280a9f9682 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 19:12:37.231924 719822 certs.go:256] generating profile certs ...
I0819 19:12:37.231988 719822 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/client.key
I0819 19:12:37.232004 719822 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/client.crt with IP's: []
I0819 19:12:37.505565 719822 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/client.crt ...
I0819 19:12:37.505611 719822 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/client.crt: {Name:mk338377b008c0bdf4231d1a7495a24a09b40b01 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 19:12:37.506217 719822 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/client.key ...
I0819 19:12:37.506235 719822 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/client.key: {Name:mk7b422647efac56ad612fb7a9822282c4b185a0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 19:12:37.506324 719822 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/apiserver.key.38a1012e
I0819 19:12:37.506350 719822 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/apiserver.crt.38a1012e with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I0819 19:12:37.774013 719822 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/apiserver.crt.38a1012e ...
I0819 19:12:37.774047 719822 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/apiserver.crt.38a1012e: {Name:mk43b7c09504c8d8b091319891cb06697582c0c3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 19:12:37.774242 719822 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/apiserver.key.38a1012e ...
I0819 19:12:37.774258 719822 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/apiserver.key.38a1012e: {Name:mk8d918e24b4e08e958585476add37c4779544cb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 19:12:37.774347 719822 certs.go:381] copying /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/apiserver.crt.38a1012e -> /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/apiserver.crt
I0819 19:12:37.774426 719822 certs.go:385] copying /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/apiserver.key.38a1012e -> /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/apiserver.key
I0819 19:12:37.774483 719822 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/proxy-client.key
I0819 19:12:37.774503 719822 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/proxy-client.crt with IP's: []
I0819 19:12:37.925140 719822 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/proxy-client.crt ...
I0819 19:12:37.925172 719822 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/proxy-client.crt: {Name:mk3026dc8259392755659a873039e5812d1aca0a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 19:12:37.925936 719822 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/proxy-client.key ...
I0819 19:12:37.925955 719822 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/proxy-client.key: {Name:mk9bdcd7af4a25856bf39f30e769b1dde9b61be6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 19:12:37.926150 719822 certs.go:484] found cert: /home/jenkins/minikube-integration/19468-713648/.minikube/certs/ca-key.pem (1675 bytes)
I0819 19:12:37.926192 719822 certs.go:484] found cert: /home/jenkins/minikube-integration/19468-713648/.minikube/certs/ca.pem (1082 bytes)
I0819 19:12:37.926223 719822 certs.go:484] found cert: /home/jenkins/minikube-integration/19468-713648/.minikube/certs/cert.pem (1123 bytes)
I0819 19:12:37.926251 719822 certs.go:484] found cert: /home/jenkins/minikube-integration/19468-713648/.minikube/certs/key.pem (1679 bytes)
I0819 19:12:37.926837 719822 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-713648/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0819 19:12:37.955188 719822 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-713648/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0819 19:12:37.982206 719822 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-713648/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0819 19:12:38.009324 719822 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-713648/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0819 19:12:38.040438 719822 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0819 19:12:38.069382 719822 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0819 19:12:38.098102 719822 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0819 19:12:38.124089 719822 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-713648/.minikube/profiles/addons-764717/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0819 19:12:38.149289 719822 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19468-713648/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0819 19:12:38.175632 719822 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0819 19:12:38.195207 719822 ssh_runner.go:195] Run: openssl version
I0819 19:12:38.201103 719822 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0819 19:12:38.211006 719822 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0819 19:12:38.214636 719822 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 19 19:12 /usr/share/ca-certificates/minikubeCA.pem
I0819 19:12:38.214746 719822 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0819 19:12:38.221565 719822 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0819 19:12:38.231290 719822 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0819 19:12:38.234716 719822 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0819 19:12:38.234768 719822 kubeadm.go:392] StartCluster: {Name:addons-764717 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-764717 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom
QemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0819 19:12:38.234858 719822 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0819 19:12:38.234920 719822 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0819 19:12:38.272637 719822 cri.go:89] found id: ""
I0819 19:12:38.272767 719822 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0819 19:12:38.282503 719822 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0819 19:12:38.291975 719822 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0819 19:12:38.292053 719822 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0819 19:12:38.303494 719822 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0819 19:12:38.303516 719822 kubeadm.go:157] found existing configuration files:
I0819 19:12:38.303602 719822 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0819 19:12:38.314784 719822 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0819 19:12:38.314883 719822 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0819 19:12:38.324212 719822 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0819 19:12:38.334476 719822 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0819 19:12:38.334652 719822 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0819 19:12:38.343604 719822 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0819 19:12:38.353475 719822 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0819 19:12:38.353629 719822 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0819 19:12:38.363152 719822 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0819 19:12:38.373219 719822 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0819 19:12:38.373286 719822 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0819 19:12:38.381816 719822 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0819 19:12:38.421185 719822 kubeadm.go:310] [init] Using Kubernetes version: v1.31.0
I0819 19:12:38.421425 719822 kubeadm.go:310] [preflight] Running pre-flight checks
I0819 19:12:38.441104 719822 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0819 19:12:38.441187 719822 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1067-aws[0m
I0819 19:12:38.441224 719822 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0819 19:12:38.441272 719822 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0819 19:12:38.441322 719822 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0819 19:12:38.441371 719822 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0819 19:12:38.441421 719822 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0819 19:12:38.441473 719822 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0819 19:12:38.441523 719822 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0819 19:12:38.441580 719822 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0819 19:12:38.441649 719822 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0819 19:12:38.441703 719822 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0819 19:12:38.504700 719822 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0819 19:12:38.504876 719822 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0819 19:12:38.504982 719822 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0819 19:12:38.509824 719822 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0819 19:12:38.515934 719822 out.go:235] - Generating certificates and keys ...
I0819 19:12:38.516054 719822 kubeadm.go:310] [certs] Using existing ca certificate authority
I0819 19:12:38.516131 719822 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0819 19:12:38.995086 719822 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0819 19:12:39.139673 719822 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0819 19:12:39.734739 719822 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0819 19:12:40.054941 719822 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0819 19:12:40.627944 719822 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0819 19:12:40.628449 719822 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-764717 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0819 19:12:41.204862 719822 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0819 19:12:41.205255 719822 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-764717 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0819 19:12:41.620498 719822 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0819 19:12:42.113961 719822 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0819 19:12:42.323237 719822 kubeadm.go:310] [certs] Generating "sa" key and public key
I0819 19:12:42.323894 719822 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0819 19:12:42.627023 719822 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0819 19:12:42.843037 719822 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0819 19:12:44.233429 719822 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0819 19:12:44.836259 719822 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0819 19:12:45.492720 719822 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0819 19:12:45.493472 719822 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0819 19:12:45.496681 719822 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0819 19:12:45.500127 719822 out.go:235] - Booting up control plane ...
I0819 19:12:45.500231 719822 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0819 19:12:45.500306 719822 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0819 19:12:45.500372 719822 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0819 19:12:45.511089 719822 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0819 19:12:45.517988 719822 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0819 19:12:45.518262 719822 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0819 19:12:45.622219 719822 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0819 19:12:45.622343 719822 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0819 19:12:47.118200 719822 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.502111655s
I0819 19:12:47.118288 719822 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0819 19:12:53.619762 719822 kubeadm.go:310] [api-check] The API server is healthy after 6.501622722s
I0819 19:12:53.640229 719822 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0819 19:12:53.668978 719822 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0819 19:12:53.701096 719822 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0819 19:12:53.701286 719822 kubeadm.go:310] [mark-control-plane] Marking the node addons-764717 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0819 19:12:53.713878 719822 kubeadm.go:310] [bootstrap-token] Using token: vbwiyt.9w2e7cty3dio5clz
I0819 19:12:53.716580 719822 out.go:235] - Configuring RBAC rules ...
I0819 19:12:53.716721 719822 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0819 19:12:53.721688 719822 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0819 19:12:53.734951 719822 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0819 19:12:53.740324 719822 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0819 19:12:53.744982 719822 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0819 19:12:53.749628 719822 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0819 19:12:54.027603 719822 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0819 19:12:54.457549 719822 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0819 19:12:55.027188 719822 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0819 19:12:55.029079 719822 kubeadm.go:310]
I0819 19:12:55.029163 719822 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0819 19:12:55.029174 719822 kubeadm.go:310]
I0819 19:12:55.029250 719822 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0819 19:12:55.029259 719822 kubeadm.go:310]
I0819 19:12:55.029284 719822 kubeadm.go:310] mkdir -p $HOME/.kube
I0819 19:12:55.029354 719822 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0819 19:12:55.029408 719822 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0819 19:12:55.029416 719822 kubeadm.go:310]
I0819 19:12:55.029470 719822 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0819 19:12:55.029478 719822 kubeadm.go:310]
I0819 19:12:55.029525 719822 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0819 19:12:55.029534 719822 kubeadm.go:310]
I0819 19:12:55.029585 719822 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0819 19:12:55.029713 719822 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0819 19:12:55.029789 719822 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0819 19:12:55.029797 719822 kubeadm.go:310]
I0819 19:12:55.029880 719822 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0819 19:12:55.029962 719822 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0819 19:12:55.029972 719822 kubeadm.go:310]
I0819 19:12:55.030054 719822 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token vbwiyt.9w2e7cty3dio5clz \
I0819 19:12:55.030158 719822 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:fa707379916665c9af57e699aaf9538c818997cdc80f78709ce47d3d08cf4d5c \
I0819 19:12:55.030182 719822 kubeadm.go:310] --control-plane
I0819 19:12:55.030187 719822 kubeadm.go:310]
I0819 19:12:55.030269 719822 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0819 19:12:55.030274 719822 kubeadm.go:310]
I0819 19:12:55.030353 719822 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token vbwiyt.9w2e7cty3dio5clz \
I0819 19:12:55.030450 719822 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:fa707379916665c9af57e699aaf9538c818997cdc80f78709ce47d3d08cf4d5c
I0819 19:12:55.038865 719822 kubeadm.go:310] W0819 19:12:38.418039 1032 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0819 19:12:55.039154 719822 kubeadm.go:310] W0819 19:12:38.418822 1032 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0819 19:12:55.039362 719822 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1067-aws\n", err: exit status 1
I0819 19:12:55.039478 719822 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0819 19:12:55.039947 719822 cni.go:84] Creating CNI manager for ""
I0819 19:12:55.040001 719822 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0819 19:12:55.043268 719822 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0819 19:12:55.058048 719822 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0819 19:12:55.062901 719822 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.0/kubectl ...
I0819 19:12:55.062925 719822 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
I0819 19:12:55.085322 719822 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0819 19:12:55.396352 719822 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0819 19:12:55.396443 719822 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0819 19:12:55.396482 719822 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-764717 minikube.k8s.io/updated_at=2024_08_19T19_12_55_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=9c2db9d51ec33b5c53a86e9ba3d384ee332e3411 minikube.k8s.io/name=addons-764717 minikube.k8s.io/primary=true
I0819 19:12:55.594119 719822 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0819 19:12:55.594216 719822 ops.go:34] apiserver oom_adj: -16
I0819 19:12:56.094259 719822 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0819 19:12:56.594638 719822 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0819 19:12:57.094527 719822 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0819 19:12:57.594939 719822 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0819 19:12:58.094617 719822 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0819 19:12:58.594299 719822 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0819 19:12:59.094452 719822 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0819 19:12:59.264217 719822 kubeadm.go:1113] duration metric: took 3.867829819s to wait for elevateKubeSystemPrivileges
I0819 19:12:59.264246 719822 kubeadm.go:394] duration metric: took 21.029480924s to StartCluster
I0819 19:12:59.264265 719822 settings.go:142] acquiring lock: {Name:mkaadefe433938b57be9d3bfe15e882f26f4b33f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 19:12:59.264381 719822 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19468-713648/kubeconfig
I0819 19:12:59.264829 719822 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19468-713648/kubeconfig: {Name:mkf31304d026c3efc4e221dc3bed7b6fa7b4139d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 19:12:59.265458 719822 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0819 19:12:59.265487 719822 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0819 19:12:59.265864 719822 config.go:182] Loaded profile config "addons-764717": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0819 19:12:59.265912 719822 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I0819 19:12:59.266035 719822 addons.go:69] Setting yakd=true in profile "addons-764717"
I0819 19:12:59.266058 719822 addons.go:234] Setting addon yakd=true in "addons-764717"
I0819 19:12:59.266082 719822 host.go:66] Checking if "addons-764717" exists ...
I0819 19:12:59.266635 719822 cli_runner.go:164] Run: docker container inspect addons-764717 --format={{.State.Status}}
I0819 19:12:59.267139 719822 addons.go:69] Setting metrics-server=true in profile "addons-764717"
I0819 19:12:59.267158 719822 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-764717"
I0819 19:12:59.267181 719822 addons.go:234] Setting addon metrics-server=true in "addons-764717"
I0819 19:12:59.267183 719822 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-764717"
I0819 19:12:59.267215 719822 host.go:66] Checking if "addons-764717" exists ...
I0819 19:12:59.267445 719822 cli_runner.go:164] Run: docker container inspect addons-764717 --format={{.State.Status}}
I0819 19:12:59.267696 719822 cli_runner.go:164] Run: docker container inspect addons-764717 --format={{.State.Status}}
I0819 19:12:59.272338 719822 addons.go:69] Setting cloud-spanner=true in profile "addons-764717"
I0819 19:12:59.272389 719822 addons.go:234] Setting addon cloud-spanner=true in "addons-764717"
I0819 19:12:59.272427 719822 host.go:66] Checking if "addons-764717" exists ...
I0819 19:12:59.273151 719822 cli_runner.go:164] Run: docker container inspect addons-764717 --format={{.State.Status}}
I0819 19:12:59.273293 719822 addons.go:69] Setting volcano=true in profile "addons-764717"
I0819 19:12:59.273323 719822 addons.go:234] Setting addon volcano=true in "addons-764717"
I0819 19:12:59.273348 719822 host.go:66] Checking if "addons-764717" exists ...
I0819 19:12:59.275808 719822 cli_runner.go:164] Run: docker container inspect addons-764717 --format={{.State.Status}}
I0819 19:12:59.280083 719822 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-764717"
I0819 19:12:59.280158 719822 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-764717"
I0819 19:12:59.280189 719822 host.go:66] Checking if "addons-764717" exists ...
I0819 19:12:59.280635 719822 cli_runner.go:164] Run: docker container inspect addons-764717 --format={{.State.Status}}
I0819 19:12:59.288774 719822 addons.go:69] Setting volumesnapshots=true in profile "addons-764717"
I0819 19:12:59.288865 719822 addons.go:234] Setting addon volumesnapshots=true in "addons-764717"
I0819 19:12:59.288937 719822 host.go:66] Checking if "addons-764717" exists ...
I0819 19:12:59.289423 719822 cli_runner.go:164] Run: docker container inspect addons-764717 --format={{.State.Status}}
I0819 19:12:59.299478 719822 addons.go:69] Setting default-storageclass=true in profile "addons-764717"
I0819 19:12:59.299526 719822 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-764717"
I0819 19:12:59.300087 719822 cli_runner.go:164] Run: docker container inspect addons-764717 --format={{.State.Status}}
I0819 19:12:59.300680 719822 addons.go:69] Setting gcp-auth=true in profile "addons-764717"
I0819 19:12:59.300783 719822 mustload.go:65] Loading cluster: addons-764717
I0819 19:12:59.300958 719822 config.go:182] Loaded profile config "addons-764717": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0819 19:12:59.301195 719822 cli_runner.go:164] Run: docker container inspect addons-764717 --format={{.State.Status}}
I0819 19:12:59.311378 719822 out.go:177] * Verifying Kubernetes components...
I0819 19:12:59.311514 719822 addons.go:69] Setting ingress=true in profile "addons-764717"
I0819 19:12:59.311560 719822 addons.go:234] Setting addon ingress=true in "addons-764717"
I0819 19:12:59.311612 719822 host.go:66] Checking if "addons-764717" exists ...
I0819 19:12:59.312118 719822 cli_runner.go:164] Run: docker container inspect addons-764717 --format={{.State.Status}}
I0819 19:12:59.334200 719822 addons.go:69] Setting ingress-dns=true in profile "addons-764717"
I0819 19:12:59.334257 719822 addons.go:234] Setting addon ingress-dns=true in "addons-764717"
I0819 19:12:59.334305 719822 host.go:66] Checking if "addons-764717" exists ...
I0819 19:12:59.334815 719822 cli_runner.go:164] Run: docker container inspect addons-764717 --format={{.State.Status}}
I0819 19:12:59.359405 719822 addons.go:69] Setting inspektor-gadget=true in profile "addons-764717"
I0819 19:12:59.359481 719822 addons.go:234] Setting addon inspektor-gadget=true in "addons-764717"
I0819 19:12:59.359553 719822 host.go:66] Checking if "addons-764717" exists ...
I0819 19:12:59.360251 719822 cli_runner.go:164] Run: docker container inspect addons-764717 --format={{.State.Status}}
I0819 19:12:59.267141 719822 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-764717"
I0819 19:12:59.381650 719822 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-764717"
I0819 19:12:59.381698 719822 host.go:66] Checking if "addons-764717" exists ...
I0819 19:12:59.382209 719822 cli_runner.go:164] Run: docker container inspect addons-764717 --format={{.State.Status}}
I0819 19:12:59.267149 719822 addons.go:69] Setting registry=true in profile "addons-764717"
I0819 19:12:59.426993 719822 addons.go:234] Setting addon registry=true in "addons-764717"
I0819 19:12:59.427038 719822 host.go:66] Checking if "addons-764717" exists ...
I0819 19:12:59.427542 719822 cli_runner.go:164] Run: docker container inspect addons-764717 --format={{.State.Status}}
I0819 19:12:59.443753 719822 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0819 19:12:59.267154 719822 addons.go:69] Setting storage-provisioner=true in profile "addons-764717"
I0819 19:12:59.452391 719822 addons.go:234] Setting addon storage-provisioner=true in "addons-764717"
I0819 19:12:59.452436 719822 host.go:66] Checking if "addons-764717" exists ...
I0819 19:12:59.452880 719822 cli_runner.go:164] Run: docker container inspect addons-764717 --format={{.State.Status}}
I0819 19:12:59.500365 719822 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0819 19:12:59.503554 719822 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0819 19:12:59.506746 719822 addons.go:234] Setting addon default-storageclass=true in "addons-764717"
I0819 19:12:59.506790 719822 host.go:66] Checking if "addons-764717" exists ...
I0819 19:12:59.507234 719822 cli_runner.go:164] Run: docker container inspect addons-764717 --format={{.State.Status}}
I0819 19:12:59.511107 719822 out.go:177] - Using image docker.io/volcanosh/vc-scheduler:v1.9.0
I0819 19:12:59.516450 719822 out.go:177] - Using image docker.io/volcanosh/vc-webhook-manager:v1.9.0
I0819 19:12:59.511331 719822 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I0819 19:12:59.511337 719822 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.1
I0819 19:12:59.511591 719822 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0819 19:12:59.529450 719822 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0819 19:12:59.529629 719822 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-764717
I0819 19:12:59.511596 719822 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0819 19:12:59.512187 719822 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-764717"
I0819 19:12:59.530674 719822 host.go:66] Checking if "addons-764717" exists ...
I0819 19:12:59.512230 719822 host.go:66] Checking if "addons-764717" exists ...
I0819 19:12:59.511577 719822 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.22
I0819 19:12:59.528533 719822 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
I0819 19:12:59.542671 719822 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0819 19:12:59.542782 719822 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-764717
I0819 19:12:59.562822 719822 out.go:177] - Using image docker.io/volcanosh/vc-controller-manager:v1.9.0
I0819 19:12:59.569657 719822 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0819 19:12:59.569881 719822 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
I0819 19:12:59.569906 719822 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0819 19:12:59.569977 719822 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-764717
I0819 19:12:59.569754 719822 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0819 19:12:59.572649 719822 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0819 19:12:59.572771 719822 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-764717
I0819 19:12:59.581963 719822 cli_runner.go:164] Run: docker container inspect addons-764717 --format={{.State.Status}}
I0819 19:12:59.601401 719822 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml
I0819 19:12:59.601438 719822 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (434001 bytes)
I0819 19:12:59.601533 719822 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-764717
I0819 19:12:59.659690 719822 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0819 19:12:59.669723 719822 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0819 19:12:59.670395 719822 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I0819 19:12:59.678013 719822 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
I0819 19:12:59.678218 719822 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33528 SSHKeyPath:/home/jenkins/minikube-integration/19468-713648/.minikube/machines/addons-764717/id_rsa Username:docker}
I0819 19:12:59.678013 719822 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.31.0
I0819 19:12:59.681745 719822 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0819 19:12:59.681766 719822 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0819 19:12:59.681853 719822 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-764717
I0819 19:12:59.679169 719822 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33528 SSHKeyPath:/home/jenkins/minikube-integration/19468-713648/.minikube/machines/addons-764717/id_rsa Username:docker}
I0819 19:12:59.682942 719822 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0819 19:12:59.680060 719822 out.go:177] - Using image docker.io/registry:2.8.3
I0819 19:12:59.681523 719822 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2
I0819 19:12:59.683117 719822 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0819 19:12:59.683194 719822 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-764717
I0819 19:12:59.693416 719822 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0819 19:12:59.696127 719822 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0819 19:12:59.698790 719822 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0819 19:12:59.701680 719822 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
I0819 19:12:59.701749 719822 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0819 19:12:59.701761 719822 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0819 19:12:59.701844 719822 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-764717
I0819 19:12:59.704693 719822 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
I0819 19:12:59.704715 719822 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I0819 19:12:59.704784 719822 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-764717
I0819 19:12:59.716715 719822 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
I0819 19:12:59.716745 719822 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I0819 19:12:59.716820 719822 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-764717
I0819 19:12:59.741712 719822 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0819 19:12:59.742076 719822 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0819 19:12:59.742090 719822 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0819 19:12:59.742151 719822 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-764717
I0819 19:12:59.751725 719822 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0819 19:12:59.752103 719822 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0819 19:12:59.752126 719822 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0819 19:12:59.752189 719822 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-764717
I0819 19:12:59.782687 719822 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0819 19:12:59.790024 719822 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33528 SSHKeyPath:/home/jenkins/minikube-integration/19468-713648/.minikube/machines/addons-764717/id_rsa Username:docker}
I0819 19:12:59.790299 719822 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0819 19:12:59.790839 719822 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I0819 19:12:59.792059 719822 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-764717
I0819 19:12:59.816484 719822 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0819 19:12:59.819710 719822 out.go:177] - Using image docker.io/busybox:stable
I0819 19:12:59.822505 719822 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0819 19:12:59.822573 719822 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0819 19:12:59.822674 719822 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-764717
I0819 19:12:59.843064 719822 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33528 SSHKeyPath:/home/jenkins/minikube-integration/19468-713648/.minikube/machines/addons-764717/id_rsa Username:docker}
I0819 19:12:59.855900 719822 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33528 SSHKeyPath:/home/jenkins/minikube-integration/19468-713648/.minikube/machines/addons-764717/id_rsa Username:docker}
I0819 19:12:59.885920 719822 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33528 SSHKeyPath:/home/jenkins/minikube-integration/19468-713648/.minikube/machines/addons-764717/id_rsa Username:docker}
I0819 19:12:59.905968 719822 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33528 SSHKeyPath:/home/jenkins/minikube-integration/19468-713648/.minikube/machines/addons-764717/id_rsa Username:docker}
I0819 19:12:59.940724 719822 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33528 SSHKeyPath:/home/jenkins/minikube-integration/19468-713648/.minikube/machines/addons-764717/id_rsa Username:docker}
I0819 19:12:59.946310 719822 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33528 SSHKeyPath:/home/jenkins/minikube-integration/19468-713648/.minikube/machines/addons-764717/id_rsa Username:docker}
I0819 19:12:59.954342 719822 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33528 SSHKeyPath:/home/jenkins/minikube-integration/19468-713648/.minikube/machines/addons-764717/id_rsa Username:docker}
I0819 19:12:59.954524 719822 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33528 SSHKeyPath:/home/jenkins/minikube-integration/19468-713648/.minikube/machines/addons-764717/id_rsa Username:docker}
I0819 19:12:59.956371 719822 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33528 SSHKeyPath:/home/jenkins/minikube-integration/19468-713648/.minikube/machines/addons-764717/id_rsa Username:docker}
I0819 19:12:59.973355 719822 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33528 SSHKeyPath:/home/jenkins/minikube-integration/19468-713648/.minikube/machines/addons-764717/id_rsa Username:docker}
I0819 19:12:59.982859 719822 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33528 SSHKeyPath:/home/jenkins/minikube-integration/19468-713648/.minikube/machines/addons-764717/id_rsa Username:docker}
I0819 19:13:00.270787 719822 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml": (1.005296031s)
I0819 19:13:00.270987 719822 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0819 19:13:00.271289 719822 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0819 19:13:00.521584 719822 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0819 19:13:00.521800 719822 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0819 19:13:00.597827 719822 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0819 19:13:00.597851 719822 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0819 19:13:00.740202 719822 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
I0819 19:13:00.740232 719822 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0819 19:13:00.750849 719822 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0819 19:13:00.754265 719822 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0819 19:13:00.754289 719822 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0819 19:13:00.776099 719822 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0819 19:13:00.804472 719822 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
I0819 19:13:00.825354 719822 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0819 19:13:00.836114 719822 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0819 19:13:00.843154 719822 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0819 19:13:00.875362 719822 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0819 19:13:00.875439 719822 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0819 19:13:00.921902 719822 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I0819 19:13:00.921967 719822 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I0819 19:13:00.988661 719822 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
I0819 19:13:00.988735 719822 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0819 19:13:00.995541 719822 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0819 19:13:01.051770 719822 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0819 19:13:01.051844 719822 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0819 19:13:01.056156 719822 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0819 19:13:01.056222 719822 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0819 19:13:01.128945 719822 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
I0819 19:13:01.129018 719822 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0819 19:13:01.181195 719822 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0819 19:13:01.198374 719822 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0819 19:13:01.198447 719822 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0819 19:13:01.242364 719822 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
I0819 19:13:01.242427 719822 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I0819 19:13:01.346065 719822 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
I0819 19:13:01.346137 719822 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0819 19:13:01.424834 719822 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0819 19:13:01.424909 719822 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0819 19:13:01.432327 719822 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0819 19:13:01.432390 719822 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0819 19:13:01.554339 719822 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0819 19:13:01.554407 719822 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0819 19:13:01.562477 719822 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
I0819 19:13:01.562555 719822 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0819 19:13:01.704977 719822 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I0819 19:13:01.705048 719822 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I0819 19:13:01.705467 719822 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0819 19:13:01.817774 719822 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0819 19:13:01.817804 719822 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0819 19:13:01.855248 719822 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0819 19:13:01.874726 719822 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
I0819 19:13:01.874791 719822 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0819 19:13:01.886842 719822 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0819 19:13:01.886916 719822 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0819 19:13:01.901742 719822 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I0819 19:13:01.901815 719822 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I0819 19:13:01.946182 719822 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0819 19:13:01.946210 719822 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0819 19:13:02.224368 719822 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0819 19:13:02.275143 719822 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0819 19:13:02.275170 719822 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0819 19:13:02.277756 719822 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0819 19:13:02.351757 719822 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I0819 19:13:02.351785 719822 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I0819 19:13:02.549083 719822 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0819 19:13:02.549112 719822 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0819 19:13:02.598971 719822 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
I0819 19:13:02.598999 719822 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I0819 19:13:02.772492 719822 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (2.021578468s)
I0819 19:13:02.772433 719822 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (2.501108128s)
I0819 19:13:02.772710 719822 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.501694025s)
I0819 19:13:02.772730 719822 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I0819 19:13:02.774731 719822 node_ready.go:35] waiting up to 6m0s for node "addons-764717" to be "Ready" ...
I0819 19:13:02.779996 719822 node_ready.go:49] node "addons-764717" has status "Ready":"True"
I0819 19:13:02.780019 719822 node_ready.go:38] duration metric: took 5.239263ms for node "addons-764717" to be "Ready" ...
I0819 19:13:02.780029 719822 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0819 19:13:02.790113 719822 pod_ready.go:79] waiting up to 6m0s for pod "coredns-6f6b679f8f-jjj55" in "kube-system" namespace to be "Ready" ...
I0819 19:13:03.031109 719822 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0819 19:13:03.031144 719822 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0819 19:13:03.096964 719822 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
I0819 19:13:03.096995 719822 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
I0819 19:13:03.273339 719822 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0819 19:13:03.273373 719822 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0819 19:13:03.277346 719822 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-764717" context rescaled to 1 replicas
I0819 19:13:03.333098 719822 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I0819 19:13:03.524336 719822 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0819 19:13:03.524380 719822 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0819 19:13:03.822729 719822 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0819 19:13:04.735696 719822 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (3.959511714s)
I0819 19:13:04.800020 719822 pod_ready.go:103] pod "coredns-6f6b679f8f-jjj55" in "kube-system" namespace has status "Ready":"False"
I0819 19:13:06.828031 719822 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0819 19:13:06.828181 719822 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-764717
I0819 19:13:06.839174 719822 pod_ready.go:103] pod "coredns-6f6b679f8f-jjj55" in "kube-system" namespace has status "Ready":"False"
I0819 19:13:06.862460 719822 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33528 SSHKeyPath:/home/jenkins/minikube-integration/19468-713648/.minikube/machines/addons-764717/id_rsa Username:docker}
I0819 19:13:07.512363 719822 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0819 19:13:07.631998 719822 addons.go:234] Setting addon gcp-auth=true in "addons-764717"
I0819 19:13:07.632065 719822 host.go:66] Checking if "addons-764717" exists ...
I0819 19:13:07.632578 719822 cli_runner.go:164] Run: docker container inspect addons-764717 --format={{.State.Status}}
I0819 19:13:07.667547 719822 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0819 19:13:07.667606 719822 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-764717
I0819 19:13:07.691293 719822 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33528 SSHKeyPath:/home/jenkins/minikube-integration/19468-713648/.minikube/machines/addons-764717/id_rsa Username:docker}
I0819 19:13:08.859205 719822 pod_ready.go:103] pod "coredns-6f6b679f8f-jjj55" in "kube-system" namespace has status "Ready":"False"
I0819 19:13:10.117847 719822 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (9.313341283s)
I0819 19:13:10.117998 719822 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (9.292625681s)
I0819 19:13:10.118522 719822 addons.go:475] Verifying addon ingress=true in "addons-764717"
I0819 19:13:10.118688 719822 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (8.936904696s)
I0819 19:13:10.118054 719822 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (9.281878449s)
I0819 19:13:10.118107 719822 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (9.274887496s)
I0819 19:13:10.118140 719822 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (9.122532925s)
I0819 19:13:10.118194 719822 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (8.41268412s)
I0819 19:13:10.119003 719822 addons.go:475] Verifying addon registry=true in "addons-764717"
I0819 19:13:10.118247 719822 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.262925734s)
I0819 19:13:10.119070 719822 addons.go:475] Verifying addon metrics-server=true in "addons-764717"
I0819 19:13:10.118276 719822 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (7.893882087s)
I0819 19:13:10.118348 719822 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (7.840565043s)
W0819 19:13:10.119257 719822 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0819 19:13:10.119281 719822 retry.go:31] will retry after 173.566509ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0819 19:13:10.118404 719822 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (6.785277475s)
I0819 19:13:10.122052 719822 out.go:177] * Verifying ingress addon...
I0819 19:13:10.123990 719822 out.go:177] * Verifying registry addon...
I0819 19:13:10.124100 719822 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-764717 service yakd-dashboard -n yakd-dashboard
I0819 19:13:10.127984 719822 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0819 19:13:10.128991 719822 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0819 19:13:10.179694 719822 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0819 19:13:10.179723 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:10.180685 719822 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0819 19:13:10.180708 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:10.293389 719822 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0819 19:13:10.644402 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:10.646943 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:10.788644 719822 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (6.965846468s)
I0819 19:13:10.788681 719822 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-764717"
I0819 19:13:10.788993 719822 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (3.121421922s)
I0819 19:13:10.791858 719822 out.go:177] * Verifying csi-hostpath-driver addon...
I0819 19:13:10.791865 719822 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0819 19:13:10.794722 719822 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
I0819 19:13:10.795563 719822 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0819 19:13:10.797494 719822 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0819 19:13:10.797519 719822 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0819 19:13:10.810577 719822 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0819 19:13:10.811109 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:10.876954 719822 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0819 19:13:10.876976 719822 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0819 19:13:10.942693 719822 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0819 19:13:10.942715 719822 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I0819 19:13:11.014782 719822 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0819 19:13:11.135083 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:11.136144 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:11.317671 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:11.318857 719822 pod_ready.go:103] pod "coredns-6f6b679f8f-jjj55" in "kube-system" namespace has status "Ready":"False"
I0819 19:13:11.633244 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:11.635608 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:11.802935 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:12.126005 719822 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.832553252s)
I0819 19:13:12.126100 719822 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.111285199s)
I0819 19:13:12.129521 719822 addons.go:475] Verifying addon gcp-auth=true in "addons-764717"
I0819 19:13:12.133714 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:12.133878 719822 out.go:177] * Verifying gcp-auth addon...
I0819 19:13:12.135766 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:12.137671 719822 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0819 19:13:12.140646 719822 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0819 19:13:12.303383 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:12.634282 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:12.635161 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:12.800707 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:13.135617 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:13.137244 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:13.302464 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:13.636544 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:13.638268 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:13.797360 719822 pod_ready.go:103] pod "coredns-6f6b679f8f-jjj55" in "kube-system" namespace has status "Ready":"False"
I0819 19:13:13.801857 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:14.135501 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:14.137416 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:14.301281 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:14.635099 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:14.636949 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:14.812695 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:15.136907 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:15.142526 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:15.303586 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:15.634079 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:15.634771 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:15.796238 719822 pod_ready.go:93] pod "coredns-6f6b679f8f-jjj55" in "kube-system" namespace has status "Ready":"True"
I0819 19:13:15.796264 719822 pod_ready.go:82] duration metric: took 13.006086793s for pod "coredns-6f6b679f8f-jjj55" in "kube-system" namespace to be "Ready" ...
I0819 19:13:15.796275 719822 pod_ready.go:79] waiting up to 6m0s for pod "coredns-6f6b679f8f-prjrm" in "kube-system" namespace to be "Ready" ...
I0819 19:13:15.798491 719822 pod_ready.go:98] error getting pod "coredns-6f6b679f8f-prjrm" in "kube-system" namespace (skipping!): pods "coredns-6f6b679f8f-prjrm" not found
I0819 19:13:15.798519 719822 pod_ready.go:82] duration metric: took 2.235688ms for pod "coredns-6f6b679f8f-prjrm" in "kube-system" namespace to be "Ready" ...
E0819 19:13:15.798531 719822 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-6f6b679f8f-prjrm" in "kube-system" namespace (skipping!): pods "coredns-6f6b679f8f-prjrm" not found
I0819 19:13:15.798538 719822 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-764717" in "kube-system" namespace to be "Ready" ...
I0819 19:13:15.800391 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:15.805701 719822 pod_ready.go:93] pod "etcd-addons-764717" in "kube-system" namespace has status "Ready":"True"
I0819 19:13:15.805728 719822 pod_ready.go:82] duration metric: took 7.182007ms for pod "etcd-addons-764717" in "kube-system" namespace to be "Ready" ...
I0819 19:13:15.805743 719822 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-764717" in "kube-system" namespace to be "Ready" ...
I0819 19:13:15.810902 719822 pod_ready.go:93] pod "kube-apiserver-addons-764717" in "kube-system" namespace has status "Ready":"True"
I0819 19:13:15.810929 719822 pod_ready.go:82] duration metric: took 5.178349ms for pod "kube-apiserver-addons-764717" in "kube-system" namespace to be "Ready" ...
I0819 19:13:15.810941 719822 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-764717" in "kube-system" namespace to be "Ready" ...
I0819 19:13:15.816817 719822 pod_ready.go:93] pod "kube-controller-manager-addons-764717" in "kube-system" namespace has status "Ready":"True"
I0819 19:13:15.816843 719822 pod_ready.go:82] duration metric: took 5.893493ms for pod "kube-controller-manager-addons-764717" in "kube-system" namespace to be "Ready" ...
I0819 19:13:15.816855 719822 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-ffzf6" in "kube-system" namespace to be "Ready" ...
I0819 19:13:15.993401 719822 pod_ready.go:93] pod "kube-proxy-ffzf6" in "kube-system" namespace has status "Ready":"True"
I0819 19:13:15.993426 719822 pod_ready.go:82] duration metric: took 176.562358ms for pod "kube-proxy-ffzf6" in "kube-system" namespace to be "Ready" ...
I0819 19:13:15.993437 719822 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-764717" in "kube-system" namespace to be "Ready" ...
I0819 19:13:16.133634 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:16.134965 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:16.301406 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:16.394305 719822 pod_ready.go:93] pod "kube-scheduler-addons-764717" in "kube-system" namespace has status "Ready":"True"
I0819 19:13:16.394332 719822 pod_ready.go:82] duration metric: took 400.885351ms for pod "kube-scheduler-addons-764717" in "kube-system" namespace to be "Ready" ...
I0819 19:13:16.394345 719822 pod_ready.go:79] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-kvhw5" in "kube-system" namespace to be "Ready" ...
I0819 19:13:16.634886 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:16.636112 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:16.801807 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:17.134367 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:17.135696 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:17.301960 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:17.634011 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:17.634536 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:17.800725 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:18.134114 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:18.134693 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:18.300791 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:18.403861 719822 pod_ready.go:103] pod "nvidia-device-plugin-daemonset-kvhw5" in "kube-system" namespace has status "Ready":"False"
I0819 19:13:18.633860 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:18.635668 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:18.802335 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:19.133269 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:19.136148 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:19.301726 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:19.642202 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:19.643385 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:19.801359 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:20.135085 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:20.136578 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:20.301892 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:20.631915 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:20.634073 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:20.800236 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:20.899860 719822 pod_ready.go:103] pod "nvidia-device-plugin-daemonset-kvhw5" in "kube-system" namespace has status "Ready":"False"
I0819 19:13:21.137694 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:21.139267 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:21.301126 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:21.635756 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:21.637446 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:21.801659 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:22.134412 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:22.134927 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:22.309891 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:22.634815 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:22.635765 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:22.802817 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:22.900536 719822 pod_ready.go:103] pod "nvidia-device-plugin-daemonset-kvhw5" in "kube-system" namespace has status "Ready":"False"
I0819 19:13:23.133697 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:23.134252 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:23.301288 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:23.633898 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:23.636001 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:23.801375 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:23.901456 719822 pod_ready.go:93] pod "nvidia-device-plugin-daemonset-kvhw5" in "kube-system" namespace has status "Ready":"True"
I0819 19:13:23.901482 719822 pod_ready.go:82] duration metric: took 7.507128438s for pod "nvidia-device-plugin-daemonset-kvhw5" in "kube-system" namespace to be "Ready" ...
I0819 19:13:23.901493 719822 pod_ready.go:39] duration metric: took 21.121452568s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0819 19:13:23.901527 719822 api_server.go:52] waiting for apiserver process to appear ...
I0819 19:13:23.901634 719822 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0819 19:13:23.919583 719822 api_server.go:72] duration metric: took 24.654062117s to wait for apiserver process to appear ...
I0819 19:13:23.919609 719822 api_server.go:88] waiting for apiserver healthz status ...
I0819 19:13:23.919630 719822 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I0819 19:13:23.927544 719822 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I0819 19:13:23.928602 719822 api_server.go:141] control plane version: v1.31.0
I0819 19:13:23.928632 719822 api_server.go:131] duration metric: took 9.014597ms to wait for apiserver health ...
I0819 19:13:23.928642 719822 system_pods.go:43] waiting for kube-system pods to appear ...
I0819 19:13:23.938355 719822 system_pods.go:59] 18 kube-system pods found
I0819 19:13:23.938398 719822 system_pods.go:61] "coredns-6f6b679f8f-jjj55" [ad3228fb-a563-43d5-bf52-97f3239d4a26] Running
I0819 19:13:23.938409 719822 system_pods.go:61] "csi-hostpath-attacher-0" [736a6b32-794c-4743-9f49-c08a81e9c3af] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0819 19:13:23.938417 719822 system_pods.go:61] "csi-hostpath-resizer-0" [d3556d5c-c6c5-44d2-84b5-a000cdc39404] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0819 19:13:23.938427 719822 system_pods.go:61] "csi-hostpathplugin-8k72f" [1ec2478d-15f8-4a48-8f64-b7aae37b9a80] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0819 19:13:23.938435 719822 system_pods.go:61] "etcd-addons-764717" [c538cfd4-25f5-47df-9f46-bfc19a32be9a] Running
I0819 19:13:23.938440 719822 system_pods.go:61] "kindnet-p7cbv" [0db82ada-723e-4095-8a5a-d6e4ec771e46] Running
I0819 19:13:23.938451 719822 system_pods.go:61] "kube-apiserver-addons-764717" [3b5686a0-e208-482b-b693-e5f4c4473e39] Running
I0819 19:13:23.938456 719822 system_pods.go:61] "kube-controller-manager-addons-764717" [5173bef4-72f2-4584-bf69-4a7fc1370989] Running
I0819 19:13:23.938461 719822 system_pods.go:61] "kube-ingress-dns-minikube" [3ec67196-fb67-4b2a-809c-872db39d19dd] Running
I0819 19:13:23.938471 719822 system_pods.go:61] "kube-proxy-ffzf6" [80b742ae-0eb1-43ab-890a-94d06e906770] Running
I0819 19:13:23.938476 719822 system_pods.go:61] "kube-scheduler-addons-764717" [cca7bc5c-fe80-464c-a78b-e6d2766a8f3d] Running
I0819 19:13:23.938481 719822 system_pods.go:61] "metrics-server-8988944d9-z27w8" [02399b78-3ca4-4bba-bfcf-3a75829d8cd2] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0819 19:13:23.938486 719822 system_pods.go:61] "nvidia-device-plugin-daemonset-kvhw5" [7ace71d8-efe9-4b5c-92a1-a84980af040a] Running
I0819 19:13:23.938492 719822 system_pods.go:61] "registry-6fb4cdfc84-mdlgd" [e16db8aa-91f9-43cd-aa8f-55fb34b58974] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0819 19:13:23.938501 719822 system_pods.go:61] "registry-proxy-95ls7" [4f8e0022-33fe-4566-87c6-b25e8349fbbf] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0819 19:13:23.938508 719822 system_pods.go:61] "snapshot-controller-56fcc65765-khfcv" [1a40e624-1896-4fa2-94f6-933045ea4c2d] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0819 19:13:23.938519 719822 system_pods.go:61] "snapshot-controller-56fcc65765-vv4tn" [665c3535-a0b3-4398-807f-ecdb47ac6bc4] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0819 19:13:23.938524 719822 system_pods.go:61] "storage-provisioner" [a5bcff9e-e914-4de2-9740-ceb293ce7618] Running
I0819 19:13:23.938530 719822 system_pods.go:74] duration metric: took 9.882716ms to wait for pod list to return data ...
I0819 19:13:23.938542 719822 default_sa.go:34] waiting for default service account to be created ...
I0819 19:13:23.941455 719822 default_sa.go:45] found service account: "default"
I0819 19:13:23.941483 719822 default_sa.go:55] duration metric: took 2.933061ms for default service account to be created ...
I0819 19:13:23.941494 719822 system_pods.go:116] waiting for k8s-apps to be running ...
I0819 19:13:23.950694 719822 system_pods.go:86] 18 kube-system pods found
I0819 19:13:23.950735 719822 system_pods.go:89] "coredns-6f6b679f8f-jjj55" [ad3228fb-a563-43d5-bf52-97f3239d4a26] Running
I0819 19:13:23.950746 719822 system_pods.go:89] "csi-hostpath-attacher-0" [736a6b32-794c-4743-9f49-c08a81e9c3af] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0819 19:13:23.950755 719822 system_pods.go:89] "csi-hostpath-resizer-0" [d3556d5c-c6c5-44d2-84b5-a000cdc39404] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0819 19:13:23.950764 719822 system_pods.go:89] "csi-hostpathplugin-8k72f" [1ec2478d-15f8-4a48-8f64-b7aae37b9a80] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0819 19:13:23.950769 719822 system_pods.go:89] "etcd-addons-764717" [c538cfd4-25f5-47df-9f46-bfc19a32be9a] Running
I0819 19:13:23.950774 719822 system_pods.go:89] "kindnet-p7cbv" [0db82ada-723e-4095-8a5a-d6e4ec771e46] Running
I0819 19:13:23.950783 719822 system_pods.go:89] "kube-apiserver-addons-764717" [3b5686a0-e208-482b-b693-e5f4c4473e39] Running
I0819 19:13:23.950788 719822 system_pods.go:89] "kube-controller-manager-addons-764717" [5173bef4-72f2-4584-bf69-4a7fc1370989] Running
I0819 19:13:23.950797 719822 system_pods.go:89] "kube-ingress-dns-minikube" [3ec67196-fb67-4b2a-809c-872db39d19dd] Running
I0819 19:13:23.950802 719822 system_pods.go:89] "kube-proxy-ffzf6" [80b742ae-0eb1-43ab-890a-94d06e906770] Running
I0819 19:13:23.950807 719822 system_pods.go:89] "kube-scheduler-addons-764717" [cca7bc5c-fe80-464c-a78b-e6d2766a8f3d] Running
I0819 19:13:23.950818 719822 system_pods.go:89] "metrics-server-8988944d9-z27w8" [02399b78-3ca4-4bba-bfcf-3a75829d8cd2] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0819 19:13:23.950824 719822 system_pods.go:89] "nvidia-device-plugin-daemonset-kvhw5" [7ace71d8-efe9-4b5c-92a1-a84980af040a] Running
I0819 19:13:23.950834 719822 system_pods.go:89] "registry-6fb4cdfc84-mdlgd" [e16db8aa-91f9-43cd-aa8f-55fb34b58974] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0819 19:13:23.950841 719822 system_pods.go:89] "registry-proxy-95ls7" [4f8e0022-33fe-4566-87c6-b25e8349fbbf] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0819 19:13:23.950849 719822 system_pods.go:89] "snapshot-controller-56fcc65765-khfcv" [1a40e624-1896-4fa2-94f6-933045ea4c2d] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0819 19:13:23.950859 719822 system_pods.go:89] "snapshot-controller-56fcc65765-vv4tn" [665c3535-a0b3-4398-807f-ecdb47ac6bc4] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0819 19:13:23.950864 719822 system_pods.go:89] "storage-provisioner" [a5bcff9e-e914-4de2-9740-ceb293ce7618] Running
I0819 19:13:23.950872 719822 system_pods.go:126] duration metric: took 9.371878ms to wait for k8s-apps to be running ...
I0819 19:13:23.950882 719822 system_svc.go:44] waiting for kubelet service to be running ....
I0819 19:13:23.950947 719822 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0819 19:13:23.966548 719822 system_svc.go:56] duration metric: took 15.654898ms WaitForService to wait for kubelet
I0819 19:13:23.966577 719822 kubeadm.go:582] duration metric: took 24.701061592s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0819 19:13:23.966598 719822 node_conditions.go:102] verifying NodePressure condition ...
I0819 19:13:23.970793 719822 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0819 19:13:23.970831 719822 node_conditions.go:123] node cpu capacity is 2
I0819 19:13:23.970850 719822 node_conditions.go:105] duration metric: took 4.244638ms to run NodePressure ...
I0819 19:13:23.970863 719822 start.go:241] waiting for startup goroutines ...
I0819 19:13:24.133071 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:24.133216 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:24.300849 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:24.633931 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:24.634417 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:24.800335 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:25.132208 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:25.134674 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:25.302187 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:25.632952 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:25.635726 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:25.801902 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:26.133407 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:26.134070 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:26.300011 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:26.633249 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:26.634023 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:26.801825 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:27.133974 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:27.135408 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:27.301139 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:27.631450 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:27.635146 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:27.801537 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:28.136607 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:28.138865 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:28.305565 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:28.657639 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:28.659390 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:28.824259 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:29.131635 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:29.134163 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:29.301051 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:29.634614 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:29.635918 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:29.801632 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:30.132488 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:30.135838 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:30.301117 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:30.634171 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:30.634535 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:30.800286 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:31.134184 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:31.134688 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:31.304387 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:31.637149 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:31.638199 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:31.801308 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:32.135077 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:32.136668 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:32.300600 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:32.633829 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:32.634014 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:32.801869 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:33.133478 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:33.134602 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:33.301995 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:33.634543 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:33.635131 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:33.800456 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:34.137414 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:34.138828 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:34.300955 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:34.631549 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:34.634270 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:34.804873 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:35.136324 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:35.137505 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:35.304648 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:35.633881 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:35.637119 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:35.814439 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:36.137089 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:36.138481 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:36.310829 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:36.639002 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:36.640109 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:36.804402 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:37.134787 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:37.137117 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:37.302992 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:37.637761 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:37.639144 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0819 19:13:37.801541 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:38.134021 719822 kapi.go:107] duration metric: took 28.006036724s to wait for kubernetes.io/minikube-addons=registry ...
I0819 19:13:38.135286 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:38.300753 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:38.633027 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:38.800593 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:39.135700 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:39.301240 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:39.635599 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:39.801962 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:40.138451 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:40.302923 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:40.642967 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:40.801646 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:41.134076 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:41.304158 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:41.633853 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:41.801289 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:42.135509 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:42.301572 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:42.633435 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:42.800767 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:43.133646 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:43.301358 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:43.634386 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:43.800994 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:44.135286 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:44.300381 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:44.635465 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:44.800565 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:45.140447 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:45.302435 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:45.633705 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:45.806692 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:46.134147 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:46.300548 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:46.633844 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:46.801660 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:47.134300 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:47.301377 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:47.633814 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:47.801230 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:48.134107 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:48.301225 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:48.633716 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:48.801945 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:49.134000 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:49.301849 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:49.634065 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:49.806191 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:50.133823 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:50.301551 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:50.634073 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:50.800573 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:51.138390 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:51.300614 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:51.633550 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:51.801056 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:52.135049 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:52.301793 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:52.634752 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:52.800734 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:53.134982 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:53.300983 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:53.641687 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:53.837381 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:54.135696 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:54.300919 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:54.634086 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:54.801072 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:55.137436 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:55.301848 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:55.634422 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:55.802983 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:56.137772 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:56.301081 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:56.634017 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:56.801333 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:57.133810 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:57.300843 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:57.634127 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:57.800863 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:58.135605 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:58.302099 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:58.634277 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:58.800608 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:59.134487 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:59.301059 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:13:59.634849 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:13:59.801376 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0819 19:14:00.185664 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:00.385162 719822 kapi.go:107] duration metric: took 49.589590192s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0819 19:14:00.634207 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:01.134447 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:01.634067 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:02.136311 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:02.633911 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:03.133924 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:03.633547 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:04.133817 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:04.634161 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:05.134010 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:05.633491 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:06.133351 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:06.634109 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:07.134008 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:07.634146 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:08.133330 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:08.633047 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:09.133678 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:09.634000 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:10.133118 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:10.633990 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:11.134233 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:11.633292 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:12.133758 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:12.633675 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:13.133994 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:13.634739 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:14.141964 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:14.633416 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:15.134388 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:15.634283 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:16.133512 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:16.633988 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:17.133971 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:17.634553 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:18.133776 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:18.634333 719822 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0819 19:14:19.154216 719822 kapi.go:107] duration metric: took 1m9.025213434s to wait for app.kubernetes.io/name=ingress-nginx ...
I0819 19:14:35.141894 719822 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0819 19:14:35.141919 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0819 19:14:35.641399 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0819 19:14:36.142397 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0819 19:14:36.640714 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0819 19:14:37.142229 719822 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0819 19:14:37.642237 719822 kapi.go:107] duration metric: took 1m25.504566394s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0819 19:14:37.644485 719822 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-764717 cluster.
I0819 19:14:37.647182 719822 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0819 19:14:37.649023 719822 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0819 19:14:37.651145 719822 out.go:177] * Enabled addons: cloud-spanner, storage-provisioner-rancher, volcano, ingress-dns, storage-provisioner, nvidia-device-plugin, metrics-server, inspektor-gadget, yakd, default-storageclass, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth
I0819 19:14:37.653241 719822 addons.go:510] duration metric: took 1m38.387319214s for enable addons: enabled=[cloud-spanner storage-provisioner-rancher volcano ingress-dns storage-provisioner nvidia-device-plugin metrics-server inspektor-gadget yakd default-storageclass volumesnapshots registry csi-hostpath-driver ingress gcp-auth]
I0819 19:14:37.653292 719822 start.go:246] waiting for cluster config update ...
I0819 19:14:37.653318 719822 start.go:255] writing updated cluster config ...
I0819 19:14:37.653669 719822 ssh_runner.go:195] Run: rm -f paused
I0819 19:14:37.994870 719822 start.go:600] kubectl: 1.31.0, cluster: 1.31.0 (minor skew: 0)
I0819 19:14:37.998106 719822 out.go:177] * Done! kubectl is now configured to use "addons-764717" cluster and "default" namespace by default
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
54bbac5fa3417 e2d3313f65753 About a minute ago Exited gadget 5 35005be3bf983 gadget-hhx62
9c0ad0ca1685a 6ef582f3ec844 3 minutes ago Running gcp-auth 0 2a9f02159e3be gcp-auth-89d5ffd79-r2bmj
a71254b93cf54 289a818c8d9c5 3 minutes ago Running controller 0 4100d8bc14ff7 ingress-nginx-controller-bc57996ff-mxrp6
631e39b3e5aff ee6d597e62dc8 3 minutes ago Running csi-snapshotter 0 807c13738fe15 csi-hostpathplugin-8k72f
c4958236d119c 642ded511e141 3 minutes ago Running csi-provisioner 0 807c13738fe15 csi-hostpathplugin-8k72f
afe7c03f92725 922312104da8a 4 minutes ago Running liveness-probe 0 807c13738fe15 csi-hostpathplugin-8k72f
0232247ff48c3 08f6b2990811a 4 minutes ago Running hostpath 0 807c13738fe15 csi-hostpathplugin-8k72f
67455b51ad68f 0107d56dbc0be 4 minutes ago Running node-driver-registrar 0 807c13738fe15 csi-hostpathplugin-8k72f
33af6215c37b5 8b46b1cd48760 4 minutes ago Running admission 0 949d96875181b volcano-admission-77d7d48b68-kmj97
0e79ebf33a62f 9a80d518f102c 4 minutes ago Running csi-attacher 0 bb0951d1aad48 csi-hostpath-attacher-0
b17dcb5c9683f d9c7ad4c226bf 4 minutes ago Running volcano-scheduler 0 572dcc126a33a volcano-scheduler-576bc46687-bbv4d
8650528c15bc4 420193b27261a 4 minutes ago Exited patch 0 352b9de484df3 ingress-nginx-admission-patch-nds9b
3b8dc64fb2c2e 1461903ec4fe9 4 minutes ago Running csi-external-health-monitor-controller 0 807c13738fe15 csi-hostpathplugin-8k72f
9a16362b2aa32 487fa743e1e22 4 minutes ago Running csi-resizer 0 ce7fd3f91ce79 csi-hostpath-resizer-0
5f15faabb7439 420193b27261a 4 minutes ago Exited create 0 e2b3b7313a55f ingress-nginx-admission-create-sfzxn
f155eeae6c5c0 4d1e5c3e97420 4 minutes ago Running volume-snapshot-controller 0 82091d1af5158 snapshot-controller-56fcc65765-khfcv
06bf465249116 1505f556b3a7b 4 minutes ago Running volcano-controllers 0 dafb5a1f11f57 volcano-controllers-56675bb4d5-2pcjc
741b5f3b697ad 77bdba588b953 4 minutes ago Running yakd 0 74c1e8d3e9cd5 yakd-dashboard-67d98fc6b-xmh9p
985a4c502d328 6fed88f43b276 4 minutes ago Running registry 0 e6db8f6d9bcbb registry-6fb4cdfc84-mdlgd
3a366e3785219 95dccb4df54ab 4 minutes ago Running metrics-server 0 fd711e5336261 metrics-server-8988944d9-z27w8
bc6a3a1f03220 4d1e5c3e97420 4 minutes ago Running volume-snapshot-controller 0 462291bbcaead snapshot-controller-56fcc65765-vv4tn
14c884fdff117 3410e1561990a 4 minutes ago Running registry-proxy 0 f940471dad142 registry-proxy-95ls7
b9fbed6dc04f2 53af6e2c4c343 4 minutes ago Running cloud-spanner-emulator 0 2413be816a943 cloud-spanner-emulator-c4bc9b5f8-sp82d
224496d02463e 7ce2150c8929b 4 minutes ago Running local-path-provisioner 0 122df1ba0d1c1 local-path-provisioner-86d989889c-j9b8s
ebb1b741915f8 a9bac31a5be8d 4 minutes ago Running nvidia-device-plugin-ctr 0 2a56650334004 nvidia-device-plugin-daemonset-kvhw5
5ea8442f13eb8 35508c2f890c4 4 minutes ago Running minikube-ingress-dns 0 41ba2ab653398 kube-ingress-dns-minikube
4d7d7d7bf7f77 2437cf7621777 4 minutes ago Running coredns 0 c3b4a11182a1e coredns-6f6b679f8f-jjj55
92e2ec280c809 ba04bb24b9575 4 minutes ago Running storage-provisioner 0 fdcd5ca8dd602 storage-provisioner
19078c79e63a8 6a23fa8fd2b78 4 minutes ago Running kindnet-cni 0 99fbc71ddbe1e kindnet-p7cbv
7a521c239c768 71d55d66fd4ee 4 minutes ago Running kube-proxy 0 3b770d2f472d7 kube-proxy-ffzf6
9859f5ff72b35 fbbbd428abb4d 5 minutes ago Running kube-scheduler 0 78d4024729175 kube-scheduler-addons-764717
9bc55c3ab6b21 27e3830e14027 5 minutes ago Running etcd 0 de91c09959f80 etcd-addons-764717
792c24c65076c fcb0683e6bdbd 5 minutes ago Running kube-controller-manager 0 62536d8b7ca8c kube-controller-manager-addons-764717
df82c63c0408e cd0f0ae0ec9e0 5 minutes ago Running kube-apiserver 0 a621567218fee kube-apiserver-addons-764717
==> containerd <==
Aug 19 19:15:10 addons-764717 containerd[822]: time="2024-08-19T19:15:10.282398737Z" level=info msg="RemoveContainer for \"3ee5fcf6267d79e9e637e6994aee40cf372ef4d3b21cfb038c32bf20b58276d5\" returns successfully"
Aug 19 19:15:54 addons-764717 containerd[822]: time="2024-08-19T19:15:54.469425549Z" level=info msg="RemoveContainer for \"a2048a0e35063c70ff47fbb4d0817d22b280ad1c18b399b7ad7bf93f0718186c\""
Aug 19 19:15:54 addons-764717 containerd[822]: time="2024-08-19T19:15:54.476342724Z" level=info msg="RemoveContainer for \"a2048a0e35063c70ff47fbb4d0817d22b280ad1c18b399b7ad7bf93f0718186c\" returns successfully"
Aug 19 19:15:54 addons-764717 containerd[822]: time="2024-08-19T19:15:54.478515432Z" level=info msg="StopPodSandbox for \"3bbd087458e2ab6227cb05587477f11c860a4defd7553468018ce018b4669d6d\""
Aug 19 19:15:54 addons-764717 containerd[822]: time="2024-08-19T19:15:54.487577170Z" level=info msg="TearDown network for sandbox \"3bbd087458e2ab6227cb05587477f11c860a4defd7553468018ce018b4669d6d\" successfully"
Aug 19 19:15:54 addons-764717 containerd[822]: time="2024-08-19T19:15:54.487752430Z" level=info msg="StopPodSandbox for \"3bbd087458e2ab6227cb05587477f11c860a4defd7553468018ce018b4669d6d\" returns successfully"
Aug 19 19:15:54 addons-764717 containerd[822]: time="2024-08-19T19:15:54.489009412Z" level=info msg="RemovePodSandbox for \"3bbd087458e2ab6227cb05587477f11c860a4defd7553468018ce018b4669d6d\""
Aug 19 19:15:54 addons-764717 containerd[822]: time="2024-08-19T19:15:54.489062072Z" level=info msg="Forcibly stopping sandbox \"3bbd087458e2ab6227cb05587477f11c860a4defd7553468018ce018b4669d6d\""
Aug 19 19:15:54 addons-764717 containerd[822]: time="2024-08-19T19:15:54.497048637Z" level=info msg="TearDown network for sandbox \"3bbd087458e2ab6227cb05587477f11c860a4defd7553468018ce018b4669d6d\" successfully"
Aug 19 19:15:54 addons-764717 containerd[822]: time="2024-08-19T19:15:54.504934968Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"3bbd087458e2ab6227cb05587477f11c860a4defd7553468018ce018b4669d6d\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus."
Aug 19 19:15:54 addons-764717 containerd[822]: time="2024-08-19T19:15:54.505072116Z" level=info msg="RemovePodSandbox \"3bbd087458e2ab6227cb05587477f11c860a4defd7553468018ce018b4669d6d\" returns successfully"
Aug 19 19:16:30 addons-764717 containerd[822]: time="2024-08-19T19:16:30.400280273Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.31.0@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc\""
Aug 19 19:16:30 addons-764717 containerd[822]: time="2024-08-19T19:16:30.525019409Z" level=info msg="ImageUpdate event name:\"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}"
Aug 19 19:16:30 addons-764717 containerd[822]: time="2024-08-19T19:16:30.527239295Z" level=info msg="stop pulling image ghcr.io/inspektor-gadget/inspektor-gadget@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc: active requests=0, bytes read=89"
Aug 19 19:16:30 addons-764717 containerd[822]: time="2024-08-19T19:16:30.530819835Z" level=info msg="Pulled image \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.31.0@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc\" with image id \"sha256:e2d3313f65753f82428cf312f6e4b9237983de19680bde57ca1c0935cadbe630\", repo tag \"\", repo digest \"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc\", size \"69907666\" in 130.483046ms"
Aug 19 19:16:30 addons-764717 containerd[822]: time="2024-08-19T19:16:30.531006204Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.31.0@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc\" returns image reference \"sha256:e2d3313f65753f82428cf312f6e4b9237983de19680bde57ca1c0935cadbe630\""
Aug 19 19:16:30 addons-764717 containerd[822]: time="2024-08-19T19:16:30.533193394Z" level=info msg="CreateContainer within sandbox \"35005be3bf983e20829c0d1fd864f9a9b405c0356f76e1ea270f417545a279c8\" for container &ContainerMetadata{Name:gadget,Attempt:5,}"
Aug 19 19:16:30 addons-764717 containerd[822]: time="2024-08-19T19:16:30.552926426Z" level=info msg="CreateContainer within sandbox \"35005be3bf983e20829c0d1fd864f9a9b405c0356f76e1ea270f417545a279c8\" for &ContainerMetadata{Name:gadget,Attempt:5,} returns container id \"54bbac5fa3417d1aa58135db4a912b6d3e7ec0f38c9bd50dcb887b9dc7086d85\""
Aug 19 19:16:30 addons-764717 containerd[822]: time="2024-08-19T19:16:30.553762489Z" level=info msg="StartContainer for \"54bbac5fa3417d1aa58135db4a912b6d3e7ec0f38c9bd50dcb887b9dc7086d85\""
Aug 19 19:16:30 addons-764717 containerd[822]: time="2024-08-19T19:16:30.608351599Z" level=info msg="StartContainer for \"54bbac5fa3417d1aa58135db4a912b6d3e7ec0f38c9bd50dcb887b9dc7086d85\" returns successfully"
Aug 19 19:16:31 addons-764717 containerd[822]: time="2024-08-19T19:16:31.905295890Z" level=info msg="shim disconnected" id=54bbac5fa3417d1aa58135db4a912b6d3e7ec0f38c9bd50dcb887b9dc7086d85 namespace=k8s.io
Aug 19 19:16:31 addons-764717 containerd[822]: time="2024-08-19T19:16:31.905359455Z" level=warning msg="cleaning up after shim disconnected" id=54bbac5fa3417d1aa58135db4a912b6d3e7ec0f38c9bd50dcb887b9dc7086d85 namespace=k8s.io
Aug 19 19:16:31 addons-764717 containerd[822]: time="2024-08-19T19:16:31.905369580Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Aug 19 19:16:32 addons-764717 containerd[822]: time="2024-08-19T19:16:32.529396920Z" level=info msg="RemoveContainer for \"c1daa53c5907bfccb3e5cbe45e2c5463cf7b6bc57788c27351f3edf4a702139b\""
Aug 19 19:16:32 addons-764717 containerd[822]: time="2024-08-19T19:16:32.536517490Z" level=info msg="RemoveContainer for \"c1daa53c5907bfccb3e5cbe45e2c5463cf7b6bc57788c27351f3edf4a702139b\" returns successfully"
==> coredns [4d7d7d7bf7f777a14f84d05997cd89b11923e6c54ec5b8f24bf684644f0d9cfb] <==
[INFO] 10.244.0.6:34353 - 32254 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000049837s
[INFO] 10.244.0.6:53540 - 9585 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001268493s
[INFO] 10.244.0.6:53540 - 13132 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001709269s
[INFO] 10.244.0.6:43611 - 2271 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000072492s
[INFO] 10.244.0.6:43611 - 46800 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000040336s
[INFO] 10.244.0.6:57157 - 62079 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000104073s
[INFO] 10.244.0.6:57157 - 16251 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000041206s
[INFO] 10.244.0.6:43437 - 1227 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000062137s
[INFO] 10.244.0.6:43437 - 11721 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.00003968s
[INFO] 10.244.0.6:36769 - 51858 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000079925s
[INFO] 10.244.0.6:36769 - 44176 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000035298s
[INFO] 10.244.0.6:45130 - 349 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.004525375s
[INFO] 10.244.0.6:45130 - 4699 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.004350943s
[INFO] 10.244.0.6:60243 - 25351 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000092208s
[INFO] 10.244.0.6:60243 - 53765 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000133037s
[INFO] 10.244.0.24:41913 - 54643 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.002047727s
[INFO] 10.244.0.24:59562 - 29270 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.001633979s
[INFO] 10.244.0.24:36517 - 24961 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000175005s
[INFO] 10.244.0.24:54438 - 49582 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000068168s
[INFO] 10.244.0.24:55672 - 59947 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000115929s
[INFO] 10.244.0.24:58838 - 3410 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000078654s
[INFO] 10.244.0.24:45525 - 19045 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.00260266s
[INFO] 10.244.0.24:48927 - 47988 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002191759s
[INFO] 10.244.0.24:45490 - 57748 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.001046874s
[INFO] 10.244.0.24:45382 - 13901 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 610 0.001361982s
==> describe nodes <==
Name: addons-764717
Roles: control-plane
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=addons-764717
kubernetes.io/os=linux
minikube.k8s.io/commit=9c2db9d51ec33b5c53a86e9ba3d384ee332e3411
minikube.k8s.io/name=addons-764717
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_08_19T19_12_55_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-764717
Annotations: csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-764717"}
kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Mon, 19 Aug 2024 19:12:51 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-764717
AcquireTime: <unset>
RenewTime: Mon, 19 Aug 2024 19:17:50 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Mon, 19 Aug 2024 19:14:57 +0000 Mon, 19 Aug 2024 19:12:48 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Mon, 19 Aug 2024 19:14:57 +0000 Mon, 19 Aug 2024 19:12:48 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Mon, 19 Aug 2024 19:14:57 +0000 Mon, 19 Aug 2024 19:12:48 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Mon, 19 Aug 2024 19:14:57 +0000 Mon, 19 Aug 2024 19:12:52 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-764717
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022360Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022360Ki
pods: 110
System Info:
Machine ID: dec7470a8d254b009288db96caa2080c
System UUID: a62f7dfa-a4b7-4e8d-9913-2a9ceb562e58
Boot ID: 6e682a37-9512-4f3a-882d-7e45a79a9483
Kernel Version: 5.15.0-1067-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.20
Kubelet Version: v1.31.0
Kube-Proxy Version:
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (27 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default cloud-spanner-emulator-c4bc9b5f8-sp82d 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m54s
gadget gadget-hhx62 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m50s
gcp-auth gcp-auth-89d5ffd79-r2bmj 0 (0%) 0 (0%) 0 (0%) 0 (0%) 3m22s
ingress-nginx ingress-nginx-controller-bc57996ff-mxrp6 100m (5%) 0 (0%) 90Mi (1%) 0 (0%) 4m48s
kube-system coredns-6f6b679f8f-jjj55 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 4m57s
kube-system csi-hostpath-attacher-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m46s
kube-system csi-hostpath-resizer-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m46s
kube-system csi-hostpathplugin-8k72f 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m46s
kube-system etcd-addons-764717 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 5m2s
kube-system kindnet-p7cbv 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 4m58s
kube-system kube-apiserver-addons-764717 250m (12%) 0 (0%) 0 (0%) 0 (0%) 5m2s
kube-system kube-controller-manager-addons-764717 200m (10%) 0 (0%) 0 (0%) 0 (0%) 5m2s
kube-system kube-ingress-dns-minikube 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m52s
kube-system kube-proxy-ffzf6 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m58s
kube-system kube-scheduler-addons-764717 100m (5%) 0 (0%) 0 (0%) 0 (0%) 5m2s
kube-system metrics-server-8988944d9-z27w8 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 4m51s
kube-system nvidia-device-plugin-daemonset-kvhw5 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m55s
kube-system registry-6fb4cdfc84-mdlgd 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m52s
kube-system registry-proxy-95ls7 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m52s
kube-system snapshot-controller-56fcc65765-khfcv 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m50s
kube-system snapshot-controller-56fcc65765-vv4tn 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m50s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m53s
local-path-storage local-path-provisioner-86d989889c-j9b8s 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m52s
volcano-system volcano-admission-77d7d48b68-kmj97 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m48s
volcano-system volcano-controllers-56675bb4d5-2pcjc 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m47s
volcano-system volcano-scheduler-576bc46687-bbv4d 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m47s
yakd-dashboard yakd-dashboard-67d98fc6b-xmh9p 0 (0%) 0 (0%) 128Mi (1%) 256Mi (3%) 4m51s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 1050m (52%) 100m (5%)
memory 638Mi (8%) 476Mi (6%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 4m56s kube-proxy
Normal NodeHasSufficientMemory 5m10s (x8 over 5m10s) kubelet Node addons-764717 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m10s (x7 over 5m10s) kubelet Node addons-764717 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m10s (x7 over 5m10s) kubelet Node addons-764717 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 5m10s kubelet Updated Node Allocatable limit across pods
Normal Starting 5m2s kubelet Starting kubelet.
Warning CgroupV1 5m2s kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeAllocatableEnforced 5m2s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 5m2s kubelet Node addons-764717 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m2s kubelet Node addons-764717 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m2s kubelet Node addons-764717 status is now: NodeHasSufficientPID
Normal RegisteredNode 4m58s node-controller Node addons-764717 event: Registered Node addons-764717 in Controller
==> dmesg <==
[Aug19 18:13] systemd-journald[216]: Failed to send stream file descriptor to service manager: Connection refused
[Aug19 18:44] overlayfs: '/var/lib/docker/overlay2/l/WCSESTVH3U25P3IZ5LAJCY2BWZ' not a directory
==> etcd [9bc55c3ab6b21e5549e1ba1269adb8b921905a3c94c6d170d70e4eb031132e69] <==
{"level":"info","ts":"2024-08-19T19:12:47.722579Z","caller":"embed/etcd.go:870","msg":"serving metrics","address":"http://127.0.0.1:2381"}
{"level":"info","ts":"2024-08-19T19:12:47.722648Z","caller":"embed/etcd.go:599","msg":"serving peer traffic","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-08-19T19:12:47.722658Z","caller":"embed/etcd.go:571","msg":"cmux::serve","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-08-19T19:12:47.730473Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc switched to configuration voters=(12593026477526642892)"}
{"level":"info","ts":"2024-08-19T19:12:47.733696Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","added-peer-id":"aec36adc501070cc","added-peer-peer-urls":["https://192.168.49.2:2380"]}
{"level":"info","ts":"2024-08-19T19:12:47.985632Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
{"level":"info","ts":"2024-08-19T19:12:47.985838Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
{"level":"info","ts":"2024-08-19T19:12:47.985935Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
{"level":"info","ts":"2024-08-19T19:12:47.986042Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
{"level":"info","ts":"2024-08-19T19:12:47.986117Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-08-19T19:12:47.986209Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
{"level":"info","ts":"2024-08-19T19:12:47.986277Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-08-19T19:12:47.993802Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-764717 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
{"level":"info","ts":"2024-08-19T19:12:47.995820Z","caller":"etcdserver/server.go:2629","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-08-19T19:12:47.996064Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-08-19T19:12:47.996446Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-08-19T19:12:47.997040Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-08-19T19:12:47.997140Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-08-19T19:12:47.997263Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
{"level":"info","ts":"2024-08-19T19:12:47.997455Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-08-19T19:12:47.997573Z","caller":"etcdserver/server.go:2653","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2024-08-19T19:12:47.998070Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-08-19T19:12:47.999133Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-08-19T19:12:47.999935Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-08-19T19:12:48.006588Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
==> gcp-auth [9c0ad0ca1685a01ce9ee71924b42e74e8cf57629057346b900a5b323759fa121] <==
2024/08/19 19:14:36 GCP Auth Webhook started!
2024/08/19 19:14:54 Ready to marshal response ...
2024/08/19 19:14:54 Ready to write response ...
2024/08/19 19:14:55 Ready to marshal response ...
2024/08/19 19:14:55 Ready to write response ...
==> kernel <==
19:17:57 up 3:00, 0 users, load average: 0.35, 1.57, 2.65
Linux addons-764717 5.15.0-1067-aws #73~20.04.1-Ubuntu SMP Wed Jul 24 17:31:05 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [19078c79e63a87d96a4a8501f3c93a1e8436ec9627a05c33a785226f994b44eb] <==
E0819 19:16:44.436269 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
W0819 19:16:51.426047 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0819 19:16:51.426242 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0819 19:16:52.230533 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0819 19:16:52.230746 1 main.go:299] handling current node
I0819 19:17:02.230655 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0819 19:17:02.230767 1 main.go:299] handling current node
I0819 19:17:12.230560 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0819 19:17:12.230654 1 main.go:299] handling current node
I0819 19:17:22.230864 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0819 19:17:22.230910 1 main.go:299] handling current node
W0819 19:17:22.337026 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0819 19:17:22.337058 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
W0819 19:17:24.188795 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0819 19:17:24.188829 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
W0819 19:17:32.120932 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0819 19:17:32.121075 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
I0819 19:17:32.230252 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0819 19:17:32.230290 1 main.go:299] handling current node
I0819 19:17:42.230644 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0819 19:17:42.230695 1 main.go:299] handling current node
I0819 19:17:52.230223 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0819 19:17:52.230258 1 main.go:299] handling current node
W0819 19:17:53.147622 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0819 19:17:53.147695 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
==> kube-apiserver [df82c63c0408e8a5c696a5f1f7661018468d7ff271cf35a213f79106d24094b1] <==
Error updating APIService "v1beta1.metrics.k8s.io" with err: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
> logger="UnhandledError"
E0819 19:13:45.734692 1 remote_available_controller.go:448] "Unhandled Error" err="v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.108.249.178:443/apis/metrics.k8s.io/v1beta1: Get \"https://10.108.249.178:443/apis/metrics.k8s.io/v1beta1\": dial tcp 10.108.249.178:443: connect: connection refused" logger="UnhandledError"
I0819 19:13:45.841030 1 handler.go:286] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
W0819 19:13:50.597879 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.94.11:443: connect: connection refused
W0819 19:13:51.625345 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.94.11:443: connect: connection refused
W0819 19:13:52.723054 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.94.11:443: connect: connection refused
W0819 19:13:53.760912 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.94.11:443: connect: connection refused
W0819 19:13:53.950570 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.108.95.114:443: connect: connection refused
E0819 19:13:53.950619 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.108.95.114:443: connect: connection refused" logger="UnhandledError"
W0819 19:13:53.952423 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.106.94.11:443: connect: connection refused
W0819 19:13:54.815705 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.94.11:443: connect: connection refused
W0819 19:13:55.841178 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.94.11:443: connect: connection refused
W0819 19:13:56.924927 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.94.11:443: connect: connection refused
W0819 19:13:57.989205 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.94.11:443: connect: connection refused
W0819 19:13:59.035401 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.106.94.11:443: connect: connection refused
W0819 19:14:14.935764 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.108.95.114:443: connect: connection refused
E0819 19:14:14.935801 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.108.95.114:443: connect: connection refused" logger="UnhandledError"
W0819 19:14:14.983993 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.108.95.114:443: connect: connection refused
E0819 19:14:14.984031 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.108.95.114:443: connect: connection refused" logger="UnhandledError"
W0819 19:14:34.917680 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.108.95.114:443: connect: connection refused
E0819 19:14:34.917720 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.108.95.114:443: connect: connection refused" logger="UnhandledError"
I0819 19:14:54.567107 1 controller.go:615] quota admission added evaluator for: jobs.batch.volcano.sh
I0819 19:14:54.613326 1 controller.go:615] quota admission added evaluator for: podgroups.scheduling.volcano.sh
==> kube-controller-manager [792c24c65076cf5fb69f909f0075b39e179d0225fd83ba6baff250fbe20be90b] <==
I0819 19:14:18.385304 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0819 19:14:19.077715 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0819 19:14:19.092946 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0819 19:14:19.105461 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0819 19:14:19.107673 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0819 19:14:19.129804 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="ingress-nginx/ingress-nginx-controller-bc57996ff" duration="70.326µs"
I0819 19:14:19.243000 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0819 19:14:20.116113 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0819 19:14:20.124473 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0819 19:14:20.132482 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0819 19:14:26.648090 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-764717"
I0819 19:14:32.373712 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="ingress-nginx/ingress-nginx-controller-bc57996ff" duration="18.474609ms"
I0819 19:14:32.374030 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="ingress-nginx/ingress-nginx-controller-bc57996ff" duration="86.957µs"
I0819 19:14:34.950767 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="35.645009ms"
I0819 19:14:34.959919 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="8.924762ms"
I0819 19:14:34.960234 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="77.702µs"
I0819 19:14:34.970794 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="50.388µs"
I0819 19:14:37.198651 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="17.580119ms"
I0819 19:14:37.199948 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="40.73µs"
I0819 19:14:49.024944 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0819 19:14:49.061100 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0819 19:14:50.018771 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0819 19:14:50.063898 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0819 19:14:54.248244 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="volcano-system/volcano-admission-init" delay="0s"
I0819 19:14:57.233992 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-764717"
==> kube-proxy [7a521c239c7683077504245bc1823bddd78ea79bed710602c4939e7668695234] <==
I0819 19:13:00.398065 1 server_linux.go:66] "Using iptables proxy"
I0819 19:13:00.539870 1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
E0819 19:13:00.539937 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I0819 19:13:00.631843 1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I0819 19:13:00.631902 1 server_linux.go:169] "Using iptables Proxier"
I0819 19:13:00.634903 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I0819 19:13:00.635351 1 server.go:483] "Version info" version="v1.31.0"
I0819 19:13:00.635377 1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0819 19:13:00.642855 1 config.go:197] "Starting service config controller"
I0819 19:13:00.642879 1 shared_informer.go:313] Waiting for caches to sync for service config
I0819 19:13:00.642898 1 config.go:326] "Starting node config controller"
I0819 19:13:00.642910 1 shared_informer.go:313] Waiting for caches to sync for node config
I0819 19:13:00.642914 1 config.go:104] "Starting endpoint slice config controller"
I0819 19:13:00.642919 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0819 19:13:00.743316 1 shared_informer.go:320] Caches are synced for node config
I0819 19:13:00.743577 1 shared_informer.go:320] Caches are synced for endpoint slice config
I0819 19:13:00.743625 1 shared_informer.go:320] Caches are synced for service config
==> kube-scheduler [9859f5ff72b3571c6beea26b72108f1a372219374a492e384f22accad01f1356] <==
E0819 19:12:51.912718 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0819 19:12:51.912915 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0819 19:12:51.913010 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0819 19:12:51.911184 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0819 19:12:51.913177 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0819 19:12:51.911222 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
E0819 19:12:51.913265 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0819 19:12:51.913395 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0819 19:12:51.913416 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0819 19:12:51.913528 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0819 19:12:51.913572 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0819 19:12:51.913715 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0819 19:12:51.913756 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
E0819 19:12:51.913057 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0819 19:12:51.913877 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0819 19:12:51.913899 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0819 19:12:51.913986 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0819 19:12:51.914116 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0819 19:12:51.915192 1 reflector.go:561] runtime/asm_arm64.s:1222: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0819 19:12:51.915221 1 reflector.go:158] "Unhandled Error" err="runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"
W0819 19:12:52.748153 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0819 19:12:52.748395 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0819 19:12:52.805887 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0819 19:12:52.806005 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
I0819 19:12:53.303903 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Aug 19 19:16:19 addons-764717 kubelet[1488]: I0819 19:16:19.398997 1488 scope.go:117] "RemoveContainer" containerID="c1daa53c5907bfccb3e5cbe45e2c5463cf7b6bc57788c27351f3edf4a702139b"
Aug 19 19:16:19 addons-764717 kubelet[1488]: E0819 19:16:19.399204 1488 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=gadget pod=gadget-hhx62_gadget(7c1eea9a-ce28-4d01-9430-a2a295695f96)\"" pod="gadget/gadget-hhx62" podUID="7c1eea9a-ce28-4d01-9430-a2a295695f96"
Aug 19 19:16:30 addons-764717 kubelet[1488]: I0819 19:16:30.399194 1488 scope.go:117] "RemoveContainer" containerID="c1daa53c5907bfccb3e5cbe45e2c5463cf7b6bc57788c27351f3edf4a702139b"
Aug 19 19:16:32 addons-764717 kubelet[1488]: I0819 19:16:32.527091 1488 scope.go:117] "RemoveContainer" containerID="c1daa53c5907bfccb3e5cbe45e2c5463cf7b6bc57788c27351f3edf4a702139b"
Aug 19 19:16:32 addons-764717 kubelet[1488]: I0819 19:16:32.527834 1488 scope.go:117] "RemoveContainer" containerID="54bbac5fa3417d1aa58135db4a912b6d3e7ec0f38c9bd50dcb887b9dc7086d85"
Aug 19 19:16:32 addons-764717 kubelet[1488]: E0819 19:16:32.528132 1488 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-hhx62_gadget(7c1eea9a-ce28-4d01-9430-a2a295695f96)\"" pod="gadget/gadget-hhx62" podUID="7c1eea9a-ce28-4d01-9430-a2a295695f96"
Aug 19 19:16:33 addons-764717 kubelet[1488]: I0819 19:16:33.531615 1488 scope.go:117] "RemoveContainer" containerID="54bbac5fa3417d1aa58135db4a912b6d3e7ec0f38c9bd50dcb887b9dc7086d85"
Aug 19 19:16:33 addons-764717 kubelet[1488]: E0819 19:16:33.531787 1488 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-hhx62_gadget(7c1eea9a-ce28-4d01-9430-a2a295695f96)\"" pod="gadget/gadget-hhx62" podUID="7c1eea9a-ce28-4d01-9430-a2a295695f96"
Aug 19 19:16:34 addons-764717 kubelet[1488]: I0819 19:16:34.534563 1488 scope.go:117] "RemoveContainer" containerID="54bbac5fa3417d1aa58135db4a912b6d3e7ec0f38c9bd50dcb887b9dc7086d85"
Aug 19 19:16:34 addons-764717 kubelet[1488]: E0819 19:16:34.534764 1488 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-hhx62_gadget(7c1eea9a-ce28-4d01-9430-a2a295695f96)\"" pod="gadget/gadget-hhx62" podUID="7c1eea9a-ce28-4d01-9430-a2a295695f96"
Aug 19 19:16:46 addons-764717 kubelet[1488]: I0819 19:16:46.399103 1488 scope.go:117] "RemoveContainer" containerID="54bbac5fa3417d1aa58135db4a912b6d3e7ec0f38c9bd50dcb887b9dc7086d85"
Aug 19 19:16:46 addons-764717 kubelet[1488]: E0819 19:16:46.399309 1488 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-hhx62_gadget(7c1eea9a-ce28-4d01-9430-a2a295695f96)\"" pod="gadget/gadget-hhx62" podUID="7c1eea9a-ce28-4d01-9430-a2a295695f96"
Aug 19 19:17:00 addons-764717 kubelet[1488]: I0819 19:17:00.400696 1488 scope.go:117] "RemoveContainer" containerID="54bbac5fa3417d1aa58135db4a912b6d3e7ec0f38c9bd50dcb887b9dc7086d85"
Aug 19 19:17:00 addons-764717 kubelet[1488]: E0819 19:17:00.400944 1488 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-hhx62_gadget(7c1eea9a-ce28-4d01-9430-a2a295695f96)\"" pod="gadget/gadget-hhx62" podUID="7c1eea9a-ce28-4d01-9430-a2a295695f96"
Aug 19 19:17:12 addons-764717 kubelet[1488]: I0819 19:17:12.398538 1488 scope.go:117] "RemoveContainer" containerID="54bbac5fa3417d1aa58135db4a912b6d3e7ec0f38c9bd50dcb887b9dc7086d85"
Aug 19 19:17:12 addons-764717 kubelet[1488]: E0819 19:17:12.399228 1488 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-hhx62_gadget(7c1eea9a-ce28-4d01-9430-a2a295695f96)\"" pod="gadget/gadget-hhx62" podUID="7c1eea9a-ce28-4d01-9430-a2a295695f96"
Aug 19 19:17:17 addons-764717 kubelet[1488]: I0819 19:17:17.398978 1488 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-6fb4cdfc84-mdlgd" secret="" err="secret \"gcp-auth\" not found"
Aug 19 19:17:23 addons-764717 kubelet[1488]: I0819 19:17:23.398627 1488 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-kvhw5" secret="" err="secret \"gcp-auth\" not found"
Aug 19 19:17:23 addons-764717 kubelet[1488]: I0819 19:17:23.399532 1488 scope.go:117] "RemoveContainer" containerID="54bbac5fa3417d1aa58135db4a912b6d3e7ec0f38c9bd50dcb887b9dc7086d85"
Aug 19 19:17:23 addons-764717 kubelet[1488]: E0819 19:17:23.399762 1488 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-hhx62_gadget(7c1eea9a-ce28-4d01-9430-a2a295695f96)\"" pod="gadget/gadget-hhx62" podUID="7c1eea9a-ce28-4d01-9430-a2a295695f96"
Aug 19 19:17:25 addons-764717 kubelet[1488]: I0819 19:17:25.398721 1488 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-95ls7" secret="" err="secret \"gcp-auth\" not found"
Aug 19 19:17:37 addons-764717 kubelet[1488]: I0819 19:17:37.398655 1488 scope.go:117] "RemoveContainer" containerID="54bbac5fa3417d1aa58135db4a912b6d3e7ec0f38c9bd50dcb887b9dc7086d85"
Aug 19 19:17:37 addons-764717 kubelet[1488]: E0819 19:17:37.398971 1488 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-hhx62_gadget(7c1eea9a-ce28-4d01-9430-a2a295695f96)\"" pod="gadget/gadget-hhx62" podUID="7c1eea9a-ce28-4d01-9430-a2a295695f96"
Aug 19 19:17:48 addons-764717 kubelet[1488]: I0819 19:17:48.398959 1488 scope.go:117] "RemoveContainer" containerID="54bbac5fa3417d1aa58135db4a912b6d3e7ec0f38c9bd50dcb887b9dc7086d85"
Aug 19 19:17:48 addons-764717 kubelet[1488]: E0819 19:17:48.399666 1488 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-hhx62_gadget(7c1eea9a-ce28-4d01-9430-a2a295695f96)\"" pod="gadget/gadget-hhx62" podUID="7c1eea9a-ce28-4d01-9430-a2a295695f96"
==> storage-provisioner [92e2ec280c809c1dc567a5125c5f478c5f8c12329f8cb1da0a817608b0522a93] <==
I0819 19:13:04.818644 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0819 19:13:04.832573 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0819 19:13:04.832622 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0819 19:13:04.844878 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0819 19:13:04.845051 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-764717_8513f15c-2007-4084-a505-28ff7a064b16!
I0819 19:13:04.846105 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"80ad29e5-123b-41ca-9cd2-4a9a62b5031c", APIVersion:"v1", ResourceVersion:"548", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-764717_8513f15c-2007-4084-a505-28ff7a064b16 became leader
I0819 19:13:04.945578 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-764717_8513f15c-2007-4084-a505-28ff7a064b16!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-764717 -n addons-764717
helpers_test.go:261: (dbg) Run: kubectl --context addons-764717 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: ingress-nginx-admission-create-sfzxn ingress-nginx-admission-patch-nds9b test-job-nginx-0
helpers_test.go:274: ======> post-mortem[TestAddons/serial/Volcano]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-764717 describe pod ingress-nginx-admission-create-sfzxn ingress-nginx-admission-patch-nds9b test-job-nginx-0
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-764717 describe pod ingress-nginx-admission-create-sfzxn ingress-nginx-admission-patch-nds9b test-job-nginx-0: exit status 1 (91.049266ms)
** stderr **
Error from server (NotFound): pods "ingress-nginx-admission-create-sfzxn" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-nds9b" not found
Error from server (NotFound): pods "test-job-nginx-0" not found
** /stderr **
helpers_test.go:279: kubectl --context addons-764717 describe pod ingress-nginx-admission-create-sfzxn ingress-nginx-admission-patch-nds9b test-job-nginx-0: exit status 1
--- FAIL: TestAddons/serial/Volcano (200.25s)