=== RUN TestAddons/serial/Volcano
addons_test.go:913: volcano-controller stabilized in 54.14946ms
addons_test.go:897: volcano-scheduler stabilized in 55.36699ms
addons_test.go:905: volcano-admission stabilized in 55.782784ms
addons_test.go:919: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-scheduler-576bc46687-tn2vq" [3bd2a4dc-d1e6-45c3-b261-e9bc89f21c0d] Running
addons_test.go:919: (dbg) TestAddons/serial/Volcano: app=volcano-scheduler healthy within 6.003709391s
addons_test.go:923: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-admission-77d7d48b68-zbqv2" [7cc58b74-b0d7-4b94-b2c3-4638247a41c9] Running
addons_test.go:923: (dbg) TestAddons/serial/Volcano: app=volcano-admission healthy within 5.004476888s
addons_test.go:927: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-controllers-56675bb4d5-zg8pg" [b55bd087-c4e6-428d-905e-b727d242fbf2] Running
addons_test.go:927: (dbg) TestAddons/serial/Volcano: app=volcano-controller healthy within 5.004254037s
addons_test.go:932: (dbg) Run: kubectl --context addons-630724 delete -n volcano-system job volcano-admission-init
addons_test.go:938: (dbg) Run: kubectl --context addons-630724 create -f testdata/vcjob.yaml
addons_test.go:946: (dbg) Run: kubectl --context addons-630724 get vcjob -n my-volcano
addons_test.go:964: (dbg) TestAddons/serial/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...
helpers_test.go:344: "test-job-nginx-0" [500faad8-af2e-44b1-96d1-7e476b971174] Pending
helpers_test.go:344: "test-job-nginx-0" [500faad8-af2e-44b1-96d1-7e476b971174] Pending: PodScheduled:Unschedulable (0/1 nodes are unavailable: 1 Insufficient cpu.)
helpers_test.go:329: TestAddons/serial/Volcano: WARNING: pod list for "my-volcano" "volcano.sh/job-name=test-job" returned: client rate limiter Wait returned an error: context deadline exceeded
addons_test.go:964: ***** TestAddons/serial/Volcano: pod "volcano.sh/job-name=test-job" failed to start within 3m0s: context deadline exceeded ****
addons_test.go:964: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-630724 -n addons-630724
addons_test.go:964: TestAddons/serial/Volcano: showing logs for failed pods as of 2024-09-09 11:49:00.687284917 +0000 UTC m=+430.896797380
addons_test.go:964: (dbg) Run: kubectl --context addons-630724 describe po test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-630724 describe po test-job-nginx-0 -n my-volcano:
Name: test-job-nginx-0
Namespace: my-volcano
Priority: 0
Service Account: default
Node: <none>
Labels: volcano.sh/job-name=test-job
volcano.sh/job-namespace=my-volcano
volcano.sh/queue-name=test
volcano.sh/task-index=0
volcano.sh/task-spec=nginx
Annotations: scheduling.k8s.io/group-name: test-job-78115208-2aa9-47be-abfe-2b71bb87f399
volcano.sh/job-name: test-job
volcano.sh/job-version: 0
volcano.sh/queue-name: test
volcano.sh/task-index: 0
volcano.sh/task-spec: nginx
volcano.sh/template-uid: test-job-nginx
Status: Pending
IP:
IPs: <none>
Controlled By: Job/test-job
Containers:
nginx:
Image: nginx:latest
Port: <none>
Host Port: <none>
Command:
sleep
10m
Limits:
cpu: 1
Requests:
cpu: 1
Environment:
GOOGLE_APPLICATION_CREDENTIALS: /google-app-creds.json
PROJECT_ID: this_is_fake
GCP_PROJECT: this_is_fake
GCLOUD_PROJECT: this_is_fake
GOOGLE_CLOUD_PROJECT: this_is_fake
CLOUDSDK_CORE_PROJECT: this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-tjfmt (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
kube-api-access-tjfmt:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
gcp-creds:
Type: HostPath (bare host directory volume)
Path: /var/lib/minikube/google_application_credentials.json
HostPathType: File
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling 2m59s volcano 0/1 nodes are unavailable: 1 Insufficient cpu.
addons_test.go:964: (dbg) Run: kubectl --context addons-630724 logs test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-630724 logs test-job-nginx-0 -n my-volcano:
addons_test.go:965: failed waiting for test-local-path pod: volcano.sh/job-name=test-job within 3m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestAddons/serial/Volcano]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect addons-630724
helpers_test.go:235: (dbg) docker inspect addons-630724:
-- stdout --
[
{
"Id": "ffb39066bf457a915c79fe74d19fc4f6c9eadb082c1a7b3da50c45a71441d501",
"Created": "2024-09-09T11:42:30.901786712Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 299996,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-09-09T11:42:31.074473704Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:8411aacd61cb8f2a7ae48c92e2c9e76ad4dd701b3dba8b30393c5cc31fbd2b15",
"ResolvConfPath": "/var/lib/docker/containers/ffb39066bf457a915c79fe74d19fc4f6c9eadb082c1a7b3da50c45a71441d501/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/ffb39066bf457a915c79fe74d19fc4f6c9eadb082c1a7b3da50c45a71441d501/hostname",
"HostsPath": "/var/lib/docker/containers/ffb39066bf457a915c79fe74d19fc4f6c9eadb082c1a7b3da50c45a71441d501/hosts",
"LogPath": "/var/lib/docker/containers/ffb39066bf457a915c79fe74d19fc4f6c9eadb082c1a7b3da50c45a71441d501/ffb39066bf457a915c79fe74d19fc4f6c9eadb082c1a7b3da50c45a71441d501-json.log",
"Name": "/addons-630724",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"addons-630724:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "addons-630724",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4194304000,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8388608000,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/8c275e2cd3941a29da9f4c3c61bc106fde134dc4d5f48b00458a95a4c6de165a-init/diff:/var/lib/docker/overlay2/814fb589cbf56b8fd633abdb6968243e97b9bab300625366d76f729b25701844/diff",
"MergedDir": "/var/lib/docker/overlay2/8c275e2cd3941a29da9f4c3c61bc106fde134dc4d5f48b00458a95a4c6de165a/merged",
"UpperDir": "/var/lib/docker/overlay2/8c275e2cd3941a29da9f4c3c61bc106fde134dc4d5f48b00458a95a4c6de165a/diff",
"WorkDir": "/var/lib/docker/overlay2/8c275e2cd3941a29da9f4c3c61bc106fde134dc4d5f48b00458a95a4c6de165a/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "addons-630724",
"Source": "/var/lib/docker/volumes/addons-630724/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "addons-630724",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-630724",
"name.minikube.sigs.k8s.io": "addons-630724",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "5afbe3ec08842490584039ca414019fc08160a9c478117a6ec489a629073df9c",
"SandboxKey": "/var/run/docker/netns/5afbe3ec0884",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33138"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33139"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33142"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33140"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33141"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"addons-630724": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:31:02",
"DriverOpts": null,
"NetworkID": "0b27d3b67e297d20eeee2b9a9a5586c7d860c25c1b815d5e6d66b8d1b1e155ba",
"EndpointID": "7e274e76f03765cf8635cc90e2c2a03ffec56f9ca339b66fbeefe6ce4fd9d975",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-630724",
"ffb39066bf45"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p addons-630724 -n addons-630724
helpers_test.go:244: <<< TestAddons/serial/Volcano FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/serial/Volcano]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p addons-630724 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-630724 logs -n 25: (1.619353142s)
helpers_test.go:252: TestAddons/serial/Volcano logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| start | -o=json --download-only | download-only-413866 | jenkins | v1.34.0 | 09 Sep 24 11:41 UTC | |
| | -p download-only-413866 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 09 Sep 24 11:41 UTC | 09 Sep 24 11:41 UTC |
| delete | -p download-only-413866 | download-only-413866 | jenkins | v1.34.0 | 09 Sep 24 11:41 UTC | 09 Sep 24 11:41 UTC |
| start | -o=json --download-only | download-only-847638 | jenkins | v1.34.0 | 09 Sep 24 11:41 UTC | |
| | -p download-only-847638 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.31.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 09 Sep 24 11:42 UTC | 09 Sep 24 11:42 UTC |
| delete | -p download-only-847638 | download-only-847638 | jenkins | v1.34.0 | 09 Sep 24 11:42 UTC | 09 Sep 24 11:42 UTC |
| delete | -p download-only-413866 | download-only-413866 | jenkins | v1.34.0 | 09 Sep 24 11:42 UTC | 09 Sep 24 11:42 UTC |
| delete | -p download-only-847638 | download-only-847638 | jenkins | v1.34.0 | 09 Sep 24 11:42 UTC | 09 Sep 24 11:42 UTC |
| start | --download-only -p | download-docker-455370 | jenkins | v1.34.0 | 09 Sep 24 11:42 UTC | |
| | download-docker-455370 | | | | | |
| | --alsologtostderr | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p download-docker-455370 | download-docker-455370 | jenkins | v1.34.0 | 09 Sep 24 11:42 UTC | 09 Sep 24 11:42 UTC |
| start | --download-only -p | binary-mirror-053699 | jenkins | v1.34.0 | 09 Sep 24 11:42 UTC | |
| | binary-mirror-053699 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:41591 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p binary-mirror-053699 | binary-mirror-053699 | jenkins | v1.34.0 | 09 Sep 24 11:42 UTC | 09 Sep 24 11:42 UTC |
| addons | enable dashboard -p | addons-630724 | jenkins | v1.34.0 | 09 Sep 24 11:42 UTC | |
| | addons-630724 | | | | | |
| addons | disable dashboard -p | addons-630724 | jenkins | v1.34.0 | 09 Sep 24 11:42 UTC | |
| | addons-630724 | | | | | |
| start | -p addons-630724 --wait=true | addons-630724 | jenkins | v1.34.0 | 09 Sep 24 11:42 UTC | 09 Sep 24 11:45 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/09/09 11:42:05
Running on machine: ip-172-31-30-239
Binary: Built with gc go1.22.5 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0909 11:42:05.766034 299508 out.go:345] Setting OutFile to fd 1 ...
I0909 11:42:05.766210 299508 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0909 11:42:05.766238 299508 out.go:358] Setting ErrFile to fd 2...
I0909 11:42:05.766257 299508 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0909 11:42:05.766515 299508 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19584-293351/.minikube/bin
I0909 11:42:05.767015 299508 out.go:352] Setting JSON to false
I0909 11:42:05.767895 299508 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":5064,"bootTime":1725877062,"procs":154,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1068-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
I0909 11:42:05.767991 299508 start.go:139] virtualization:
I0909 11:42:05.771252 299508 out.go:177] * [addons-630724] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I0909 11:42:05.774244 299508 out.go:177] - MINIKUBE_LOCATION=19584
I0909 11:42:05.774385 299508 notify.go:220] Checking for updates...
I0909 11:42:05.779500 299508 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0909 11:42:05.782675 299508 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19584-293351/kubeconfig
I0909 11:42:05.786047 299508 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19584-293351/.minikube
I0909 11:42:05.789322 299508 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0909 11:42:05.792081 299508 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0909 11:42:05.794866 299508 driver.go:394] Setting default libvirt URI to qemu:///system
I0909 11:42:05.818773 299508 docker.go:123] docker version: linux-27.2.1:Docker Engine - Community
I0909 11:42:05.818951 299508 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0909 11:42:05.871606 299508 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-09 11:42:05.862180964 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1068-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.2.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:472731909fa34bd7bc9c087e4c27943f9835f111 Expected:472731909fa34bd7bc9c087e4c27943f9835f111} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0909 11:42:05.871718 299508 docker.go:307] overlay module found
I0909 11:42:05.874914 299508 out.go:177] * Using the docker driver based on user configuration
I0909 11:42:05.877686 299508 start.go:297] selected driver: docker
I0909 11:42:05.877704 299508 start.go:901] validating driver "docker" against <nil>
I0909 11:42:05.877718 299508 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0909 11:42:05.878355 299508 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0909 11:42:05.935780 299508 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-09 11:42:05.926673029 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1068-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.2.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:472731909fa34bd7bc9c087e4c27943f9835f111 Expected:472731909fa34bd7bc9c087e4c27943f9835f111} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0909 11:42:05.935954 299508 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0909 11:42:05.936197 299508 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0909 11:42:05.939106 299508 out.go:177] * Using Docker driver with root privileges
I0909 11:42:05.941451 299508 cni.go:84] Creating CNI manager for ""
I0909 11:42:05.941484 299508 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0909 11:42:05.941498 299508 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0909 11:42:05.941587 299508 start.go:340] cluster config:
{Name:addons-630724 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-630724 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: N
etworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 G
PUs: AutoPauseInterval:1m0s}
I0909 11:42:05.946607 299508 out.go:177] * Starting "addons-630724" primary control-plane node in "addons-630724" cluster
I0909 11:42:05.948954 299508 cache.go:121] Beginning downloading kic base image for docker with containerd
I0909 11:42:05.951482 299508 out.go:177] * Pulling base image v0.0.45 ...
I0909 11:42:05.953984 299508 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0909 11:42:05.954041 299508 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19584-293351/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4
I0909 11:42:05.954054 299508 cache.go:56] Caching tarball of preloaded images
I0909 11:42:05.954087 299508 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 in local docker daemon
I0909 11:42:05.954148 299508 preload.go:172] Found /home/jenkins/minikube-integration/19584-293351/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0909 11:42:05.954159 299508 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on containerd
I0909 11:42:05.954534 299508 profile.go:143] Saving config to /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/config.json ...
I0909 11:42:05.954559 299508 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/config.json: {Name:mkc8150b164886927a10ebe7d052ba51fed06395 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0909 11:42:05.969430 299508 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 to local cache
I0909 11:42:05.969563 299508 image.go:63] Checking for gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 in local cache directory
I0909 11:42:05.969588 299508 image.go:66] Found gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 in local cache directory, skipping pull
I0909 11:42:05.969594 299508 image.go:135] gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 exists in cache, skipping pull
I0909 11:42:05.969602 299508 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 as a tarball
I0909 11:42:05.969615 299508 cache.go:162] Loading gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 from local cache
I0909 11:42:23.105251 299508 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 from cached tarball
I0909 11:42:23.105296 299508 cache.go:194] Successfully downloaded all kic artifacts
I0909 11:42:23.105361 299508 start.go:360] acquireMachinesLock for addons-630724: {Name:mk78d6c6d8207ca26f71a24085d773e3b39cb19f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0909 11:42:23.106044 299508 start.go:364] duration metric: took 652.845µs to acquireMachinesLock for "addons-630724"
I0909 11:42:23.106104 299508 start.go:93] Provisioning new machine with config: &{Name:addons-630724 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-630724 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[
] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePa
th: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0909 11:42:23.106190 299508 start.go:125] createHost starting for "" (driver="docker")
I0909 11:42:23.109431 299508 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
I0909 11:42:23.109706 299508 start.go:159] libmachine.API.Create for "addons-630724" (driver="docker")
I0909 11:42:23.109744 299508 client.go:168] LocalClient.Create starting
I0909 11:42:23.109855 299508 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19584-293351/.minikube/certs/ca.pem
I0909 11:42:23.749363 299508 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19584-293351/.minikube/certs/cert.pem
I0909 11:42:24.337395 299508 cli_runner.go:164] Run: docker network inspect addons-630724 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0909 11:42:24.351591 299508 cli_runner.go:211] docker network inspect addons-630724 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0909 11:42:24.351689 299508 network_create.go:284] running [docker network inspect addons-630724] to gather additional debugging logs...
I0909 11:42:24.351714 299508 cli_runner.go:164] Run: docker network inspect addons-630724
W0909 11:42:24.367303 299508 cli_runner.go:211] docker network inspect addons-630724 returned with exit code 1
I0909 11:42:24.367345 299508 network_create.go:287] error running [docker network inspect addons-630724]: docker network inspect addons-630724: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-630724 not found
I0909 11:42:24.367361 299508 network_create.go:289] output of [docker network inspect addons-630724]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-630724 not found
** /stderr **
I0909 11:42:24.367536 299508 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0909 11:42:24.381403 299508 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40017b0870}
I0909 11:42:24.381450 299508 network_create.go:124] attempt to create docker network addons-630724 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0909 11:42:24.381517 299508 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-630724 addons-630724
I0909 11:42:24.454255 299508 network_create.go:108] docker network addons-630724 192.168.49.0/24 created
I0909 11:42:24.454290 299508 kic.go:121] calculated static IP "192.168.49.2" for the "addons-630724" container
I0909 11:42:24.454368 299508 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0909 11:42:24.468677 299508 cli_runner.go:164] Run: docker volume create addons-630724 --label name.minikube.sigs.k8s.io=addons-630724 --label created_by.minikube.sigs.k8s.io=true
I0909 11:42:24.487305 299508 oci.go:103] Successfully created a docker volume addons-630724
I0909 11:42:24.487397 299508 cli_runner.go:164] Run: docker run --rm --name addons-630724-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-630724 --entrypoint /usr/bin/test -v addons-630724:/var gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 -d /var/lib
I0909 11:42:26.610009 299508 cli_runner.go:217] Completed: docker run --rm --name addons-630724-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-630724 --entrypoint /usr/bin/test -v addons-630724:/var gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 -d /var/lib: (2.122564764s)
I0909 11:42:26.610039 299508 oci.go:107] Successfully prepared a docker volume addons-630724
I0909 11:42:26.610069 299508 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0909 11:42:26.610094 299508 kic.go:194] Starting extracting preloaded images to volume ...
I0909 11:42:26.610179 299508 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19584-293351/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-630724:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 -I lz4 -xf /preloaded.tar -C /extractDir
I0909 11:42:30.825212 299508 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19584-293351/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-630724:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 -I lz4 -xf /preloaded.tar -C /extractDir: (4.214988058s)
I0909 11:42:30.825251 299508 kic.go:203] duration metric: took 4.215153316s to extract preloaded images to volume ...
W0909 11:42:30.825416 299508 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0909 11:42:30.825529 299508 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0909 11:42:30.884513 299508 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-630724 --name addons-630724 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-630724 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-630724 --network addons-630724 --ip 192.168.49.2 --volume addons-630724:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85
I0909 11:42:31.261118 299508 cli_runner.go:164] Run: docker container inspect addons-630724 --format={{.State.Running}}
I0909 11:42:31.288605 299508 cli_runner.go:164] Run: docker container inspect addons-630724 --format={{.State.Status}}
I0909 11:42:31.317193 299508 cli_runner.go:164] Run: docker exec addons-630724 stat /var/lib/dpkg/alternatives/iptables
I0909 11:42:31.395671 299508 oci.go:144] the created container "addons-630724" has a running status.
I0909 11:42:31.395701 299508 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19584-293351/.minikube/machines/addons-630724/id_rsa...
I0909 11:42:32.740980 299508 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19584-293351/.minikube/machines/addons-630724/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0909 11:42:32.761249 299508 cli_runner.go:164] Run: docker container inspect addons-630724 --format={{.State.Status}}
I0909 11:42:32.777952 299508 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0909 11:42:32.777976 299508 kic_runner.go:114] Args: [docker exec --privileged addons-630724 chown docker:docker /home/docker/.ssh/authorized_keys]
I0909 11:42:32.836150 299508 cli_runner.go:164] Run: docker container inspect addons-630724 --format={{.State.Status}}
I0909 11:42:32.852718 299508 machine.go:93] provisionDockerMachine start ...
I0909 11:42:32.852834 299508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-630724
I0909 11:42:32.868767 299508 main.go:141] libmachine: Using SSH client type: native
I0909 11:42:32.869046 299508 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0909 11:42:32.869061 299508 main.go:141] libmachine: About to run SSH command:
hostname
I0909 11:42:32.989033 299508 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-630724
I0909 11:42:32.989058 299508 ubuntu.go:169] provisioning hostname "addons-630724"
I0909 11:42:32.989138 299508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-630724
I0909 11:42:33.006001 299508 main.go:141] libmachine: Using SSH client type: native
I0909 11:42:33.006264 299508 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0909 11:42:33.006282 299508 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-630724 && echo "addons-630724" | sudo tee /etc/hostname
I0909 11:42:33.162553 299508 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-630724
I0909 11:42:33.162664 299508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-630724
I0909 11:42:33.180036 299508 main.go:141] libmachine: Using SSH client type: native
I0909 11:42:33.180311 299508 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0909 11:42:33.180335 299508 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-630724' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-630724/g' /etc/hosts;
else
echo '127.0.1.1 addons-630724' | sudo tee -a /etc/hosts;
fi
fi
I0909 11:42:33.301667 299508 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0909 11:42:33.301699 299508 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19584-293351/.minikube CaCertPath:/home/jenkins/minikube-integration/19584-293351/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19584-293351/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19584-293351/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19584-293351/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19584-293351/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19584-293351/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19584-293351/.minikube}
I0909 11:42:33.301775 299508 ubuntu.go:177] setting up certificates
I0909 11:42:33.301785 299508 provision.go:84] configureAuth start
I0909 11:42:33.301870 299508 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-630724
I0909 11:42:33.319873 299508 provision.go:143] copyHostCerts
I0909 11:42:33.319998 299508 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19584-293351/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19584-293351/.minikube/ca.pem (1078 bytes)
I0909 11:42:33.320161 299508 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19584-293351/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19584-293351/.minikube/cert.pem (1123 bytes)
I0909 11:42:33.320336 299508 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19584-293351/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19584-293351/.minikube/key.pem (1679 bytes)
I0909 11:42:33.320413 299508 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19584-293351/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19584-293351/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19584-293351/.minikube/certs/ca-key.pem org=jenkins.addons-630724 san=[127.0.0.1 192.168.49.2 addons-630724 localhost minikube]
I0909 11:42:33.735772 299508 provision.go:177] copyRemoteCerts
I0909 11:42:33.735853 299508 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0909 11:42:33.735900 299508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-630724
I0909 11:42:33.754458 299508 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19584-293351/.minikube/machines/addons-630724/id_rsa Username:docker}
I0909 11:42:33.843635 299508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19584-293351/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0909 11:42:33.869320 299508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19584-293351/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0909 11:42:33.895157 299508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19584-293351/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0909 11:42:33.921236 299508 provision.go:87] duration metric: took 619.429638ms to configureAuth
I0909 11:42:33.921263 299508 ubuntu.go:193] setting minikube options for container-runtime
I0909 11:42:33.921467 299508 config.go:182] Loaded profile config "addons-630724": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0909 11:42:33.921480 299508 machine.go:96] duration metric: took 1.068737418s to provisionDockerMachine
I0909 11:42:33.921487 299508 client.go:171] duration metric: took 10.811738013s to LocalClient.Create
I0909 11:42:33.921504 299508 start.go:167] duration metric: took 10.811800298s to libmachine.API.Create "addons-630724"
I0909 11:42:33.921512 299508 start.go:293] postStartSetup for "addons-630724" (driver="docker")
I0909 11:42:33.921521 299508 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0909 11:42:33.921578 299508 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0909 11:42:33.921617 299508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-630724
I0909 11:42:33.940087 299508 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19584-293351/.minikube/machines/addons-630724/id_rsa Username:docker}
I0909 11:42:34.037216 299508 ssh_runner.go:195] Run: cat /etc/os-release
I0909 11:42:34.041747 299508 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0909 11:42:34.041784 299508 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0909 11:42:34.041800 299508 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0909 11:42:34.041807 299508 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0909 11:42:34.041819 299508 filesync.go:126] Scanning /home/jenkins/minikube-integration/19584-293351/.minikube/addons for local assets ...
I0909 11:42:34.041895 299508 filesync.go:126] Scanning /home/jenkins/minikube-integration/19584-293351/.minikube/files for local assets ...
I0909 11:42:34.041934 299508 start.go:296] duration metric: took 120.415868ms for postStartSetup
I0909 11:42:34.044305 299508 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-630724
I0909 11:42:34.068333 299508 profile.go:143] Saving config to /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/config.json ...
I0909 11:42:34.068638 299508 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0909 11:42:34.068692 299508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-630724
I0909 11:42:34.085909 299508 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19584-293351/.minikube/machines/addons-630724/id_rsa Username:docker}
I0909 11:42:34.170832 299508 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0909 11:42:34.175867 299508 start.go:128] duration metric: took 11.069659214s to createHost
I0909 11:42:34.175892 299508 start.go:83] releasing machines lock for "addons-630724", held for 11.069829388s
I0909 11:42:34.175966 299508 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-630724
I0909 11:42:34.192895 299508 ssh_runner.go:195] Run: cat /version.json
I0909 11:42:34.192930 299508 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0909 11:42:34.192959 299508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-630724
I0909 11:42:34.192971 299508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-630724
I0909 11:42:34.218238 299508 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19584-293351/.minikube/machines/addons-630724/id_rsa Username:docker}
I0909 11:42:34.223559 299508 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19584-293351/.minikube/machines/addons-630724/id_rsa Username:docker}
I0909 11:42:34.430089 299508 ssh_runner.go:195] Run: systemctl --version
I0909 11:42:34.434570 299508 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0909 11:42:34.438901 299508 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0909 11:42:34.465269 299508 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0909 11:42:34.465393 299508 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0909 11:42:34.496110 299508 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0909 11:42:34.496132 299508 start.go:495] detecting cgroup driver to use...
I0909 11:42:34.496186 299508 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0909 11:42:34.496261 299508 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0909 11:42:34.509194 299508 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0909 11:42:34.521088 299508 docker.go:217] disabling cri-docker service (if available) ...
I0909 11:42:34.521205 299508 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0909 11:42:34.535522 299508 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0909 11:42:34.550129 299508 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0909 11:42:34.642356 299508 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0909 11:42:34.738006 299508 docker.go:233] disabling docker service ...
I0909 11:42:34.738081 299508 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0909 11:42:34.758158 299508 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0909 11:42:34.770300 299508 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0909 11:42:34.854658 299508 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0909 11:42:34.946973 299508 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0909 11:42:34.958557 299508 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0909 11:42:34.977076 299508 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0909 11:42:34.988095 299508 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0909 11:42:35.000102 299508 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0909 11:42:35.000183 299508 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0909 11:42:35.010796 299508 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0909 11:42:35.022199 299508 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0909 11:42:35.036342 299508 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0909 11:42:35.052614 299508 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0909 11:42:35.066665 299508 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0909 11:42:35.080698 299508 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0909 11:42:35.092931 299508 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0909 11:42:35.105493 299508 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0909 11:42:35.115261 299508 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0909 11:42:35.125938 299508 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0909 11:42:35.218936 299508 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0909 11:42:35.346024 299508 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0909 11:42:35.346136 299508 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0909 11:42:35.349699 299508 start.go:563] Will wait 60s for crictl version
I0909 11:42:35.349792 299508 ssh_runner.go:195] Run: which crictl
I0909 11:42:35.353239 299508 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0909 11:42:35.388496 299508 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.21
RuntimeApiVersion: v1
I0909 11:42:35.388607 299508 ssh_runner.go:195] Run: containerd --version
I0909 11:42:35.411597 299508 ssh_runner.go:195] Run: containerd --version
I0909 11:42:35.439373 299508 out.go:177] * Preparing Kubernetes v1.31.0 on containerd 1.7.21 ...
I0909 11:42:35.441744 299508 cli_runner.go:164] Run: docker network inspect addons-630724 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0909 11:42:35.457565 299508 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I0909 11:42:35.461280 299508 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0909 11:42:35.472484 299508 kubeadm.go:883] updating cluster {Name:addons-630724 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-630724 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] D
NSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: Soc
ketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0909 11:42:35.472609 299508 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0909 11:42:35.472672 299508 ssh_runner.go:195] Run: sudo crictl images --output json
I0909 11:42:35.511498 299508 containerd.go:627] all images are preloaded for containerd runtime.
I0909 11:42:35.511523 299508 containerd.go:534] Images already preloaded, skipping extraction
I0909 11:42:35.511586 299508 ssh_runner.go:195] Run: sudo crictl images --output json
I0909 11:42:35.548770 299508 containerd.go:627] all images are preloaded for containerd runtime.
I0909 11:42:35.548794 299508 cache_images.go:84] Images are preloaded, skipping loading
I0909 11:42:35.548803 299508 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.0 containerd true true} ...
I0909 11:42:35.548912 299508 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-630724 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.31.0 ClusterName:addons-630724 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0909 11:42:35.548987 299508 ssh_runner.go:195] Run: sudo crictl info
I0909 11:42:35.586203 299508 cni.go:84] Creating CNI manager for ""
I0909 11:42:35.586227 299508 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0909 11:42:35.586237 299508 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0909 11:42:35.586287 299508 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-630724 NodeName:addons-630724 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc
/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0909 11:42:35.586454 299508 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "addons-630724"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0909 11:42:35.586533 299508 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.0
I0909 11:42:35.595890 299508 binaries.go:44] Found k8s binaries, skipping transfer
I0909 11:42:35.596007 299508 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0909 11:42:35.605622 299508 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (317 bytes)
I0909 11:42:35.624809 299508 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0909 11:42:35.644607 299508 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2167 bytes)
I0909 11:42:35.663698 299508 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0909 11:42:35.667507 299508 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0909 11:42:35.678754 299508 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0909 11:42:35.757455 299508 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0909 11:42:35.774295 299508 certs.go:68] Setting up /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724 for IP: 192.168.49.2
I0909 11:42:35.774319 299508 certs.go:194] generating shared ca certs ...
I0909 11:42:35.774336 299508 certs.go:226] acquiring lock for ca certs: {Name:mk64d965bac1786dcbeb0e8f5c0f634bb13cc423 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0909 11:42:35.774986 299508 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19584-293351/.minikube/ca.key
I0909 11:42:36.317340 299508 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19584-293351/.minikube/ca.crt ...
I0909 11:42:36.317373 299508 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19584-293351/.minikube/ca.crt: {Name:mkf9a433af54dfff56e580a413ccd0c375984f1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0909 11:42:36.318081 299508 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19584-293351/.minikube/ca.key ...
I0909 11:42:36.318102 299508 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19584-293351/.minikube/ca.key: {Name:mkafecebf80a44c8a45269c88abf3f40c10fd069 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0909 11:42:36.318618 299508 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19584-293351/.minikube/proxy-client-ca.key
I0909 11:42:36.474407 299508 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19584-293351/.minikube/proxy-client-ca.crt ...
I0909 11:42:36.474439 299508 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19584-293351/.minikube/proxy-client-ca.crt: {Name:mk8153a3108267b87d3c5699ff2c17cf455d9395 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0909 11:42:36.474617 299508 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19584-293351/.minikube/proxy-client-ca.key ...
I0909 11:42:36.474632 299508 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19584-293351/.minikube/proxy-client-ca.key: {Name:mka3b55ff605ab68ba3630eec767fe2ec5145ee1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0909 11:42:36.474711 299508 certs.go:256] generating profile certs ...
I0909 11:42:36.474778 299508 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/client.key
I0909 11:42:36.474795 299508 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/client.crt with IP's: []
I0909 11:42:36.767309 299508 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/client.crt ...
I0909 11:42:36.767342 299508 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/client.crt: {Name:mk1328f11c7d94ea703f40fa72a1003fa1699b7f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0909 11:42:36.767533 299508 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/client.key ...
I0909 11:42:36.767545 299508 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/client.key: {Name:mk600396ffa4ae140d6d5d7d95498f20d073bd0b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0909 11:42:36.768152 299508 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/apiserver.key.4dc5a15b
I0909 11:42:36.768178 299508 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/apiserver.crt.4dc5a15b with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I0909 11:42:37.147472 299508 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/apiserver.crt.4dc5a15b ...
I0909 11:42:37.147506 299508 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/apiserver.crt.4dc5a15b: {Name:mk2b6bd1a9788702ef050bdf3deaf2e64a62a8b0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0909 11:42:37.147701 299508 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/apiserver.key.4dc5a15b ...
I0909 11:42:37.147718 299508 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/apiserver.key.4dc5a15b: {Name:mk3e1e8d0b0f9af6dc7861b24c02faec4f7efe60 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0909 11:42:37.147827 299508 certs.go:381] copying /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/apiserver.crt.4dc5a15b -> /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/apiserver.crt
I0909 11:42:37.147906 299508 certs.go:385] copying /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/apiserver.key.4dc5a15b -> /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/apiserver.key
I0909 11:42:37.147966 299508 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/proxy-client.key
I0909 11:42:37.147988 299508 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/proxy-client.crt with IP's: []
I0909 11:42:38.074188 299508 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/proxy-client.crt ...
I0909 11:42:38.074227 299508 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/proxy-client.crt: {Name:mk217697632eca99e9f3ca40c580d8d366e1e881 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0909 11:42:38.074436 299508 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/proxy-client.key ...
I0909 11:42:38.074456 299508 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/proxy-client.key: {Name:mk0079fe613e2d8aba3833c6cf13cdc173642ec0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0909 11:42:38.074663 299508 certs.go:484] found cert: /home/jenkins/minikube-integration/19584-293351/.minikube/certs/ca-key.pem (1679 bytes)
I0909 11:42:38.074708 299508 certs.go:484] found cert: /home/jenkins/minikube-integration/19584-293351/.minikube/certs/ca.pem (1078 bytes)
I0909 11:42:38.074747 299508 certs.go:484] found cert: /home/jenkins/minikube-integration/19584-293351/.minikube/certs/cert.pem (1123 bytes)
I0909 11:42:38.074785 299508 certs.go:484] found cert: /home/jenkins/minikube-integration/19584-293351/.minikube/certs/key.pem (1679 bytes)
I0909 11:42:38.075537 299508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19584-293351/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0909 11:42:38.105929 299508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19584-293351/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0909 11:42:38.132957 299508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19584-293351/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0909 11:42:38.162916 299508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19584-293351/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0909 11:42:38.187851 299508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0909 11:42:38.213257 299508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0909 11:42:38.238680 299508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0909 11:42:38.263033 299508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19584-293351/.minikube/profiles/addons-630724/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0909 11:42:38.287726 299508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19584-293351/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0909 11:42:38.312107 299508 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0909 11:42:38.330593 299508 ssh_runner.go:195] Run: openssl version
I0909 11:42:38.336389 299508 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0909 11:42:38.347009 299508 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0909 11:42:38.350795 299508 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 9 11:42 /usr/share/ca-certificates/minikubeCA.pem
I0909 11:42:38.350904 299508 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0909 11:42:38.357895 299508 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0909 11:42:38.367536 299508 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0909 11:42:38.370851 299508 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0909 11:42:38.370928 299508 kubeadm.go:392] StartCluster: {Name:addons-630724 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-630724 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSD
omain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: Socket
VMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0909 11:42:38.371028 299508 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0909 11:42:38.371102 299508 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0909 11:42:38.411753 299508 cri.go:89] found id: ""
I0909 11:42:38.411830 299508 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0909 11:42:38.420840 299508 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0909 11:42:38.429837 299508 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0909 11:42:38.429905 299508 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0909 11:42:38.438735 299508 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0909 11:42:38.438754 299508 kubeadm.go:157] found existing configuration files:
I0909 11:42:38.438805 299508 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0909 11:42:38.447785 299508 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0909 11:42:38.447850 299508 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0909 11:42:38.456329 299508 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0909 11:42:38.465055 299508 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0909 11:42:38.465135 299508 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0909 11:42:38.473724 299508 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0909 11:42:38.482671 299508 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0909 11:42:38.482755 299508 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0909 11:42:38.491304 299508 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0909 11:42:38.500206 299508 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0909 11:42:38.500294 299508 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0909 11:42:38.508447 299508 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0909 11:42:38.552111 299508 kubeadm.go:310] [init] Using Kubernetes version: v1.31.0
I0909 11:42:38.552439 299508 kubeadm.go:310] [preflight] Running pre-flight checks
I0909 11:42:38.571015 299508 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0909 11:42:38.571091 299508 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1068-aws[0m
I0909 11:42:38.571132 299508 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0909 11:42:38.571179 299508 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0909 11:42:38.571229 299508 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0909 11:42:38.571279 299508 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0909 11:42:38.571330 299508 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0909 11:42:38.571378 299508 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0909 11:42:38.571447 299508 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0909 11:42:38.571494 299508 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0909 11:42:38.571544 299508 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0909 11:42:38.571592 299508 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0909 11:42:38.639156 299508 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0909 11:42:38.639271 299508 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0909 11:42:38.639666 299508 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0909 11:42:38.645028 299508 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0909 11:42:38.648044 299508 out.go:235] - Generating certificates and keys ...
I0909 11:42:38.648235 299508 kubeadm.go:310] [certs] Using existing ca certificate authority
I0909 11:42:38.648356 299508 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0909 11:42:39.211808 299508 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0909 11:42:39.405451 299508 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0909 11:42:39.769822 299508 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0909 11:42:40.657856 299508 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0909 11:42:41.257478 299508 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0909 11:42:41.257745 299508 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-630724 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0909 11:42:41.771337 299508 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0909 11:42:41.771470 299508 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-630724 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0909 11:42:42.221887 299508 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0909 11:42:43.227376 299508 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0909 11:42:43.673026 299508 kubeadm.go:310] [certs] Generating "sa" key and public key
I0909 11:42:43.673267 299508 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0909 11:42:43.976333 299508 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0909 11:42:44.732957 299508 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0909 11:42:45.287077 299508 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0909 11:42:45.775464 299508 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0909 11:42:46.375960 299508 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0909 11:42:46.376670 299508 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0909 11:42:46.379680 299508 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0909 11:42:46.382705 299508 out.go:235] - Booting up control plane ...
I0909 11:42:46.382811 299508 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0909 11:42:46.382920 299508 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0909 11:42:46.383007 299508 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0909 11:42:46.407323 299508 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0909 11:42:46.414142 299508 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0909 11:42:46.414200 299508 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0909 11:42:46.508900 299508 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0909 11:42:46.509020 299508 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0909 11:42:48.009775 299508 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.50097337s
I0909 11:42:48.010092 299508 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0909 11:42:54.012034 299508 kubeadm.go:310] [api-check] The API server is healthy after 6.001766554s
I0909 11:42:54.041608 299508 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0909 11:42:54.075357 299508 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0909 11:42:54.101688 299508 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0909 11:42:54.101899 299508 kubeadm.go:310] [mark-control-plane] Marking the node addons-630724 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0909 11:42:54.113710 299508 kubeadm.go:310] [bootstrap-token] Using token: 8vzcty.j9q0clltylx56b6k
I0909 11:42:54.116149 299508 out.go:235] - Configuring RBAC rules ...
I0909 11:42:54.116284 299508 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0909 11:42:54.123581 299508 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0909 11:42:54.132649 299508 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0909 11:42:54.136945 299508 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0909 11:42:54.140829 299508 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0909 11:42:54.145011 299508 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0909 11:42:54.418878 299508 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0909 11:42:54.847994 299508 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0909 11:42:55.419211 299508 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0909 11:42:55.425450 299508 kubeadm.go:310]
I0909 11:42:55.425530 299508 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0909 11:42:55.425541 299508 kubeadm.go:310]
I0909 11:42:55.425622 299508 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0909 11:42:55.425631 299508 kubeadm.go:310]
I0909 11:42:55.425656 299508 kubeadm.go:310] mkdir -p $HOME/.kube
I0909 11:42:55.425739 299508 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0909 11:42:55.425797 299508 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0909 11:42:55.425803 299508 kubeadm.go:310]
I0909 11:42:55.425856 299508 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0909 11:42:55.425860 299508 kubeadm.go:310]
I0909 11:42:55.425907 299508 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0909 11:42:55.425912 299508 kubeadm.go:310]
I0909 11:42:55.425967 299508 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0909 11:42:55.426041 299508 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0909 11:42:55.426107 299508 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0909 11:42:55.426112 299508 kubeadm.go:310]
I0909 11:42:55.426193 299508 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0909 11:42:55.426267 299508 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0909 11:42:55.426272 299508 kubeadm.go:310]
I0909 11:42:55.428418 299508 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token 8vzcty.j9q0clltylx56b6k \
I0909 11:42:55.428530 299508 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:d97303b8dff703c93af99443bb4f4617d91cfbc7f43fe338dca36f5194fc79ea \
I0909 11:42:55.428551 299508 kubeadm.go:310] --control-plane
I0909 11:42:55.428556 299508 kubeadm.go:310]
I0909 11:42:55.428638 299508 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0909 11:42:55.428642 299508 kubeadm.go:310]
I0909 11:42:55.428720 299508 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token 8vzcty.j9q0clltylx56b6k \
I0909 11:42:55.428818 299508 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:d97303b8dff703c93af99443bb4f4617d91cfbc7f43fe338dca36f5194fc79ea
I0909 11:42:55.433635 299508 kubeadm.go:310] W0909 11:42:38.548617 1026 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0909 11:42:55.433930 299508 kubeadm.go:310] W0909 11:42:38.549656 1026 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0909 11:42:55.434141 299508 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1068-aws\n", err: exit status 1
I0909 11:42:55.434246 299508 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0909 11:42:55.434271 299508 cni.go:84] Creating CNI manager for ""
I0909 11:42:55.434279 299508 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0909 11:42:55.438188 299508 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0909 11:42:55.440646 299508 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0909 11:42:55.445642 299508 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.0/kubectl ...
I0909 11:42:55.445667 299508 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I0909 11:42:55.466164 299508 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0909 11:42:55.758646 299508 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0909 11:42:55.758812 299508 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0909 11:42:55.758902 299508 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-630724 minikube.k8s.io/updated_at=2024_09_09T11_42_55_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=cf17d6b4040a54caaa170f92a048a513bb2a2b0d minikube.k8s.io/name=addons-630724 minikube.k8s.io/primary=true
I0909 11:42:55.766822 299508 ops.go:34] apiserver oom_adj: -16
I0909 11:42:55.944617 299508 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0909 11:42:56.444733 299508 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0909 11:42:56.945316 299508 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0909 11:42:57.445729 299508 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0909 11:42:57.944755 299508 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0909 11:42:58.445595 299508 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0909 11:42:58.945538 299508 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0909 11:42:59.445476 299508 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0909 11:42:59.945642 299508 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0909 11:43:00.097723 299508 kubeadm.go:1113] duration metric: took 4.338957155s to wait for elevateKubeSystemPrivileges
I0909 11:43:00.097757 299508 kubeadm.go:394] duration metric: took 21.726834181s to StartCluster
I0909 11:43:00.097780 299508 settings.go:142] acquiring lock: {Name:mkc0cf74a30d95d81b37a0b110eb41a0038a2e4a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0909 11:43:00.098482 299508 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19584-293351/kubeconfig
I0909 11:43:00.098913 299508 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19584-293351/kubeconfig: {Name:mkbeab7fc7181afffa8bad310530f684996f4102 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0909 11:43:00.099267 299508 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0909 11:43:00.099518 299508 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0909 11:43:00.100112 299508 config.go:182] Loaded profile config "addons-630724": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0909 11:43:00.100167 299508 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I0909 11:43:00.100250 299508 addons.go:69] Setting yakd=true in profile "addons-630724"
I0909 11:43:00.100273 299508 addons.go:234] Setting addon yakd=true in "addons-630724"
I0909 11:43:00.100301 299508 host.go:66] Checking if "addons-630724" exists ...
I0909 11:43:00.100799 299508 cli_runner.go:164] Run: docker container inspect addons-630724 --format={{.State.Status}}
I0909 11:43:00.111155 299508 out.go:177] * Verifying Kubernetes components...
I0909 11:43:00.111605 299508 addons.go:69] Setting inspektor-gadget=true in profile "addons-630724"
I0909 11:43:00.111636 299508 addons.go:234] Setting addon inspektor-gadget=true in "addons-630724"
I0909 11:43:00.111674 299508 host.go:66] Checking if "addons-630724" exists ...
I0909 11:43:00.112205 299508 cli_runner.go:164] Run: docker container inspect addons-630724 --format={{.State.Status}}
I0909 11:43:00.125570 299508 addons.go:69] Setting metrics-server=true in profile "addons-630724"
I0909 11:43:00.125621 299508 addons.go:234] Setting addon metrics-server=true in "addons-630724"
I0909 11:43:00.125668 299508 host.go:66] Checking if "addons-630724" exists ...
I0909 11:43:00.126152 299508 cli_runner.go:164] Run: docker container inspect addons-630724 --format={{.State.Status}}
I0909 11:43:00.133375 299508 addons.go:69] Setting cloud-spanner=true in profile "addons-630724"
I0909 11:43:00.133435 299508 addons.go:234] Setting addon cloud-spanner=true in "addons-630724"
I0909 11:43:00.133480 299508 host.go:66] Checking if "addons-630724" exists ...
I0909 11:43:00.133981 299508 cli_runner.go:164] Run: docker container inspect addons-630724 --format={{.State.Status}}
I0909 11:43:00.157576 299508 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-630724"
I0909 11:43:00.157632 299508 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-630724"
I0909 11:43:00.157675 299508 host.go:66] Checking if "addons-630724" exists ...
I0909 11:43:00.158168 299508 cli_runner.go:164] Run: docker container inspect addons-630724 --format={{.State.Status}}
I0909 11:43:00.195154 299508 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-630724"
I0909 11:43:00.195254 299508 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-630724"
I0909 11:43:00.195292 299508 host.go:66] Checking if "addons-630724" exists ...
I0909 11:43:00.195817 299508 cli_runner.go:164] Run: docker container inspect addons-630724 --format={{.State.Status}}
I0909 11:43:00.216963 299508 addons.go:69] Setting default-storageclass=true in profile "addons-630724"
I0909 11:43:00.217268 299508 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-630724"
I0909 11:43:00.232318 299508 addons.go:69] Setting registry=true in profile "addons-630724"
I0909 11:43:00.232381 299508 addons.go:234] Setting addon registry=true in "addons-630724"
I0909 11:43:00.232425 299508 host.go:66] Checking if "addons-630724" exists ...
I0909 11:43:00.232926 299508 cli_runner.go:164] Run: docker container inspect addons-630724 --format={{.State.Status}}
I0909 11:43:00.217147 299508 addons.go:69] Setting gcp-auth=true in profile "addons-630724"
I0909 11:43:00.235296 299508 mustload.go:65] Loading cluster: addons-630724
I0909 11:43:00.235606 299508 config.go:182] Loaded profile config "addons-630724": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0909 11:43:00.235949 299508 cli_runner.go:164] Run: docker container inspect addons-630724 --format={{.State.Status}}
I0909 11:43:00.217161 299508 addons.go:69] Setting ingress=true in profile "addons-630724"
I0909 11:43:00.245760 299508 addons.go:234] Setting addon ingress=true in "addons-630724"
I0909 11:43:00.245848 299508 host.go:66] Checking if "addons-630724" exists ...
I0909 11:43:00.246414 299508 cli_runner.go:164] Run: docker container inspect addons-630724 --format={{.State.Status}}
I0909 11:43:00.217173 299508 addons.go:69] Setting ingress-dns=true in profile "addons-630724"
I0909 11:43:00.257571 299508 addons.go:234] Setting addon ingress-dns=true in "addons-630724"
I0909 11:43:00.257737 299508 host.go:66] Checking if "addons-630724" exists ...
I0909 11:43:00.258680 299508 cli_runner.go:164] Run: docker container inspect addons-630724 --format={{.State.Status}}
I0909 11:43:00.258928 299508 addons.go:69] Setting storage-provisioner=true in profile "addons-630724"
I0909 11:43:00.259006 299508 addons.go:234] Setting addon storage-provisioner=true in "addons-630724"
I0909 11:43:00.259095 299508 host.go:66] Checking if "addons-630724" exists ...
I0909 11:43:00.275679 299508 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-630724"
I0909 11:43:00.275796 299508 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-630724"
I0909 11:43:00.276248 299508 cli_runner.go:164] Run: docker container inspect addons-630724 --format={{.State.Status}}
I0909 11:43:00.276494 299508 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0909 11:43:00.285773 299508 cli_runner.go:164] Run: docker container inspect addons-630724 --format={{.State.Status}}
I0909 11:43:00.350658 299508 addons.go:69] Setting volcano=true in profile "addons-630724"
I0909 11:43:00.350723 299508 addons.go:234] Setting addon volcano=true in "addons-630724"
I0909 11:43:00.350771 299508 host.go:66] Checking if "addons-630724" exists ...
I0909 11:43:00.351287 299508 cli_runner.go:164] Run: docker container inspect addons-630724 --format={{.State.Status}}
I0909 11:43:00.375547 299508 cli_runner.go:164] Run: docker container inspect addons-630724 --format={{.State.Status}}
I0909 11:43:00.381771 299508 addons.go:69] Setting volumesnapshots=true in profile "addons-630724"
I0909 11:43:00.381824 299508 addons.go:234] Setting addon volumesnapshots=true in "addons-630724"
I0909 11:43:00.381873 299508 host.go:66] Checking if "addons-630724" exists ...
I0909 11:43:00.382388 299508 cli_runner.go:164] Run: docker container inspect addons-630724 --format={{.State.Status}}
I0909 11:43:00.480100 299508 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2
I0909 11:43:00.491030 299508 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0909 11:43:00.491081 299508 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0909 11:43:00.550003 299508 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I0909 11:43:00.570067 299508 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0
I0909 11:43:00.572571 299508 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
I0909 11:43:00.572596 299508 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I0909 11:43:00.572674 299508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-630724
I0909 11:43:00.572861 299508 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.23
I0909 11:43:00.578468 299508 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
I0909 11:43:00.578494 299508 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0909 11:43:00.578561 299508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-630724
I0909 11:43:00.596814 299508 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
I0909 11:43:00.596838 299508 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0909 11:43:00.596907 299508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-630724
I0909 11:43:00.600885 299508 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
I0909 11:43:00.604479 299508 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0909 11:43:00.604514 299508 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0909 11:43:00.604581 299508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-630724
I0909 11:43:00.616096 299508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-630724
I0909 11:43:00.616882 299508 host.go:66] Checking if "addons-630724" exists ...
I0909 11:43:00.644901 299508 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I0909 11:43:00.648800 299508 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0909 11:43:00.648873 299508 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0909 11:43:00.648981 299508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-630724
I0909 11:43:00.650836 299508 addons.go:234] Setting addon default-storageclass=true in "addons-630724"
I0909 11:43:00.650879 299508 host.go:66] Checking if "addons-630724" exists ...
I0909 11:43:00.651313 299508 cli_runner.go:164] Run: docker container inspect addons-630724 --format={{.State.Status}}
I0909 11:43:00.666426 299508 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0909 11:43:00.670871 299508 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0909 11:43:00.670969 299508 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0909 11:43:00.671075 299508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-630724
I0909 11:43:00.690887 299508 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0909 11:43:00.670889 299508 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0909 11:43:00.708556 299508 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0909 11:43:00.710807 299508 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0909 11:43:00.712800 299508 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0909 11:43:00.719675 299508 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0909 11:43:00.722679 299508 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0909 11:43:00.722758 299508 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19584-293351/.minikube/machines/addons-630724/id_rsa Username:docker}
I0909 11:43:00.725736 299508 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0909 11:43:00.725983 299508 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0909 11:43:00.730166 299508 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0909 11:43:00.730392 299508 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0909 11:43:00.730406 299508 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0909 11:43:00.730484 299508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-630724
I0909 11:43:00.755004 299508 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2
I0909 11:43:00.757422 299508 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0909 11:43:00.760024 299508 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0909 11:43:00.760047 299508 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I0909 11:43:00.760111 299508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-630724
I0909 11:43:00.762143 299508 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0909 11:43:00.762188 299508 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0909 11:43:00.762293 299508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-630724
I0909 11:43:00.777042 299508 out.go:177] - Using image docker.io/volcanosh/vc-webhook-manager:v1.9.0
I0909 11:43:00.779262 299508 out.go:177] - Using image docker.io/volcanosh/vc-controller-manager:v1.9.0
I0909 11:43:00.782937 299508 out.go:177] - Using image docker.io/volcanosh/vc-scheduler:v1.9.0
I0909 11:43:00.789406 299508 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml
I0909 11:43:00.789430 299508 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (434001 bytes)
I0909 11:43:00.789499 299508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-630724
I0909 11:43:00.819210 299508 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19584-293351/.minikube/machines/addons-630724/id_rsa Username:docker}
I0909 11:43:00.823281 299508 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19584-293351/.minikube/machines/addons-630724/id_rsa Username:docker}
I0909 11:43:00.831214 299508 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-630724"
I0909 11:43:00.831259 299508 host.go:66] Checking if "addons-630724" exists ...
I0909 11:43:00.831682 299508 cli_runner.go:164] Run: docker container inspect addons-630724 --format={{.State.Status}}
I0909 11:43:00.839859 299508 out.go:177] - Using image docker.io/registry:2.8.3
I0909 11:43:00.845606 299508 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
I0909 11:43:00.847861 299508 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
I0909 11:43:00.847880 299508 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I0909 11:43:00.847947 299508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-630724
I0909 11:43:00.851890 299508 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19584-293351/.minikube/machines/addons-630724/id_rsa Username:docker}
I0909 11:43:00.884780 299508 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19584-293351/.minikube/machines/addons-630724/id_rsa Username:docker}
I0909 11:43:00.906322 299508 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0909 11:43:00.906342 299508 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0909 11:43:00.906401 299508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-630724
I0909 11:43:00.913423 299508 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19584-293351/.minikube/machines/addons-630724/id_rsa Username:docker}
I0909 11:43:00.921128 299508 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19584-293351/.minikube/machines/addons-630724/id_rsa Username:docker}
I0909 11:43:00.958855 299508 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19584-293351/.minikube/machines/addons-630724/id_rsa Username:docker}
I0909 11:43:00.973306 299508 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19584-293351/.minikube/machines/addons-630724/id_rsa Username:docker}
I0909 11:43:00.988821 299508 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19584-293351/.minikube/machines/addons-630724/id_rsa Username:docker}
I0909 11:43:00.989545 299508 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19584-293351/.minikube/machines/addons-630724/id_rsa Username:docker}
I0909 11:43:01.004834 299508 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19584-293351/.minikube/machines/addons-630724/id_rsa Username:docker}
W0909 11:43:01.006044 299508 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0909 11:43:01.006077 299508 retry.go:31] will retry after 268.955619ms: ssh: handshake failed: EOF
I0909 11:43:01.008623 299508 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19584-293351/.minikube/machines/addons-630724/id_rsa Username:docker}
I0909 11:43:01.021731 299508 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0909 11:43:01.023914 299508 out.go:177] - Using image docker.io/busybox:stable
I0909 11:43:01.026892 299508 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0909 11:43:01.026918 299508 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0909 11:43:01.026990 299508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-630724
I0909 11:43:01.053689 299508 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19584-293351/.minikube/machines/addons-630724/id_rsa Username:docker}
W0909 11:43:01.054692 299508 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0909 11:43:01.054717 299508 retry.go:31] will retry after 134.813462ms: ssh: handshake failed: EOF
I0909 11:43:01.121976 299508 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml": (1.022429595s)
I0909 11:43:01.122197 299508 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0909 11:43:01.122339 299508 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0909 11:43:01.389802 299508 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0909 11:43:01.557412 299508 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0909 11:43:01.557440 299508 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0909 11:43:01.589760 299508 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0909 11:43:01.589786 299508 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0909 11:43:01.602951 299508 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0909 11:43:01.652502 299508 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0909 11:43:01.740887 299508 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
I0909 11:43:01.740921 299508 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0909 11:43:01.745652 299508 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
I0909 11:43:01.745679 299508 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0909 11:43:01.752123 299508 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
I0909 11:43:01.788566 299508 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0909 11:43:01.810967 299508 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0909 11:43:01.810993 299508 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0909 11:43:01.818916 299508 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0909 11:43:01.818943 299508 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0909 11:43:01.850744 299508 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0909 11:43:01.869439 299508 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I0909 11:43:01.869462 299508 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I0909 11:43:01.879437 299508 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0909 11:43:01.879462 299508 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0909 11:43:02.036909 299508 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0909 11:43:02.036937 299508 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0909 11:43:02.097029 299508 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
I0909 11:43:02.097056 299508 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I0909 11:43:02.149525 299508 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0909 11:43:02.149549 299508 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0909 11:43:02.173726 299508 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0909 11:43:02.197648 299508 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0909 11:43:02.207993 299508 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
I0909 11:43:02.208022 299508 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0909 11:43:02.227309 299508 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
I0909 11:43:02.227339 299508 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0909 11:43:02.280565 299508 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0909 11:43:02.280593 299508 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0909 11:43:02.458438 299508 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0909 11:43:02.497191 299508 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0909 11:43:02.497224 299508 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0909 11:43:02.505310 299508 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I0909 11:43:02.505412 299508 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I0909 11:43:02.557231 299508 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0909 11:43:02.557257 299508 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0909 11:43:02.597564 299508 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
I0909 11:43:02.597595 299508 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0909 11:43:02.611596 299508 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0909 11:43:02.911437 299508 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0909 11:43:02.911465 299508 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0909 11:43:02.938427 299508 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I0909 11:43:02.938455 299508 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I0909 11:43:02.955647 299508 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0909 11:43:02.955676 299508 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0909 11:43:03.102646 299508 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
I0909 11:43:03.102670 299508 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0909 11:43:03.265430 299508 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0909 11:43:03.265458 299508 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0909 11:43:03.296974 299508 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0909 11:43:03.296999 299508 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0909 11:43:03.432720 299508 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I0909 11:43:03.432748 299508 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I0909 11:43:03.480776 299508 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0909 11:43:03.589700 299508 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (2.467312193s)
I0909 11:43:03.589799 299508 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.467563449s)
I0909 11:43:03.589821 299508 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I0909 11:43:03.589888 299508 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (2.200057004s)
I0909 11:43:03.591606 299508 node_ready.go:35] waiting up to 6m0s for node "addons-630724" to be "Ready" ...
I0909 11:43:03.600386 299508 node_ready.go:49] node "addons-630724" has status "Ready":"True"
I0909 11:43:03.600411 299508 node_ready.go:38] duration metric: took 8.663302ms for node "addons-630724" to be "Ready" ...
I0909 11:43:03.600421 299508 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0909 11:43:03.626012 299508 pod_ready.go:79] waiting up to 6m0s for pod "coredns-6f6b679f8f-7w27w" in "kube-system" namespace to be "Ready" ...
I0909 11:43:03.776153 299508 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0909 11:43:03.788321 299508 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0909 11:43:03.788387 299508 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0909 11:43:03.793317 299508 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
I0909 11:43:03.793409 299508 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I0909 11:43:04.098202 299508 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-630724" context rescaled to 1 replicas
I0909 11:43:04.117097 299508 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0909 11:43:04.117175 299508 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0909 11:43:04.120805 299508 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (2.517813985s)
I0909 11:43:04.129901 299508 pod_ready.go:98] error getting pod "coredns-6f6b679f8f-7w27w" in "kube-system" namespace (skipping!): pods "coredns-6f6b679f8f-7w27w" not found
I0909 11:43:04.129971 299508 pod_ready.go:82] duration metric: took 503.878608ms for pod "coredns-6f6b679f8f-7w27w" in "kube-system" namespace to be "Ready" ...
E0909 11:43:04.129998 299508 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-6f6b679f8f-7w27w" in "kube-system" namespace (skipping!): pods "coredns-6f6b679f8f-7w27w" not found
I0909 11:43:04.130017 299508 pod_ready.go:79] waiting up to 6m0s for pod "coredns-6f6b679f8f-zj4kb" in "kube-system" namespace to be "Ready" ...
I0909 11:43:04.184074 299508 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
I0909 11:43:04.184152 299508 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
I0909 11:43:04.196931 299508 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0909 11:43:04.196996 299508 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0909 11:43:04.365649 299508 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I0909 11:43:04.437797 299508 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0909 11:43:04.437876 299508 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0909 11:43:04.766738 299508 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (3.11419906s)
I0909 11:43:04.802771 299508 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0909 11:43:06.140746 299508 pod_ready.go:103] pod "coredns-6f6b679f8f-zj4kb" in "kube-system" namespace has status "Ready":"False"
I0909 11:43:07.839758 299508 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0909 11:43:07.839882 299508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-630724
I0909 11:43:07.865565 299508 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19584-293351/.minikube/machines/addons-630724/id_rsa Username:docker}
I0909 11:43:08.253174 299508 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0909 11:43:08.459174 299508 addons.go:234] Setting addon gcp-auth=true in "addons-630724"
I0909 11:43:08.459269 299508 host.go:66] Checking if "addons-630724" exists ...
I0909 11:43:08.459815 299508 cli_runner.go:164] Run: docker container inspect addons-630724 --format={{.State.Status}}
I0909 11:43:08.485133 299508 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0909 11:43:08.485189 299508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-630724
I0909 11:43:08.508504 299508 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19584-293351/.minikube/machines/addons-630724/id_rsa Username:docker}
I0909 11:43:08.637602 299508 pod_ready.go:103] pod "coredns-6f6b679f8f-zj4kb" in "kube-system" namespace has status "Ready":"False"
I0909 11:43:10.642636 299508 pod_ready.go:103] pod "coredns-6f6b679f8f-zj4kb" in "kube-system" namespace has status "Ready":"False"
I0909 11:43:11.238514 299508 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (9.486353441s)
I0909 11:43:11.238652 299508 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (9.450063986s)
I0909 11:43:11.238669 299508 addons.go:475] Verifying addon ingress=true in "addons-630724"
I0909 11:43:11.238859 299508 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (9.388082634s)
I0909 11:43:11.238910 299508 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (9.065156021s)
I0909 11:43:11.239154 299508 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (9.041480318s)
I0909 11:43:11.239220 299508 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.780743643s)
I0909 11:43:11.239242 299508 addons.go:475] Verifying addon metrics-server=true in "addons-630724"
I0909 11:43:11.239267 299508 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (8.627645131s)
I0909 11:43:11.239278 299508 addons.go:475] Verifying addon registry=true in "addons-630724"
I0909 11:43:11.239286 299508 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (7.758483659s)
I0909 11:43:11.239548 299508 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (7.463312313s)
W0909 11:43:11.239578 299508 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0909 11:43:11.239609 299508 retry.go:31] will retry after 263.912122ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0909 11:43:11.239676 299508 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (6.873948803s)
I0909 11:43:11.241567 299508 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-630724 service yakd-dashboard -n yakd-dashboard
I0909 11:43:11.241622 299508 out.go:177] * Verifying registry addon...
I0909 11:43:11.241600 299508 out.go:177] * Verifying ingress addon...
I0909 11:43:11.245680 299508 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0909 11:43:11.246708 299508 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0909 11:43:11.323497 299508 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0909 11:43:11.323527 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:11.324617 299508 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0909 11:43:11.324652 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
W0909 11:43:11.367924 299508 out.go:270] ! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error while marking storage class local-path as non-default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]
I0909 11:43:11.504635 299508 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0909 11:43:11.812856 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:11.814362 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:12.075992 299508 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (3.590806581s)
I0909 11:43:12.076099 299508 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (7.273293279s)
I0909 11:43:12.076123 299508 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-630724"
I0909 11:43:12.082390 299508 out.go:177] * Verifying csi-hostpath-driver addon...
I0909 11:43:12.082526 299508 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0909 11:43:12.092738 299508 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0909 11:43:12.095250 299508 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
I0909 11:43:12.097399 299508 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0909 11:43:12.097477 299508 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0909 11:43:12.103630 299508 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0909 11:43:12.103804 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:12.164374 299508 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0909 11:43:12.164401 299508 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0909 11:43:12.217611 299508 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0909 11:43:12.217638 299508 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I0909 11:43:12.252585 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:12.253832 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:12.258134 299508 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0909 11:43:12.598648 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:12.754212 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:12.754828 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:13.100503 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:13.149755 299508 pod_ready.go:103] pod "coredns-6f6b679f8f-zj4kb" in "kube-system" namespace has status "Ready":"False"
I0909 11:43:13.255763 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:13.263102 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:13.442497 299508 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.937796432s)
I0909 11:43:13.442565 299508 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.184342054s)
I0909 11:43:13.446153 299508 addons.go:475] Verifying addon gcp-auth=true in "addons-630724"
I0909 11:43:13.448875 299508 out.go:177] * Verifying gcp-auth addon...
I0909 11:43:13.452009 299508 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0909 11:43:13.455210 299508 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0909 11:43:13.598480 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:13.753867 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:13.755055 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:14.098775 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:14.252556 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:14.253987 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:14.608858 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:14.752084 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:14.753576 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:15.099504 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:15.252483 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:15.252642 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:15.598338 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:15.639415 299508 pod_ready.go:103] pod "coredns-6f6b679f8f-zj4kb" in "kube-system" namespace has status "Ready":"False"
I0909 11:43:15.751462 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:15.752127 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:16.099351 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:16.252869 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:16.253598 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:16.598636 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:16.752558 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:16.753133 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:17.097956 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:17.250311 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:17.252408 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:17.598893 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:17.751342 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:17.752272 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:18.099200 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:18.140569 299508 pod_ready.go:103] pod "coredns-6f6b679f8f-zj4kb" in "kube-system" namespace has status "Ready":"False"
I0909 11:43:18.250448 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:18.250892 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:18.597985 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:18.751576 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:18.752500 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:19.099760 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:19.251287 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:19.251401 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:19.598065 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:19.750754 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:19.752331 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:20.110105 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:20.270309 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:20.277139 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:20.598257 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:20.640790 299508 pod_ready.go:103] pod "coredns-6f6b679f8f-zj4kb" in "kube-system" namespace has status "Ready":"False"
I0909 11:43:20.751709 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:20.753685 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:21.098869 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:21.250194 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:21.250994 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:21.597275 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:21.750651 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:21.752263 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:22.098139 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:22.250478 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:22.251223 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:22.598681 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:22.749840 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:22.751844 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:23.098005 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:23.136610 299508 pod_ready.go:103] pod "coredns-6f6b679f8f-zj4kb" in "kube-system" namespace has status "Ready":"False"
I0909 11:43:23.249487 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:23.250455 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:23.598221 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:23.751524 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:23.752413 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:24.100541 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:24.253370 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:24.254589 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:24.598193 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:24.637057 299508 pod_ready.go:93] pod "coredns-6f6b679f8f-zj4kb" in "kube-system" namespace has status "Ready":"True"
I0909 11:43:24.637082 299508 pod_ready.go:82] duration metric: took 20.507028612s for pod "coredns-6f6b679f8f-zj4kb" in "kube-system" namespace to be "Ready" ...
I0909 11:43:24.637094 299508 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-630724" in "kube-system" namespace to be "Ready" ...
I0909 11:43:24.642757 299508 pod_ready.go:93] pod "etcd-addons-630724" in "kube-system" namespace has status "Ready":"True"
I0909 11:43:24.642782 299508 pod_ready.go:82] duration metric: took 5.68056ms for pod "etcd-addons-630724" in "kube-system" namespace to be "Ready" ...
I0909 11:43:24.642796 299508 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-630724" in "kube-system" namespace to be "Ready" ...
I0909 11:43:24.649022 299508 pod_ready.go:93] pod "kube-apiserver-addons-630724" in "kube-system" namespace has status "Ready":"True"
I0909 11:43:24.649095 299508 pod_ready.go:82] duration metric: took 6.290419ms for pod "kube-apiserver-addons-630724" in "kube-system" namespace to be "Ready" ...
I0909 11:43:24.649122 299508 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-630724" in "kube-system" namespace to be "Ready" ...
I0909 11:43:24.656152 299508 pod_ready.go:93] pod "kube-controller-manager-addons-630724" in "kube-system" namespace has status "Ready":"True"
I0909 11:43:24.656223 299508 pod_ready.go:82] duration metric: took 7.079822ms for pod "kube-controller-manager-addons-630724" in "kube-system" namespace to be "Ready" ...
I0909 11:43:24.656248 299508 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-5gj4z" in "kube-system" namespace to be "Ready" ...
I0909 11:43:24.663139 299508 pod_ready.go:93] pod "kube-proxy-5gj4z" in "kube-system" namespace has status "Ready":"True"
I0909 11:43:24.663208 299508 pod_ready.go:82] duration metric: took 6.941534ms for pod "kube-proxy-5gj4z" in "kube-system" namespace to be "Ready" ...
I0909 11:43:24.663234 299508 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-630724" in "kube-system" namespace to be "Ready" ...
I0909 11:43:24.751877 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:24.754702 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:25.100448 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:25.100681 299508 pod_ready.go:93] pod "kube-scheduler-addons-630724" in "kube-system" namespace has status "Ready":"True"
I0909 11:43:25.100695 299508 pod_ready.go:82] duration metric: took 437.442585ms for pod "kube-scheduler-addons-630724" in "kube-system" namespace to be "Ready" ...
I0909 11:43:25.100708 299508 pod_ready.go:79] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-rdh99" in "kube-system" namespace to be "Ready" ...
I0909 11:43:25.250314 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:25.253752 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:25.598139 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:25.752452 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:25.753462 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:26.098926 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:26.251748 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:26.254248 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:26.598231 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:26.749778 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:26.752667 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:27.097814 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:27.109712 299508 pod_ready.go:103] pod "nvidia-device-plugin-daemonset-rdh99" in "kube-system" namespace has status "Ready":"False"
I0909 11:43:27.250796 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:27.251596 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:27.597396 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:27.754417 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:27.755685 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:28.098262 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:28.251889 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:28.252769 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:28.600304 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:28.612860 299508 pod_ready.go:93] pod "nvidia-device-plugin-daemonset-rdh99" in "kube-system" namespace has status "Ready":"True"
I0909 11:43:28.612932 299508 pod_ready.go:82] duration metric: took 3.512214453s for pod "nvidia-device-plugin-daemonset-rdh99" in "kube-system" namespace to be "Ready" ...
I0909 11:43:28.612958 299508 pod_ready.go:39] duration metric: took 25.012525381s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0909 11:43:28.613013 299508 api_server.go:52] waiting for apiserver process to appear ...
I0909 11:43:28.613130 299508 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0909 11:43:28.632827 299508 api_server.go:72] duration metric: took 28.53351033s to wait for apiserver process to appear ...
I0909 11:43:28.632857 299508 api_server.go:88] waiting for apiserver healthz status ...
I0909 11:43:28.632878 299508 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I0909 11:43:28.641394 299508 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I0909 11:43:28.642667 299508 api_server.go:141] control plane version: v1.31.0
I0909 11:43:28.642704 299508 api_server.go:131] duration metric: took 9.831513ms to wait for apiserver health ...
I0909 11:43:28.642713 299508 system_pods.go:43] waiting for kube-system pods to appear ...
I0909 11:43:28.656148 299508 system_pods.go:59] 18 kube-system pods found
I0909 11:43:28.656191 299508 system_pods.go:61] "coredns-6f6b679f8f-zj4kb" [29e61772-58b9-4b6d-88fd-d8ce4ba0b38a] Running
I0909 11:43:28.656202 299508 system_pods.go:61] "csi-hostpath-attacher-0" [3842728e-66ca-422e-acde-133bae99d3c4] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0909 11:43:28.656212 299508 system_pods.go:61] "csi-hostpath-resizer-0" [97de549f-71e2-409c-9da8-42b295dc5a57] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0909 11:43:28.656220 299508 system_pods.go:61] "csi-hostpathplugin-s47vz" [2734ebd9-ff76-48e1-a4ea-0e597198dc62] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0909 11:43:28.656226 299508 system_pods.go:61] "etcd-addons-630724" [cff444ae-d27c-41dd-a984-b5b198026ebc] Running
I0909 11:43:28.656232 299508 system_pods.go:61] "kindnet-xkh4c" [7b75dbb8-b91e-435a-9b72-fa4983916f50] Running
I0909 11:43:28.656239 299508 system_pods.go:61] "kube-apiserver-addons-630724" [8e2d4657-514c-4cec-b5af-72f405523d53] Running
I0909 11:43:28.656247 299508 system_pods.go:61] "kube-controller-manager-addons-630724" [9bbd5362-5aec-493f-9102-041a680f0cb2] Running
I0909 11:43:28.656252 299508 system_pods.go:61] "kube-ingress-dns-minikube" [a1b0cae1-6265-4c78-a01e-0caddeaf2dc5] Running
I0909 11:43:28.656263 299508 system_pods.go:61] "kube-proxy-5gj4z" [787b1893-00ed-425e-b052-e07f74f62a36] Running
I0909 11:43:28.656267 299508 system_pods.go:61] "kube-scheduler-addons-630724" [cf7047ba-483f-4d7f-8e62-808d55c508a3] Running
I0909 11:43:28.656273 299508 system_pods.go:61] "metrics-server-84c5f94fbc-mtk8x" [d3a4f297-8b21-4bf6-b16d-87007ad009c9] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0909 11:43:28.656283 299508 system_pods.go:61] "nvidia-device-plugin-daemonset-rdh99" [2c40ce95-e2f5-4194-a39f-80ddedabf707] Running
I0909 11:43:28.656292 299508 system_pods.go:61] "registry-6fb4cdfc84-mr9ck" [e7dd8cff-56cc-4632-a210-f2a55ade65eb] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0909 11:43:28.656303 299508 system_pods.go:61] "registry-proxy-dm8pk" [a039b26f-4cfc-480f-9f4f-bf39b72b5d47] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0909 11:43:28.656311 299508 system_pods.go:61] "snapshot-controller-56fcc65765-8542r" [cafb2f79-0974-4e97-aa7a-d8d589bbd43f] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0909 11:43:28.656323 299508 system_pods.go:61] "snapshot-controller-56fcc65765-pf2x7" [639db539-a517-4a95-8696-5635904081e5] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0909 11:43:28.656327 299508 system_pods.go:61] "storage-provisioner" [5845b8e9-9588-46a8-9800-6ecd13c0c585] Running
I0909 11:43:28.656335 299508 system_pods.go:74] duration metric: took 13.615805ms to wait for pod list to return data ...
I0909 11:43:28.656347 299508 default_sa.go:34] waiting for default service account to be created ...
I0909 11:43:28.659308 299508 default_sa.go:45] found service account: "default"
I0909 11:43:28.659340 299508 default_sa.go:55] duration metric: took 2.987275ms for default service account to be created ...
I0909 11:43:28.659350 299508 system_pods.go:116] waiting for k8s-apps to be running ...
I0909 11:43:28.751743 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:28.752270 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:28.841284 299508 system_pods.go:86] 18 kube-system pods found
I0909 11:43:28.841322 299508 system_pods.go:89] "coredns-6f6b679f8f-zj4kb" [29e61772-58b9-4b6d-88fd-d8ce4ba0b38a] Running
I0909 11:43:28.841344 299508 system_pods.go:89] "csi-hostpath-attacher-0" [3842728e-66ca-422e-acde-133bae99d3c4] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0909 11:43:28.841352 299508 system_pods.go:89] "csi-hostpath-resizer-0" [97de549f-71e2-409c-9da8-42b295dc5a57] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0909 11:43:28.841360 299508 system_pods.go:89] "csi-hostpathplugin-s47vz" [2734ebd9-ff76-48e1-a4ea-0e597198dc62] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0909 11:43:28.841364 299508 system_pods.go:89] "etcd-addons-630724" [cff444ae-d27c-41dd-a984-b5b198026ebc] Running
I0909 11:43:28.841369 299508 system_pods.go:89] "kindnet-xkh4c" [7b75dbb8-b91e-435a-9b72-fa4983916f50] Running
I0909 11:43:28.841374 299508 system_pods.go:89] "kube-apiserver-addons-630724" [8e2d4657-514c-4cec-b5af-72f405523d53] Running
I0909 11:43:28.841378 299508 system_pods.go:89] "kube-controller-manager-addons-630724" [9bbd5362-5aec-493f-9102-041a680f0cb2] Running
I0909 11:43:28.841383 299508 system_pods.go:89] "kube-ingress-dns-minikube" [a1b0cae1-6265-4c78-a01e-0caddeaf2dc5] Running
I0909 11:43:28.841387 299508 system_pods.go:89] "kube-proxy-5gj4z" [787b1893-00ed-425e-b052-e07f74f62a36] Running
I0909 11:43:28.841391 299508 system_pods.go:89] "kube-scheduler-addons-630724" [cf7047ba-483f-4d7f-8e62-808d55c508a3] Running
I0909 11:43:28.841398 299508 system_pods.go:89] "metrics-server-84c5f94fbc-mtk8x" [d3a4f297-8b21-4bf6-b16d-87007ad009c9] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0909 11:43:28.841407 299508 system_pods.go:89] "nvidia-device-plugin-daemonset-rdh99" [2c40ce95-e2f5-4194-a39f-80ddedabf707] Running
I0909 11:43:28.841415 299508 system_pods.go:89] "registry-6fb4cdfc84-mr9ck" [e7dd8cff-56cc-4632-a210-f2a55ade65eb] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0909 11:43:28.841426 299508 system_pods.go:89] "registry-proxy-dm8pk" [a039b26f-4cfc-480f-9f4f-bf39b72b5d47] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0909 11:43:28.841433 299508 system_pods.go:89] "snapshot-controller-56fcc65765-8542r" [cafb2f79-0974-4e97-aa7a-d8d589bbd43f] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0909 11:43:28.841440 299508 system_pods.go:89] "snapshot-controller-56fcc65765-pf2x7" [639db539-a517-4a95-8696-5635904081e5] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0909 11:43:28.841445 299508 system_pods.go:89] "storage-provisioner" [5845b8e9-9588-46a8-9800-6ecd13c0c585] Running
I0909 11:43:28.841453 299508 system_pods.go:126] duration metric: took 182.096381ms to wait for k8s-apps to be running ...
I0909 11:43:28.841461 299508 system_svc.go:44] waiting for kubelet service to be running ....
I0909 11:43:28.841520 299508 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0909 11:43:28.855696 299508 system_svc.go:56] duration metric: took 14.223867ms WaitForService to wait for kubelet
I0909 11:43:28.855728 299508 kubeadm.go:582] duration metric: took 28.756430101s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0909 11:43:28.855750 299508 node_conditions.go:102] verifying NodePressure condition ...
I0909 11:43:29.048016 299508 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0909 11:43:29.048106 299508 node_conditions.go:123] node cpu capacity is 2
I0909 11:43:29.048135 299508 node_conditions.go:105] duration metric: took 192.377837ms to run NodePressure ...
I0909 11:43:29.048161 299508 start.go:241] waiting for startup goroutines ...
I0909 11:43:29.114835 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:29.276595 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:29.277078 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:29.598201 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:29.750802 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:29.752035 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:30.120673 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:30.250499 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:30.253576 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:30.598447 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:30.754034 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:30.755017 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:31.098350 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:31.255292 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:31.256434 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:31.597704 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:31.750113 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:31.750796 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:32.098268 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:32.253184 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:32.254352 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:32.599172 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:32.752639 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:32.753705 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:33.098419 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:33.251017 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:33.252019 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:33.597430 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:33.751269 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:33.752178 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:34.098702 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:34.251397 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:34.253718 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:34.598933 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:34.751642 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:34.752913 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:35.098441 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:35.250831 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:35.252897 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:35.598367 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:35.752718 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:35.753232 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:36.103083 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:36.261369 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:36.261513 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:36.598464 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:36.752386 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:36.753766 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:37.098575 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:37.252653 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:37.254790 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:37.598786 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:37.750539 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0909 11:43:37.752459 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:38.098711 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:38.251299 299508 kapi.go:107] duration metric: took 27.004592251s to wait for kubernetes.io/minikube-addons=registry ...
I0909 11:43:38.254299 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:38.598461 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:38.751218 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:39.098573 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:39.252410 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:39.598189 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:39.751168 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:40.105483 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:40.250671 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:40.601227 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:40.751238 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:41.097813 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:41.253487 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:41.599382 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:41.751254 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:42.098049 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:42.254809 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:42.597976 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:42.750266 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:43.100806 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:43.251603 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:43.599175 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:43.765970 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:44.098284 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:44.264635 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:44.602501 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:44.750476 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:45.106947 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:45.269618 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:45.598248 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:45.753605 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:46.098168 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:46.250988 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:46.598076 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:46.752184 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:47.098014 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:47.249927 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:47.600604 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:47.751337 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:48.098312 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:48.250692 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:48.598916 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:48.750578 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:49.097677 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:49.250233 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:49.598904 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:49.751216 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:50.105630 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:50.249740 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:50.597826 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:50.751116 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:51.098202 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:51.258296 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:51.598790 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:51.752810 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:52.101627 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:52.250310 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:52.598573 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:52.769406 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:53.098259 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:53.251711 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:53.598922 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:53.752022 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:54.099751 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:54.252837 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:54.598408 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:54.751771 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:55.099140 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:55.250317 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:55.597915 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:55.750130 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:56.099593 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:56.252119 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:56.597802 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:56.750769 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:57.098371 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:57.250639 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:57.598046 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:57.754980 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:58.098395 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:58.250812 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:58.597809 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:58.750665 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:59.097898 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:59.250749 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:43:59.598612 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:43:59.750349 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:00.128244 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:44:00.259449 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:00.600821 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:44:00.753013 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:01.098920 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:44:01.251274 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:01.598559 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:44:01.755152 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:02.098997 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:44:02.252172 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:02.598328 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:44:02.751717 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:03.097627 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:44:03.251464 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:03.598919 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:44:03.750744 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:04.099273 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:44:04.254968 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:04.598605 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:44:04.749717 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:05.098444 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:44:05.250948 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:05.598467 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:44:05.751665 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:06.098419 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0909 11:44:06.250945 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:06.599195 299508 kapi.go:107] duration metric: took 54.506455267s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0909 11:44:06.750646 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:07.250597 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:07.750475 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:08.250641 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:08.749793 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:09.250720 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:09.750299 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:10.251047 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:10.750255 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:11.251596 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:11.749828 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:12.250234 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:12.750256 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:13.251197 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:13.750196 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:14.251502 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:14.749901 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:15.251560 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:15.750868 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:16.250863 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:16.751179 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:17.250168 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:17.750500 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:18.251045 299508 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0909 11:44:18.750033 299508 kapi.go:107] duration metric: took 1m7.504347264s to wait for app.kubernetes.io/name=ingress-nginx ...
I0909 11:44:35.457712 299508 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0909 11:44:35.457743 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:35.956363 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:36.455894 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:36.957583 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:37.455345 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:37.958305 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:38.456340 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:38.956487 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:39.456202 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:39.955290 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:40.455999 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:40.956657 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:41.455791 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:41.955675 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:42.455889 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:42.956115 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:43.456066 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:43.956147 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:44.455675 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:44.956012 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:45.455605 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:45.955841 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:46.455563 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:46.958517 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:47.456966 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:47.955321 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:48.456208 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:48.955224 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:49.457576 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:49.959605 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:50.455377 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:50.955071 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:51.456066 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:51.955751 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:52.455860 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:52.956104 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:53.456491 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:53.956777 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:54.455227 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:54.955538 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:55.455923 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:55.955392 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:56.456902 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:56.956052 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:57.456008 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:57.956601 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:58.455567 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:58.956048 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:59.456743 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:44:59.956012 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:00.457083 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:00.956650 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:01.457577 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:01.955442 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:02.456137 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:02.955894 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:03.456077 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:03.957261 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:04.455152 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:04.956643 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:05.456236 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:05.956319 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:06.457016 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:06.960450 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:07.456897 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:07.955742 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:08.455932 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:08.955709 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:09.455985 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:09.955298 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:10.455968 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:10.955869 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:11.455550 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:11.955405 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:12.455688 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:12.955948 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:13.456025 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:13.956048 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:14.455213 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:14.955852 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:15.455897 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:15.955169 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:16.455990 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:16.958235 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:17.456380 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:17.956672 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:18.455734 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:18.962266 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:19.459341 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:19.956368 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:20.456414 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:20.955173 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:21.455653 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:21.954956 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:22.456243 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:22.955595 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:23.456625 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:23.955875 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:24.455713 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:24.955508 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:25.455911 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:25.955674 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:26.455635 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:26.955449 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:27.455810 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:27.955803 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:28.456186 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:28.955212 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:29.455949 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:29.955316 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:30.455395 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:30.955160 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:31.455567 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:31.955199 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:32.455832 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:32.955352 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:33.456597 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:33.955628 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:34.455401 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:34.955643 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:35.456385 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:35.956174 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:36.456461 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:36.957571 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:37.455472 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:37.956538 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:38.455845 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:38.955079 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:39.455625 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:39.956157 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:40.455877 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:40.956075 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:41.455988 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:41.955783 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:42.456399 299508 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0909 11:45:42.956443 299508 kapi.go:107] duration metric: took 2m29.50443355s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0909 11:45:42.958903 299508 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-630724 cluster.
I0909 11:45:42.961055 299508 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0909 11:45:42.963079 299508 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0909 11:45:42.965292 299508 out.go:177] * Enabled addons: nvidia-device-plugin, cloud-spanner, storage-provisioner, volcano, ingress-dns, metrics-server, inspektor-gadget, yakd, storage-provisioner-rancher, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth
I0909 11:45:42.967280 299508 addons.go:510] duration metric: took 2m42.867117127s for enable addons: enabled=[nvidia-device-plugin cloud-spanner storage-provisioner volcano ingress-dns metrics-server inspektor-gadget yakd storage-provisioner-rancher volumesnapshots registry csi-hostpath-driver ingress gcp-auth]
I0909 11:45:42.967349 299508 start.go:246] waiting for cluster config update ...
I0909 11:45:42.967380 299508 start.go:255] writing updated cluster config ...
I0909 11:45:42.968033 299508 ssh_runner.go:195] Run: rm -f paused
I0909 11:45:43.318269 299508 start.go:600] kubectl: 1.31.0, cluster: 1.31.0 (minor skew: 0)
I0909 11:45:43.320230 299508 out.go:177] * Done! kubectl is now configured to use "addons-630724" cluster and "default" namespace by default
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
b2b4400ec48f6 4f725bf50aaa5 2 minutes ago Exited gadget 5 0edb93973fbff gadget-25vg2
be89f95d4432a 6ef582f3ec844 3 minutes ago Running gcp-auth 0 4a2c720d08d32 gcp-auth-89d5ffd79-vmb4s
c84d82deeb16d 8b46b1cd48760 4 minutes ago Running admission 0 a6c354848dd67 volcano-admission-77d7d48b68-zbqv2
78a237e5b91c6 289a818c8d9c5 4 minutes ago Running controller 0 67e3bde6fe26d ingress-nginx-controller-bc57996ff-zhr58
56587e51e9c4d ee6d597e62dc8 4 minutes ago Running csi-snapshotter 0 8a95f2f95600f csi-hostpathplugin-s47vz
bdcb8d6236005 642ded511e141 4 minutes ago Running csi-provisioner 0 8a95f2f95600f csi-hostpathplugin-s47vz
c795dd7a9c4f0 922312104da8a 4 minutes ago Running liveness-probe 0 8a95f2f95600f csi-hostpathplugin-s47vz
77f5f00608d9a 08f6b2990811a 5 minutes ago Running hostpath 0 8a95f2f95600f csi-hostpathplugin-s47vz
94dd9213a8d77 0107d56dbc0be 5 minutes ago Running node-driver-registrar 0 8a95f2f95600f csi-hostpathplugin-s47vz
1b6c908989f70 487fa743e1e22 5 minutes ago Running csi-resizer 0 dde478652a045 csi-hostpath-resizer-0
81f73590b5050 9a80d518f102c 5 minutes ago Running csi-attacher 0 aabd6fc69b3bf csi-hostpath-attacher-0
f12ed2f780d33 1461903ec4fe9 5 minutes ago Running csi-external-health-monitor-controller 0 8a95f2f95600f csi-hostpathplugin-s47vz
70b1fd29ef0b0 d9c7ad4c226bf 5 minutes ago Running volcano-scheduler 0 5949e27429311 volcano-scheduler-576bc46687-tn2vq
82ead50e701be 420193b27261a 5 minutes ago Exited patch 0 ea32b92174eb5 ingress-nginx-admission-patch-z4gbs
ca39cd378cd21 420193b27261a 5 minutes ago Exited create 0 80ddcb660a602 ingress-nginx-admission-create-p8lvw
079c324fa1f45 1505f556b3a7b 5 minutes ago Running volcano-controllers 0 f72c33de2434e volcano-controllers-56675bb4d5-zg8pg
f9e7ed150c683 5548a49bb60ba 5 minutes ago Running metrics-server 0 beb6ef54121f2 metrics-server-84c5f94fbc-mtk8x
fc2e2c473ef38 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 a900d12e32c42 snapshot-controller-56fcc65765-pf2x7
6ef9a9b34fc18 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 5ab5181999475 snapshot-controller-56fcc65765-8542r
13d712dce18a7 7ce2150c8929b 5 minutes ago Running local-path-provisioner 0 24c5b092fe61f local-path-provisioner-86d989889c-zxx64
9633b37c7e2fa 8be4bcf8ec607 5 minutes ago Running cloud-spanner-emulator 0 00712839bb5e7 cloud-spanner-emulator-769b77f747-ms8dm
d512c42317707 6fed88f43b276 5 minutes ago Running registry 0 a88b5c7411342 registry-6fb4cdfc84-mr9ck
0d2d4bcd329c9 3410e1561990a 5 minutes ago Running registry-proxy 0 9ff6f809716d3 registry-proxy-dm8pk
564c5d70fcc6c 77bdba588b953 5 minutes ago Running yakd 0 fb6c2379818d6 yakd-dashboard-67d98fc6b-54qsf
b2d665c9a8b51 a9bac31a5be8d 5 minutes ago Running nvidia-device-plugin-ctr 0 c85f492728c16 nvidia-device-plugin-daemonset-rdh99
ae0b843281229 2437cf7621777 5 minutes ago Running coredns 0 81ad3fdc2ee81 coredns-6f6b679f8f-zj4kb
ae5de811bd19d 35508c2f890c4 5 minutes ago Running minikube-ingress-dns 0 dcc56d83812ef kube-ingress-dns-minikube
7df1caab246cb ba04bb24b9575 5 minutes ago Running storage-provisioner 0 346e39fa22b4a storage-provisioner
b7e50e771b064 6a23fa8fd2b78 5 minutes ago Running kindnet-cni 0 6a9bc20a3d1f8 kindnet-xkh4c
49c6943beea95 71d55d66fd4ee 6 minutes ago Running kube-proxy 0 97937ed199174 kube-proxy-5gj4z
36a5807fddd61 fbbbd428abb4d 6 minutes ago Running kube-scheduler 0 5b6cf3ec76e14 kube-scheduler-addons-630724
3094c2a2bfafb 27e3830e14027 6 minutes ago Running etcd 0 93f6047267051 etcd-addons-630724
1a42dda2b9553 fcb0683e6bdbd 6 minutes ago Running kube-controller-manager 0 08685c88590e1 kube-controller-manager-addons-630724
51b6d3c7a0c6d cd0f0ae0ec9e0 6 minutes ago Running kube-apiserver 0 ca2741e9e1426 kube-apiserver-addons-630724
==> containerd <==
Sep 09 11:45:54 addons-630724 containerd[816]: time="2024-09-09T11:45:54.835017728Z" level=info msg="RemovePodSandbox \"371c40b1c26abaecffe923ad6235e8cec2c0a4d5131ac2137584f4f965e2460e\" returns successfully"
Sep 09 11:46:43 addons-630724 containerd[816]: time="2024-09-09T11:46:43.754347161Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\""
Sep 09 11:46:43 addons-630724 containerd[816]: time="2024-09-09T11:46:43.874681363Z" level=info msg="ImageUpdate event name:\"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}"
Sep 09 11:46:43 addons-630724 containerd[816]: time="2024-09-09T11:46:43.876260912Z" level=info msg="stop pulling image ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec: active requests=0, bytes read=89"
Sep 09 11:46:43 addons-630724 containerd[816]: time="2024-09-09T11:46:43.879769457Z" level=info msg="Pulled image \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\" with image id \"sha256:4f725bf50aaa5c697fbb84c107e9c7a3766f0f85f514ffce712d03ee5f62e8dd\", repo tag \"\", repo digest \"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\", size \"72524105\" in 125.371031ms"
Sep 09 11:46:43 addons-630724 containerd[816]: time="2024-09-09T11:46:43.879816079Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\" returns image reference \"sha256:4f725bf50aaa5c697fbb84c107e9c7a3766f0f85f514ffce712d03ee5f62e8dd\""
Sep 09 11:46:43 addons-630724 containerd[816]: time="2024-09-09T11:46:43.882064213Z" level=info msg="CreateContainer within sandbox \"0edb93973fbffee25b8769f80c7bc27d7df46a9ff431cd8e4b33f40d73a6ad48\" for container &ContainerMetadata{Name:gadget,Attempt:5,}"
Sep 09 11:46:43 addons-630724 containerd[816]: time="2024-09-09T11:46:43.898580638Z" level=info msg="CreateContainer within sandbox \"0edb93973fbffee25b8769f80c7bc27d7df46a9ff431cd8e4b33f40d73a6ad48\" for &ContainerMetadata{Name:gadget,Attempt:5,} returns container id \"b2b4400ec48f6dfa07e51c937f306b77a015a2fe931b2ccaa4d5bb2077e372e4\""
Sep 09 11:46:43 addons-630724 containerd[816]: time="2024-09-09T11:46:43.899416008Z" level=info msg="StartContainer for \"b2b4400ec48f6dfa07e51c937f306b77a015a2fe931b2ccaa4d5bb2077e372e4\""
Sep 09 11:46:43 addons-630724 containerd[816]: time="2024-09-09T11:46:43.981802598Z" level=info msg="StartContainer for \"b2b4400ec48f6dfa07e51c937f306b77a015a2fe931b2ccaa4d5bb2077e372e4\" returns successfully"
Sep 09 11:46:45 addons-630724 containerd[816]: time="2024-09-09T11:46:45.862296335Z" level=info msg="shim disconnected" id=b2b4400ec48f6dfa07e51c937f306b77a015a2fe931b2ccaa4d5bb2077e372e4 namespace=k8s.io
Sep 09 11:46:45 addons-630724 containerd[816]: time="2024-09-09T11:46:45.862365258Z" level=warning msg="cleaning up after shim disconnected" id=b2b4400ec48f6dfa07e51c937f306b77a015a2fe931b2ccaa4d5bb2077e372e4 namespace=k8s.io
Sep 09 11:46:45 addons-630724 containerd[816]: time="2024-09-09T11:46:45.862378263Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Sep 09 11:46:46 addons-630724 containerd[816]: time="2024-09-09T11:46:46.041297079Z" level=info msg="RemoveContainer for \"e0fb7aebe0a58308786aae25410a315ae23286dd34710451c1a641030196d8c4\""
Sep 09 11:46:46 addons-630724 containerd[816]: time="2024-09-09T11:46:46.055582494Z" level=info msg="RemoveContainer for \"e0fb7aebe0a58308786aae25410a315ae23286dd34710451c1a641030196d8c4\" returns successfully"
Sep 09 11:46:54 addons-630724 containerd[816]: time="2024-09-09T11:46:54.839376802Z" level=info msg="RemoveContainer for \"34f360fed2a60dd7bcba2def749cc2273b313c85bdc3dd0af6b15e3f1f504d22\""
Sep 09 11:46:54 addons-630724 containerd[816]: time="2024-09-09T11:46:54.845694097Z" level=info msg="RemoveContainer for \"34f360fed2a60dd7bcba2def749cc2273b313c85bdc3dd0af6b15e3f1f504d22\" returns successfully"
Sep 09 11:46:54 addons-630724 containerd[816]: time="2024-09-09T11:46:54.847768488Z" level=info msg="StopPodSandbox for \"2993acc78a0ad37ccc1068a0f4cf571445bddf2814c61956a81d6844f3babfdc\""
Sep 09 11:46:54 addons-630724 containerd[816]: time="2024-09-09T11:46:54.855477665Z" level=info msg="TearDown network for sandbox \"2993acc78a0ad37ccc1068a0f4cf571445bddf2814c61956a81d6844f3babfdc\" successfully"
Sep 09 11:46:54 addons-630724 containerd[816]: time="2024-09-09T11:46:54.855518108Z" level=info msg="StopPodSandbox for \"2993acc78a0ad37ccc1068a0f4cf571445bddf2814c61956a81d6844f3babfdc\" returns successfully"
Sep 09 11:46:54 addons-630724 containerd[816]: time="2024-09-09T11:46:54.856101229Z" level=info msg="RemovePodSandbox for \"2993acc78a0ad37ccc1068a0f4cf571445bddf2814c61956a81d6844f3babfdc\""
Sep 09 11:46:54 addons-630724 containerd[816]: time="2024-09-09T11:46:54.856153832Z" level=info msg="Forcibly stopping sandbox \"2993acc78a0ad37ccc1068a0f4cf571445bddf2814c61956a81d6844f3babfdc\""
Sep 09 11:46:54 addons-630724 containerd[816]: time="2024-09-09T11:46:54.863701245Z" level=info msg="TearDown network for sandbox \"2993acc78a0ad37ccc1068a0f4cf571445bddf2814c61956a81d6844f3babfdc\" successfully"
Sep 09 11:46:54 addons-630724 containerd[816]: time="2024-09-09T11:46:54.870248874Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"2993acc78a0ad37ccc1068a0f4cf571445bddf2814c61956a81d6844f3babfdc\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus."
Sep 09 11:46:54 addons-630724 containerd[816]: time="2024-09-09T11:46:54.870372820Z" level=info msg="RemovePodSandbox \"2993acc78a0ad37ccc1068a0f4cf571445bddf2814c61956a81d6844f3babfdc\" returns successfully"
==> coredns [ae0b84328122953d7acd982d68ad712c21c98c324056c819fba660c9c43f6c33] <==
[INFO] 10.244.0.4:50788 - 13263 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000074461s
[INFO] 10.244.0.4:46141 - 59359 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002052264s
[INFO] 10.244.0.4:46141 - 31192 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002377054s
[INFO] 10.244.0.4:60188 - 20794 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000056919s
[INFO] 10.244.0.4:60188 - 12084 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000045965s
[INFO] 10.244.0.4:57678 - 26283 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000135006s
[INFO] 10.244.0.4:57678 - 62900 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000054194s
[INFO] 10.244.0.4:59523 - 48472 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000062334s
[INFO] 10.244.0.4:59523 - 40533 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000045021s
[INFO] 10.244.0.4:57820 - 65262 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000061907s
[INFO] 10.244.0.4:57820 - 7660 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000035996s
[INFO] 10.244.0.4:35713 - 2123 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002392201s
[INFO] 10.244.0.4:35713 - 34381 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002618924s
[INFO] 10.244.0.4:56198 - 32664 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000079991s
[INFO] 10.244.0.4:56198 - 45723 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000071212s
[INFO] 10.244.0.24:48977 - 20517 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.004691268s
[INFO] 10.244.0.24:39503 - 63590 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.004774557s
[INFO] 10.244.0.24:56970 - 38244 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000171536s
[INFO] 10.244.0.24:45264 - 28219 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000127926s
[INFO] 10.244.0.24:51831 - 33091 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000119392s
[INFO] 10.244.0.24:45906 - 2493 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000205653s
[INFO] 10.244.0.24:45936 - 14145 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002283767s
[INFO] 10.244.0.24:60969 - 39360 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.00218474s
[INFO] 10.244.0.24:35870 - 38611 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.001521653s
[INFO] 10.244.0.24:48640 - 1430 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 648 0.002231935s
==> describe nodes <==
Name: addons-630724
Roles: control-plane
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=addons-630724
kubernetes.io/os=linux
minikube.k8s.io/commit=cf17d6b4040a54caaa170f92a048a513bb2a2b0d
minikube.k8s.io/name=addons-630724
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_09_09T11_42_55_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-630724
Annotations: csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-630724"}
kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Mon, 09 Sep 2024 11:42:52 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-630724
AcquireTime: <unset>
RenewTime: Mon, 09 Sep 2024 11:48:52 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Mon, 09 Sep 2024 11:45:57 +0000 Mon, 09 Sep 2024 11:42:49 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Mon, 09 Sep 2024 11:45:57 +0000 Mon, 09 Sep 2024 11:42:49 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Mon, 09 Sep 2024 11:45:57 +0000 Mon, 09 Sep 2024 11:42:49 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Mon, 09 Sep 2024 11:45:57 +0000 Mon, 09 Sep 2024 11:42:52 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-630724
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022300Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022300Ki
pods: 110
System Info:
Machine ID: 130cf7c327844c8191f904e90564b1b7
System UUID: 4b5ee642-66d0-4a05-8720-33700d75e3f5
Boot ID: 7d6e1781-aee8-4484-a8de-8a5868c84ccd
Kernel Version: 5.15.0-1068-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.21
Kubelet Version: v1.31.0
Kube-Proxy Version:
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (27 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default cloud-spanner-emulator-769b77f747-ms8dm 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
gadget gadget-25vg2 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m55s
gcp-auth gcp-auth-89d5ffd79-vmb4s 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m27s
ingress-nginx ingress-nginx-controller-bc57996ff-zhr58 100m (5%) 0 (0%) 90Mi (1%) 0 (0%) 5m54s
kube-system coredns-6f6b679f8f-zj4kb 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 6m2s
kube-system csi-hostpath-attacher-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m51s
kube-system csi-hostpath-resizer-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m50s
kube-system csi-hostpathplugin-s47vz 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m51s
kube-system etcd-addons-630724 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 6m7s
kube-system kindnet-xkh4c 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 6m3s
kube-system kube-apiserver-addons-630724 250m (12%) 0 (0%) 0 (0%) 0 (0%) 6m7s
kube-system kube-controller-manager-addons-630724 200m (10%) 0 (0%) 0 (0%) 0 (0%) 6m7s
kube-system kube-ingress-dns-minikube 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
kube-system kube-proxy-5gj4z 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m3s
kube-system kube-scheduler-addons-630724 100m (5%) 0 (0%) 0 (0%) 0 (0%) 6m7s
kube-system metrics-server-84c5f94fbc-mtk8x 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 5m56s
kube-system nvidia-device-plugin-daemonset-rdh99 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m
kube-system registry-6fb4cdfc84-mr9ck 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
kube-system registry-proxy-dm8pk 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
kube-system snapshot-controller-56fcc65765-8542r 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m55s
kube-system snapshot-controller-56fcc65765-pf2x7 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m55s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
local-path-storage local-path-provisioner-86d989889c-zxx64 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
volcano-system volcano-admission-77d7d48b68-zbqv2 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m53s
volcano-system volcano-controllers-56675bb4d5-zg8pg 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
volcano-system volcano-scheduler-576bc46687-tn2vq 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
yakd-dashboard yakd-dashboard-67d98fc6b-54qsf 0 (0%) 0 (0%) 128Mi (1%) 256Mi (3%) 5m56s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 1050m (52%) 100m (5%)
memory 638Mi (8%) 476Mi (6%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 6m kube-proxy
Normal NodeHasSufficientMemory 6m15s (x8 over 6m15s) kubelet Node addons-630724 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m15s (x7 over 6m15s) kubelet Node addons-630724 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m15s (x7 over 6m15s) kubelet Node addons-630724 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 6m15s kubelet Updated Node Allocatable limit across pods
Normal Starting 6m8s kubelet Starting kubelet.
Warning CgroupV1 6m8s kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeAllocatableEnforced 6m8s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 6m8s kubelet Node addons-630724 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m8s kubelet Node addons-630724 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m8s kubelet Node addons-630724 status is now: NodeHasSufficientPID
Normal RegisteredNode 6m3s node-controller Node addons-630724 event: Registered Node addons-630724 in Controller
==> dmesg <==
[Sep 9 10:17] ACPI: SRAT not present
[ +0.000000] ACPI: SRAT not present
[ +0.000000] SPI driver altr_a10sr has no spi_device_id for altr,a10sr
[ +0.015096] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[ +0.478389] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
[ +0.837018] ena 0000:00:05.0: LLQ is not supported Fallback to host mode policy.
[ +6.634111] kauditd_printk_skb: 36 callbacks suppressed
[Sep 9 10:32] hrtimer: interrupt took 14196427 ns
[Sep 9 11:14] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
==> etcd [3094c2a2bfafbc38d9f5eafab0dca626003ede84f454774bcc0981067c0f9e26] <==
{"level":"info","ts":"2024-09-09T11:42:48.791006Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","added-peer-id":"aec36adc501070cc","added-peer-peer-urls":["https://192.168.49.2:2380"]}
{"level":"info","ts":"2024-09-09T11:42:48.787858Z","caller":"embed/etcd.go:599","msg":"serving peer traffic","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-09-09T11:42:48.791088Z","caller":"embed/etcd.go:571","msg":"cmux::serve","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-09-09T11:42:48.795255Z","caller":"embed/etcd.go:279","msg":"now serving peer/client/metrics","local-member-id":"aec36adc501070cc","initial-advertise-peer-urls":["https://192.168.49.2:2380"],"listen-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.49.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
{"level":"info","ts":"2024-09-09T11:42:48.795304Z","caller":"embed/etcd.go:870","msg":"serving metrics","address":"http://127.0.0.1:2381"}
{"level":"info","ts":"2024-09-09T11:42:48.918158Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
{"level":"info","ts":"2024-09-09T11:42:48.918382Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
{"level":"info","ts":"2024-09-09T11:42:48.918484Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
{"level":"info","ts":"2024-09-09T11:42:48.918654Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
{"level":"info","ts":"2024-09-09T11:42:48.918735Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-09T11:42:48.918827Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
{"level":"info","ts":"2024-09-09T11:42:48.918905Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-09T11:42:48.919905Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-630724 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
{"level":"info","ts":"2024-09-09T11:42:48.920068Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-09T11:42:48.920469Z","caller":"etcdserver/server.go:2629","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-09T11:42:48.921516Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-09T11:42:48.922329Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-09T11:42:48.922680Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-09-09T11:42:48.922826Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-09-09T11:42:48.923338Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
{"level":"info","ts":"2024-09-09T11:42:48.922361Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-09T11:42:48.930563Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-09-09T11:42:48.923828Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-09T11:42:48.930986Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-09T11:42:48.931111Z","caller":"etcdserver/server.go:2653","msg":"cluster version is updated","cluster-version":"3.5"}
==> gcp-auth [be89f95d4432a945c4652c532de56d1398ba5cbda4ec24bcd4ce004c9fc26c6e] <==
2024/09/09 11:45:42 GCP Auth Webhook started!
2024/09/09 11:45:59 Ready to marshal response ...
2024/09/09 11:45:59 Ready to write response ...
2024/09/09 11:46:00 Ready to marshal response ...
2024/09/09 11:46:00 Ready to write response ...
==> kernel <==
11:49:02 up 1:31, 0 users, load average: 0.30, 1.22, 2.02
Linux addons-630724 5.15.0-1068-aws #74~20.04.1-Ubuntu SMP Tue Aug 6 19:45:17 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [b7e50e771b064702269b0d4247f0d015e833b5b0f007064d5f0cac8da968bffd] <==
I0909 11:46:54.312559 1 main.go:299] handling current node
I0909 11:47:04.309645 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0909 11:47:04.309686 1 main.go:299] handling current node
I0909 11:47:14.314843 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0909 11:47:14.314878 1 main.go:299] handling current node
I0909 11:47:24.318843 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0909 11:47:24.318878 1 main.go:299] handling current node
I0909 11:47:34.310308 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0909 11:47:34.310404 1 main.go:299] handling current node
I0909 11:47:44.316653 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0909 11:47:44.316688 1 main.go:299] handling current node
I0909 11:47:54.312168 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0909 11:47:54.312265 1 main.go:299] handling current node
I0909 11:48:04.310541 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0909 11:48:04.310581 1 main.go:299] handling current node
I0909 11:48:14.313864 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0909 11:48:14.313901 1 main.go:299] handling current node
I0909 11:48:24.310738 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0909 11:48:24.310775 1 main.go:299] handling current node
I0909 11:48:34.315839 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0909 11:48:34.315875 1 main.go:299] handling current node
I0909 11:48:44.318036 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0909 11:48:44.318075 1 main.go:299] handling current node
I0909 11:48:54.309690 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0909 11:48:54.309727 1 main.go:299] handling current node
==> kube-apiserver [51b6d3c7a0c6d72a81af6f21db99bc978374708a69ea364661b7d7ad2b54e0f9] <==
W0909 11:44:14.572844 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.101.110.71:443: connect: connection refused
W0909 11:44:15.672720 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.101.110.71:443: connect: connection refused
W0909 11:44:16.283431 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.100.122.255:443: connect: connection refused
E0909 11:44:16.283484 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.100.122.255:443: connect: connection refused" logger="UnhandledError"
W0909 11:44:16.285539 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.101.110.71:443: connect: connection refused
W0909 11:44:16.304866 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.100.122.255:443: connect: connection refused
E0909 11:44:16.304921 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.100.122.255:443: connect: connection refused" logger="UnhandledError"
W0909 11:44:16.306635 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.101.110.71:443: connect: connection refused
W0909 11:44:16.724645 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.101.110.71:443: connect: connection refused
W0909 11:44:17.760338 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.101.110.71:443: connect: connection refused
W0909 11:44:18.823741 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.101.110.71:443: connect: connection refused
W0909 11:44:19.922357 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.101.110.71:443: connect: connection refused
W0909 11:44:20.962004 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.101.110.71:443: connect: connection refused
W0909 11:44:21.999493 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.101.110.71:443: connect: connection refused
W0909 11:44:23.030643 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.101.110.71:443: connect: connection refused
W0909 11:44:24.059729 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.101.110.71:443: connect: connection refused
W0909 11:44:25.098825 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.101.110.71:443: connect: connection refused
W0909 11:44:35.260796 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.100.122.255:443: connect: connection refused
E0909 11:44:35.260904 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.100.122.255:443: connect: connection refused" logger="UnhandledError"
W0909 11:45:16.294322 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.100.122.255:443: connect: connection refused
E0909 11:45:16.294361 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.100.122.255:443: connect: connection refused" logger="UnhandledError"
W0909 11:45:16.313528 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.100.122.255:443: connect: connection refused
E0909 11:45:16.313574 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.100.122.255:443: connect: connection refused" logger="UnhandledError"
I0909 11:45:59.876852 1 controller.go:615] quota admission added evaluator for: jobs.batch.volcano.sh
I0909 11:45:59.913733 1 controller.go:615] quota admission added evaluator for: podgroups.scheduling.volcano.sh
==> kube-controller-manager [1a42dda2b95537cbca0a26449012a2a3b9bea44ad07b0e3559886c91d5820d3b] <==
I0909 11:45:16.322250 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0909 11:45:16.324272 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0909 11:45:16.340183 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0909 11:45:16.345851 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0909 11:45:16.356586 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0909 11:45:16.366100 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0909 11:45:16.375787 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0909 11:45:17.720272 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0909 11:45:17.733832 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0909 11:45:18.957932 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0909 11:45:19.007630 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0909 11:45:19.966283 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0909 11:45:19.976567 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0909 11:45:19.982009 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0909 11:45:20.014383 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0909 11:45:20.090263 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0909 11:45:20.119191 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0909 11:45:42.846079 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="15.248978ms"
I0909 11:45:42.846535 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="53.464µs"
I0909 11:45:49.025134 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0909 11:45:49.065814 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0909 11:45:50.009650 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0909 11:45:50.110709 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0909 11:45:57.767887 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-630724"
I0909 11:45:59.578729 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="volcano-system/volcano-admission-init" delay="0s"
==> kube-proxy [49c6943beea95fe5f33705b54a5d87a5a11a9c8cdbdb7d359d7400ff19857718] <==
I0909 11:43:01.581231 1 server_linux.go:66] "Using iptables proxy"
I0909 11:43:01.679638 1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
E0909 11:43:01.701524 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I0909 11:43:01.764695 1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I0909 11:43:01.764763 1 server_linux.go:169] "Using iptables Proxier"
I0909 11:43:01.766863 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I0909 11:43:01.767252 1 server.go:483] "Version info" version="v1.31.0"
I0909 11:43:01.767273 1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0909 11:43:01.774179 1 config.go:326] "Starting node config controller"
I0909 11:43:01.774220 1 shared_informer.go:313] Waiting for caches to sync for node config
I0909 11:43:01.774747 1 config.go:197] "Starting service config controller"
I0909 11:43:01.774769 1 shared_informer.go:313] Waiting for caches to sync for service config
I0909 11:43:01.774783 1 config.go:104] "Starting endpoint slice config controller"
I0909 11:43:01.774788 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0909 11:43:01.874730 1 shared_informer.go:320] Caches are synced for node config
I0909 11:43:01.874908 1 shared_informer.go:320] Caches are synced for endpoint slice config
I0909 11:43:01.874957 1 shared_informer.go:320] Caches are synced for service config
==> kube-scheduler [36a5807fddd61ac2693288b01d648d83ef516dd1d01e208c1c5e902e79dc1bbc] <==
E0909 11:42:52.301292 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
E0909 11:42:52.301474 1 reflector.go:158] "Unhandled Error" err="runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"
E0909 11:42:52.305202 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError"
E0909 11:42:52.305225 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
E0909 11:42:52.305251 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"
E0909 11:42:52.305266 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
E0909 11:42:52.305280 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
E0909 11:42:52.305296 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError"
E0909 11:42:52.305309 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"
E0909 11:42:52.305322 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
E0909 11:42:52.305350 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
E0909 11:42:52.305379 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0909 11:42:53.212721 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0909 11:42:53.212954 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0909 11:42:53.261769 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0909 11:42:53.262010 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0909 11:42:53.301982 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0909 11:42:53.302235 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0909 11:42:53.363799 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0909 11:42:53.364043 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0909 11:42:53.445702 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0909 11:42:53.445941 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0909 11:42:53.485401 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0909 11:42:53.485649 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError"
I0909 11:42:53.862557 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Sep 09 11:47:03 addons-630724 kubelet[1490]: E0909 11:47:03.753323 1490 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-25vg2_gadget(c94aaf2a-00d7-4b99-8aaf-2a73cfa7e837)\"" pod="gadget/gadget-25vg2" podUID="c94aaf2a-00d7-4b99-8aaf-2a73cfa7e837"
Sep 09 11:47:04 addons-630724 kubelet[1490]: I0909 11:47:04.753545 1490 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-rdh99" secret="" err="secret \"gcp-auth\" not found"
Sep 09 11:47:17 addons-630724 kubelet[1490]: I0909 11:47:17.753228 1490 scope.go:117] "RemoveContainer" containerID="b2b4400ec48f6dfa07e51c937f306b77a015a2fe931b2ccaa4d5bb2077e372e4"
Sep 09 11:47:17 addons-630724 kubelet[1490]: E0909 11:47:17.753506 1490 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-25vg2_gadget(c94aaf2a-00d7-4b99-8aaf-2a73cfa7e837)\"" pod="gadget/gadget-25vg2" podUID="c94aaf2a-00d7-4b99-8aaf-2a73cfa7e837"
Sep 09 11:47:27 addons-630724 kubelet[1490]: I0909 11:47:27.753382 1490 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-dm8pk" secret="" err="secret \"gcp-auth\" not found"
Sep 09 11:47:31 addons-630724 kubelet[1490]: I0909 11:47:31.752348 1490 scope.go:117] "RemoveContainer" containerID="b2b4400ec48f6dfa07e51c937f306b77a015a2fe931b2ccaa4d5bb2077e372e4"
Sep 09 11:47:31 addons-630724 kubelet[1490]: E0909 11:47:31.752568 1490 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-25vg2_gadget(c94aaf2a-00d7-4b99-8aaf-2a73cfa7e837)\"" pod="gadget/gadget-25vg2" podUID="c94aaf2a-00d7-4b99-8aaf-2a73cfa7e837"
Sep 09 11:47:32 addons-630724 kubelet[1490]: I0909 11:47:32.753844 1490 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-6fb4cdfc84-mr9ck" secret="" err="secret \"gcp-auth\" not found"
Sep 09 11:47:44 addons-630724 kubelet[1490]: I0909 11:47:44.754418 1490 scope.go:117] "RemoveContainer" containerID="b2b4400ec48f6dfa07e51c937f306b77a015a2fe931b2ccaa4d5bb2077e372e4"
Sep 09 11:47:44 addons-630724 kubelet[1490]: E0909 11:47:44.755053 1490 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-25vg2_gadget(c94aaf2a-00d7-4b99-8aaf-2a73cfa7e837)\"" pod="gadget/gadget-25vg2" podUID="c94aaf2a-00d7-4b99-8aaf-2a73cfa7e837"
Sep 09 11:47:56 addons-630724 kubelet[1490]: I0909 11:47:56.753456 1490 scope.go:117] "RemoveContainer" containerID="b2b4400ec48f6dfa07e51c937f306b77a015a2fe931b2ccaa4d5bb2077e372e4"
Sep 09 11:47:56 addons-630724 kubelet[1490]: E0909 11:47:56.753666 1490 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-25vg2_gadget(c94aaf2a-00d7-4b99-8aaf-2a73cfa7e837)\"" pod="gadget/gadget-25vg2" podUID="c94aaf2a-00d7-4b99-8aaf-2a73cfa7e837"
Sep 09 11:48:09 addons-630724 kubelet[1490]: I0909 11:48:09.752843 1490 scope.go:117] "RemoveContainer" containerID="b2b4400ec48f6dfa07e51c937f306b77a015a2fe931b2ccaa4d5bb2077e372e4"
Sep 09 11:48:09 addons-630724 kubelet[1490]: E0909 11:48:09.753800 1490 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-25vg2_gadget(c94aaf2a-00d7-4b99-8aaf-2a73cfa7e837)\"" pod="gadget/gadget-25vg2" podUID="c94aaf2a-00d7-4b99-8aaf-2a73cfa7e837"
Sep 09 11:48:20 addons-630724 kubelet[1490]: I0909 11:48:20.752808 1490 scope.go:117] "RemoveContainer" containerID="b2b4400ec48f6dfa07e51c937f306b77a015a2fe931b2ccaa4d5bb2077e372e4"
Sep 09 11:48:20 addons-630724 kubelet[1490]: E0909 11:48:20.753008 1490 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-25vg2_gadget(c94aaf2a-00d7-4b99-8aaf-2a73cfa7e837)\"" pod="gadget/gadget-25vg2" podUID="c94aaf2a-00d7-4b99-8aaf-2a73cfa7e837"
Sep 09 11:48:23 addons-630724 kubelet[1490]: I0909 11:48:23.752842 1490 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-rdh99" secret="" err="secret \"gcp-auth\" not found"
Sep 09 11:48:33 addons-630724 kubelet[1490]: I0909 11:48:33.752857 1490 scope.go:117] "RemoveContainer" containerID="b2b4400ec48f6dfa07e51c937f306b77a015a2fe931b2ccaa4d5bb2077e372e4"
Sep 09 11:48:33 addons-630724 kubelet[1490]: E0909 11:48:33.753083 1490 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-25vg2_gadget(c94aaf2a-00d7-4b99-8aaf-2a73cfa7e837)\"" pod="gadget/gadget-25vg2" podUID="c94aaf2a-00d7-4b99-8aaf-2a73cfa7e837"
Sep 09 11:48:34 addons-630724 kubelet[1490]: I0909 11:48:34.753807 1490 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-dm8pk" secret="" err="secret \"gcp-auth\" not found"
Sep 09 11:48:48 addons-630724 kubelet[1490]: I0909 11:48:48.753447 1490 scope.go:117] "RemoveContainer" containerID="b2b4400ec48f6dfa07e51c937f306b77a015a2fe931b2ccaa4d5bb2077e372e4"
Sep 09 11:48:48 addons-630724 kubelet[1490]: E0909 11:48:48.754094 1490 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-25vg2_gadget(c94aaf2a-00d7-4b99-8aaf-2a73cfa7e837)\"" pod="gadget/gadget-25vg2" podUID="c94aaf2a-00d7-4b99-8aaf-2a73cfa7e837"
Sep 09 11:48:59 addons-630724 kubelet[1490]: I0909 11:48:59.752982 1490 scope.go:117] "RemoveContainer" containerID="b2b4400ec48f6dfa07e51c937f306b77a015a2fe931b2ccaa4d5bb2077e372e4"
Sep 09 11:48:59 addons-630724 kubelet[1490]: E0909 11:48:59.753215 1490 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-25vg2_gadget(c94aaf2a-00d7-4b99-8aaf-2a73cfa7e837)\"" pod="gadget/gadget-25vg2" podUID="c94aaf2a-00d7-4b99-8aaf-2a73cfa7e837"
Sep 09 11:49:00 addons-630724 kubelet[1490]: I0909 11:49:00.753588 1490 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-6fb4cdfc84-mr9ck" secret="" err="secret \"gcp-auth\" not found"
==> storage-provisioner [7df1caab246cba1503b7b3f98c83d8d5243eaccd6559813510d84a53f3186c9a] <==
I0909 11:43:06.100122 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0909 11:43:06.120555 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0909 11:43:06.120629 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0909 11:43:06.141211 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0909 11:43:06.143511 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-630724_4e8161d1-fb6b-4efb-a25e-db5dd13e99df!
I0909 11:43:06.144458 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"d00c08e1-96be-4d1a-a9c3-6167005335d5", APIVersion:"v1", ResourceVersion:"526", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-630724_4e8161d1-fb6b-4efb-a25e-db5dd13e99df became leader
I0909 11:43:06.251853 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-630724_4e8161d1-fb6b-4efb-a25e-db5dd13e99df!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-630724 -n addons-630724
helpers_test.go:261: (dbg) Run: kubectl --context addons-630724 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: ingress-nginx-admission-create-p8lvw ingress-nginx-admission-patch-z4gbs test-job-nginx-0
helpers_test.go:274: ======> post-mortem[TestAddons/serial/Volcano]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-630724 describe pod ingress-nginx-admission-create-p8lvw ingress-nginx-admission-patch-z4gbs test-job-nginx-0
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-630724 describe pod ingress-nginx-admission-create-p8lvw ingress-nginx-admission-patch-z4gbs test-job-nginx-0: exit status 1 (110.732202ms)
** stderr **
Error from server (NotFound): pods "ingress-nginx-admission-create-p8lvw" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-z4gbs" not found
Error from server (NotFound): pods "test-job-nginx-0" not found
** /stderr **
helpers_test.go:279: kubectl --context addons-630724 describe pod ingress-nginx-admission-create-p8lvw ingress-nginx-admission-patch-z4gbs test-job-nginx-0: exit status 1
--- FAIL: TestAddons/serial/Volcano (200.26s)