=== RUN TestAddons/serial/Volcano
addons_test.go:851: volcano-controller stabilized in 49.455449ms
addons_test.go:843: volcano-admission stabilized in 49.772479ms
addons_test.go:835: volcano-scheduler stabilized in 50.5439ms
addons_test.go:857: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-scheduler-576bc46687-mnc29" [b2e0791f-e956-4457-b58b-bbb49568a9e1] Running
addons_test.go:857: (dbg) TestAddons/serial/Volcano: app=volcano-scheduler healthy within 6.00358557s
addons_test.go:861: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-admission-77d7d48b68-6qlln" [4c8db678-82e7-443b-b226-e2a338ee8e00] Running
addons_test.go:861: (dbg) TestAddons/serial/Volcano: app=volcano-admission healthy within 5.003941439s
addons_test.go:865: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-controllers-56675bb4d5-hzv8d" [e4176790-8b76-4f47-ad4d-01921ee37495] Running
addons_test.go:865: (dbg) TestAddons/serial/Volcano: app=volcano-controller healthy within 5.003045431s
addons_test.go:870: (dbg) Run: kubectl --context addons-365496 delete -n volcano-system job volcano-admission-init
addons_test.go:876: (dbg) Run: kubectl --context addons-365496 create -f testdata/vcjob.yaml
addons_test.go:884: (dbg) Run: kubectl --context addons-365496 get vcjob -n my-volcano
addons_test.go:902: (dbg) TestAddons/serial/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...
helpers_test.go:344: "test-job-nginx-0" [5b553ea6-4469-42a7-a5ad-2340a7584390] Pending
helpers_test.go:344: "test-job-nginx-0" [5b553ea6-4469-42a7-a5ad-2340a7584390] Pending: PodScheduled:Unschedulable (0/1 nodes are unavailable: 1 Insufficient cpu.)
helpers_test.go:329: TestAddons/serial/Volcano: WARNING: pod list for "my-volcano" "volcano.sh/job-name=test-job" returned: client rate limiter Wait returned an error: context deadline exceeded
addons_test.go:902: ***** TestAddons/serial/Volcano: pod "volcano.sh/job-name=test-job" failed to start within 3m0s: context deadline exceeded ****
addons_test.go:902: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-365496 -n addons-365496
addons_test.go:902: TestAddons/serial/Volcano: showing logs for failed pods as of 2024-09-13 18:31:26.392432699 +0000 UTC m=+438.247101746
addons_test.go:902: (dbg) Run: kubectl --context addons-365496 describe po test-job-nginx-0 -n my-volcano
addons_test.go:902: (dbg) kubectl --context addons-365496 describe po test-job-nginx-0 -n my-volcano:
Name: test-job-nginx-0
Namespace: my-volcano
Priority: 0
Service Account: default
Node: <none>
Labels: volcano.sh/job-name=test-job
volcano.sh/job-namespace=my-volcano
volcano.sh/queue-name=test
volcano.sh/task-index=0
volcano.sh/task-spec=nginx
Annotations: scheduling.k8s.io/group-name: test-job-e94bdfec-254f-409b-8cf3-146567ea4d18
volcano.sh/job-name: test-job
volcano.sh/job-version: 0
volcano.sh/queue-name: test
volcano.sh/task-index: 0
volcano.sh/task-spec: nginx
volcano.sh/template-uid: test-job-nginx
Status: Pending
IP:
IPs: <none>
Controlled By: Job/test-job
Containers:
nginx:
Image: nginx:latest
Port: <none>
Host Port: <none>
Command:
sleep
10m
Limits:
cpu: 1
Requests:
cpu: 1
Environment:
GOOGLE_APPLICATION_CREDENTIALS: /google-app-creds.json
PROJECT_ID: this_is_fake
GCP_PROJECT: this_is_fake
GCLOUD_PROJECT: this_is_fake
GOOGLE_CLOUD_PROJECT: this_is_fake
CLOUDSDK_CORE_PROJECT: this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-n5c79 (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
kube-api-access-n5c79:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
gcp-creds:
Type: HostPath (bare host directory volume)
Path: /var/lib/minikube/google_application_credentials.json
HostPathType: File
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling 2m59s volcano 0/1 nodes are unavailable: 1 Insufficient cpu.
addons_test.go:902: (dbg) Run: kubectl --context addons-365496 logs test-job-nginx-0 -n my-volcano
addons_test.go:902: (dbg) kubectl --context addons-365496 logs test-job-nginx-0 -n my-volcano:
addons_test.go:903: failed waiting for test-local-path pod: volcano.sh/job-name=test-job within 3m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestAddons/serial/Volcano]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect addons-365496
helpers_test.go:235: (dbg) docker inspect addons-365496:
-- stdout --
[
{
"Id": "4bb1777e282eaa7e2c95b915afe33cedfe4e8635b0610b141f9fccde880dfad1",
"Created": "2024-09-13T18:24:54.348786948Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 301376,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-09-13T18:24:54.487171136Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:7fd83909ee30d45ee853480d01e762968b1b9847bff4690fcb8ae034ea6e4a6b",
"ResolvConfPath": "/var/lib/docker/containers/4bb1777e282eaa7e2c95b915afe33cedfe4e8635b0610b141f9fccde880dfad1/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/4bb1777e282eaa7e2c95b915afe33cedfe4e8635b0610b141f9fccde880dfad1/hostname",
"HostsPath": "/var/lib/docker/containers/4bb1777e282eaa7e2c95b915afe33cedfe4e8635b0610b141f9fccde880dfad1/hosts",
"LogPath": "/var/lib/docker/containers/4bb1777e282eaa7e2c95b915afe33cedfe4e8635b0610b141f9fccde880dfad1/4bb1777e282eaa7e2c95b915afe33cedfe4e8635b0610b141f9fccde880dfad1-json.log",
"Name": "/addons-365496",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"addons-365496:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "addons-365496",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4194304000,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8388608000,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/fe027c633b889a1cfa37810f37d8bcef95d368b42aa44d0cca88fe8ae4aef031-init/diff:/var/lib/docker/overlay2/1e27a5e54f357010ba737f5c8a23d488564c0db127238c72cb46cd665c37659d/diff",
"MergedDir": "/var/lib/docker/overlay2/fe027c633b889a1cfa37810f37d8bcef95d368b42aa44d0cca88fe8ae4aef031/merged",
"UpperDir": "/var/lib/docker/overlay2/fe027c633b889a1cfa37810f37d8bcef95d368b42aa44d0cca88fe8ae4aef031/diff",
"WorkDir": "/var/lib/docker/overlay2/fe027c633b889a1cfa37810f37d8bcef95d368b42aa44d0cca88fe8ae4aef031/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "addons-365496",
"Source": "/var/lib/docker/volumes/addons-365496/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "addons-365496",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726193793-19634@sha256:4434bf9c4c4590e602ea482d2337d9d858a3db898bec2a85c17f78c81593c44e",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-365496",
"name.minikube.sigs.k8s.io": "addons-365496",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "d112789639439545eb7a1760b1fae05fa35f010203ce9fa04a6b792049580529",
"SandboxKey": "/var/run/docker/netns/d11278963943",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33138"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33139"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33142"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33140"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33141"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"addons-365496": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:31:02",
"DriverOpts": null,
"NetworkID": "712a4426b60e20de12cae2da7c445b50e0520bf3f20a5f9a4e0756b771011227",
"EndpointID": "591200d3112434a13d1783f150403f4a3e3aaa1d9c690fdc3700eafb6db646f5",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-365496",
"4bb1777e282e"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p addons-365496 -n addons-365496
helpers_test.go:244: <<< TestAddons/serial/Volcano FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/serial/Volcano]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p addons-365496 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-365496 logs -n 25: (1.604900283s)
helpers_test.go:252: TestAddons/serial/Volcano logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| start | -o=json --download-only | download-only-776826 | jenkins | v1.34.0 | 13 Sep 24 18:24 UTC | |
| | -p download-only-776826 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 13 Sep 24 18:24 UTC | 13 Sep 24 18:24 UTC |
| delete | -p download-only-776826 | download-only-776826 | jenkins | v1.34.0 | 13 Sep 24 18:24 UTC | 13 Sep 24 18:24 UTC |
| start | -o=json --download-only | download-only-021767 | jenkins | v1.34.0 | 13 Sep 24 18:24 UTC | |
| | -p download-only-021767 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 13 Sep 24 18:24 UTC | 13 Sep 24 18:24 UTC |
| delete | -p download-only-021767 | download-only-021767 | jenkins | v1.34.0 | 13 Sep 24 18:24 UTC | 13 Sep 24 18:24 UTC |
| delete | -p download-only-776826 | download-only-776826 | jenkins | v1.34.0 | 13 Sep 24 18:24 UTC | 13 Sep 24 18:24 UTC |
| delete | -p download-only-021767 | download-only-021767 | jenkins | v1.34.0 | 13 Sep 24 18:24 UTC | 13 Sep 24 18:24 UTC |
| start | --download-only -p | download-docker-875542 | jenkins | v1.34.0 | 13 Sep 24 18:24 UTC | |
| | download-docker-875542 | | | | | |
| | --alsologtostderr | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p download-docker-875542 | download-docker-875542 | jenkins | v1.34.0 | 13 Sep 24 18:24 UTC | 13 Sep 24 18:24 UTC |
| start | --download-only -p | binary-mirror-832553 | jenkins | v1.34.0 | 13 Sep 24 18:24 UTC | |
| | binary-mirror-832553 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:39563 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p binary-mirror-832553 | binary-mirror-832553 | jenkins | v1.34.0 | 13 Sep 24 18:24 UTC | 13 Sep 24 18:24 UTC |
| addons | disable dashboard -p | addons-365496 | jenkins | v1.34.0 | 13 Sep 24 18:24 UTC | |
| | addons-365496 | | | | | |
| addons | enable dashboard -p | addons-365496 | jenkins | v1.34.0 | 13 Sep 24 18:24 UTC | |
| | addons-365496 | | | | | |
| start | -p addons-365496 --wait=true | addons-365496 | jenkins | v1.34.0 | 13 Sep 24 18:24 UTC | 13 Sep 24 18:28 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/09/13 18:24:29
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.23.0 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0913 18:24:29.639225 300876 out.go:345] Setting OutFile to fd 1 ...
I0913 18:24:29.639460 300876 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0913 18:24:29.639473 300876 out.go:358] Setting ErrFile to fd 2...
I0913 18:24:29.639479 300876 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0913 18:24:29.639755 300876 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19636-294721/.minikube/bin
I0913 18:24:29.640310 300876 out.go:352] Setting JSON to false
I0913 18:24:29.641294 300876 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":7617,"bootTime":1726244253,"procs":158,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1069-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0913 18:24:29.641379 300876 start.go:139] virtualization:
I0913 18:24:29.643730 300876 out.go:177] * [addons-365496] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I0913 18:24:29.645637 300876 out.go:177] - MINIKUBE_LOCATION=19636
I0913 18:24:29.645778 300876 notify.go:220] Checking for updates...
I0913 18:24:29.649655 300876 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0913 18:24:29.652281 300876 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19636-294721/kubeconfig
I0913 18:24:29.654977 300876 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19636-294721/.minikube
I0913 18:24:29.657184 300876 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0913 18:24:29.659099 300876 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0913 18:24:29.661395 300876 driver.go:394] Setting default libvirt URI to qemu:///system
I0913 18:24:29.689383 300876 docker.go:123] docker version: linux-27.2.1:Docker Engine - Community
I0913 18:24:29.689516 300876 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0913 18:24:29.748655 300876 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-13 18:24:29.73901111 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1069-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.2.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0913 18:24:29.748801 300876 docker.go:318] overlay module found
I0913 18:24:29.752469 300876 out.go:177] * Using the docker driver based on user configuration
I0913 18:24:29.754683 300876 start.go:297] selected driver: docker
I0913 18:24:29.754709 300876 start.go:901] validating driver "docker" against <nil>
I0913 18:24:29.754725 300876 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0913 18:24:29.755371 300876 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0913 18:24:29.806312 300876 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-13 18:24:29.79658602 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1069-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.2.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0913 18:24:29.806527 300876 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0913 18:24:29.806760 300876 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0913 18:24:29.809531 300876 out.go:177] * Using Docker driver with root privileges
I0913 18:24:29.811912 300876 cni.go:84] Creating CNI manager for ""
I0913 18:24:29.811978 300876 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0913 18:24:29.811999 300876 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0913 18:24:29.812091 300876 start.go:340] cluster config:
{Name:addons-365496 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726193793-19634@sha256:4434bf9c4c4590e602ea482d2337d9d858a3db898bec2a85c17f78c81593c44e Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-365496 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHA
uthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0913 18:24:29.815341 300876 out.go:177] * Starting "addons-365496" primary control-plane node in "addons-365496" cluster
I0913 18:24:29.817436 300876 cache.go:121] Beginning downloading kic base image for docker with containerd
I0913 18:24:29.819627 300876 out.go:177] * Pulling base image v0.0.45-1726193793-19634 ...
I0913 18:24:29.822617 300876 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I0913 18:24:29.822668 300876 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19636-294721/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4
I0913 18:24:29.822681 300876 cache.go:56] Caching tarball of preloaded images
I0913 18:24:29.822724 300876 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726193793-19634@sha256:4434bf9c4c4590e602ea482d2337d9d858a3db898bec2a85c17f78c81593c44e in local docker daemon
I0913 18:24:29.822783 300876 preload.go:172] Found /home/jenkins/minikube-integration/19636-294721/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0913 18:24:29.822796 300876 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on containerd
I0913 18:24:29.823176 300876 profile.go:143] Saving config to /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/config.json ...
I0913 18:24:29.823257 300876 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/config.json: {Name:mk2df2a23078c7d167e3c0fb72a0cce538d9b578 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 18:24:29.843254 300876 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726193793-19634@sha256:4434bf9c4c4590e602ea482d2337d9d858a3db898bec2a85c17f78c81593c44e to local cache
I0913 18:24:29.843396 300876 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726193793-19634@sha256:4434bf9c4c4590e602ea482d2337d9d858a3db898bec2a85c17f78c81593c44e in local cache directory
I0913 18:24:29.843420 300876 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726193793-19634@sha256:4434bf9c4c4590e602ea482d2337d9d858a3db898bec2a85c17f78c81593c44e in local cache directory, skipping pull
I0913 18:24:29.843425 300876 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726193793-19634@sha256:4434bf9c4c4590e602ea482d2337d9d858a3db898bec2a85c17f78c81593c44e exists in cache, skipping pull
I0913 18:24:29.843434 300876 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726193793-19634@sha256:4434bf9c4c4590e602ea482d2337d9d858a3db898bec2a85c17f78c81593c44e as a tarball
I0913 18:24:29.843443 300876 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726193793-19634@sha256:4434bf9c4c4590e602ea482d2337d9d858a3db898bec2a85c17f78c81593c44e from local cache
I0913 18:24:47.371784 300876 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726193793-19634@sha256:4434bf9c4c4590e602ea482d2337d9d858a3db898bec2a85c17f78c81593c44e from cached tarball
I0913 18:24:47.371834 300876 cache.go:194] Successfully downloaded all kic artifacts
I0913 18:24:47.371891 300876 start.go:360] acquireMachinesLock for addons-365496: {Name:mk749daf7a7766074f9c763c16ee6bf077a81cf6 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0913 18:24:47.372022 300876 start.go:364] duration metric: took 104.615µs to acquireMachinesLock for "addons-365496"
I0913 18:24:47.372057 300876 start.go:93] Provisioning new machine with config: &{Name:addons-365496 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726193793-19634@sha256:4434bf9c4c4590e602ea482d2337d9d858a3db898bec2a85c17f78c81593c44e Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-365496 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fa
lse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0913 18:24:47.372135 300876 start.go:125] createHost starting for "" (driver="docker")
I0913 18:24:47.374970 300876 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
I0913 18:24:47.375242 300876 start.go:159] libmachine.API.Create for "addons-365496" (driver="docker")
I0913 18:24:47.375287 300876 client.go:168] LocalClient.Create starting
I0913 18:24:47.375394 300876 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19636-294721/.minikube/certs/ca.pem
I0913 18:24:47.572358 300876 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19636-294721/.minikube/certs/cert.pem
I0913 18:24:47.927712 300876 cli_runner.go:164] Run: docker network inspect addons-365496 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0913 18:24:47.948313 300876 cli_runner.go:211] docker network inspect addons-365496 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0913 18:24:47.948415 300876 network_create.go:284] running [docker network inspect addons-365496] to gather additional debugging logs...
I0913 18:24:47.948435 300876 cli_runner.go:164] Run: docker network inspect addons-365496
W0913 18:24:47.963453 300876 cli_runner.go:211] docker network inspect addons-365496 returned with exit code 1
I0913 18:24:47.963485 300876 network_create.go:287] error running [docker network inspect addons-365496]: docker network inspect addons-365496: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-365496 not found
I0913 18:24:47.963500 300876 network_create.go:289] output of [docker network inspect addons-365496]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-365496 not found
** /stderr **
I0913 18:24:47.963604 300876 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0913 18:24:47.980319 300876 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4001b3efe0}
I0913 18:24:47.980363 300876 network_create.go:124] attempt to create docker network addons-365496 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0913 18:24:47.980420 300876 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-365496 addons-365496
I0913 18:24:48.064109 300876 network_create.go:108] docker network addons-365496 192.168.49.0/24 created
I0913 18:24:48.064143 300876 kic.go:121] calculated static IP "192.168.49.2" for the "addons-365496" container
I0913 18:24:48.064228 300876 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0913 18:24:48.079914 300876 cli_runner.go:164] Run: docker volume create addons-365496 --label name.minikube.sigs.k8s.io=addons-365496 --label created_by.minikube.sigs.k8s.io=true
I0913 18:24:48.098320 300876 oci.go:103] Successfully created a docker volume addons-365496
I0913 18:24:48.098426 300876 cli_runner.go:164] Run: docker run --rm --name addons-365496-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-365496 --entrypoint /usr/bin/test -v addons-365496:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726193793-19634@sha256:4434bf9c4c4590e602ea482d2337d9d858a3db898bec2a85c17f78c81593c44e -d /var/lib
I0913 18:24:50.212177 300876 cli_runner.go:217] Completed: docker run --rm --name addons-365496-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-365496 --entrypoint /usr/bin/test -v addons-365496:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726193793-19634@sha256:4434bf9c4c4590e602ea482d2337d9d858a3db898bec2a85c17f78c81593c44e -d /var/lib: (2.113685151s)
I0913 18:24:50.212209 300876 oci.go:107] Successfully prepared a docker volume addons-365496
I0913 18:24:50.212237 300876 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I0913 18:24:50.212258 300876 kic.go:194] Starting extracting preloaded images to volume ...
I0913 18:24:50.212331 300876 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19636-294721/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-365496:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726193793-19634@sha256:4434bf9c4c4590e602ea482d2337d9d858a3db898bec2a85c17f78c81593c44e -I lz4 -xf /preloaded.tar -C /extractDir
I0913 18:24:54.284557 300876 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19636-294721/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-365496:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726193793-19634@sha256:4434bf9c4c4590e602ea482d2337d9d858a3db898bec2a85c17f78c81593c44e -I lz4 -xf /preloaded.tar -C /extractDir: (4.072180362s)
I0913 18:24:54.284591 300876 kic.go:203] duration metric: took 4.072330548s to extract preloaded images to volume ...
W0913 18:24:54.284730 300876 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0913 18:24:54.284848 300876 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0913 18:24:54.335096 300876 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-365496 --name addons-365496 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-365496 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-365496 --network addons-365496 --ip 192.168.49.2 --volume addons-365496:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726193793-19634@sha256:4434bf9c4c4590e602ea482d2337d9d858a3db898bec2a85c17f78c81593c44e
I0913 18:24:54.655201 300876 cli_runner.go:164] Run: docker container inspect addons-365496 --format={{.State.Running}}
I0913 18:24:54.678468 300876 cli_runner.go:164] Run: docker container inspect addons-365496 --format={{.State.Status}}
I0913 18:24:54.701107 300876 cli_runner.go:164] Run: docker exec addons-365496 stat /var/lib/dpkg/alternatives/iptables
I0913 18:24:54.765481 300876 oci.go:144] the created container "addons-365496" has a running status.
I0913 18:24:54.765509 300876 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19636-294721/.minikube/machines/addons-365496/id_rsa...
I0913 18:24:55.245662 300876 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19636-294721/.minikube/machines/addons-365496/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0913 18:24:55.274930 300876 cli_runner.go:164] Run: docker container inspect addons-365496 --format={{.State.Status}}
I0913 18:24:55.300708 300876 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0913 18:24:55.300733 300876 kic_runner.go:114] Args: [docker exec --privileged addons-365496 chown docker:docker /home/docker/.ssh/authorized_keys]
I0913 18:24:55.382937 300876 cli_runner.go:164] Run: docker container inspect addons-365496 --format={{.State.Status}}
I0913 18:24:55.404071 300876 machine.go:93] provisionDockerMachine start ...
I0913 18:24:55.404174 300876 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-365496
I0913 18:24:55.426305 300876 main.go:141] libmachine: Using SSH client type: native
I0913 18:24:55.426577 300876 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x41abe0] 0x41d420 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0913 18:24:55.426587 300876 main.go:141] libmachine: About to run SSH command:
hostname
I0913 18:24:55.595601 300876 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-365496
I0913 18:24:55.595685 300876 ubuntu.go:169] provisioning hostname "addons-365496"
I0913 18:24:55.595778 300876 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-365496
I0913 18:24:55.612839 300876 main.go:141] libmachine: Using SSH client type: native
I0913 18:24:55.613071 300876 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x41abe0] 0x41d420 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0913 18:24:55.613082 300876 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-365496 && echo "addons-365496" | sudo tee /etc/hostname
I0913 18:24:55.775089 300876 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-365496
I0913 18:24:55.775178 300876 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-365496
I0913 18:24:55.792639 300876 main.go:141] libmachine: Using SSH client type: native
I0913 18:24:55.792891 300876 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x41abe0] 0x41d420 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0913 18:24:55.792916 300876 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-365496' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-365496/g' /etc/hosts;
else
echo '127.0.1.1 addons-365496' | sudo tee -a /etc/hosts;
fi
fi
I0913 18:24:55.940405 300876 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0913 18:24:55.940499 300876 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19636-294721/.minikube CaCertPath:/home/jenkins/minikube-integration/19636-294721/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19636-294721/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19636-294721/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19636-294721/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19636-294721/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19636-294721/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19636-294721/.minikube}
I0913 18:24:55.940553 300876 ubuntu.go:177] setting up certificates
I0913 18:24:55.940584 300876 provision.go:84] configureAuth start
I0913 18:24:55.940684 300876 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-365496
I0913 18:24:55.956932 300876 provision.go:143] copyHostCerts
I0913 18:24:55.957017 300876 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19636-294721/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19636-294721/.minikube/ca.pem (1078 bytes)
I0913 18:24:55.957144 300876 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19636-294721/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19636-294721/.minikube/cert.pem (1123 bytes)
I0913 18:24:55.957213 300876 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19636-294721/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19636-294721/.minikube/key.pem (1679 bytes)
I0913 18:24:55.957282 300876 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19636-294721/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19636-294721/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19636-294721/.minikube/certs/ca-key.pem org=jenkins.addons-365496 san=[127.0.0.1 192.168.49.2 addons-365496 localhost minikube]
I0913 18:24:56.484797 300876 provision.go:177] copyRemoteCerts
I0913 18:24:56.484888 300876 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0913 18:24:56.484946 300876 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-365496
I0913 18:24:56.505234 300876 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19636-294721/.minikube/machines/addons-365496/id_rsa Username:docker}
I0913 18:24:56.608771 300876 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19636-294721/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0913 18:24:56.633191 300876 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19636-294721/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0913 18:24:56.657292 300876 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19636-294721/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0913 18:24:56.682473 300876 provision.go:87] duration metric: took 741.84889ms to configureAuth
I0913 18:24:56.682502 300876 ubuntu.go:193] setting minikube options for container-runtime
I0913 18:24:56.682702 300876 config.go:182] Loaded profile config "addons-365496": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I0913 18:24:56.682710 300876 machine.go:96] duration metric: took 1.278614475s to provisionDockerMachine
I0913 18:24:56.682717 300876 client.go:171] duration metric: took 9.307420337s to LocalClient.Create
I0913 18:24:56.682741 300876 start.go:167] duration metric: took 9.307500001s to libmachine.API.Create "addons-365496"
I0913 18:24:56.682750 300876 start.go:293] postStartSetup for "addons-365496" (driver="docker")
I0913 18:24:56.682759 300876 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0913 18:24:56.682813 300876 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0913 18:24:56.682860 300876 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-365496
I0913 18:24:56.699985 300876 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19636-294721/.minikube/machines/addons-365496/id_rsa Username:docker}
I0913 18:24:56.801140 300876 ssh_runner.go:195] Run: cat /etc/os-release
I0913 18:24:56.804507 300876 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0913 18:24:56.804545 300876 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0913 18:24:56.804559 300876 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0913 18:24:56.804567 300876 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0913 18:24:56.804578 300876 filesync.go:126] Scanning /home/jenkins/minikube-integration/19636-294721/.minikube/addons for local assets ...
I0913 18:24:56.804651 300876 filesync.go:126] Scanning /home/jenkins/minikube-integration/19636-294721/.minikube/files for local assets ...
I0913 18:24:56.804680 300876 start.go:296] duration metric: took 121.92474ms for postStartSetup
I0913 18:24:56.804994 300876 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-365496
I0913 18:24:56.824091 300876 profile.go:143] Saving config to /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/config.json ...
I0913 18:24:56.824402 300876 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0913 18:24:56.824456 300876 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-365496
I0913 18:24:56.840746 300876 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19636-294721/.minikube/machines/addons-365496/id_rsa Username:docker}
I0913 18:24:56.936801 300876 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0913 18:24:56.941357 300876 start.go:128] duration metric: took 9.569204693s to createHost
I0913 18:24:56.941380 300876 start.go:83] releasing machines lock for "addons-365496", held for 9.569342039s
I0913 18:24:56.941453 300876 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-365496
I0913 18:24:56.957462 300876 ssh_runner.go:195] Run: cat /version.json
I0913 18:24:56.957496 300876 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0913 18:24:56.957516 300876 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-365496
I0913 18:24:56.957573 300876 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-365496
I0913 18:24:56.974627 300876 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19636-294721/.minikube/machines/addons-365496/id_rsa Username:docker}
I0913 18:24:56.984210 300876 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19636-294721/.minikube/machines/addons-365496/id_rsa Username:docker}
I0913 18:24:57.206802 300876 ssh_runner.go:195] Run: systemctl --version
I0913 18:24:57.211239 300876 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0913 18:24:57.215463 300876 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0913 18:24:57.242027 300876 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0913 18:24:57.242137 300876 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0913 18:24:57.270934 300876 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0913 18:24:57.271002 300876 start.go:495] detecting cgroup driver to use...
I0913 18:24:57.271052 300876 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0913 18:24:57.271152 300876 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0913 18:24:57.283708 300876 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0913 18:24:57.295150 300876 docker.go:217] disabling cri-docker service (if available) ...
I0913 18:24:57.295288 300876 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0913 18:24:57.309805 300876 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0913 18:24:57.324533 300876 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0913 18:24:57.403788 300876 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0913 18:24:57.495618 300876 docker.go:233] disabling docker service ...
I0913 18:24:57.495707 300876 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0913 18:24:57.515636 300876 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0913 18:24:57.528057 300876 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0913 18:24:57.613913 300876 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0913 18:24:57.717121 300876 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0913 18:24:57.729300 300876 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0913 18:24:57.745549 300876 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0913 18:24:57.755645 300876 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0913 18:24:57.769306 300876 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0913 18:24:57.769431 300876 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0913 18:24:57.779691 300876 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0913 18:24:57.790378 300876 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0913 18:24:57.800645 300876 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0913 18:24:57.810834 300876 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0913 18:24:57.819929 300876 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0913 18:24:57.829528 300876 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0913 18:24:57.839486 300876 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0913 18:24:57.849873 300876 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0913 18:24:57.858762 300876 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0913 18:24:57.867394 300876 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0913 18:24:57.955490 300876 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0913 18:24:58.100598 300876 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0913 18:24:58.100694 300876 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0913 18:24:58.105062 300876 start.go:563] Will wait 60s for crictl version
I0913 18:24:58.105132 300876 ssh_runner.go:195] Run: which crictl
I0913 18:24:58.108808 300876 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0913 18:24:58.145398 300876 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.22
RuntimeApiVersion: v1
I0913 18:24:58.145479 300876 ssh_runner.go:195] Run: containerd --version
I0913 18:24:58.167780 300876 ssh_runner.go:195] Run: containerd --version
I0913 18:24:58.192508 300876 out.go:177] * Preparing Kubernetes v1.31.1 on containerd 1.7.22 ...
I0913 18:24:58.194548 300876 cli_runner.go:164] Run: docker network inspect addons-365496 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0913 18:24:58.208910 300876 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I0913 18:24:58.212595 300876 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0913 18:24:58.223196 300876 kubeadm.go:883] updating cluster {Name:addons-365496 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726193793-19634@sha256:4434bf9c4c4590e602ea482d2337d9d858a3db898bec2a85c17f78c81593c44e Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-365496 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cus
tomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0913 18:24:58.223354 300876 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I0913 18:24:58.223417 300876 ssh_runner.go:195] Run: sudo crictl images --output json
I0913 18:24:58.258802 300876 containerd.go:627] all images are preloaded for containerd runtime.
I0913 18:24:58.258825 300876 containerd.go:534] Images already preloaded, skipping extraction
I0913 18:24:58.258883 300876 ssh_runner.go:195] Run: sudo crictl images --output json
I0913 18:24:58.294335 300876 containerd.go:627] all images are preloaded for containerd runtime.
I0913 18:24:58.294357 300876 cache_images.go:84] Images are preloaded, skipping loading
I0913 18:24:58.294365 300876 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.1 containerd true true} ...
I0913 18:24:58.294465 300876 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-365496 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.31.1 ClusterName:addons-365496 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0913 18:24:58.294536 300876 ssh_runner.go:195] Run: sudo crictl info
I0913 18:24:58.330527 300876 cni.go:84] Creating CNI manager for ""
I0913 18:24:58.330553 300876 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0913 18:24:58.330564 300876 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0913 18:24:58.330586 300876 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-365496 NodeName:addons-365496 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc
/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0913 18:24:58.330720 300876 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "addons-365496"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0913 18:24:58.330796 300876 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1
I0913 18:24:58.339651 300876 binaries.go:44] Found k8s binaries, skipping transfer
I0913 18:24:58.339722 300876 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0913 18:24:58.348465 300876 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (317 bytes)
I0913 18:24:58.366974 300876 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0913 18:24:58.385747 300876 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2167 bytes)
I0913 18:24:58.404526 300876 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0913 18:24:58.407932 300876 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0913 18:24:58.419052 300876 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0913 18:24:58.495375 300876 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0913 18:24:58.511026 300876 certs.go:68] Setting up /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496 for IP: 192.168.49.2
I0913 18:24:58.511090 300876 certs.go:194] generating shared ca certs ...
I0913 18:24:58.511123 300876 certs.go:226] acquiring lock for ca certs: {Name:mkcfea799d72a2f680b36929e56fe310238b284d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 18:24:58.511293 300876 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19636-294721/.minikube/ca.key
I0913 18:24:59.035186 300876 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19636-294721/.minikube/ca.crt ...
I0913 18:24:59.035227 300876 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19636-294721/.minikube/ca.crt: {Name:mkfa39b4c69758910a16362024f6353f30d0f7c9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 18:24:59.035439 300876 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19636-294721/.minikube/ca.key ...
I0913 18:24:59.035454 300876 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19636-294721/.minikube/ca.key: {Name:mk2fd87d66df25022b5f2efdd2eb2d305c50e85f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 18:24:59.035930 300876 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19636-294721/.minikube/proxy-client-ca.key
I0913 18:24:59.563387 300876 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19636-294721/.minikube/proxy-client-ca.crt ...
I0913 18:24:59.563421 300876 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19636-294721/.minikube/proxy-client-ca.crt: {Name:mk9728107ab9c42757b9c6da463fd37adf684a0a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 18:24:59.564022 300876 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19636-294721/.minikube/proxy-client-ca.key ...
I0913 18:24:59.564038 300876 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19636-294721/.minikube/proxy-client-ca.key: {Name:mk9c15f225129c8039f14b758d05d6288fefbf97 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 18:24:59.564498 300876 certs.go:256] generating profile certs ...
I0913 18:24:59.564566 300876 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/client.key
I0913 18:24:59.564584 300876 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/client.crt with IP's: []
I0913 18:24:59.752949 300876 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/client.crt ...
I0913 18:24:59.752982 300876 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/client.crt: {Name:mka0c8e1b7147e05724f14b1f392b48065f0281d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 18:24:59.753175 300876 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/client.key ...
I0913 18:24:59.753188 300876 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/client.key: {Name:mk5134347a6fabeffadaf4d463f513bce01cbc03 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 18:24:59.753278 300876 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/apiserver.key.5eae004d
I0913 18:24:59.753298 300876 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/apiserver.crt.5eae004d with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I0913 18:25:00.103510 300876 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/apiserver.crt.5eae004d ...
I0913 18:25:00.103546 300876 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/apiserver.crt.5eae004d: {Name:mk0c01d8342fd876e927c87f5db8ee494908f8b8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 18:25:00.103841 300876 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/apiserver.key.5eae004d ...
I0913 18:25:00.103864 300876 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/apiserver.key.5eae004d: {Name:mk046f2ee84c2bc239a938e108ef5185102b452b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 18:25:00.103986 300876 certs.go:381] copying /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/apiserver.crt.5eae004d -> /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/apiserver.crt
I0913 18:25:00.104079 300876 certs.go:385] copying /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/apiserver.key.5eae004d -> /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/apiserver.key
I0913 18:25:00.104130 300876 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/proxy-client.key
I0913 18:25:00.104148 300876 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/proxy-client.crt with IP's: []
I0913 18:25:00.505130 300876 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/proxy-client.crt ...
I0913 18:25:00.505167 300876 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/proxy-client.crt: {Name:mkab12d195b2f18510f1918935ba15f03fd455c7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 18:25:00.511518 300876 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/proxy-client.key ...
I0913 18:25:00.511558 300876 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/proxy-client.key: {Name:mk214148346bca35e5232dce22b3c50a993b68fc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 18:25:00.511805 300876 certs.go:484] found cert: /home/jenkins/minikube-integration/19636-294721/.minikube/certs/ca-key.pem (1675 bytes)
I0913 18:25:00.511885 300876 certs.go:484] found cert: /home/jenkins/minikube-integration/19636-294721/.minikube/certs/ca.pem (1078 bytes)
I0913 18:25:00.511919 300876 certs.go:484] found cert: /home/jenkins/minikube-integration/19636-294721/.minikube/certs/cert.pem (1123 bytes)
I0913 18:25:00.511952 300876 certs.go:484] found cert: /home/jenkins/minikube-integration/19636-294721/.minikube/certs/key.pem (1679 bytes)
I0913 18:25:00.512669 300876 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19636-294721/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0913 18:25:00.542728 300876 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19636-294721/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0913 18:25:00.573321 300876 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19636-294721/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0913 18:25:00.600303 300876 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19636-294721/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0913 18:25:00.627125 300876 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0913 18:25:00.653679 300876 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0913 18:25:00.679907 300876 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0913 18:25:00.706362 300876 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19636-294721/.minikube/profiles/addons-365496/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0913 18:25:00.732549 300876 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19636-294721/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0913 18:25:00.760189 300876 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0913 18:25:00.780115 300876 ssh_runner.go:195] Run: openssl version
I0913 18:25:00.786339 300876 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0913 18:25:00.796341 300876 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0913 18:25:00.800316 300876 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 13 18:24 /usr/share/ca-certificates/minikubeCA.pem
I0913 18:25:00.800418 300876 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0913 18:25:00.808238 300876 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0913 18:25:00.818588 300876 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0913 18:25:00.822216 300876 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0913 18:25:00.822267 300876 kubeadm.go:392] StartCluster: {Name:addons-365496 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726193793-19634@sha256:4434bf9c4c4590e602ea482d2337d9d858a3db898bec2a85c17f78c81593c44e Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-365496 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom
QemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0913 18:25:00.822356 300876 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0913 18:25:00.822422 300876 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0913 18:25:00.861232 300876 cri.go:89] found id: ""
I0913 18:25:00.861307 300876 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0913 18:25:00.870499 300876 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0913 18:25:00.879805 300876 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0913 18:25:00.879963 300876 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0913 18:25:00.889845 300876 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0913 18:25:00.889868 300876 kubeadm.go:157] found existing configuration files:
I0913 18:25:00.889942 300876 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0913 18:25:00.899434 300876 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0913 18:25:00.899508 300876 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0913 18:25:00.908551 300876 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0913 18:25:00.917826 300876 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0913 18:25:00.917916 300876 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0913 18:25:00.926539 300876 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0913 18:25:00.935739 300876 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0913 18:25:00.935833 300876 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0913 18:25:00.944643 300876 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0913 18:25:00.954401 300876 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0913 18:25:00.954475 300876 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0913 18:25:00.963591 300876 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0913 18:25:01.007354 300876 kubeadm.go:310] [init] Using Kubernetes version: v1.31.1
I0913 18:25:01.007419 300876 kubeadm.go:310] [preflight] Running pre-flight checks
I0913 18:25:01.038248 300876 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0913 18:25:01.038327 300876 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1069-aws[0m
I0913 18:25:01.038368 300876 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0913 18:25:01.038419 300876 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0913 18:25:01.038471 300876 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0913 18:25:01.038523 300876 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0913 18:25:01.038575 300876 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0913 18:25:01.038629 300876 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0913 18:25:01.038686 300876 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0913 18:25:01.038735 300876 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0913 18:25:01.038784 300876 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0913 18:25:01.038834 300876 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0913 18:25:01.119028 300876 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0913 18:25:01.119145 300876 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0913 18:25:01.119262 300876 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0913 18:25:01.128277 300876 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0913 18:25:01.131253 300876 out.go:235] - Generating certificates and keys ...
I0913 18:25:01.131399 300876 kubeadm.go:310] [certs] Using existing ca certificate authority
I0913 18:25:01.131483 300876 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0913 18:25:01.526009 300876 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0913 18:25:02.049016 300876 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0913 18:25:02.919499 300876 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0913 18:25:03.053637 300876 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0913 18:25:03.640156 300876 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0913 18:25:03.640479 300876 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-365496 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0913 18:25:03.982538 300876 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0913 18:25:03.982864 300876 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-365496 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0913 18:25:04.637803 300876 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0913 18:25:05.321823 300876 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0913 18:25:06.187331 300876 kubeadm.go:310] [certs] Generating "sa" key and public key
I0913 18:25:06.187659 300876 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0913 18:25:06.793805 300876 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0913 18:25:07.641536 300876 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0913 18:25:09.047296 300876 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0913 18:25:10.234052 300876 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0913 18:25:10.898995 300876 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0913 18:25:10.901867 300876 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0913 18:25:10.904744 300876 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0913 18:25:10.906866 300876 out.go:235] - Booting up control plane ...
I0913 18:25:10.906974 300876 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0913 18:25:10.907051 300876 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0913 18:25:10.907798 300876 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0913 18:25:10.920025 300876 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0913 18:25:10.926500 300876 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0913 18:25:10.926868 300876 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0913 18:25:11.030335 300876 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0913 18:25:11.030478 300876 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0913 18:25:12.534076 300876 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.50394154s
I0913 18:25:12.534165 300876 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0913 18:25:19.036479 300876 kubeadm.go:310] [api-check] The API server is healthy after 6.502220303s
I0913 18:25:19.062169 300876 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0913 18:25:19.076042 300876 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0913 18:25:19.100310 300876 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0913 18:25:19.100532 300876 kubeadm.go:310] [mark-control-plane] Marking the node addons-365496 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0913 18:25:19.110811 300876 kubeadm.go:310] [bootstrap-token] Using token: r3yeef.060crf9oxzvbcg7z
I0913 18:25:19.112918 300876 out.go:235] - Configuring RBAC rules ...
I0913 18:25:19.113050 300876 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0913 18:25:19.117763 300876 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0913 18:25:19.125668 300876 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0913 18:25:19.129524 300876 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0913 18:25:19.134911 300876 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0913 18:25:19.138720 300876 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0913 18:25:19.449341 300876 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0913 18:25:19.882855 300876 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0913 18:25:20.449519 300876 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0913 18:25:20.450606 300876 kubeadm.go:310]
I0913 18:25:20.450682 300876 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0913 18:25:20.450688 300876 kubeadm.go:310]
I0913 18:25:20.450781 300876 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0913 18:25:20.450786 300876 kubeadm.go:310]
I0913 18:25:20.450811 300876 kubeadm.go:310] mkdir -p $HOME/.kube
I0913 18:25:20.450870 300876 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0913 18:25:20.450920 300876 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0913 18:25:20.450925 300876 kubeadm.go:310]
I0913 18:25:20.450978 300876 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0913 18:25:20.450982 300876 kubeadm.go:310]
I0913 18:25:20.451030 300876 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0913 18:25:20.451035 300876 kubeadm.go:310]
I0913 18:25:20.451086 300876 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0913 18:25:20.451160 300876 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0913 18:25:20.451228 300876 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0913 18:25:20.451232 300876 kubeadm.go:310]
I0913 18:25:20.451341 300876 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0913 18:25:20.451419 300876 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0913 18:25:20.451423 300876 kubeadm.go:310]
I0913 18:25:20.451507 300876 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token r3yeef.060crf9oxzvbcg7z \
I0913 18:25:20.451608 300876 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:13941826923f22ac0db2edd39cf0a3b801bee2d7b6f854537f110b8d070e63eb \
I0913 18:25:20.451631 300876 kubeadm.go:310] --control-plane
I0913 18:25:20.451635 300876 kubeadm.go:310]
I0913 18:25:20.451718 300876 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0913 18:25:20.451723 300876 kubeadm.go:310]
I0913 18:25:20.451803 300876 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token r3yeef.060crf9oxzvbcg7z \
I0913 18:25:20.451932 300876 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:13941826923f22ac0db2edd39cf0a3b801bee2d7b6f854537f110b8d070e63eb
I0913 18:25:20.454537 300876 kubeadm.go:310] W0913 18:25:01.003911 1012 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0913 18:25:20.454947 300876 kubeadm.go:310] W0913 18:25:01.004812 1012 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0913 18:25:20.455238 300876 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1069-aws\n", err: exit status 1
I0913 18:25:20.455399 300876 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0913 18:25:20.455426 300876 cni.go:84] Creating CNI manager for ""
I0913 18:25:20.455437 300876 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0913 18:25:20.459080 300876 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0913 18:25:20.460975 300876 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0913 18:25:20.465605 300876 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.1/kubectl ...
I0913 18:25:20.465626 300876 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I0913 18:25:20.484731 300876 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0913 18:25:20.773769 300876 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0913 18:25:20.773903 300876 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 18:25:20.773953 300876 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-365496 minikube.k8s.io/updated_at=2024_09_13T18_25_20_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=fdd33bebc6743cfd1c61ec7fe066add478610a92 minikube.k8s.io/name=addons-365496 minikube.k8s.io/primary=true
I0913 18:25:20.787318 300876 ops.go:34] apiserver oom_adj: -16
I0913 18:25:20.988940 300876 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 18:25:21.489724 300876 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 18:25:21.990018 300876 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 18:25:22.489274 300876 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 18:25:22.989786 300876 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 18:25:23.489950 300876 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 18:25:23.989590 300876 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 18:25:24.489849 300876 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 18:25:24.607506 300876 kubeadm.go:1113] duration metric: took 3.833651264s to wait for elevateKubeSystemPrivileges
I0913 18:25:24.607535 300876 kubeadm.go:394] duration metric: took 23.785273092s to StartCluster
I0913 18:25:24.607553 300876 settings.go:142] acquiring lock: {Name:mk333e8204c78b81aa3f1acc0bed9e0be37c938b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 18:25:24.608063 300876 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19636-294721/kubeconfig
I0913 18:25:24.608461 300876 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19636-294721/kubeconfig: {Name:mkda3b252234a454ce87630794d60843f992d9e0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 18:25:24.609016 300876 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0913 18:25:24.609246 300876 config.go:182] Loaded profile config "addons-365496": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I0913 18:25:24.609277 300876 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I0913 18:25:24.609371 300876 addons.go:69] Setting yakd=true in profile "addons-365496"
I0913 18:25:24.609384 300876 addons.go:234] Setting addon yakd=true in "addons-365496"
I0913 18:25:24.609408 300876 host.go:66] Checking if "addons-365496" exists ...
I0913 18:25:24.609864 300876 cli_runner.go:164] Run: docker container inspect addons-365496 --format={{.State.Status}}
I0913 18:25:24.609053 300876 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0913 18:25:24.610395 300876 addons.go:69] Setting cloud-spanner=true in profile "addons-365496"
I0913 18:25:24.610421 300876 addons.go:234] Setting addon cloud-spanner=true in "addons-365496"
I0913 18:25:24.610448 300876 host.go:66] Checking if "addons-365496" exists ...
I0913 18:25:24.610954 300876 cli_runner.go:164] Run: docker container inspect addons-365496 --format={{.State.Status}}
I0913 18:25:24.612236 300876 out.go:177] * Verifying Kubernetes components...
I0913 18:25:24.612565 300876 addons.go:69] Setting registry=true in profile "addons-365496"
I0913 18:25:24.612604 300876 addons.go:234] Setting addon registry=true in "addons-365496"
I0913 18:25:24.612661 300876 host.go:66] Checking if "addons-365496" exists ...
I0913 18:25:24.613999 300876 cli_runner.go:164] Run: docker container inspect addons-365496 --format={{.State.Status}}
I0913 18:25:24.614504 300876 addons.go:69] Setting storage-provisioner=true in profile "addons-365496"
I0913 18:25:24.614558 300876 addons.go:234] Setting addon storage-provisioner=true in "addons-365496"
I0913 18:25:24.614602 300876 host.go:66] Checking if "addons-365496" exists ...
I0913 18:25:24.616464 300876 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-365496"
I0913 18:25:24.616520 300876 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-365496"
I0913 18:25:24.616551 300876 host.go:66] Checking if "addons-365496" exists ...
I0913 18:25:24.616975 300876 cli_runner.go:164] Run: docker container inspect addons-365496 --format={{.State.Status}}
I0913 18:25:24.615936 300876 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-365496"
I0913 18:25:24.617448 300876 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-365496"
I0913 18:25:24.617766 300876 cli_runner.go:164] Run: docker container inspect addons-365496 --format={{.State.Status}}
I0913 18:25:24.615962 300876 addons.go:69] Setting volcano=true in profile "addons-365496"
I0913 18:25:24.630808 300876 addons.go:234] Setting addon volcano=true in "addons-365496"
I0913 18:25:24.644108 300876 host.go:66] Checking if "addons-365496" exists ...
I0913 18:25:24.644761 300876 cli_runner.go:164] Run: docker container inspect addons-365496 --format={{.State.Status}}
I0913 18:25:24.630871 300876 addons.go:69] Setting default-storageclass=true in profile "addons-365496"
I0913 18:25:24.653230 300876 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-365496"
I0913 18:25:24.653709 300876 cli_runner.go:164] Run: docker container inspect addons-365496 --format={{.State.Status}}
I0913 18:25:24.630892 300876 addons.go:69] Setting gcp-auth=true in profile "addons-365496"
I0913 18:25:24.668140 300876 mustload.go:65] Loading cluster: addons-365496
I0913 18:25:24.668344 300876 config.go:182] Loaded profile config "addons-365496": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I0913 18:25:24.668605 300876 cli_runner.go:164] Run: docker container inspect addons-365496 --format={{.State.Status}}
I0913 18:25:24.630899 300876 addons.go:69] Setting ingress=true in profile "addons-365496"
I0913 18:25:24.680082 300876 addons.go:234] Setting addon ingress=true in "addons-365496"
I0913 18:25:24.680149 300876 host.go:66] Checking if "addons-365496" exists ...
I0913 18:25:24.680641 300876 cli_runner.go:164] Run: docker container inspect addons-365496 --format={{.State.Status}}
I0913 18:25:24.630907 300876 addons.go:69] Setting ingress-dns=true in profile "addons-365496"
I0913 18:25:24.692805 300876 addons.go:234] Setting addon ingress-dns=true in "addons-365496"
I0913 18:25:24.692940 300876 host.go:66] Checking if "addons-365496" exists ...
I0913 18:25:24.693557 300876 cli_runner.go:164] Run: docker container inspect addons-365496 --format={{.State.Status}}
I0913 18:25:24.694064 300876 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.23
I0913 18:25:24.703325 300876 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I0913 18:25:24.703677 300876 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
I0913 18:25:24.703725 300876 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0913 18:25:24.703822 300876 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-365496
I0913 18:25:24.630914 300876 addons.go:69] Setting inspektor-gadget=true in profile "addons-365496"
I0913 18:25:24.704499 300876 addons.go:234] Setting addon inspektor-gadget=true in "addons-365496"
I0913 18:25:24.704560 300876 host.go:66] Checking if "addons-365496" exists ...
I0913 18:25:24.705215 300876 cli_runner.go:164] Run: docker container inspect addons-365496 --format={{.State.Status}}
I0913 18:25:24.708903 300876 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
I0913 18:25:24.708966 300876 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0913 18:25:24.709056 300876 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-365496
I0913 18:25:24.630921 300876 addons.go:69] Setting metrics-server=true in profile "addons-365496"
I0913 18:25:24.764436 300876 addons.go:234] Setting addon metrics-server=true in "addons-365496"
I0913 18:25:24.764491 300876 host.go:66] Checking if "addons-365496" exists ...
I0913 18:25:24.764984 300876 cli_runner.go:164] Run: docker container inspect addons-365496 --format={{.State.Status}}
I0913 18:25:24.630929 300876 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-365496"
I0913 18:25:24.784111 300876 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-365496"
I0913 18:25:24.784153 300876 host.go:66] Checking if "addons-365496" exists ...
I0913 18:25:24.784619 300876 cli_runner.go:164] Run: docker container inspect addons-365496 --format={{.State.Status}}
I0913 18:25:24.631417 300876 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0913 18:25:24.631807 300876 cli_runner.go:164] Run: docker container inspect addons-365496 --format={{.State.Status}}
I0913 18:25:24.804848 300876 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0913 18:25:24.810026 300876 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-365496"
I0913 18:25:24.810078 300876 host.go:66] Checking if "addons-365496" exists ...
I0913 18:25:24.810515 300876 cli_runner.go:164] Run: docker container inspect addons-365496 --format={{.State.Status}}
I0913 18:25:24.615972 300876 addons.go:69] Setting volumesnapshots=true in profile "addons-365496"
I0913 18:25:24.815138 300876 addons.go:234] Setting addon volumesnapshots=true in "addons-365496"
I0913 18:25:24.815180 300876 host.go:66] Checking if "addons-365496" exists ...
I0913 18:25:24.815662 300876 cli_runner.go:164] Run: docker container inspect addons-365496 --format={{.State.Status}}
I0913 18:25:24.836288 300876 host.go:66] Checking if "addons-365496" exists ...
I0913 18:25:24.837338 300876 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0913 18:25:24.844258 300876 out.go:177] - Using image docker.io/volcanosh/vc-scheduler:v1.9.0
I0913 18:25:24.846489 300876 out.go:177] - Using image docker.io/registry:2.8.3
I0913 18:25:24.838632 300876 addons.go:234] Setting addon default-storageclass=true in "addons-365496"
I0913 18:25:24.871456 300876 host.go:66] Checking if "addons-365496" exists ...
I0913 18:25:24.887504 300876 out.go:177] - Using image docker.io/volcanosh/vc-webhook-manager:v1.9.0
I0913 18:25:24.887715 300876 cli_runner.go:164] Run: docker container inspect addons-365496 --format={{.State.Status}}
I0913 18:25:24.891987 300876 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
I0913 18:25:24.892322 300876 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0913 18:25:24.892796 300876 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2
I0913 18:25:24.893276 300876 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I0913 18:25:24.893612 300876 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0913 18:25:24.918740 300876 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19636-294721/.minikube/machines/addons-365496/id_rsa Username:docker}
I0913 18:25:24.919458 300876 out.go:177] - Using image docker.io/volcanosh/vc-controller-manager:v1.9.0
I0913 18:25:24.919446 300876 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
I0913 18:25:24.919562 300876 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I0913 18:25:24.920063 300876 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-365496
I0913 18:25:24.924111 300876 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0913 18:25:24.928755 300876 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml
I0913 18:25:24.931047 300876 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (434001 bytes)
I0913 18:25:24.931172 300876 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-365496
I0913 18:25:24.945416 300876 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0913 18:25:24.947259 300876 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0913 18:25:24.947605 300876 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0913 18:25:24.947622 300876 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0913 18:25:24.947684 300876 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-365496
I0913 18:25:24.950849 300876 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0913 18:25:24.952697 300876 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0913 18:25:24.955229 300876 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0913 18:25:24.957087 300876 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0913 18:25:24.957191 300876 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0913 18:25:24.957206 300876 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0913 18:25:24.957274 300876 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-365496
I0913 18:25:24.990936 300876 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0913 18:25:24.990958 300876 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I0913 18:25:24.991023 300876 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-365496
I0913 18:25:25.002992 300876 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0913 18:25:25.003357 300876 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0
I0913 18:25:25.003076 300876 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0913 18:25:25.003174 300876 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19636-294721/.minikube/machines/addons-365496/id_rsa Username:docker}
I0913 18:25:25.014146 300876 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0913 18:25:25.016774 300876 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
I0913 18:25:25.017160 300876 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0913 18:25:25.017478 300876 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0913 18:25:25.017639 300876 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-365496
I0913 18:25:25.030878 300876 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0913 18:25:25.030902 300876 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0913 18:25:25.030985 300876 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-365496
I0913 18:25:25.017187 300876 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0913 18:25:25.032148 300876 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0913 18:25:25.032229 300876 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-365496
I0913 18:25:25.017194 300876 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
I0913 18:25:25.068038 300876 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I0913 18:25:25.068114 300876 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-365496
I0913 18:25:25.084154 300876 out.go:177] - Using image docker.io/busybox:stable
I0913 18:25:25.086611 300876 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0913 18:25:25.086631 300876 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0913 18:25:25.086695 300876 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-365496
I0913 18:25:25.090212 300876 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2
I0913 18:25:25.092219 300876 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0913 18:25:25.092253 300876 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0913 18:25:25.092335 300876 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-365496
I0913 18:25:25.125798 300876 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0913 18:25:25.125821 300876 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0913 18:25:25.125889 300876 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-365496
I0913 18:25:25.130137 300876 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19636-294721/.minikube/machines/addons-365496/id_rsa Username:docker}
I0913 18:25:25.130613 300876 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19636-294721/.minikube/machines/addons-365496/id_rsa Username:docker}
I0913 18:25:25.146034 300876 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19636-294721/.minikube/machines/addons-365496/id_rsa Username:docker}
I0913 18:25:25.167025 300876 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19636-294721/.minikube/machines/addons-365496/id_rsa Username:docker}
I0913 18:25:25.220557 300876 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19636-294721/.minikube/machines/addons-365496/id_rsa Username:docker}
I0913 18:25:25.221948 300876 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19636-294721/.minikube/machines/addons-365496/id_rsa Username:docker}
I0913 18:25:25.224969 300876 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19636-294721/.minikube/machines/addons-365496/id_rsa Username:docker}
I0913 18:25:25.233237 300876 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19636-294721/.minikube/machines/addons-365496/id_rsa Username:docker}
I0913 18:25:25.239289 300876 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19636-294721/.minikube/machines/addons-365496/id_rsa Username:docker}
I0913 18:25:25.247821 300876 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0913 18:25:25.249094 300876 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19636-294721/.minikube/machines/addons-365496/id_rsa Username:docker}
I0913 18:25:25.272097 300876 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19636-294721/.minikube/machines/addons-365496/id_rsa Username:docker}
I0913 18:25:25.274417 300876 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19636-294721/.minikube/machines/addons-365496/id_rsa Username:docker}
W0913 18:25:25.275922 300876 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0913 18:25:25.275950 300876 retry.go:31] will retry after 181.749268ms: ssh: handshake failed: EOF
I0913 18:25:25.468533 300876 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
I0913 18:25:25.468611 300876 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0913 18:25:25.590330 300876 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
I0913 18:25:25.590405 300876 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0913 18:25:25.637192 300876 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0913 18:25:25.745266 300876 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0913 18:25:25.787573 300876 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0913 18:25:25.811985 300876 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0913 18:25:25.844939 300876 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0913 18:25:25.844964 300876 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0913 18:25:25.851737 300876 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0913 18:25:25.898837 300876 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I0913 18:25:25.898864 300876 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I0913 18:25:25.922777 300876 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0913 18:25:25.933280 300876 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0913 18:25:25.933307 300876 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0913 18:25:25.971084 300876 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
I0913 18:25:25.971111 300876 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0913 18:25:25.973678 300876 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0913 18:25:25.973702 300876 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0913 18:25:26.014811 300876 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
I0913 18:25:26.014843 300876 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0913 18:25:26.051802 300876 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
I0913 18:25:26.061319 300876 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0913 18:25:26.248703 300876 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0913 18:25:26.248731 300876 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0913 18:25:26.303487 300876 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0913 18:25:26.303568 300876 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0913 18:25:26.316440 300876 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
I0913 18:25:26.316508 300876 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0913 18:25:26.330039 300876 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
I0913 18:25:26.330119 300876 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I0913 18:25:26.394657 300876 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
I0913 18:25:26.394732 300876 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0913 18:25:26.409029 300876 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0913 18:25:26.409104 300876 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0913 18:25:26.550865 300876 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0913 18:25:26.550937 300876 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0913 18:25:26.656592 300876 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0913 18:25:26.686734 300876 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0913 18:25:26.686797 300876 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0913 18:25:26.688903 300876 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I0913 18:25:26.688972 300876 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I0913 18:25:26.708195 300876 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0913 18:25:26.708268 300876 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0913 18:25:26.756790 300876 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0913 18:25:26.756870 300876 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0913 18:25:26.822559 300876 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0913 18:25:26.891175 300876 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0913 18:25:26.961494 300876 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0913 18:25:26.961568 300876 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0913 18:25:27.078344 300876 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I0913 18:25:27.078422 300876 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I0913 18:25:27.114236 300876 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0913 18:25:27.114308 300876 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0913 18:25:27.242771 300876 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I0913 18:25:27.242847 300876 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I0913 18:25:27.256494 300876 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0913 18:25:27.256568 300876 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0913 18:25:27.329819 300876 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.411343557s)
I0913 18:25:27.329846 300876 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I0913 18:25:27.330836 300876 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (2.082963437s)
I0913 18:25:27.331535 300876 node_ready.go:35] waiting up to 6m0s for node "addons-365496" to be "Ready" ...
I0913 18:25:27.335076 300876 node_ready.go:49] node "addons-365496" has status "Ready":"True"
I0913 18:25:27.335147 300876 node_ready.go:38] duration metric: took 3.593366ms for node "addons-365496" to be "Ready" ...
I0913 18:25:27.335171 300876 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0913 18:25:27.348826 300876 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-88c7r" in "kube-system" namespace to be "Ready" ...
I0913 18:25:27.375590 300876 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0913 18:25:27.666616 300876 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0913 18:25:27.666689 300876 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0913 18:25:27.676881 300876 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
I0913 18:25:27.676944 300876 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I0913 18:25:27.847470 300876 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-365496" context rescaled to 1 replicas
I0913 18:25:27.870455 300876 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (2.233165181s)
I0913 18:25:27.962733 300876 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
I0913 18:25:27.962803 300876 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
I0913 18:25:27.977203 300876 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0913 18:25:27.977277 300876 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0913 18:25:28.116971 300876 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I0913 18:25:28.153155 300876 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0913 18:25:28.153225 300876 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0913 18:25:28.335197 300876 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0913 18:25:28.335277 300876 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0913 18:25:28.351948 300876 pod_ready.go:98] error getting pod "coredns-7c65d6cfc9-88c7r" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-88c7r" not found
I0913 18:25:28.352022 300876 pod_ready.go:82] duration metric: took 1.003126016s for pod "coredns-7c65d6cfc9-88c7r" in "kube-system" namespace to be "Ready" ...
E0913 18:25:28.352049 300876 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-7c65d6cfc9-88c7r" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-88c7r" not found
I0913 18:25:28.352077 300876 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-qx7rg" in "kube-system" namespace to be "Ready" ...
I0913 18:25:28.609954 300876 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0913 18:25:28.610028 300876 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0913 18:25:28.883588 300876 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0913 18:25:29.423563 300876 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (3.678242826s)
I0913 18:25:29.985967 300876 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (4.134206918s)
I0913 18:25:29.986070 300876 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (4.198474583s)
I0913 18:25:29.985890 300876 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (4.173869952s)
I0913 18:25:30.364750 300876 pod_ready.go:103] pod "coredns-7c65d6cfc9-qx7rg" in "kube-system" namespace has status "Ready":"False"
I0913 18:25:32.095516 300876 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0913 18:25:32.095657 300876 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-365496
I0913 18:25:32.120742 300876 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19636-294721/.minikube/machines/addons-365496/id_rsa Username:docker}
I0913 18:25:32.437625 300876 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0913 18:25:32.593591 300876 addons.go:234] Setting addon gcp-auth=true in "addons-365496"
I0913 18:25:32.593644 300876 host.go:66] Checking if "addons-365496" exists ...
I0913 18:25:32.594117 300876 cli_runner.go:164] Run: docker container inspect addons-365496 --format={{.State.Status}}
I0913 18:25:32.618230 300876 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0913 18:25:32.618285 300876 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-365496
I0913 18:25:32.659706 300876 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19636-294721/.minikube/machines/addons-365496/id_rsa Username:docker}
I0913 18:25:32.858526 300876 pod_ready.go:103] pod "coredns-7c65d6cfc9-qx7rg" in "kube-system" namespace has status "Ready":"False"
I0913 18:25:33.397404 300876 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (7.47458741s)
I0913 18:25:33.397437 300876 addons.go:475] Verifying addon ingress=true in "addons-365496"
I0913 18:25:33.402276 300876 out.go:177] * Verifying ingress addon...
I0913 18:25:33.405324 300876 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0913 18:25:33.409221 300876 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0913 18:25:33.409248 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:33.941002 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:34.445513 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:34.905091 300876 pod_ready.go:103] pod "coredns-7c65d6cfc9-qx7rg" in "kube-system" namespace has status "Ready":"False"
I0913 18:25:34.948924 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:35.043280 300876 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (8.991437918s)
I0913 18:25:35.043346 300876 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (8.982005314s)
I0913 18:25:35.043580 300876 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.386914895s)
I0913 18:25:35.043601 300876 addons.go:475] Verifying addon metrics-server=true in "addons-365496"
I0913 18:25:35.043639 300876 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (8.221010994s)
I0913 18:25:35.043772 300876 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (8.15252447s)
I0913 18:25:35.043787 300876 addons.go:475] Verifying addon registry=true in "addons-365496"
I0913 18:25:35.043942 300876 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (7.668316652s)
W0913 18:25:35.043976 300876 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0913 18:25:35.043994 300876 retry.go:31] will retry after 160.071968ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0913 18:25:35.044070 300876 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (6.927027208s)
I0913 18:25:35.046771 300876 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-365496 service yakd-dashboard -n yakd-dashboard
I0913 18:25:35.046907 300876 out.go:177] * Verifying registry addon...
I0913 18:25:35.049655 300876 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0913 18:25:35.111742 300876 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0913 18:25:35.111775 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:35.204420 300876 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0913 18:25:35.416997 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:35.556086 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:35.710837 300876 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (6.827152537s)
I0913 18:25:35.710878 300876 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-365496"
I0913 18:25:35.711045 300876 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (3.092793993s)
I0913 18:25:35.713064 300876 out.go:177] * Verifying csi-hostpath-driver addon...
I0913 18:25:35.713119 300876 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
I0913 18:25:35.716634 300876 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0913 18:25:35.719136 300876 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0913 18:25:35.721087 300876 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0913 18:25:35.721117 300876 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0913 18:25:35.744285 300876 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0913 18:25:35.744363 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:35.859413 300876 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0913 18:25:35.859443 300876 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0913 18:25:35.910493 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:35.934281 300876 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0913 18:25:35.934302 300876 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I0913 18:25:35.982734 300876 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0913 18:25:36.054424 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:36.233428 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:36.410086 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:36.553390 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:36.721486 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:36.914070 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:37.066359 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:37.095536 300876 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.891057294s)
I0913 18:25:37.095699 300876 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.112892829s)
I0913 18:25:37.099834 300876 addons.go:475] Verifying addon gcp-auth=true in "addons-365496"
I0913 18:25:37.103207 300876 out.go:177] * Verifying gcp-auth addon...
I0913 18:25:37.106539 300876 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0913 18:25:37.163105 300876 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0913 18:25:37.221629 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:37.358390 300876 pod_ready.go:103] pod "coredns-7c65d6cfc9-qx7rg" in "kube-system" namespace has status "Ready":"False"
I0913 18:25:37.409734 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:37.553954 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:37.722848 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:37.909800 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:38.057095 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:38.257988 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:38.411180 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:38.554382 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:38.723104 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:38.914134 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:39.054484 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:39.223273 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:39.361344 300876 pod_ready.go:103] pod "coredns-7c65d6cfc9-qx7rg" in "kube-system" namespace has status "Ready":"False"
I0913 18:25:39.410016 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:39.555498 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:39.722583 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:39.914282 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:40.054960 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:40.222070 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:40.410103 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:40.554252 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:40.722547 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:40.910357 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:41.054890 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:41.221854 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:41.410100 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:41.554940 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:41.721316 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:41.859334 300876 pod_ready.go:103] pod "coredns-7c65d6cfc9-qx7rg" in "kube-system" namespace has status "Ready":"False"
I0913 18:25:41.910227 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:42.053942 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:42.224774 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:42.409780 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:42.553311 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:42.721439 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:42.915463 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:43.054490 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:43.222843 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:43.409823 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:43.553288 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:43.721338 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:43.910372 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:44.054571 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:44.257002 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:44.358453 300876 pod_ready.go:103] pod "coredns-7c65d6cfc9-qx7rg" in "kube-system" namespace has status "Ready":"False"
I0913 18:25:44.412275 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:44.553863 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:44.721244 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:44.909645 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:45.058311 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:45.225012 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:45.410893 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:45.553594 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:45.721800 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:45.909953 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:46.053808 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:46.220938 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:46.358811 300876 pod_ready.go:103] pod "coredns-7c65d6cfc9-qx7rg" in "kube-system" namespace has status "Ready":"False"
I0913 18:25:46.409404 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:46.553676 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:46.721889 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:46.909942 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:47.053510 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:47.222624 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:47.410538 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:47.553367 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:47.721473 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:47.910070 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:48.054310 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:48.222204 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:48.410000 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:48.553565 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:48.721927 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:48.858131 300876 pod_ready.go:103] pod "coredns-7c65d6cfc9-qx7rg" in "kube-system" namespace has status "Ready":"False"
I0913 18:25:48.910032 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:49.053594 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:49.221930 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:49.410023 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:49.554115 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:49.721458 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:49.910124 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:50.054727 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:50.221586 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:50.410211 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:50.554289 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:50.722607 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:50.910061 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:51.054039 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:51.221948 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:51.358047 300876 pod_ready.go:103] pod "coredns-7c65d6cfc9-qx7rg" in "kube-system" namespace has status "Ready":"False"
I0913 18:25:51.410260 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:51.553936 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:51.721089 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:51.909948 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:52.053967 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:52.221051 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:52.409617 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:52.553305 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:52.722316 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:52.910333 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:53.054064 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:53.221307 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:53.358789 300876 pod_ready.go:103] pod "coredns-7c65d6cfc9-qx7rg" in "kube-system" namespace has status "Ready":"False"
I0913 18:25:53.409583 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:53.554269 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:53.721700 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:53.910865 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:54.053838 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:54.221348 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:54.410767 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:54.553119 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:54.732150 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:54.910160 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:55.053961 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:55.221836 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:55.410354 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:55.554001 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:55.720898 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:55.867748 300876 pod_ready.go:103] pod "coredns-7c65d6cfc9-qx7rg" in "kube-system" namespace has status "Ready":"False"
I0913 18:25:55.910240 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:56.054724 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:56.221266 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:56.409724 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:56.553110 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:56.721464 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:56.909672 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:57.053307 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:57.221797 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:57.409429 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:57.554156 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:57.720797 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:57.909828 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:58.053468 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:58.221591 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:58.357954 300876 pod_ready.go:103] pod "coredns-7c65d6cfc9-qx7rg" in "kube-system" namespace has status "Ready":"False"
I0913 18:25:58.409539 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:58.553528 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:58.756633 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:58.911149 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:59.053678 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:59.221512 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:59.409611 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:25:59.553125 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:25:59.721622 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:25:59.910359 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:00.105872 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:00.247650 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:00.361677 300876 pod_ready.go:103] pod "coredns-7c65d6cfc9-qx7rg" in "kube-system" namespace has status "Ready":"False"
I0913 18:26:00.411644 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:00.554155 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:00.721992 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:00.910341 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:01.053802 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:01.222426 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:01.410167 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:01.554127 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:01.721601 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:01.910705 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:02.053333 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:02.221689 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:02.410708 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:02.553227 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:02.724147 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:02.858809 300876 pod_ready.go:103] pod "coredns-7c65d6cfc9-qx7rg" in "kube-system" namespace has status "Ready":"False"
I0913 18:26:02.910125 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:03.054356 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:03.222726 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:03.410403 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:03.555194 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:03.721971 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:03.910481 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:04.053540 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:04.222234 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:04.410290 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:04.553675 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:04.721812 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:04.859447 300876 pod_ready.go:103] pod "coredns-7c65d6cfc9-qx7rg" in "kube-system" namespace has status "Ready":"False"
I0913 18:26:04.910126 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:05.054416 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:05.221384 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:05.410441 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:05.554036 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:05.721724 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:05.909851 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:06.053665 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:06.221042 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:06.409752 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:06.553906 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:06.721509 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:06.911112 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:07.054041 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:07.221684 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:07.358821 300876 pod_ready.go:103] pod "coredns-7c65d6cfc9-qx7rg" in "kube-system" namespace has status "Ready":"False"
I0913 18:26:07.409629 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:07.553238 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:07.721435 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:07.910412 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:08.054722 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:08.221232 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:08.409843 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:08.553575 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:08.731289 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:08.911963 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:09.054020 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:09.221665 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:09.409194 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:09.554207 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:09.721855 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:09.858473 300876 pod_ready.go:103] pod "coredns-7c65d6cfc9-qx7rg" in "kube-system" namespace has status "Ready":"False"
I0913 18:26:09.909897 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:10.063193 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:10.222099 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:10.411094 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:10.554246 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:10.721797 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:10.912049 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:11.053930 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:11.222636 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:11.410757 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:11.553826 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:11.721874 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:11.861247 300876 pod_ready.go:103] pod "coredns-7c65d6cfc9-qx7rg" in "kube-system" namespace has status "Ready":"False"
I0913 18:26:11.910089 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:12.062246 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:12.222422 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:12.410075 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:12.555922 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:12.722096 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:12.911358 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:13.054572 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 18:26:13.223339 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:13.411679 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:13.554429 300876 kapi.go:107] duration metric: took 38.504771779s to wait for kubernetes.io/minikube-addons=registry ...
I0913 18:26:13.722156 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:13.910867 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:14.226410 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:14.360561 300876 pod_ready.go:103] pod "coredns-7c65d6cfc9-qx7rg" in "kube-system" namespace has status "Ready":"False"
I0913 18:26:14.409927 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:14.721601 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:14.910401 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:15.232813 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:15.359527 300876 pod_ready.go:93] pod "coredns-7c65d6cfc9-qx7rg" in "kube-system" namespace has status "Ready":"True"
I0913 18:26:15.359613 300876 pod_ready.go:82] duration metric: took 47.007497993s for pod "coredns-7c65d6cfc9-qx7rg" in "kube-system" namespace to be "Ready" ...
I0913 18:26:15.359641 300876 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-365496" in "kube-system" namespace to be "Ready" ...
I0913 18:26:15.366588 300876 pod_ready.go:93] pod "etcd-addons-365496" in "kube-system" namespace has status "Ready":"True"
I0913 18:26:15.366614 300876 pod_ready.go:82] duration metric: took 6.95187ms for pod "etcd-addons-365496" in "kube-system" namespace to be "Ready" ...
I0913 18:26:15.366631 300876 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-365496" in "kube-system" namespace to be "Ready" ...
I0913 18:26:15.372690 300876 pod_ready.go:93] pod "kube-apiserver-addons-365496" in "kube-system" namespace has status "Ready":"True"
I0913 18:26:15.372722 300876 pod_ready.go:82] duration metric: took 6.083531ms for pod "kube-apiserver-addons-365496" in "kube-system" namespace to be "Ready" ...
I0913 18:26:15.372734 300876 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-365496" in "kube-system" namespace to be "Ready" ...
I0913 18:26:15.378990 300876 pod_ready.go:93] pod "kube-controller-manager-addons-365496" in "kube-system" namespace has status "Ready":"True"
I0913 18:26:15.379015 300876 pod_ready.go:82] duration metric: took 6.273528ms for pod "kube-controller-manager-addons-365496" in "kube-system" namespace to be "Ready" ...
I0913 18:26:15.379027 300876 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-tkzx8" in "kube-system" namespace to be "Ready" ...
I0913 18:26:15.385358 300876 pod_ready.go:93] pod "kube-proxy-tkzx8" in "kube-system" namespace has status "Ready":"True"
I0913 18:26:15.385379 300876 pod_ready.go:82] duration metric: took 6.344683ms for pod "kube-proxy-tkzx8" in "kube-system" namespace to be "Ready" ...
I0913 18:26:15.385389 300876 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-365496" in "kube-system" namespace to be "Ready" ...
I0913 18:26:15.410925 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:15.721872 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:15.757014 300876 pod_ready.go:93] pod "kube-scheduler-addons-365496" in "kube-system" namespace has status "Ready":"True"
I0913 18:26:15.757085 300876 pod_ready.go:82] duration metric: took 371.68744ms for pod "kube-scheduler-addons-365496" in "kube-system" namespace to be "Ready" ...
I0913 18:26:15.757109 300876 pod_ready.go:39] duration metric: took 48.421911612s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0913 18:26:15.757158 300876 api_server.go:52] waiting for apiserver process to appear ...
I0913 18:26:15.757257 300876 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0913 18:26:15.774344 300876 api_server.go:72] duration metric: took 51.165288111s to wait for apiserver process to appear ...
I0913 18:26:15.774369 300876 api_server.go:88] waiting for apiserver healthz status ...
I0913 18:26:15.774394 300876 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I0913 18:26:15.782534 300876 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I0913 18:26:15.783759 300876 api_server.go:141] control plane version: v1.31.1
I0913 18:26:15.783794 300876 api_server.go:131] duration metric: took 9.416893ms to wait for apiserver health ...
I0913 18:26:15.783803 300876 system_pods.go:43] waiting for kube-system pods to appear ...
I0913 18:26:15.913391 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:16.022097 300876 system_pods.go:59] 18 kube-system pods found
I0913 18:26:16.022144 300876 system_pods.go:61] "coredns-7c65d6cfc9-qx7rg" [5223fe9b-4303-4cba-a2b9-ace271e5c575] Running
I0913 18:26:16.022158 300876 system_pods.go:61] "csi-hostpath-attacher-0" [10d6994d-9486-4fe0-90c5-7952672a9e3a] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0913 18:26:16.022166 300876 system_pods.go:61] "csi-hostpath-resizer-0" [20688c19-42ff-4221-b998-9149f2b9ee45] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0913 18:26:16.022176 300876 system_pods.go:61] "csi-hostpathplugin-hlqgv" [6d2b25c5-d569-481f-9909-2c3915ed6585] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0913 18:26:16.022182 300876 system_pods.go:61] "etcd-addons-365496" [ccfd253c-cbac-48de-8a64-666ceb2b3994] Running
I0913 18:26:16.022187 300876 system_pods.go:61] "kindnet-dp2m9" [f9107fae-ceb7-4c76-bd94-8fb1a105e4ce] Running
I0913 18:26:16.022191 300876 system_pods.go:61] "kube-apiserver-addons-365496" [cf3eed5e-836d-480a-803e-03d31eeced05] Running
I0913 18:26:16.022196 300876 system_pods.go:61] "kube-controller-manager-addons-365496" [91723736-aaae-4109-b1b3-8c0805d21a12] Running
I0913 18:26:16.022206 300876 system_pods.go:61] "kube-ingress-dns-minikube" [d825beaa-336d-4293-af8a-9c3972bdfdea] Running
I0913 18:26:16.022211 300876 system_pods.go:61] "kube-proxy-tkzx8" [e7c0f8ca-a1ed-451f-86de-aca16fec7dfa] Running
I0913 18:26:16.022222 300876 system_pods.go:61] "kube-scheduler-addons-365496" [ce3e3740-f13a-4f83-a0d1-fbbd010c9895] Running
I0913 18:26:16.022229 300876 system_pods.go:61] "metrics-server-84c5f94fbc-zw9g7" [8c940fcd-9cef-4740-9433-0b9ccb893566] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0913 18:26:16.022237 300876 system_pods.go:61] "nvidia-device-plugin-daemonset-8p94d" [0dce0d3d-b978-40ef-8ed8-f936aece4e07] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I0913 18:26:16.022245 300876 system_pods.go:61] "registry-66c9cd494c-97mff" [74f2b527-02d3-446a-b0e7-cb8eab4b50e9] Running
I0913 18:26:16.022250 300876 system_pods.go:61] "registry-proxy-wlc96" [75b88ef1-69ac-4b5a-bd2a-9dbaede32979] Running
I0913 18:26:16.022256 300876 system_pods.go:61] "snapshot-controller-56fcc65765-r65bz" [5554025b-35c5-4f9e-bb25-493fbee15f74] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0913 18:26:16.022263 300876 system_pods.go:61] "snapshot-controller-56fcc65765-zqcnd" [79f78186-f2a5-473f-b8f1-35de2439cc99] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0913 18:26:16.022267 300876 system_pods.go:61] "storage-provisioner" [1fb4d923-e342-40ff-a481-83b0082c30db] Running
I0913 18:26:16.022275 300876 system_pods.go:74] duration metric: took 238.465775ms to wait for pod list to return data ...
I0913 18:26:16.022285 300876 default_sa.go:34] waiting for default service account to be created ...
I0913 18:26:16.155668 300876 default_sa.go:45] found service account: "default"
I0913 18:26:16.155701 300876 default_sa.go:55] duration metric: took 133.408882ms for default service account to be created ...
I0913 18:26:16.155713 300876 system_pods.go:116] waiting for k8s-apps to be running ...
I0913 18:26:16.221079 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:16.362473 300876 system_pods.go:86] 18 kube-system pods found
I0913 18:26:16.362513 300876 system_pods.go:89] "coredns-7c65d6cfc9-qx7rg" [5223fe9b-4303-4cba-a2b9-ace271e5c575] Running
I0913 18:26:16.362525 300876 system_pods.go:89] "csi-hostpath-attacher-0" [10d6994d-9486-4fe0-90c5-7952672a9e3a] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0913 18:26:16.362533 300876 system_pods.go:89] "csi-hostpath-resizer-0" [20688c19-42ff-4221-b998-9149f2b9ee45] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0913 18:26:16.362541 300876 system_pods.go:89] "csi-hostpathplugin-hlqgv" [6d2b25c5-d569-481f-9909-2c3915ed6585] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0913 18:26:16.362546 300876 system_pods.go:89] "etcd-addons-365496" [ccfd253c-cbac-48de-8a64-666ceb2b3994] Running
I0913 18:26:16.362552 300876 system_pods.go:89] "kindnet-dp2m9" [f9107fae-ceb7-4c76-bd94-8fb1a105e4ce] Running
I0913 18:26:16.362563 300876 system_pods.go:89] "kube-apiserver-addons-365496" [cf3eed5e-836d-480a-803e-03d31eeced05] Running
I0913 18:26:16.362568 300876 system_pods.go:89] "kube-controller-manager-addons-365496" [91723736-aaae-4109-b1b3-8c0805d21a12] Running
I0913 18:26:16.362577 300876 system_pods.go:89] "kube-ingress-dns-minikube" [d825beaa-336d-4293-af8a-9c3972bdfdea] Running
I0913 18:26:16.362581 300876 system_pods.go:89] "kube-proxy-tkzx8" [e7c0f8ca-a1ed-451f-86de-aca16fec7dfa] Running
I0913 18:26:16.362585 300876 system_pods.go:89] "kube-scheduler-addons-365496" [ce3e3740-f13a-4f83-a0d1-fbbd010c9895] Running
I0913 18:26:16.362592 300876 system_pods.go:89] "metrics-server-84c5f94fbc-zw9g7" [8c940fcd-9cef-4740-9433-0b9ccb893566] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0913 18:26:16.362603 300876 system_pods.go:89] "nvidia-device-plugin-daemonset-8p94d" [0dce0d3d-b978-40ef-8ed8-f936aece4e07] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I0913 18:26:16.362608 300876 system_pods.go:89] "registry-66c9cd494c-97mff" [74f2b527-02d3-446a-b0e7-cb8eab4b50e9] Running
I0913 18:26:16.362615 300876 system_pods.go:89] "registry-proxy-wlc96" [75b88ef1-69ac-4b5a-bd2a-9dbaede32979] Running
I0913 18:26:16.362622 300876 system_pods.go:89] "snapshot-controller-56fcc65765-r65bz" [5554025b-35c5-4f9e-bb25-493fbee15f74] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0913 18:26:16.362629 300876 system_pods.go:89] "snapshot-controller-56fcc65765-zqcnd" [79f78186-f2a5-473f-b8f1-35de2439cc99] Running
I0913 18:26:16.362634 300876 system_pods.go:89] "storage-provisioner" [1fb4d923-e342-40ff-a481-83b0082c30db] Running
I0913 18:26:16.362641 300876 system_pods.go:126] duration metric: took 206.922488ms to wait for k8s-apps to be running ...
I0913 18:26:16.362649 300876 system_svc.go:44] waiting for kubelet service to be running ....
I0913 18:26:16.362712 300876 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0913 18:26:16.377362 300876 system_svc.go:56] duration metric: took 14.70387ms WaitForService to wait for kubelet
I0913 18:26:16.377393 300876 kubeadm.go:582] duration metric: took 51.76834727s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0913 18:26:16.377440 300876 node_conditions.go:102] verifying NodePressure condition ...
I0913 18:26:16.409410 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:16.556838 300876 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0913 18:26:16.556870 300876 node_conditions.go:123] node cpu capacity is 2
I0913 18:26:16.556883 300876 node_conditions.go:105] duration metric: took 179.433007ms to run NodePressure ...
I0913 18:26:16.556896 300876 start.go:241] waiting for startup goroutines ...
I0913 18:26:16.722022 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:16.910996 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:17.221424 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:17.410049 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:17.721988 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:17.911789 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:18.222953 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:18.410390 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:18.722302 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:18.910733 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:19.224348 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:19.410300 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:19.721603 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:19.910133 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:20.223609 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:20.409652 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:20.722638 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:20.910596 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:21.222456 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:21.410161 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:21.721977 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:21.910011 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:22.239355 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:22.409769 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:22.720994 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:22.911208 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:23.224607 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:23.410053 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:23.721458 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:23.909643 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:24.221699 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:24.409750 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:24.723930 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:24.910069 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:25.224503 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:25.410402 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:25.721126 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:25.909143 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:26.221738 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:26.410186 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:26.720983 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:26.911407 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:27.229440 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:27.413040 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:27.724673 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:27.910959 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:28.225746 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:28.410308 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:28.721422 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:28.912150 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:29.222299 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:29.410644 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:29.724548 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:29.912756 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:30.222881 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:30.411956 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:30.722149 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:30.910200 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:31.265604 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:31.410209 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:31.733551 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:31.912012 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:32.222267 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:32.409564 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:32.722283 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:32.909938 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:33.222477 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:33.410208 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:33.721628 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:33.910255 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:34.222097 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:34.410959 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:34.721647 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:34.911497 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:35.221790 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:35.410423 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:35.721420 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:35.910784 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:36.222319 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:36.410769 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:36.721800 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:36.910498 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:37.222166 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:37.411240 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:37.722354 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:37.910647 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:38.222028 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:38.410494 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:38.721388 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:38.910015 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:39.225093 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:39.412574 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:39.721015 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:39.910285 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:40.222140 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:40.409253 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:40.722457 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:40.910367 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:41.223554 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:41.410452 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:41.721339 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:41.909193 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:42.223624 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:42.410914 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:42.721076 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:42.911597 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:43.222188 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:43.410487 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:43.722234 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:43.910617 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:44.224428 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:44.410771 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:44.737642 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:44.909323 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:45.224408 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:45.411050 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:45.725531 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:45.909997 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:46.222606 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:46.410223 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:46.721584 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:46.909752 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:47.256492 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:47.410896 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:47.721210 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:47.910541 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:48.222874 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:48.411054 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:48.722855 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:48.909877 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:49.222682 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:49.410452 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:49.722157 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:49.912101 300876 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 18:26:50.221681 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:50.420522 300876 kapi.go:107] duration metric: took 1m17.015193189s to wait for app.kubernetes.io/name=ingress-nginx ...
I0913 18:26:50.721458 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:51.222609 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:51.722087 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:52.222954 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:52.721734 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:53.222166 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:53.722637 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:54.221288 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:54.721501 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:55.221383 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:55.722338 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:56.221741 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 18:26:56.722089 300876 kapi.go:107] duration metric: took 1m21.005452296s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0913 18:27:00.610838 300876 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0913 18:27:00.610868 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:01.110588 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:01.610576 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:02.110075 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:02.610071 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:03.110199 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:03.609984 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:04.110029 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:04.609925 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:05.110277 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:05.610379 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:06.110193 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:06.610763 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:07.110162 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:07.610272 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:08.112636 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:08.610779 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:09.111153 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:09.610899 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:10.111455 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:10.610459 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:11.110066 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:11.611442 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:12.111257 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:12.609539 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:13.110256 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:13.610038 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:14.110303 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:14.609753 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:15.110263 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:15.610415 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:16.109953 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:16.610835 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:17.110919 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:17.609873 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:18.110558 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:18.610335 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:19.110855 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:19.610406 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:20.110298 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:20.610214 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:21.109803 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:21.611264 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:22.114368 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:22.616555 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:23.110634 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:23.610596 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:24.110627 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:24.610016 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:25.110085 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:25.609964 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:26.110528 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:26.610570 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:27.110928 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:27.610983 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:28.110786 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:28.611607 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:29.110701 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:29.610674 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:30.110930 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:30.610430 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:31.110053 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:31.610643 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:32.111193 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:32.609685 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:33.113008 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:33.611147 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:34.110536 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:34.610227 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:35.110202 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:35.609822 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:36.110579 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:36.610375 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:37.110146 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:37.610793 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:38.110755 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:38.610146 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:39.111014 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:39.610612 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:40.109978 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:40.610633 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:41.111001 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:41.610615 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:42.113140 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:42.610700 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:43.110365 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:43.610585 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:44.110379 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:44.610013 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:45.111122 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:45.609920 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:46.110159 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:46.610160 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:47.110021 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:47.610477 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:48.111470 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:48.610290 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:49.110718 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:49.611342 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:50.110582 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:50.610263 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:51.111038 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:51.610241 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:52.110914 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:52.610815 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:53.109664 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:53.610643 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:54.109931 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:54.610309 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:55.110823 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:55.610314 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:56.110415 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:56.609921 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:57.110158 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:57.610971 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:58.110268 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:58.610610 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:59.110305 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:27:59.609919 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:28:00.120664 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:28:00.610657 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:28:01.110496 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:28:01.610693 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:28:02.111117 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:28:02.609816 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:28:03.111186 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:28:03.611024 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:28:04.110170 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:28:04.611619 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:28:05.110678 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:28:05.611333 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:28:06.110201 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:28:06.610905 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:28:07.110908 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:28:07.615245 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:28:08.110641 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:28:08.610844 300876 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 18:28:09.111274 300876 kapi.go:107] duration metric: took 2m32.004732533s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0913 18:28:09.113140 300876 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-365496 cluster.
I0913 18:28:09.114791 300876 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0913 18:28:09.116463 300876 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0913 18:28:09.118348 300876 out.go:177] * Enabled addons: cloud-spanner, storage-provisioner, ingress-dns, nvidia-device-plugin, storage-provisioner-rancher, volcano, metrics-server, inspektor-gadget, yakd, default-storageclass, volumesnapshots, registry, ingress, csi-hostpath-driver, gcp-auth
I0913 18:28:09.120167 300876 addons.go:510] duration metric: took 2m44.510879964s for enable addons: enabled=[cloud-spanner storage-provisioner ingress-dns nvidia-device-plugin storage-provisioner-rancher volcano metrics-server inspektor-gadget yakd default-storageclass volumesnapshots registry ingress csi-hostpath-driver gcp-auth]
I0913 18:28:09.120225 300876 start.go:246] waiting for cluster config update ...
I0913 18:28:09.120250 300876 start.go:255] writing updated cluster config ...
I0913 18:28:09.120566 300876 ssh_runner.go:195] Run: rm -f paused
I0913 18:28:09.472688 300876 start.go:600] kubectl: 1.31.0, cluster: 1.31.1 (minor skew: 0)
I0913 18:28:09.474796 300876 out.go:177] * Done! kubectl is now configured to use "addons-365496" cluster and "default" namespace by default
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
7f08f6ac7b60d 4f725bf50aaa5 2 minutes ago Exited gadget 5 d57e222c5d9f2 gadget-pdh2j
3156af38d2ccc 6ef582f3ec844 3 minutes ago Running gcp-auth 0 654c2a0e698a3 gcp-auth-89d5ffd79-l6kks
4e4dc786b2c02 ee6d597e62dc8 4 minutes ago Running csi-snapshotter 0 1542ede3c88f3 csi-hostpathplugin-hlqgv
34c02eac4f720 642ded511e141 4 minutes ago Running csi-provisioner 0 1542ede3c88f3 csi-hostpathplugin-hlqgv
5245f996c1bdb 922312104da8a 4 minutes ago Running liveness-probe 0 1542ede3c88f3 csi-hostpathplugin-hlqgv
6781d11d2fcdf 08f6b2990811a 4 minutes ago Running hostpath 0 1542ede3c88f3 csi-hostpathplugin-hlqgv
85db0a6780082 8b46b1cd48760 4 minutes ago Running admission 0 7d1107d53345f volcano-admission-77d7d48b68-6qlln
0d03cdcd8b0f9 289a818c8d9c5 4 minutes ago Running controller 0 96d1f3ba51bc2 ingress-nginx-controller-bc57996ff-549v2
066eb503b7703 0107d56dbc0be 4 minutes ago Running node-driver-registrar 0 1542ede3c88f3 csi-hostpathplugin-hlqgv
9fbe2bf968f8f a9bac31a5be8d 4 minutes ago Running nvidia-device-plugin-ctr 0 8cfe30d8031d5 nvidia-device-plugin-daemonset-8p94d
669aa78201de5 8be4bcf8ec607 4 minutes ago Running cloud-spanner-emulator 0 302eb37d8b7e6 cloud-spanner-emulator-769b77f747-p8cr7
e3516fefc1b53 420193b27261a 4 minutes ago Exited patch 2 4f46f86d082af ingress-nginx-admission-patch-mvhxj
44a3eb096e1d8 1505f556b3a7b 4 minutes ago Running volcano-controllers 0 88b1caa0e98fb volcano-controllers-56675bb4d5-hzv8d
2765b3880ccd0 9a80d518f102c 4 minutes ago Running csi-attacher 0 004a972c383f4 csi-hostpath-attacher-0
a51630560a089 420193b27261a 4 minutes ago Exited create 0 d8668cd7db966 ingress-nginx-admission-create-z9plc
6162cd15e5079 d9c7ad4c226bf 4 minutes ago Running volcano-scheduler 0 cbe7a432dea50 volcano-scheduler-576bc46687-mnc29
85f0ed449d0da 5548a49bb60ba 5 minutes ago Running metrics-server 0 33aeb35173fec metrics-server-84c5f94fbc-zw9g7
2db7de86dd7cf 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 8334b7f35e24e snapshot-controller-56fcc65765-r65bz
8ae11de7a3065 1461903ec4fe9 5 minutes ago Running csi-external-health-monitor-controller 0 1542ede3c88f3 csi-hostpathplugin-hlqgv
8106555c37f6b 487fa743e1e22 5 minutes ago Running csi-resizer 0 f84fea86266b3 csi-hostpath-resizer-0
ff0159e994472 77bdba588b953 5 minutes ago Running yakd 0 8af668f2f2ddf yakd-dashboard-67d98fc6b-dbp2p
465012c553b56 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 c66d9fe281158 snapshot-controller-56fcc65765-zqcnd
e6706d77e177e 2f6c962e7b831 5 minutes ago Running coredns 0 8da692ccb5eb9 coredns-7c65d6cfc9-qx7rg
d0e1bbccbe5ad 7ce2150c8929b 5 minutes ago Running local-path-provisioner 0 febee4530ff5a local-path-provisioner-86d989889c-cktm5
3859ef37da681 c9cf76bb104e1 5 minutes ago Running registry 0 5819d342735a3 registry-66c9cd494c-97mff
b59f63d900fb6 3410e1561990a 5 minutes ago Running registry-proxy 0 063dc7da20a6b registry-proxy-wlc96
44d420544e61f 35508c2f890c4 5 minutes ago Running minikube-ingress-dns 0 89758dafa7477 kube-ingress-dns-minikube
26c263a6b5164 ba04bb24b9575 5 minutes ago Running storage-provisioner 0 c81a459fd86b7 storage-provisioner
23b7d42007768 24a140c548c07 6 minutes ago Running kube-proxy 0 344191bc2858c kube-proxy-tkzx8
af39148dbb88d 6a23fa8fd2b78 6 minutes ago Running kindnet-cni 0 1469e0e101301 kindnet-dp2m9
146201e9102c8 d3f53a98c0a9d 6 minutes ago Running kube-apiserver 0 e2eaf2a874fa3 kube-apiserver-addons-365496
872204cca9225 7f8aa378bb47d 6 minutes ago Running kube-scheduler 0 13a22e7e8daaa kube-scheduler-addons-365496
43675c6cf08f3 279f381cb3736 6 minutes ago Running kube-controller-manager 0 53d73d89639fb kube-controller-manager-addons-365496
16ba1a0b25361 27e3830e14027 6 minutes ago Running etcd 0 9415187d5ac6c etcd-addons-365496
==> containerd <==
Sep 13 18:29:04 addons-365496 containerd[810]: time="2024-09-13T18:29:04.940029556Z" level=info msg="CreateContainer within sandbox \"d57e222c5d9f21b79f9c1e71492905318ee45510eec0601d56110779de15a53d\" for container &ContainerMetadata{Name:gadget,Attempt:5,}"
Sep 13 18:29:04 addons-365496 containerd[810]: time="2024-09-13T18:29:04.964358576Z" level=info msg="CreateContainer within sandbox \"d57e222c5d9f21b79f9c1e71492905318ee45510eec0601d56110779de15a53d\" for &ContainerMetadata{Name:gadget,Attempt:5,} returns container id \"7f08f6ac7b60dd2e035617b6a69082ccb89d11075caae36b25ace42deca6a51f\""
Sep 13 18:29:04 addons-365496 containerd[810]: time="2024-09-13T18:29:04.965187499Z" level=info msg="StartContainer for \"7f08f6ac7b60dd2e035617b6a69082ccb89d11075caae36b25ace42deca6a51f\""
Sep 13 18:29:05 addons-365496 containerd[810]: time="2024-09-13T18:29:05.027476072Z" level=info msg="StartContainer for \"7f08f6ac7b60dd2e035617b6a69082ccb89d11075caae36b25ace42deca6a51f\" returns successfully"
Sep 13 18:29:06 addons-365496 containerd[810]: time="2024-09-13T18:29:06.574928964Z" level=error msg="ExecSync for \"7f08f6ac7b60dd2e035617b6a69082ccb89d11075caae36b25ace42deca6a51f\" failed" error="failed to exec in container: failed to create exec \"93b2c1c1f23292857206096122a1a6a1368e2c6e4abfbb92094324b4b623b10a\": cannot exec in a stopped state: unknown"
Sep 13 18:29:06 addons-365496 containerd[810]: time="2024-09-13T18:29:06.580776435Z" level=error msg="ExecSync for \"7f08f6ac7b60dd2e035617b6a69082ccb89d11075caae36b25ace42deca6a51f\" failed" error="failed to exec in container: failed to create exec \"5dcd0f4f06380b4a45067e4cd70087f65a14d94b6d358b49799faa310ea04dc6\": cannot exec in a stopped state: unknown"
Sep 13 18:29:06 addons-365496 containerd[810]: time="2024-09-13T18:29:06.582093251Z" level=error msg="ExecSync for \"7f08f6ac7b60dd2e035617b6a69082ccb89d11075caae36b25ace42deca6a51f\" failed" error="failed to exec in container: failed to create exec \"37a58e0718b3a27e123047e46381675aee0275124148b6d0dee693ea21d05792\": cannot exec in a stopped state: unknown"
Sep 13 18:29:06 addons-365496 containerd[810]: time="2024-09-13T18:29:06.598154633Z" level=error msg="ExecSync for \"7f08f6ac7b60dd2e035617b6a69082ccb89d11075caae36b25ace42deca6a51f\" failed" error="rpc error: code = NotFound desc = failed to exec in container: failed to create exec \"be4306506ed899030b680da7d404d6dcea4272c3cb57ec20ba288ca62e8a2b69\": task 7f08f6ac7b60dd2e035617b6a69082ccb89d11075caae36b25ace42deca6a51f not found: not found"
Sep 13 18:29:06 addons-365496 containerd[810]: time="2024-09-13T18:29:06.598683675Z" level=info msg="shim disconnected" id=7f08f6ac7b60dd2e035617b6a69082ccb89d11075caae36b25ace42deca6a51f namespace=k8s.io
Sep 13 18:29:06 addons-365496 containerd[810]: time="2024-09-13T18:29:06.600056966Z" level=warning msg="cleaning up after shim disconnected" id=7f08f6ac7b60dd2e035617b6a69082ccb89d11075caae36b25ace42deca6a51f namespace=k8s.io
Sep 13 18:29:06 addons-365496 containerd[810]: time="2024-09-13T18:29:06.600088679Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Sep 13 18:29:06 addons-365496 containerd[810]: time="2024-09-13T18:29:06.600044166Z" level=error msg="ExecSync for \"7f08f6ac7b60dd2e035617b6a69082ccb89d11075caae36b25ace42deca6a51f\" failed" error="rpc error: code = NotFound desc = failed to exec in container: failed to create exec \"a1bcadd62215118394ca6828d880c2f04a3077892d77c81651a0c988685eb1bc\": task 7f08f6ac7b60dd2e035617b6a69082ccb89d11075caae36b25ace42deca6a51f not found: not found"
Sep 13 18:29:06 addons-365496 containerd[810]: time="2024-09-13T18:29:06.601275632Z" level=error msg="ExecSync for \"7f08f6ac7b60dd2e035617b6a69082ccb89d11075caae36b25ace42deca6a51f\" failed" error="rpc error: code = NotFound desc = failed to exec in container: failed to load task: no running task found: task 7f08f6ac7b60dd2e035617b6a69082ccb89d11075caae36b25ace42deca6a51f not found: not found"
Sep 13 18:29:06 addons-365496 containerd[810]: time="2024-09-13T18:29:06.798245026Z" level=info msg="RemoveContainer for \"d754ae30d76d3324f3c993058ca83ce12e9475a2d5d958f3350bd9c49d62cc22\""
Sep 13 18:29:06 addons-365496 containerd[810]: time="2024-09-13T18:29:06.811981666Z" level=info msg="RemoveContainer for \"d754ae30d76d3324f3c993058ca83ce12e9475a2d5d958f3350bd9c49d62cc22\" returns successfully"
Sep 13 18:29:19 addons-365496 containerd[810]: time="2024-09-13T18:29:19.857852841Z" level=info msg="RemoveContainer for \"a01f4890e4e98fdd9ad38612b11dcd971692fd151cb77762e7c640108d101fdf\""
Sep 13 18:29:19 addons-365496 containerd[810]: time="2024-09-13T18:29:19.865007668Z" level=info msg="RemoveContainer for \"a01f4890e4e98fdd9ad38612b11dcd971692fd151cb77762e7c640108d101fdf\" returns successfully"
Sep 13 18:29:19 addons-365496 containerd[810]: time="2024-09-13T18:29:19.867435532Z" level=info msg="StopPodSandbox for \"531a70aa534547ce7196690527efa91e0b06d217622ee3040aff10c94c9a777c\""
Sep 13 18:29:19 addons-365496 containerd[810]: time="2024-09-13T18:29:19.875387733Z" level=info msg="TearDown network for sandbox \"531a70aa534547ce7196690527efa91e0b06d217622ee3040aff10c94c9a777c\" successfully"
Sep 13 18:29:19 addons-365496 containerd[810]: time="2024-09-13T18:29:19.875429710Z" level=info msg="StopPodSandbox for \"531a70aa534547ce7196690527efa91e0b06d217622ee3040aff10c94c9a777c\" returns successfully"
Sep 13 18:29:19 addons-365496 containerd[810]: time="2024-09-13T18:29:19.876059486Z" level=info msg="RemovePodSandbox for \"531a70aa534547ce7196690527efa91e0b06d217622ee3040aff10c94c9a777c\""
Sep 13 18:29:19 addons-365496 containerd[810]: time="2024-09-13T18:29:19.876185714Z" level=info msg="Forcibly stopping sandbox \"531a70aa534547ce7196690527efa91e0b06d217622ee3040aff10c94c9a777c\""
Sep 13 18:29:19 addons-365496 containerd[810]: time="2024-09-13T18:29:19.883580574Z" level=info msg="TearDown network for sandbox \"531a70aa534547ce7196690527efa91e0b06d217622ee3040aff10c94c9a777c\" successfully"
Sep 13 18:29:19 addons-365496 containerd[810]: time="2024-09-13T18:29:19.889541375Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"531a70aa534547ce7196690527efa91e0b06d217622ee3040aff10c94c9a777c\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus."
Sep 13 18:29:19 addons-365496 containerd[810]: time="2024-09-13T18:29:19.889662786Z" level=info msg="RemovePodSandbox \"531a70aa534547ce7196690527efa91e0b06d217622ee3040aff10c94c9a777c\" returns successfully"
==> coredns [e6706d77e177e96d6bbd0e5368265b0cf73dd6d1b9628c1798a1b6ef8274576e] <==
CoreDNS-1.11.3
linux/arm64, go1.21.11, a6338e9
[INFO] 127.0.0.1:54975 - 14333 "HINFO IN 8629097169692245054.4506638775227950158. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.011087587s
[INFO] 10.244.0.2:33368 - 12884 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000211815s
[INFO] 10.244.0.2:33368 - 34899 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000173777s
[INFO] 10.244.0.2:32789 - 7736 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000153559s
[INFO] 10.244.0.2:32789 - 62783 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000115085s
[INFO] 10.244.0.2:44976 - 35545 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000084488s
[INFO] 10.244.0.2:44976 - 26075 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000087204s
[INFO] 10.244.0.2:53602 - 57840 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000133981s
[INFO] 10.244.0.2:53602 - 55282 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000075176s
[INFO] 10.244.0.2:51977 - 35483 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.00495147s
[INFO] 10.244.0.2:51977 - 5017 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.005228475s
[INFO] 10.244.0.2:33918 - 26652 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000071172s
[INFO] 10.244.0.2:33918 - 35353 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000051659s
[INFO] 10.244.0.24:43702 - 24500 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000191647s
[INFO] 10.244.0.24:52968 - 1898 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000229185s
[INFO] 10.244.0.24:44423 - 60736 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000175499s
[INFO] 10.244.0.24:48881 - 1876 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000163996s
[INFO] 10.244.0.24:39661 - 44481 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000187323s
[INFO] 10.244.0.24:53291 - 46378 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000124833s
[INFO] 10.244.0.24:45658 - 57696 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002587149s
[INFO] 10.244.0.24:53499 - 46221 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002733299s
[INFO] 10.244.0.24:57244 - 31912 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.002120966s
[INFO] 10.244.0.24:44133 - 6053 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 610 0.001962526s
==> describe nodes <==
Name: addons-365496
Roles: control-plane
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=addons-365496
kubernetes.io/os=linux
minikube.k8s.io/commit=fdd33bebc6743cfd1c61ec7fe066add478610a92
minikube.k8s.io/name=addons-365496
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_09_13T18_25_20_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-365496
Annotations: csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-365496"}
kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Fri, 13 Sep 2024 18:25:17 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-365496
AcquireTime: <unset>
RenewTime: Fri, 13 Sep 2024 18:31:27 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Fri, 13 Sep 2024 18:28:23 +0000 Fri, 13 Sep 2024 18:25:13 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Fri, 13 Sep 2024 18:28:23 +0000 Fri, 13 Sep 2024 18:25:13 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Fri, 13 Sep 2024 18:28:23 +0000 Fri, 13 Sep 2024 18:25:13 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Fri, 13 Sep 2024 18:28:23 +0000 Fri, 13 Sep 2024 18:25:17 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-365496
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022296Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022296Ki
pods: 110
System Info:
Machine ID: 529e1a0df4834f48992727382bc24d29
System UUID: 82273203-7c22-4996-baf1-b7a9dfe1b21b
Boot ID: 31d76137-2e5d-4866-b75b-16f7e69e7ff6
Kernel Version: 5.15.0-1069-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.22
Kubelet Version: v1.31.1
Kube-Proxy Version: v1.31.1
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (27 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default cloud-spanner-emulator-769b77f747-p8cr7 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m1s
gadget gadget-pdh2j 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
gcp-auth gcp-auth-89d5ffd79-l6kks 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m28s
ingress-nginx ingress-nginx-controller-bc57996ff-549v2 100m (5%) 0 (0%) 90Mi (1%) 0 (0%) 5m55s
kube-system coredns-7c65d6cfc9-qx7rg 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 6m3s
kube-system csi-hostpath-attacher-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m53s
kube-system csi-hostpath-resizer-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m53s
kube-system csi-hostpathplugin-hlqgv 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m53s
kube-system etcd-addons-365496 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 6m8s
kube-system kindnet-dp2m9 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 6m4s
kube-system kube-apiserver-addons-365496 250m (12%) 0 (0%) 0 (0%) 0 (0%) 6m8s
kube-system kube-controller-manager-addons-365496 200m (10%) 0 (0%) 0 (0%) 0 (0%) 6m8s
kube-system kube-ingress-dns-minikube 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m
kube-system kube-proxy-tkzx8 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m4s
kube-system kube-scheduler-addons-365496 100m (5%) 0 (0%) 0 (0%) 0 (0%) 6m8s
kube-system metrics-server-84c5f94fbc-zw9g7 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 5m58s
kube-system nvidia-device-plugin-daemonset-8p94d 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m1s
kube-system registry-66c9cd494c-97mff 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m59s
kube-system registry-proxy-wlc96 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m59s
kube-system snapshot-controller-56fcc65765-r65bz 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
kube-system snapshot-controller-56fcc65765-zqcnd 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m59s
local-path-storage local-path-provisioner-86d989889c-cktm5 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m59s
volcano-system volcano-admission-77d7d48b68-6qlln 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m55s
volcano-system volcano-controllers-56675bb4d5-hzv8d 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m54s
volcano-system volcano-scheduler-576bc46687-mnc29 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m54s
yakd-dashboard yakd-dashboard-67d98fc6b-dbp2p 0 (0%) 0 (0%) 128Mi (1%) 256Mi (3%) 5m58s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 1050m (52%) 100m (5%)
memory 638Mi (8%) 476Mi (6%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 6m1s kube-proxy
Warning CgroupV1 6m16s kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeHasSufficientMemory 6m16s (x8 over 6m16s) kubelet Node addons-365496 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m16s (x7 over 6m16s) kubelet Node addons-365496 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m16s (x7 over 6m16s) kubelet Node addons-365496 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 6m16s kubelet Updated Node Allocatable limit across pods
Normal Starting 6m9s kubelet Starting kubelet.
Warning CgroupV1 6m9s kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeAllocatableEnforced 6m9s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 6m8s kubelet Node addons-365496 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m8s kubelet Node addons-365496 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m8s kubelet Node addons-365496 status is now: NodeHasSufficientPID
Normal RegisteredNode 6m5s node-controller Node addons-365496 event: Registered Node addons-365496 in Controller
==> dmesg <==
[Sep13 16:17] ACPI: SRAT not present
[ +0.000000] ACPI: SRAT not present
[ +0.000000] SPI driver altr_a10sr has no spi_device_id for altr,a10sr
[ +0.015201] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[ +0.448905] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
[ +0.746796] ena 0000:00:05.0: LLQ is not supported Fallback to host mode policy.
[ +6.102084] kauditd_printk_skb: 36 callbacks suppressed
[Sep13 17:15] hrtimer: interrupt took 6691767 ns
[Sep13 17:51] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
==> etcd [16ba1a0b25361626e2d273703598fe0718581748fc45df05ec35277b853219cd] <==
{"level":"info","ts":"2024-09-13T18:25:13.123574Z","caller":"embed/etcd.go:870","msg":"serving metrics","address":"http://127.0.0.1:2381"}
{"level":"info","ts":"2024-09-13T18:25:13.511893Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
{"level":"info","ts":"2024-09-13T18:25:13.512139Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
{"level":"info","ts":"2024-09-13T18:25:13.512328Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
{"level":"info","ts":"2024-09-13T18:25:13.512422Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
{"level":"info","ts":"2024-09-13T18:25:13.512516Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-13T18:25:13.512602Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
{"level":"info","ts":"2024-09-13T18:25:13.512690Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-13T18:25:13.516041Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-365496 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
{"level":"info","ts":"2024-09-13T18:25:13.516236Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-13T18:25:13.517653Z","caller":"etcdserver/server.go:2629","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-13T18:25:13.517935Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-13T18:25:13.519350Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-13T18:25:13.519568Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-13T18:25:13.519723Z","caller":"etcdserver/server.go:2653","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-13T18:25:13.518873Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-13T18:25:13.531914Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-09-13T18:25:13.532134Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-09-13T18:25:13.533457Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-13T18:25:13.534481Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
{"level":"info","ts":"2024-09-13T18:25:13.544402Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-09-13T18:26:31.072619Z","caller":"traceutil/trace.go:171","msg":"trace[614794107] linearizableReadLoop","detail":"{readStateIndex:1269; appliedIndex:1267; }","duration":"103.127736ms","start":"2024-09-13T18:26:30.969473Z","end":"2024-09-13T18:26:31.072601Z","steps":["trace[614794107] 'read index received' (duration: 43.26509ms)","trace[614794107] 'applied index is now lower than readState.Index' (duration: 59.861998ms)"],"step_count":2}
{"level":"info","ts":"2024-09-13T18:26:31.072726Z","caller":"traceutil/trace.go:171","msg":"trace[778269580] transaction","detail":"{read_only:false; response_revision:1236; number_of_response:1; }","duration":"103.308789ms","start":"2024-09-13T18:26:30.969409Z","end":"2024-09-13T18:26:31.072718Z","steps":["trace[778269580] 'process raft request' (duration: 53.301855ms)","trace[778269580] 'compare' (duration: 49.721224ms)"],"step_count":2}
{"level":"warn","ts":"2024-09-13T18:26:31.073276Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"103.770541ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-system/snapshot-controller-leader\" ","response":"range_response_count:1 size:499"}
{"level":"info","ts":"2024-09-13T18:26:31.073314Z","caller":"traceutil/trace.go:171","msg":"trace[786434522] range","detail":"{range_begin:/registry/leases/kube-system/snapshot-controller-leader; range_end:; response_count:1; response_revision:1239; }","duration":"103.835641ms","start":"2024-09-13T18:26:30.969470Z","end":"2024-09-13T18:26:31.073305Z","steps":["trace[786434522] 'agreement among raft nodes before linearized reading' (duration: 103.436839ms)"],"step_count":1}
==> gcp-auth [3156af38d2ccce22d7ad745d7d86ae8e81ccc5c06eae4f426578b946f64df0de] <==
2024/09/13 18:28:08 GCP Auth Webhook started!
2024/09/13 18:28:25 Ready to marshal response ...
2024/09/13 18:28:25 Ready to write response ...
2024/09/13 18:28:26 Ready to marshal response ...
2024/09/13 18:28:26 Ready to write response ...
==> kernel <==
18:31:28 up 2:13, 0 users, load average: 0.20, 1.27, 2.18
Linux addons-365496 5.15.0-1069-aws #75~20.04.1-Ubuntu SMP Mon Aug 19 16:22:47 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [af39148dbb88d11557580b160bae6801ea0f769594be14ca8d8b18f4c39d1c4a] <==
I0913 18:29:26.516924 1 main.go:299] handling current node
I0913 18:29:36.516177 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0913 18:29:36.516214 1 main.go:299] handling current node
I0913 18:29:46.516063 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0913 18:29:46.516237 1 main.go:299] handling current node
I0913 18:29:56.516715 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0913 18:29:56.516750 1 main.go:299] handling current node
I0913 18:30:06.516511 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0913 18:30:06.516544 1 main.go:299] handling current node
I0913 18:30:16.516379 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0913 18:30:16.516414 1 main.go:299] handling current node
I0913 18:30:26.517078 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0913 18:30:26.517110 1 main.go:299] handling current node
I0913 18:30:36.517003 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0913 18:30:36.517042 1 main.go:299] handling current node
I0913 18:30:46.516813 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0913 18:30:46.516849 1 main.go:299] handling current node
I0913 18:30:56.516148 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0913 18:30:56.516185 1 main.go:299] handling current node
I0913 18:31:06.516815 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0913 18:31:06.516860 1 main.go:299] handling current node
I0913 18:31:16.516419 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0913 18:31:16.516449 1 main.go:299] handling current node
I0913 18:31:26.517081 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0913 18:31:26.517378 1 main.go:299] handling current node
==> kube-apiserver [146201e9102c8efb75c45cb6f138adae71c174216e85c3a75139a223c6f7ddc3] <==
W0913 18:26:40.105091 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.111.28.231:443: connect: connection refused
W0913 18:26:41.074494 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.28.231:443: connect: connection refused
W0913 18:26:42.083066 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.28.231:443: connect: connection refused
W0913 18:26:43.172998 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.28.231:443: connect: connection refused
W0913 18:26:44.209593 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.28.231:443: connect: connection refused
W0913 18:26:45.262941 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.28.231:443: connect: connection refused
W0913 18:26:46.353973 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.28.231:443: connect: connection refused
W0913 18:26:47.462767 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.28.231:443: connect: connection refused
W0913 18:26:48.559290 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.28.231:443: connect: connection refused
W0913 18:26:49.606986 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.28.231:443: connect: connection refused
W0913 18:26:50.614114 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.28.231:443: connect: connection refused
W0913 18:26:51.652042 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.28.231:443: connect: connection refused
W0913 18:26:52.733852 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.28.231:443: connect: connection refused
W0913 18:26:53.829760 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.28.231:443: connect: connection refused
W0913 18:26:54.865743 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.28.231:443: connect: connection refused
W0913 18:26:55.925511 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.28.231:443: connect: connection refused
W0913 18:26:56.939415 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.28.231:443: connect: connection refused
W0913 18:27:00.043683 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.105.108.247:443: connect: connection refused
E0913 18:27:00.043728 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.105.108.247:443: connect: connection refused" logger="UnhandledError"
W0913 18:27:40.058001 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.105.108.247:443: connect: connection refused
E0913 18:27:40.058049 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.105.108.247:443: connect: connection refused" logger="UnhandledError"
W0913 18:27:40.111840 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.105.108.247:443: connect: connection refused
E0913 18:27:40.111962 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.105.108.247:443: connect: connection refused" logger="UnhandledError"
I0913 18:28:25.920067 1 controller.go:615] quota admission added evaluator for: jobs.batch.volcano.sh
I0913 18:28:25.959003 1 controller.go:615] quota admission added evaluator for: podgroups.scheduling.volcano.sh
==> kube-controller-manager [43675c6cf08f391dbc368df750bc1b945efb55faed0ca0c909710abb89da806a] <==
I0913 18:27:40.078779 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0913 18:27:40.088862 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0913 18:27:40.102636 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0913 18:27:40.121858 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0913 18:27:40.132910 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0913 18:27:40.140072 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0913 18:27:40.156063 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0913 18:27:41.552781 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0913 18:27:41.568198 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0913 18:27:42.683176 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0913 18:27:42.723944 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0913 18:27:43.690705 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0913 18:27:43.699734 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0913 18:27:43.710313 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0913 18:27:43.731096 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0913 18:27:43.740986 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0913 18:27:43.748423 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0913 18:28:08.655128 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="9.803037ms"
I0913 18:28:08.655395 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="55.639µs"
I0913 18:28:13.024996 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0913 18:28:13.030579 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0913 18:28:13.074996 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0913 18:28:13.076378 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0913 18:28:23.629776 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-365496"
I0913 18:28:25.674397 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="volcano-system/volcano-admission-init" delay="0s"
==> kube-proxy [23b7d420077687bcf8b4d7c3920a157743bfcbf19119f20542f62749705b0e9b] <==
I0913 18:25:26.449944 1 server_linux.go:66] "Using iptables proxy"
I0913 18:25:26.561561 1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
E0913 18:25:26.561623 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I0913 18:25:26.599288 1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I0913 18:25:26.599351 1 server_linux.go:169] "Using iptables Proxier"
I0913 18:25:26.601110 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I0913 18:25:26.601515 1 server.go:483] "Version info" version="v1.31.1"
I0913 18:25:26.601530 1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0913 18:25:26.612098 1 config.go:199] "Starting service config controller"
I0913 18:25:26.612129 1 shared_informer.go:313] Waiting for caches to sync for service config
I0913 18:25:26.612155 1 config.go:105] "Starting endpoint slice config controller"
I0913 18:25:26.612160 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0913 18:25:26.618225 1 config.go:328] "Starting node config controller"
I0913 18:25:26.618243 1 shared_informer.go:313] Waiting for caches to sync for node config
I0913 18:25:26.712515 1 shared_informer.go:320] Caches are synced for endpoint slice config
I0913 18:25:26.712581 1 shared_informer.go:320] Caches are synced for service config
I0913 18:25:26.718906 1 shared_informer.go:320] Caches are synced for node config
==> kube-scheduler [872204cca9225c00dfbee0f82b21af29831b0f32ff1722cc9d960564ff2d2ef8] <==
W0913 18:25:17.349625 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0913 18:25:17.355810 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0913 18:25:17.349998 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0913 18:25:17.355978 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0913 18:25:17.356426 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0913 18:25:17.356671 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0913 18:25:18.175241 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0913 18:25:18.175483 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError"
W0913 18:25:18.203304 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0913 18:25:18.203524 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0913 18:25:18.252098 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0913 18:25:18.252351 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0913 18:25:18.280165 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0913 18:25:18.280420 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0913 18:25:18.346861 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0913 18:25:18.347091 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0913 18:25:18.441070 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0913 18:25:18.441334 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0913 18:25:18.506902 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0913 18:25:18.507193 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0913 18:25:18.516176 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0913 18:25:18.516437 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0913 18:25:18.721135 1 reflector.go:561] runtime/asm_arm64.s:1222: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0913 18:25:18.721413 1 reflector.go:158] "Unhandled Error" err="runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"
I0913 18:25:21.933322 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Sep 13 18:29:19 addons-365496 kubelet[1496]: I0913 18:29:19.856136 1496 scope.go:117] "RemoveContainer" containerID="a01f4890e4e98fdd9ad38612b11dcd971692fd151cb77762e7c640108d101fdf"
Sep 13 18:29:24 addons-365496 kubelet[1496]: I0913 18:29:24.796767 1496 scope.go:117] "RemoveContainer" containerID="7f08f6ac7b60dd2e035617b6a69082ccb89d11075caae36b25ace42deca6a51f"
Sep 13 18:29:24 addons-365496 kubelet[1496]: E0913 18:29:24.797511 1496 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-pdh2j_gadget(afd3e4e8-b87f-4a18-9e27-d7e8ed94acb3)\"" pod="gadget/gadget-pdh2j" podUID="afd3e4e8-b87f-4a18-9e27-d7e8ed94acb3"
Sep 13 18:29:39 addons-365496 kubelet[1496]: I0913 18:29:39.797736 1496 scope.go:117] "RemoveContainer" containerID="7f08f6ac7b60dd2e035617b6a69082ccb89d11075caae36b25ace42deca6a51f"
Sep 13 18:29:39 addons-365496 kubelet[1496]: E0913 18:29:39.797969 1496 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-pdh2j_gadget(afd3e4e8-b87f-4a18-9e27-d7e8ed94acb3)\"" pod="gadget/gadget-pdh2j" podUID="afd3e4e8-b87f-4a18-9e27-d7e8ed94acb3"
Sep 13 18:29:50 addons-365496 kubelet[1496]: I0913 18:29:50.797135 1496 scope.go:117] "RemoveContainer" containerID="7f08f6ac7b60dd2e035617b6a69082ccb89d11075caae36b25ace42deca6a51f"
Sep 13 18:29:50 addons-365496 kubelet[1496]: E0913 18:29:50.797353 1496 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-pdh2j_gadget(afd3e4e8-b87f-4a18-9e27-d7e8ed94acb3)\"" pod="gadget/gadget-pdh2j" podUID="afd3e4e8-b87f-4a18-9e27-d7e8ed94acb3"
Sep 13 18:29:54 addons-365496 kubelet[1496]: I0913 18:29:54.796879 1496 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-wlc96" secret="" err="secret \"gcp-auth\" not found"
Sep 13 18:30:02 addons-365496 kubelet[1496]: I0913 18:30:02.796299 1496 scope.go:117] "RemoveContainer" containerID="7f08f6ac7b60dd2e035617b6a69082ccb89d11075caae36b25ace42deca6a51f"
Sep 13 18:30:02 addons-365496 kubelet[1496]: E0913 18:30:02.796512 1496 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-pdh2j_gadget(afd3e4e8-b87f-4a18-9e27-d7e8ed94acb3)\"" pod="gadget/gadget-pdh2j" podUID="afd3e4e8-b87f-4a18-9e27-d7e8ed94acb3"
Sep 13 18:30:17 addons-365496 kubelet[1496]: I0913 18:30:17.796506 1496 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-66c9cd494c-97mff" secret="" err="secret \"gcp-auth\" not found"
Sep 13 18:30:17 addons-365496 kubelet[1496]: I0913 18:30:17.798400 1496 scope.go:117] "RemoveContainer" containerID="7f08f6ac7b60dd2e035617b6a69082ccb89d11075caae36b25ace42deca6a51f"
Sep 13 18:30:17 addons-365496 kubelet[1496]: E0913 18:30:17.798850 1496 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-pdh2j_gadget(afd3e4e8-b87f-4a18-9e27-d7e8ed94acb3)\"" pod="gadget/gadget-pdh2j" podUID="afd3e4e8-b87f-4a18-9e27-d7e8ed94acb3"
Sep 13 18:30:20 addons-365496 kubelet[1496]: I0913 18:30:20.796933 1496 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-8p94d" secret="" err="secret \"gcp-auth\" not found"
Sep 13 18:30:31 addons-365496 kubelet[1496]: I0913 18:30:31.796740 1496 scope.go:117] "RemoveContainer" containerID="7f08f6ac7b60dd2e035617b6a69082ccb89d11075caae36b25ace42deca6a51f"
Sep 13 18:30:31 addons-365496 kubelet[1496]: E0913 18:30:31.796938 1496 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-pdh2j_gadget(afd3e4e8-b87f-4a18-9e27-d7e8ed94acb3)\"" pod="gadget/gadget-pdh2j" podUID="afd3e4e8-b87f-4a18-9e27-d7e8ed94acb3"
Sep 13 18:30:43 addons-365496 kubelet[1496]: I0913 18:30:43.798495 1496 scope.go:117] "RemoveContainer" containerID="7f08f6ac7b60dd2e035617b6a69082ccb89d11075caae36b25ace42deca6a51f"
Sep 13 18:30:43 addons-365496 kubelet[1496]: E0913 18:30:43.798716 1496 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-pdh2j_gadget(afd3e4e8-b87f-4a18-9e27-d7e8ed94acb3)\"" pod="gadget/gadget-pdh2j" podUID="afd3e4e8-b87f-4a18-9e27-d7e8ed94acb3"
Sep 13 18:30:55 addons-365496 kubelet[1496]: I0913 18:30:55.797152 1496 scope.go:117] "RemoveContainer" containerID="7f08f6ac7b60dd2e035617b6a69082ccb89d11075caae36b25ace42deca6a51f"
Sep 13 18:30:55 addons-365496 kubelet[1496]: E0913 18:30:55.797364 1496 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-pdh2j_gadget(afd3e4e8-b87f-4a18-9e27-d7e8ed94acb3)\"" pod="gadget/gadget-pdh2j" podUID="afd3e4e8-b87f-4a18-9e27-d7e8ed94acb3"
Sep 13 18:30:58 addons-365496 kubelet[1496]: I0913 18:30:58.796969 1496 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-wlc96" secret="" err="secret \"gcp-auth\" not found"
Sep 13 18:31:08 addons-365496 kubelet[1496]: I0913 18:31:08.796111 1496 scope.go:117] "RemoveContainer" containerID="7f08f6ac7b60dd2e035617b6a69082ccb89d11075caae36b25ace42deca6a51f"
Sep 13 18:31:08 addons-365496 kubelet[1496]: E0913 18:31:08.796336 1496 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-pdh2j_gadget(afd3e4e8-b87f-4a18-9e27-d7e8ed94acb3)\"" pod="gadget/gadget-pdh2j" podUID="afd3e4e8-b87f-4a18-9e27-d7e8ed94acb3"
Sep 13 18:31:22 addons-365496 kubelet[1496]: I0913 18:31:22.796750 1496 scope.go:117] "RemoveContainer" containerID="7f08f6ac7b60dd2e035617b6a69082ccb89d11075caae36b25ace42deca6a51f"
Sep 13 18:31:22 addons-365496 kubelet[1496]: E0913 18:31:22.796977 1496 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-pdh2j_gadget(afd3e4e8-b87f-4a18-9e27-d7e8ed94acb3)\"" pod="gadget/gadget-pdh2j" podUID="afd3e4e8-b87f-4a18-9e27-d7e8ed94acb3"
==> storage-provisioner [26c263a6b51649100c660741f593e29921f080d100a49687ebc79412e4af35ce] <==
I0913 18:25:30.352515 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0913 18:25:30.376646 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0913 18:25:30.376697 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0913 18:25:30.409395 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0913 18:25:30.409757 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-365496_4295536e-644f-4318-a4e4-7e90e0bc510e!
I0913 18:25:30.410211 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"17e1890c-2e1f-483a-b864-533e18556dc2", APIVersion:"v1", ResourceVersion:"578", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-365496_4295536e-644f-4318-a4e4-7e90e0bc510e became leader
I0913 18:25:30.510484 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-365496_4295536e-644f-4318-a4e4-7e90e0bc510e!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-365496 -n addons-365496
helpers_test.go:261: (dbg) Run: kubectl --context addons-365496 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: ingress-nginx-admission-create-z9plc ingress-nginx-admission-patch-mvhxj test-job-nginx-0
helpers_test.go:274: ======> post-mortem[TestAddons/serial/Volcano]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-365496 describe pod ingress-nginx-admission-create-z9plc ingress-nginx-admission-patch-mvhxj test-job-nginx-0
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-365496 describe pod ingress-nginx-admission-create-z9plc ingress-nginx-admission-patch-mvhxj test-job-nginx-0: exit status 1 (93.995193ms)
** stderr **
Error from server (NotFound): pods "ingress-nginx-admission-create-z9plc" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-mvhxj" not found
Error from server (NotFound): pods "test-job-nginx-0" not found
** /stderr **
helpers_test.go:279: kubectl --context addons-365496 describe pod ingress-nginx-admission-create-z9plc ingress-nginx-admission-patch-mvhxj test-job-nginx-0: exit status 1
--- FAIL: TestAddons/serial/Volcano (199.85s)