=== RUN TestAddons/serial/Volcano
addons_test.go:897: volcano-scheduler stabilized in 49.522068ms
addons_test.go:913: volcano-controller stabilized in 49.800647ms
addons_test.go:905: volcano-admission stabilized in 49.845144ms
addons_test.go:919: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-scheduler-576bc46687-wh65j" [9397e547-55f2-400c-8b92-61642a2ec0d5] Running
addons_test.go:919: (dbg) TestAddons/serial/Volcano: app=volcano-scheduler healthy within 6.003634724s
addons_test.go:923: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-admission-77d7d48b68-cqpjm" [1b39ddf7-e011-4d52-afea-f7234222012c] Running
addons_test.go:923: (dbg) TestAddons/serial/Volcano: app=volcano-admission healthy within 5.004556896s
addons_test.go:927: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-controllers-56675bb4d5-sxb4b" [9b0054a1-cf6f-4550-839c-9624f54a2260] Running
addons_test.go:927: (dbg) TestAddons/serial/Volcano: app=volcano-controller healthy within 5.003581213s
addons_test.go:932: (dbg) Run: kubectl --context addons-313736 delete -n volcano-system job volcano-admission-init
addons_test.go:938: (dbg) Run: kubectl --context addons-313736 create -f testdata/vcjob.yaml
addons_test.go:946: (dbg) Run: kubectl --context addons-313736 get vcjob -n my-volcano
addons_test.go:964: (dbg) TestAddons/serial/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...
helpers_test.go:344: "test-job-nginx-0" [67152cc0-2868-44df-9684-eafbb86c90de] Pending
helpers_test.go:344: "test-job-nginx-0" [67152cc0-2868-44df-9684-eafbb86c90de] Pending: PodScheduled:Unschedulable (0/1 nodes are unavailable: 1 Insufficient cpu.)
helpers_test.go:329: TestAddons/serial/Volcano: WARNING: pod list for "my-volcano" "volcano.sh/job-name=test-job" returned: client rate limiter Wait returned an error: context deadline exceeded
addons_test.go:964: ***** TestAddons/serial/Volcano: pod "volcano.sh/job-name=test-job" failed to start within 3m0s: context deadline exceeded ****
addons_test.go:964: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-313736 -n addons-313736
addons_test.go:964: TestAddons/serial/Volcano: showing logs for failed pods as of 2024-08-29 18:32:08.641314145 +0000 UTC m=+439.792103167
addons_test.go:964: (dbg) Run: kubectl --context addons-313736 describe po test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-313736 describe po test-job-nginx-0 -n my-volcano:
Name: test-job-nginx-0
Namespace: my-volcano
Priority: 0
Service Account: default
Node: <none>
Labels: volcano.sh/job-name=test-job
volcano.sh/job-namespace=my-volcano
volcano.sh/queue-name=test
volcano.sh/task-index=0
volcano.sh/task-spec=nginx
Annotations: scheduling.k8s.io/group-name: test-job-8470f901-d456-441a-b4b9-08f1e17a65af
volcano.sh/job-name: test-job
volcano.sh/job-version: 0
volcano.sh/queue-name: test
volcano.sh/task-index: 0
volcano.sh/task-spec: nginx
volcano.sh/template-uid: test-job-nginx
Status: Pending
IP:
IPs: <none>
Controlled By: Job/test-job
Containers:
nginx:
Image: nginx:latest
Port: <none>
Host Port: <none>
Command:
sleep
10m
Limits:
cpu: 1
Requests:
cpu: 1
Environment:
GOOGLE_APPLICATION_CREDENTIALS: /google-app-creds.json
PROJECT_ID: this_is_fake
GCP_PROJECT: this_is_fake
GCLOUD_PROJECT: this_is_fake
GOOGLE_CLOUD_PROJECT: this_is_fake
CLOUDSDK_CORE_PROJECT: this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-ctjcx (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
kube-api-access-ctjcx:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
gcp-creds:
Type: HostPath (bare host directory volume)
Path: /var/lib/minikube/google_application_credentials.json
HostPathType: File
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling 2m59s volcano 0/1 nodes are unavailable: 1 Insufficient cpu.
addons_test.go:964: (dbg) Run: kubectl --context addons-313736 logs test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-313736 logs test-job-nginx-0 -n my-volcano:
addons_test.go:965: failed waiting for test-local-path pod: volcano.sh/job-name=test-job within 3m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestAddons/serial/Volcano]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect addons-313736
helpers_test.go:235: (dbg) docker inspect addons-313736:
-- stdout --
[
{
"Id": "347db04336a1ff656fc018615a8ebd684b2fc092635bf581d89a6a2f69c4ffe9",
"Created": "2024-08-29T18:25:42.104434644Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 301527,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-08-29T18:25:42.281083473Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:2cc8dc59c2b679153d99f84cc70dab3e87225f8a0d04f61969b54714a9c4cd4d",
"ResolvConfPath": "/var/lib/docker/containers/347db04336a1ff656fc018615a8ebd684b2fc092635bf581d89a6a2f69c4ffe9/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/347db04336a1ff656fc018615a8ebd684b2fc092635bf581d89a6a2f69c4ffe9/hostname",
"HostsPath": "/var/lib/docker/containers/347db04336a1ff656fc018615a8ebd684b2fc092635bf581d89a6a2f69c4ffe9/hosts",
"LogPath": "/var/lib/docker/containers/347db04336a1ff656fc018615a8ebd684b2fc092635bf581d89a6a2f69c4ffe9/347db04336a1ff656fc018615a8ebd684b2fc092635bf581d89a6a2f69c4ffe9-json.log",
"Name": "/addons-313736",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"addons-313736:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "addons-313736",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4194304000,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8388608000,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/91b56a837674ec1bfe7595991f0bc515a429c4041d038819752945758d44de5d-init/diff:/var/lib/docker/overlay2/889597e2fa0d4ae1da41b954737822c6552e3ca1f5f3387677bb8d8206dfa304/diff",
"MergedDir": "/var/lib/docker/overlay2/91b56a837674ec1bfe7595991f0bc515a429c4041d038819752945758d44de5d/merged",
"UpperDir": "/var/lib/docker/overlay2/91b56a837674ec1bfe7595991f0bc515a429c4041d038819752945758d44de5d/diff",
"WorkDir": "/var/lib/docker/overlay2/91b56a837674ec1bfe7595991f0bc515a429c4041d038819752945758d44de5d/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "addons-313736",
"Source": "/var/lib/docker/volumes/addons-313736/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "addons-313736",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-313736",
"name.minikube.sigs.k8s.io": "addons-313736",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "5b3eaba4f36993057c0b3061dbdf7ebf098c80731912a84c1f6da134aa65397e",
"SandboxKey": "/var/run/docker/netns/5b3eaba4f369",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33138"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33139"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33142"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33140"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33141"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"addons-313736": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:31:02",
"DriverOpts": null,
"NetworkID": "acdd5a40889a2663a7f84aa79bab65ab60fde0e4f4d7e25141e4110588decf5a",
"EndpointID": "c992e2b20722c5636674a23c3c1180ccc3e474c8cdb3a4c43a50378337700b80",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-313736",
"347db04336a1"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p addons-313736 -n addons-313736
helpers_test.go:244: <<< TestAddons/serial/Volcano FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/serial/Volcano]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p addons-313736 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-313736 logs -n 25: (1.580920251s)
helpers_test.go:252: TestAddons/serial/Volcano logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| start | -o=json --download-only | download-only-320461 | jenkins | v1.33.1 | 29 Aug 24 18:24 UTC | |
| | -p download-only-320461 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.33.1 | 29 Aug 24 18:25 UTC | 29 Aug 24 18:25 UTC |
| delete | -p download-only-320461 | download-only-320461 | jenkins | v1.33.1 | 29 Aug 24 18:25 UTC | 29 Aug 24 18:25 UTC |
| start | -o=json --download-only | download-only-064575 | jenkins | v1.33.1 | 29 Aug 24 18:25 UTC | |
| | -p download-only-064575 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.31.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.33.1 | 29 Aug 24 18:25 UTC | 29 Aug 24 18:25 UTC |
| delete | -p download-only-064575 | download-only-064575 | jenkins | v1.33.1 | 29 Aug 24 18:25 UTC | 29 Aug 24 18:25 UTC |
| delete | -p download-only-320461 | download-only-320461 | jenkins | v1.33.1 | 29 Aug 24 18:25 UTC | 29 Aug 24 18:25 UTC |
| delete | -p download-only-064575 | download-only-064575 | jenkins | v1.33.1 | 29 Aug 24 18:25 UTC | 29 Aug 24 18:25 UTC |
| start | --download-only -p | download-docker-995180 | jenkins | v1.33.1 | 29 Aug 24 18:25 UTC | |
| | download-docker-995180 | | | | | |
| | --alsologtostderr | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p download-docker-995180 | download-docker-995180 | jenkins | v1.33.1 | 29 Aug 24 18:25 UTC | 29 Aug 24 18:25 UTC |
| start | --download-only -p | binary-mirror-738747 | jenkins | v1.33.1 | 29 Aug 24 18:25 UTC | |
| | binary-mirror-738747 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:44599 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p binary-mirror-738747 | binary-mirror-738747 | jenkins | v1.33.1 | 29 Aug 24 18:25 UTC | 29 Aug 24 18:25 UTC |
| addons | enable dashboard -p | addons-313736 | jenkins | v1.33.1 | 29 Aug 24 18:25 UTC | |
| | addons-313736 | | | | | |
| addons | disable dashboard -p | addons-313736 | jenkins | v1.33.1 | 29 Aug 24 18:25 UTC | |
| | addons-313736 | | | | | |
| start | -p addons-313736 --wait=true | addons-313736 | jenkins | v1.33.1 | 29 Aug 24 18:25 UTC | 29 Aug 24 18:28 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/08/29 18:25:16
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.22.5 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0829 18:25:16.224701 301038 out.go:345] Setting OutFile to fd 1 ...
I0829 18:25:16.224824 301038 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0829 18:25:16.224854 301038 out.go:358] Setting ErrFile to fd 2...
I0829 18:25:16.224860 301038 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0829 18:25:16.225118 301038 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19531-294887/.minikube/bin
I0829 18:25:16.225539 301038 out.go:352] Setting JSON to false
I0829 18:25:16.226357 301038 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":7664,"bootTime":1724948253,"procs":155,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1068-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0829 18:25:16.226440 301038 start.go:139] virtualization:
I0829 18:25:16.228948 301038 out.go:177] * [addons-313736] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0829 18:25:16.231610 301038 out.go:177] - MINIKUBE_LOCATION=19531
I0829 18:25:16.231744 301038 notify.go:220] Checking for updates...
I0829 18:25:16.235985 301038 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0829 18:25:16.237924 301038 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19531-294887/kubeconfig
I0829 18:25:16.239960 301038 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19531-294887/.minikube
I0829 18:25:16.241704 301038 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0829 18:25:16.243453 301038 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0829 18:25:16.245341 301038 driver.go:392] Setting default libvirt URI to qemu:///system
I0829 18:25:16.266162 301038 docker.go:123] docker version: linux-27.2.0:Docker Engine - Community
I0829 18:25:16.266287 301038 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0829 18:25:16.320130 301038 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-08-29 18:25:16.311094027 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1068-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:472731909fa34bd7bc9c087e4c27943f9835f111 Expected:472731909fa34bd7bc9c087e4c27943f9835f111} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0829 18:25:16.320245 301038 docker.go:307] overlay module found
I0829 18:25:16.322293 301038 out.go:177] * Using the docker driver based on user configuration
I0829 18:25:16.324333 301038 start.go:297] selected driver: docker
I0829 18:25:16.324347 301038 start.go:901] validating driver "docker" against <nil>
I0829 18:25:16.324362 301038 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0829 18:25:16.324978 301038 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0829 18:25:16.386039 301038 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-08-29 18:25:16.376464282 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1068-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:472731909fa34bd7bc9c087e4c27943f9835f111 Expected:472731909fa34bd7bc9c087e4c27943f9835f111} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0829 18:25:16.386215 301038 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0829 18:25:16.386453 301038 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0829 18:25:16.388376 301038 out.go:177] * Using Docker driver with root privileges
I0829 18:25:16.390293 301038 cni.go:84] Creating CNI manager for ""
I0829 18:25:16.390320 301038 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0829 18:25:16.390330 301038 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0829 18:25:16.390410 301038 start.go:340] cluster config:
{Name:addons-313736 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-313736 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHA
uthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0829 18:25:16.392307 301038 out.go:177] * Starting "addons-313736" primary control-plane node in "addons-313736" cluster
I0829 18:25:16.394139 301038 cache.go:121] Beginning downloading kic base image for docker with containerd
I0829 18:25:16.395817 301038 out.go:177] * Pulling base image v0.0.44-1724775115-19521 ...
I0829 18:25:16.397407 301038 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0829 18:25:16.397460 301038 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19531-294887/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4
I0829 18:25:16.397486 301038 cache.go:56] Caching tarball of preloaded images
I0829 18:25:16.397517 301038 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce in local docker daemon
I0829 18:25:16.397566 301038 preload.go:172] Found /home/jenkins/minikube-integration/19531-294887/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0829 18:25:16.397576 301038 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on containerd
I0829 18:25:16.397933 301038 profile.go:143] Saving config to /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/config.json ...
I0829 18:25:16.397964 301038 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/config.json: {Name:mkedc31710657f1f43b0da4b298c7ef116ada95c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 18:25:16.423529 301038 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce to local cache
I0829 18:25:16.423649 301038 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce in local cache directory
I0829 18:25:16.423672 301038 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce in local cache directory, skipping pull
I0829 18:25:16.423678 301038 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce exists in cache, skipping pull
I0829 18:25:16.423689 301038 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce as a tarball
I0829 18:25:16.423697 301038 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce from local cache
I0829 18:25:33.673058 301038 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce from cached tarball
I0829 18:25:33.673105 301038 cache.go:194] Successfully downloaded all kic artifacts
I0829 18:25:33.673148 301038 start.go:360] acquireMachinesLock for addons-313736: {Name:mkdae46c59c7580ef7e5bdda5b920119c9fecf9a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0829 18:25:33.673259 301038 start.go:364] duration metric: took 88.483µs to acquireMachinesLock for "addons-313736"
I0829 18:25:33.673292 301038 start.go:93] Provisioning new machine with config: &{Name:addons-313736 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-313736 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fa
lse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0829 18:25:33.673382 301038 start.go:125] createHost starting for "" (driver="docker")
I0829 18:25:33.675869 301038 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
I0829 18:25:33.676134 301038 start.go:159] libmachine.API.Create for "addons-313736" (driver="docker")
I0829 18:25:33.676171 301038 client.go:168] LocalClient.Create starting
I0829 18:25:33.676281 301038 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19531-294887/.minikube/certs/ca.pem
I0829 18:25:34.397735 301038 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19531-294887/.minikube/certs/cert.pem
I0829 18:25:35.707861 301038 cli_runner.go:164] Run: docker network inspect addons-313736 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0829 18:25:35.721621 301038 cli_runner.go:211] docker network inspect addons-313736 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0829 18:25:35.721720 301038 network_create.go:284] running [docker network inspect addons-313736] to gather additional debugging logs...
I0829 18:25:35.721743 301038 cli_runner.go:164] Run: docker network inspect addons-313736
W0829 18:25:35.736855 301038 cli_runner.go:211] docker network inspect addons-313736 returned with exit code 1
I0829 18:25:35.736889 301038 network_create.go:287] error running [docker network inspect addons-313736]: docker network inspect addons-313736: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-313736 not found
I0829 18:25:35.736909 301038 network_create.go:289] output of [docker network inspect addons-313736]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-313736 not found
** /stderr **
I0829 18:25:35.737036 301038 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0829 18:25:35.751967 301038 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4000714bb0}
I0829 18:25:35.752026 301038 network_create.go:124] attempt to create docker network addons-313736 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0829 18:25:35.752086 301038 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-313736 addons-313736
I0829 18:25:35.822949 301038 network_create.go:108] docker network addons-313736 192.168.49.0/24 created
I0829 18:25:35.823048 301038 kic.go:121] calculated static IP "192.168.49.2" for the "addons-313736" container
I0829 18:25:35.823133 301038 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0829 18:25:35.838935 301038 cli_runner.go:164] Run: docker volume create addons-313736 --label name.minikube.sigs.k8s.io=addons-313736 --label created_by.minikube.sigs.k8s.io=true
I0829 18:25:35.856618 301038 oci.go:103] Successfully created a docker volume addons-313736
I0829 18:25:35.856716 301038 cli_runner.go:164] Run: docker run --rm --name addons-313736-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-313736 --entrypoint /usr/bin/test -v addons-313736:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce -d /var/lib
I0829 18:25:37.888343 301038 cli_runner.go:217] Completed: docker run --rm --name addons-313736-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-313736 --entrypoint /usr/bin/test -v addons-313736:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce -d /var/lib: (2.031583536s)
I0829 18:25:37.888377 301038 oci.go:107] Successfully prepared a docker volume addons-313736
I0829 18:25:37.888405 301038 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0829 18:25:37.888425 301038 kic.go:194] Starting extracting preloaded images to volume ...
I0829 18:25:37.888518 301038 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19531-294887/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-313736:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce -I lz4 -xf /preloaded.tar -C /extractDir
I0829 18:25:42.017120 301038 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19531-294887/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-313736:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce -I lz4 -xf /preloaded.tar -C /extractDir: (4.128558882s)
I0829 18:25:42.017158 301038 kic.go:203] duration metric: took 4.128728924s to extract preloaded images to volume ...
W0829 18:25:42.017310 301038 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0829 18:25:42.017450 301038 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0829 18:25:42.086477 301038 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-313736 --name addons-313736 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-313736 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-313736 --network addons-313736 --ip 192.168.49.2 --volume addons-313736:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce
I0829 18:25:42.440075 301038 cli_runner.go:164] Run: docker container inspect addons-313736 --format={{.State.Running}}
I0829 18:25:42.468090 301038 cli_runner.go:164] Run: docker container inspect addons-313736 --format={{.State.Status}}
I0829 18:25:42.490458 301038 cli_runner.go:164] Run: docker exec addons-313736 stat /var/lib/dpkg/alternatives/iptables
I0829 18:25:42.568861 301038 oci.go:144] the created container "addons-313736" has a running status.
I0829 18:25:42.568889 301038 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19531-294887/.minikube/machines/addons-313736/id_rsa...
I0829 18:25:42.965143 301038 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19531-294887/.minikube/machines/addons-313736/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0829 18:25:43.002499 301038 cli_runner.go:164] Run: docker container inspect addons-313736 --format={{.State.Status}}
I0829 18:25:43.028627 301038 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0829 18:25:43.028649 301038 kic_runner.go:114] Args: [docker exec --privileged addons-313736 chown docker:docker /home/docker/.ssh/authorized_keys]
I0829 18:25:43.114568 301038 cli_runner.go:164] Run: docker container inspect addons-313736 --format={{.State.Status}}
I0829 18:25:43.138095 301038 machine.go:93] provisionDockerMachine start ...
I0829 18:25:43.138189 301038 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-313736
I0829 18:25:43.159416 301038 main.go:141] libmachine: Using SSH client type: native
I0829 18:25:43.159695 301038 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0829 18:25:43.159705 301038 main.go:141] libmachine: About to run SSH command:
hostname
I0829 18:25:43.310237 301038 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-313736
I0829 18:25:43.310302 301038 ubuntu.go:169] provisioning hostname "addons-313736"
I0829 18:25:43.310397 301038 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-313736
I0829 18:25:43.333171 301038 main.go:141] libmachine: Using SSH client type: native
I0829 18:25:43.333422 301038 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0829 18:25:43.333440 301038 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-313736 && echo "addons-313736" | sudo tee /etc/hostname
I0829 18:25:43.493063 301038 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-313736
I0829 18:25:43.493149 301038 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-313736
I0829 18:25:43.518548 301038 main.go:141] libmachine: Using SSH client type: native
I0829 18:25:43.518788 301038 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0829 18:25:43.518806 301038 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-313736' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-313736/g' /etc/hosts;
else
echo '127.0.1.1 addons-313736' | sudo tee -a /etc/hosts;
fi
fi
I0829 18:25:43.662760 301038 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0829 18:25:43.662789 301038 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19531-294887/.minikube CaCertPath:/home/jenkins/minikube-integration/19531-294887/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19531-294887/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19531-294887/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19531-294887/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19531-294887/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19531-294887/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19531-294887/.minikube}
I0829 18:25:43.662817 301038 ubuntu.go:177] setting up certificates
I0829 18:25:43.662828 301038 provision.go:84] configureAuth start
I0829 18:25:43.662888 301038 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-313736
I0829 18:25:43.679093 301038 provision.go:143] copyHostCerts
I0829 18:25:43.679180 301038 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19531-294887/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19531-294887/.minikube/cert.pem (1123 bytes)
I0829 18:25:43.679299 301038 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19531-294887/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19531-294887/.minikube/key.pem (1675 bytes)
I0829 18:25:43.679352 301038 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19531-294887/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19531-294887/.minikube/ca.pem (1078 bytes)
I0829 18:25:43.679397 301038 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19531-294887/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19531-294887/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19531-294887/.minikube/certs/ca-key.pem org=jenkins.addons-313736 san=[127.0.0.1 192.168.49.2 addons-313736 localhost minikube]
I0829 18:25:43.917736 301038 provision.go:177] copyRemoteCerts
I0829 18:25:43.917824 301038 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0829 18:25:43.917869 301038 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-313736
I0829 18:25:43.934006 301038 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19531-294887/.minikube/machines/addons-313736/id_rsa Username:docker}
I0829 18:25:44.033034 301038 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-294887/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0829 18:25:44.058558 301038 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-294887/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0829 18:25:44.082438 301038 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-294887/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0829 18:25:44.106407 301038 provision.go:87] duration metric: took 443.565225ms to configureAuth
I0829 18:25:44.106432 301038 ubuntu.go:193] setting minikube options for container-runtime
I0829 18:25:44.106616 301038 config.go:182] Loaded profile config "addons-313736": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0829 18:25:44.106623 301038 machine.go:96] duration metric: took 968.51165ms to provisionDockerMachine
I0829 18:25:44.106630 301038 client.go:171] duration metric: took 10.430449489s to LocalClient.Create
I0829 18:25:44.106653 301038 start.go:167] duration metric: took 10.430523138s to libmachine.API.Create "addons-313736"
I0829 18:25:44.106662 301038 start.go:293] postStartSetup for "addons-313736" (driver="docker")
I0829 18:25:44.106672 301038 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0829 18:25:44.106722 301038 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0829 18:25:44.106763 301038 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-313736
I0829 18:25:44.123045 301038 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19531-294887/.minikube/machines/addons-313736/id_rsa Username:docker}
I0829 18:25:44.219820 301038 ssh_runner.go:195] Run: cat /etc/os-release
I0829 18:25:44.222724 301038 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0829 18:25:44.222779 301038 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0829 18:25:44.222792 301038 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0829 18:25:44.222800 301038 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0829 18:25:44.222812 301038 filesync.go:126] Scanning /home/jenkins/minikube-integration/19531-294887/.minikube/addons for local assets ...
I0829 18:25:44.222875 301038 filesync.go:126] Scanning /home/jenkins/minikube-integration/19531-294887/.minikube/files for local assets ...
I0829 18:25:44.222902 301038 start.go:296] duration metric: took 116.235011ms for postStartSetup
I0829 18:25:44.223230 301038 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-313736
I0829 18:25:44.240098 301038 profile.go:143] Saving config to /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/config.json ...
I0829 18:25:44.240396 301038 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0829 18:25:44.240451 301038 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-313736
I0829 18:25:44.256177 301038 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19531-294887/.minikube/machines/addons-313736/id_rsa Username:docker}
I0829 18:25:44.348052 301038 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0829 18:25:44.353035 301038 start.go:128] duration metric: took 10.679633594s to createHost
I0829 18:25:44.353061 301038 start.go:83] releasing machines lock for "addons-313736", held for 10.679786455s
I0829 18:25:44.353142 301038 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-313736
I0829 18:25:44.369643 301038 ssh_runner.go:195] Run: cat /version.json
I0829 18:25:44.369704 301038 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-313736
I0829 18:25:44.369951 301038 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0829 18:25:44.370025 301038 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-313736
I0829 18:25:44.399393 301038 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19531-294887/.minikube/machines/addons-313736/id_rsa Username:docker}
I0829 18:25:44.400669 301038 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19531-294887/.minikube/machines/addons-313736/id_rsa Username:docker}
I0829 18:25:44.689460 301038 ssh_runner.go:195] Run: systemctl --version
I0829 18:25:44.693890 301038 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0829 18:25:44.698174 301038 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0829 18:25:44.723447 301038 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0829 18:25:44.723524 301038 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0829 18:25:44.755472 301038 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0829 18:25:44.755498 301038 start.go:495] detecting cgroup driver to use...
I0829 18:25:44.755533 301038 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0829 18:25:44.755590 301038 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0829 18:25:44.768465 301038 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0829 18:25:44.780342 301038 docker.go:217] disabling cri-docker service (if available) ...
I0829 18:25:44.780441 301038 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0829 18:25:44.794778 301038 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0829 18:25:44.809623 301038 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0829 18:25:44.900072 301038 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0829 18:25:44.986775 301038 docker.go:233] disabling docker service ...
I0829 18:25:44.986864 301038 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0829 18:25:45.008134 301038 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0829 18:25:45.052444 301038 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0829 18:25:45.175275 301038 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0829 18:25:45.288875 301038 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0829 18:25:45.304235 301038 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0829 18:25:45.329100 301038 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0829 18:25:45.342764 301038 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0829 18:25:45.354364 301038 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0829 18:25:45.354483 301038 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0829 18:25:45.367927 301038 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0829 18:25:45.381031 301038 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0829 18:25:45.391926 301038 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0829 18:25:45.406831 301038 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0829 18:25:45.418175 301038 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0829 18:25:45.434313 301038 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0829 18:25:45.445385 301038 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0829 18:25:45.455932 301038 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0829 18:25:45.464584 301038 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0829 18:25:45.475102 301038 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0829 18:25:45.566476 301038 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0829 18:25:45.685402 301038 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0829 18:25:45.685496 301038 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0829 18:25:45.689168 301038 start.go:563] Will wait 60s for crictl version
I0829 18:25:45.689231 301038 ssh_runner.go:195] Run: which crictl
I0829 18:25:45.692771 301038 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0829 18:25:45.727552 301038 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.20
RuntimeApiVersion: v1
I0829 18:25:45.727639 301038 ssh_runner.go:195] Run: containerd --version
I0829 18:25:45.750326 301038 ssh_runner.go:195] Run: containerd --version
I0829 18:25:45.774916 301038 out.go:177] * Preparing Kubernetes v1.31.0 on containerd 1.7.20 ...
I0829 18:25:45.777830 301038 cli_runner.go:164] Run: docker network inspect addons-313736 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0829 18:25:45.793007 301038 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I0829 18:25:45.796625 301038 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0829 18:25:45.807456 301038 kubeadm.go:883] updating cluster {Name:addons-313736 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-313736 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cus
tomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0829 18:25:45.807597 301038 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0829 18:25:45.807662 301038 ssh_runner.go:195] Run: sudo crictl images --output json
I0829 18:25:45.845926 301038 containerd.go:627] all images are preloaded for containerd runtime.
I0829 18:25:45.845951 301038 containerd.go:534] Images already preloaded, skipping extraction
I0829 18:25:45.846011 301038 ssh_runner.go:195] Run: sudo crictl images --output json
I0829 18:25:45.881106 301038 containerd.go:627] all images are preloaded for containerd runtime.
I0829 18:25:45.881131 301038 cache_images.go:84] Images are preloaded, skipping loading
I0829 18:25:45.881140 301038 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.0 containerd true true} ...
I0829 18:25:45.881251 301038 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-313736 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.31.0 ClusterName:addons-313736 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0829 18:25:45.881320 301038 ssh_runner.go:195] Run: sudo crictl info
I0829 18:25:45.923072 301038 cni.go:84] Creating CNI manager for ""
I0829 18:25:45.923097 301038 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0829 18:25:45.923107 301038 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0829 18:25:45.923130 301038 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-313736 NodeName:addons-313736 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc
/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0829 18:25:45.923267 301038 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "addons-313736"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0829 18:25:45.923339 301038 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.0
I0829 18:25:45.932242 301038 binaries.go:44] Found k8s binaries, skipping transfer
I0829 18:25:45.932311 301038 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0829 18:25:45.940838 301038 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (317 bytes)
I0829 18:25:45.958403 301038 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0829 18:25:45.976449 301038 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2167 bytes)
I0829 18:25:45.994325 301038 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0829 18:25:45.997709 301038 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0829 18:25:46.011350 301038 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0829 18:25:46.099855 301038 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0829 18:25:46.113810 301038 certs.go:68] Setting up /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736 for IP: 192.168.49.2
I0829 18:25:46.113833 301038 certs.go:194] generating shared ca certs ...
I0829 18:25:46.113859 301038 certs.go:226] acquiring lock for ca certs: {Name:mkff870c43d6180289c0855b84e483f3e166f96a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 18:25:46.114029 301038 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19531-294887/.minikube/ca.key
I0829 18:25:46.389401 301038 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19531-294887/.minikube/ca.crt ...
I0829 18:25:46.389436 301038 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19531-294887/.minikube/ca.crt: {Name:mkb36e2277ad89935a8786f01cb6c942e0758b17 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 18:25:46.390183 301038 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19531-294887/.minikube/ca.key ...
I0829 18:25:46.390202 301038 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19531-294887/.minikube/ca.key: {Name:mk2522154b61f144023d747baf534ad0732bb9aa Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 18:25:46.390628 301038 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19531-294887/.minikube/proxy-client-ca.key
I0829 18:25:46.561671 301038 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19531-294887/.minikube/proxy-client-ca.crt ...
I0829 18:25:46.561704 301038 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19531-294887/.minikube/proxy-client-ca.crt: {Name:mk979ffbe288ed2fd2e08962cbd6f24ff579f7e0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 18:25:46.562420 301038 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19531-294887/.minikube/proxy-client-ca.key ...
I0829 18:25:46.562436 301038 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19531-294887/.minikube/proxy-client-ca.key: {Name:mkd2ea76c5e133a954f67c1d237dfaf5d1dac144 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 18:25:46.563004 301038 certs.go:256] generating profile certs ...
I0829 18:25:46.563068 301038 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/client.key
I0829 18:25:46.563089 301038 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/client.crt with IP's: []
I0829 18:25:46.784270 301038 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/client.crt ...
I0829 18:25:46.784303 301038 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/client.crt: {Name:mk7a57f44e25b73b7e9b19a969e80ba1325d85dc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 18:25:46.784487 301038 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/client.key ...
I0829 18:25:46.784500 301038 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/client.key: {Name:mkffd22a25d761d6ddccb9a21963a2ab1dd56184 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 18:25:46.784972 301038 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/apiserver.key.d236617d
I0829 18:25:46.784998 301038 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/apiserver.crt.d236617d with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I0829 18:25:47.357291 301038 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/apiserver.crt.d236617d ...
I0829 18:25:47.357324 301038 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/apiserver.crt.d236617d: {Name:mkc351d359433f6f5d5a6118d8aaf7477ef54898 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 18:25:47.357507 301038 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/apiserver.key.d236617d ...
I0829 18:25:47.357522 301038 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/apiserver.key.d236617d: {Name:mk455c08dba36ac3cfe548269c5809a3fa6a578a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 18:25:47.358053 301038 certs.go:381] copying /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/apiserver.crt.d236617d -> /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/apiserver.crt
I0829 18:25:47.358150 301038 certs.go:385] copying /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/apiserver.key.d236617d -> /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/apiserver.key
I0829 18:25:47.358212 301038 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/proxy-client.key
I0829 18:25:47.358236 301038 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/proxy-client.crt with IP's: []
I0829 18:25:47.917577 301038 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/proxy-client.crt ...
I0829 18:25:47.917616 301038 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/proxy-client.crt: {Name:mkd900cda1b7179bb90be70153e245c640eefed0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 18:25:47.917817 301038 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/proxy-client.key ...
I0829 18:25:47.917835 301038 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/proxy-client.key: {Name:mk71bfb454a2c81ba1464d4aabdb7088f034e4c8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 18:25:47.918490 301038 certs.go:484] found cert: /home/jenkins/minikube-integration/19531-294887/.minikube/certs/ca-key.pem (1675 bytes)
I0829 18:25:47.918561 301038 certs.go:484] found cert: /home/jenkins/minikube-integration/19531-294887/.minikube/certs/ca.pem (1078 bytes)
I0829 18:25:47.918599 301038 certs.go:484] found cert: /home/jenkins/minikube-integration/19531-294887/.minikube/certs/cert.pem (1123 bytes)
I0829 18:25:47.918643 301038 certs.go:484] found cert: /home/jenkins/minikube-integration/19531-294887/.minikube/certs/key.pem (1675 bytes)
I0829 18:25:47.919336 301038 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-294887/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0829 18:25:47.945068 301038 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-294887/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0829 18:25:47.970830 301038 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-294887/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0829 18:25:47.996108 301038 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-294887/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0829 18:25:48.028362 301038 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0829 18:25:48.056836 301038 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0829 18:25:48.082628 301038 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0829 18:25:48.107914 301038 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-294887/.minikube/profiles/addons-313736/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0829 18:25:48.132234 301038 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-294887/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0829 18:25:48.156779 301038 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0829 18:25:48.174579 301038 ssh_runner.go:195] Run: openssl version
I0829 18:25:48.180350 301038 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0829 18:25:48.189939 301038 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0829 18:25:48.193730 301038 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 29 18:25 /usr/share/ca-certificates/minikubeCA.pem
I0829 18:25:48.193836 301038 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0829 18:25:48.200794 301038 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0829 18:25:48.210037 301038 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0829 18:25:48.213478 301038 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0829 18:25:48.213529 301038 kubeadm.go:392] StartCluster: {Name:addons-313736 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-313736 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom
QemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0829 18:25:48.213618 301038 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0829 18:25:48.213682 301038 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0829 18:25:48.252042 301038 cri.go:89] found id: ""
I0829 18:25:48.252128 301038 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0829 18:25:48.260790 301038 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0829 18:25:48.269628 301038 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0829 18:25:48.269759 301038 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0829 18:25:48.280241 301038 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0829 18:25:48.280264 301038 kubeadm.go:157] found existing configuration files:
I0829 18:25:48.280319 301038 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0829 18:25:48.289100 301038 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0829 18:25:48.289197 301038 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0829 18:25:48.298044 301038 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0829 18:25:48.306885 301038 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0829 18:25:48.307052 301038 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0829 18:25:48.316018 301038 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0829 18:25:48.325375 301038 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0829 18:25:48.325439 301038 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0829 18:25:48.334251 301038 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0829 18:25:48.343141 301038 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0829 18:25:48.343261 301038 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0829 18:25:48.352107 301038 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0829 18:25:48.398016 301038 kubeadm.go:310] [init] Using Kubernetes version: v1.31.0
I0829 18:25:48.398154 301038 kubeadm.go:310] [preflight] Running pre-flight checks
I0829 18:25:48.427190 301038 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0829 18:25:48.427287 301038 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1068-aws[0m
I0829 18:25:48.427344 301038 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0829 18:25:48.427419 301038 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0829 18:25:48.427496 301038 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0829 18:25:48.427576 301038 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0829 18:25:48.427651 301038 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0829 18:25:48.427730 301038 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0829 18:25:48.427807 301038 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0829 18:25:48.427879 301038 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0829 18:25:48.427955 301038 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0829 18:25:48.428041 301038 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0829 18:25:48.503978 301038 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0829 18:25:48.504160 301038 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0829 18:25:48.504283 301038 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0829 18:25:48.509308 301038 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0829 18:25:48.512320 301038 out.go:235] - Generating certificates and keys ...
I0829 18:25:48.512527 301038 kubeadm.go:310] [certs] Using existing ca certificate authority
I0829 18:25:48.512649 301038 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0829 18:25:48.913678 301038 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0829 18:25:49.372753 301038 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0829 18:25:50.392205 301038 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0829 18:25:51.263615 301038 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0829 18:25:51.565117 301038 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0829 18:25:51.565488 301038 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-313736 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0829 18:25:52.175772 301038 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0829 18:25:52.176794 301038 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-313736 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0829 18:25:53.183240 301038 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0829 18:25:53.295201 301038 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0829 18:25:53.911629 301038 kubeadm.go:310] [certs] Generating "sa" key and public key
I0829 18:25:53.911931 301038 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0829 18:25:54.457846 301038 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0829 18:25:54.772262 301038 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0829 18:25:55.233897 301038 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0829 18:25:55.393352 301038 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0829 18:25:55.573722 301038 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0829 18:25:55.574382 301038 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0829 18:25:55.577278 301038 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0829 18:25:55.579953 301038 out.go:235] - Booting up control plane ...
I0829 18:25:55.580068 301038 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0829 18:25:55.580149 301038 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0829 18:25:55.580628 301038 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0829 18:25:55.591480 301038 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0829 18:25:55.597942 301038 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0829 18:25:55.598003 301038 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0829 18:25:55.701402 301038 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0829 18:25:55.701534 301038 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0829 18:25:56.702740 301038 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.001359605s
I0829 18:25:56.702859 301038 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0829 18:26:03.205962 301038 kubeadm.go:310] [api-check] The API server is healthy after 6.501936754s
I0829 18:26:03.229986 301038 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0829 18:26:03.245440 301038 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0829 18:26:03.275556 301038 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0829 18:26:03.275753 301038 kubeadm.go:310] [mark-control-plane] Marking the node addons-313736 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0829 18:26:03.287663 301038 kubeadm.go:310] [bootstrap-token] Using token: n1f4cs.3lvp13kk7b90rgjk
I0829 18:26:03.289839 301038 out.go:235] - Configuring RBAC rules ...
I0829 18:26:03.289962 301038 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0829 18:26:03.297391 301038 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0829 18:26:03.307392 301038 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0829 18:26:03.312296 301038 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0829 18:26:03.320555 301038 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0829 18:26:03.326900 301038 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0829 18:26:03.614747 301038 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0829 18:26:04.046693 301038 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0829 18:26:04.614021 301038 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0829 18:26:04.615085 301038 kubeadm.go:310]
I0829 18:26:04.615159 301038 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0829 18:26:04.615174 301038 kubeadm.go:310]
I0829 18:26:04.615256 301038 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0829 18:26:04.615268 301038 kubeadm.go:310]
I0829 18:26:04.615294 301038 kubeadm.go:310] mkdir -p $HOME/.kube
I0829 18:26:04.615353 301038 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0829 18:26:04.615410 301038 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0829 18:26:04.615423 301038 kubeadm.go:310]
I0829 18:26:04.615476 301038 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0829 18:26:04.615482 301038 kubeadm.go:310]
I0829 18:26:04.615528 301038 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0829 18:26:04.615536 301038 kubeadm.go:310]
I0829 18:26:04.615587 301038 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0829 18:26:04.615661 301038 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0829 18:26:04.615733 301038 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0829 18:26:04.615740 301038 kubeadm.go:310]
I0829 18:26:04.615825 301038 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0829 18:26:04.615903 301038 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0829 18:26:04.615911 301038 kubeadm.go:310]
I0829 18:26:04.615992 301038 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token n1f4cs.3lvp13kk7b90rgjk \
I0829 18:26:04.616101 301038 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:205230fdf83ff2176d62fc9c7a2ea39b2331080d0ddfbf443cb0634ca32f089e \
I0829 18:26:04.616127 301038 kubeadm.go:310] --control-plane
I0829 18:26:04.616132 301038 kubeadm.go:310]
I0829 18:26:04.616213 301038 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0829 18:26:04.616221 301038 kubeadm.go:310]
I0829 18:26:04.616299 301038 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token n1f4cs.3lvp13kk7b90rgjk \
I0829 18:26:04.616401 301038 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:205230fdf83ff2176d62fc9c7a2ea39b2331080d0ddfbf443cb0634ca32f089e
I0829 18:26:04.620249 301038 kubeadm.go:310] W0829 18:25:48.394572 1016 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0829 18:26:04.620538 301038 kubeadm.go:310] W0829 18:25:48.395504 1016 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0829 18:26:04.620752 301038 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1068-aws\n", err: exit status 1
I0829 18:26:04.620857 301038 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0829 18:26:04.620876 301038 cni.go:84] Creating CNI manager for ""
I0829 18:26:04.620890 301038 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0829 18:26:04.623783 301038 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0829 18:26:04.626236 301038 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0829 18:26:04.630573 301038 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.0/kubectl ...
I0829 18:26:04.630594 301038 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I0829 18:26:04.648854 301038 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0829 18:26:04.909705 301038 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0829 18:26:04.909859 301038 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0829 18:26:04.909946 301038 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-313736 minikube.k8s.io/updated_at=2024_08_29T18_26_04_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=95341f0b655cea8be5ebfc6bf112c8367dc08d33 minikube.k8s.io/name=addons-313736 minikube.k8s.io/primary=true
I0829 18:26:05.066703 301038 ops.go:34] apiserver oom_adj: -16
I0829 18:26:05.066927 301038 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0829 18:26:05.567634 301038 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0829 18:26:06.067766 301038 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0829 18:26:06.567587 301038 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0829 18:26:07.067098 301038 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0829 18:26:07.567752 301038 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0829 18:26:08.067138 301038 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0829 18:26:08.567212 301038 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0829 18:26:09.067988 301038 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0829 18:26:09.175089 301038 kubeadm.go:1113] duration metric: took 4.265296065s to wait for elevateKubeSystemPrivileges
I0829 18:26:09.175140 301038 kubeadm.go:394] duration metric: took 20.961612895s to StartCluster
I0829 18:26:09.175162 301038 settings.go:142] acquiring lock: {Name:mk2dbfd3425bb484a347461faf55714633ba5b5b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 18:26:09.175282 301038 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19531-294887/kubeconfig
I0829 18:26:09.175688 301038 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19531-294887/kubeconfig: {Name:mked59a8be214d4cb513c204ec61c1d6af8f1d6f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 18:26:09.175886 301038 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0829 18:26:09.176027 301038 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0829 18:26:09.176286 301038 config.go:182] Loaded profile config "addons-313736": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0829 18:26:09.176320 301038 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I0829 18:26:09.176418 301038 addons.go:69] Setting yakd=true in profile "addons-313736"
I0829 18:26:09.176446 301038 addons.go:234] Setting addon yakd=true in "addons-313736"
I0829 18:26:09.176473 301038 host.go:66] Checking if "addons-313736" exists ...
I0829 18:26:09.176985 301038 cli_runner.go:164] Run: docker container inspect addons-313736 --format={{.State.Status}}
I0829 18:26:09.177567 301038 addons.go:69] Setting inspektor-gadget=true in profile "addons-313736"
I0829 18:26:09.177602 301038 addons.go:234] Setting addon inspektor-gadget=true in "addons-313736"
I0829 18:26:09.177629 301038 host.go:66] Checking if "addons-313736" exists ...
I0829 18:26:09.178051 301038 cli_runner.go:164] Run: docker container inspect addons-313736 --format={{.State.Status}}
I0829 18:26:09.178297 301038 addons.go:69] Setting metrics-server=true in profile "addons-313736"
I0829 18:26:09.178341 301038 addons.go:234] Setting addon metrics-server=true in "addons-313736"
I0829 18:26:09.178402 301038 host.go:66] Checking if "addons-313736" exists ...
I0829 18:26:09.178886 301038 cli_runner.go:164] Run: docker container inspect addons-313736 --format={{.State.Status}}
I0829 18:26:09.179429 301038 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-313736"
I0829 18:26:09.179464 301038 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-313736"
I0829 18:26:09.179501 301038 host.go:66] Checking if "addons-313736" exists ...
I0829 18:26:09.179907 301038 cli_runner.go:164] Run: docker container inspect addons-313736 --format={{.State.Status}}
I0829 18:26:09.186122 301038 addons.go:69] Setting cloud-spanner=true in profile "addons-313736"
I0829 18:26:09.186171 301038 addons.go:234] Setting addon cloud-spanner=true in "addons-313736"
I0829 18:26:09.186208 301038 host.go:66] Checking if "addons-313736" exists ...
I0829 18:26:09.186653 301038 cli_runner.go:164] Run: docker container inspect addons-313736 --format={{.State.Status}}
I0829 18:26:09.190571 301038 addons.go:69] Setting registry=true in profile "addons-313736"
I0829 18:26:09.190610 301038 addons.go:234] Setting addon registry=true in "addons-313736"
I0829 18:26:09.190649 301038 host.go:66] Checking if "addons-313736" exists ...
I0829 18:26:09.191147 301038 cli_runner.go:164] Run: docker container inspect addons-313736 --format={{.State.Status}}
I0829 18:26:09.199798 301038 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-313736"
I0829 18:26:09.199884 301038 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-313736"
I0829 18:26:09.199924 301038 host.go:66] Checking if "addons-313736" exists ...
I0829 18:26:09.200394 301038 cli_runner.go:164] Run: docker container inspect addons-313736 --format={{.State.Status}}
I0829 18:26:09.209247 301038 addons.go:69] Setting storage-provisioner=true in profile "addons-313736"
I0829 18:26:09.209292 301038 addons.go:234] Setting addon storage-provisioner=true in "addons-313736"
I0829 18:26:09.209332 301038 host.go:66] Checking if "addons-313736" exists ...
I0829 18:26:09.209777 301038 cli_runner.go:164] Run: docker container inspect addons-313736 --format={{.State.Status}}
I0829 18:26:09.219883 301038 addons.go:69] Setting default-storageclass=true in profile "addons-313736"
I0829 18:26:09.219931 301038 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-313736"
I0829 18:26:09.220255 301038 cli_runner.go:164] Run: docker container inspect addons-313736 --format={{.State.Status}}
I0829 18:26:09.227566 301038 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-313736"
I0829 18:26:09.227613 301038 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-313736"
I0829 18:26:09.227937 301038 cli_runner.go:164] Run: docker container inspect addons-313736 --format={{.State.Status}}
I0829 18:26:09.230211 301038 addons.go:69] Setting gcp-auth=true in profile "addons-313736"
I0829 18:26:09.230269 301038 mustload.go:65] Loading cluster: addons-313736
I0829 18:26:09.230448 301038 config.go:182] Loaded profile config "addons-313736": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0829 18:26:09.230732 301038 cli_runner.go:164] Run: docker container inspect addons-313736 --format={{.State.Status}}
I0829 18:26:09.247167 301038 addons.go:69] Setting volcano=true in profile "addons-313736"
I0829 18:26:09.247211 301038 addons.go:234] Setting addon volcano=true in "addons-313736"
I0829 18:26:09.247371 301038 host.go:66] Checking if "addons-313736" exists ...
I0829 18:26:09.247825 301038 cli_runner.go:164] Run: docker container inspect addons-313736 --format={{.State.Status}}
I0829 18:26:09.248533 301038 addons.go:69] Setting ingress=true in profile "addons-313736"
I0829 18:26:09.248571 301038 addons.go:234] Setting addon ingress=true in "addons-313736"
I0829 18:26:09.248616 301038 host.go:66] Checking if "addons-313736" exists ...
I0829 18:26:09.249082 301038 cli_runner.go:164] Run: docker container inspect addons-313736 --format={{.State.Status}}
I0829 18:26:09.270174 301038 addons.go:69] Setting volumesnapshots=true in profile "addons-313736"
I0829 18:26:09.270213 301038 addons.go:234] Setting addon volumesnapshots=true in "addons-313736"
I0829 18:26:09.270255 301038 host.go:66] Checking if "addons-313736" exists ...
I0829 18:26:09.270698 301038 cli_runner.go:164] Run: docker container inspect addons-313736 --format={{.State.Status}}
I0829 18:26:09.271333 301038 addons.go:69] Setting ingress-dns=true in profile "addons-313736"
I0829 18:26:09.271373 301038 addons.go:234] Setting addon ingress-dns=true in "addons-313736"
I0829 18:26:09.271411 301038 host.go:66] Checking if "addons-313736" exists ...
I0829 18:26:09.271844 301038 cli_runner.go:164] Run: docker container inspect addons-313736 --format={{.State.Status}}
I0829 18:26:09.297416 301038 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I0829 18:26:09.300031 301038 out.go:177] * Verifying Kubernetes components...
I0829 18:26:09.346140 301038 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.31.0
I0829 18:26:09.351075 301038 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
I0829 18:26:09.351146 301038 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I0829 18:26:09.351260 301038 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-313736
I0829 18:26:09.370948 301038 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
I0829 18:26:09.370968 301038 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0829 18:26:09.372181 301038 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-313736
I0829 18:26:09.374078 301038 addons.go:234] Setting addon default-storageclass=true in "addons-313736"
I0829 18:26:09.374116 301038 host.go:66] Checking if "addons-313736" exists ...
I0829 18:26:09.374541 301038 cli_runner.go:164] Run: docker container inspect addons-313736 --format={{.State.Status}}
I0829 18:26:09.402924 301038 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0829 18:26:09.404948 301038 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0829 18:26:09.409041 301038 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0829 18:26:09.411965 301038 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0829 18:26:09.415065 301038 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0829 18:26:09.415221 301038 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0829 18:26:09.415315 301038 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.1
I0829 18:26:09.434669 301038 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
I0829 18:26:09.436075 301038 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-313736"
I0829 18:26:09.436157 301038 host.go:66] Checking if "addons-313736" exists ...
I0829 18:26:09.436623 301038 cli_runner.go:164] Run: docker container inspect addons-313736 --format={{.State.Status}}
I0829 18:26:09.439148 301038 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0829 18:26:09.439205 301038 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0829 18:26:09.439301 301038 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-313736
I0829 18:26:09.447434 301038 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.23
I0829 18:26:09.450504 301038 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
I0829 18:26:09.450571 301038 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0829 18:26:09.450671 301038 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-313736
I0829 18:26:09.456249 301038 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0829 18:26:09.456268 301038 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0829 18:26:09.456337 301038 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-313736
I0829 18:26:09.467161 301038 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0829 18:26:09.497555 301038 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
I0829 18:26:09.497717 301038 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0829 18:26:09.507333 301038 out.go:177] - Using image docker.io/registry:2.8.3
I0829 18:26:09.507448 301038 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0829 18:26:09.507489 301038 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0829 18:26:09.507578 301038 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-313736
I0829 18:26:09.508663 301038 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0829 18:26:09.510317 301038 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19531-294887/.minikube/machines/addons-313736/id_rsa Username:docker}
I0829 18:26:09.512073 301038 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0829 18:26:09.512091 301038 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0829 18:26:09.512145 301038 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-313736
I0829 18:26:09.515503 301038 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0829 18:26:09.515806 301038 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
I0829 18:26:09.515821 301038 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I0829 18:26:09.515880 301038 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-313736
I0829 18:26:09.527446 301038 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I0829 18:26:09.529777 301038 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0829 18:26:09.529800 301038 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0829 18:26:09.529861 301038 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-313736
I0829 18:26:09.544061 301038 out.go:177] - Using image docker.io/volcanosh/vc-webhook-manager:v1.9.0
I0829 18:26:09.544940 301038 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2
I0829 18:26:09.548072 301038 out.go:177] - Using image docker.io/volcanosh/vc-controller-manager:v1.9.0
I0829 18:26:09.550202 301038 out.go:177] - Using image docker.io/volcanosh/vc-scheduler:v1.9.0
I0829 18:26:09.550293 301038 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0829 18:26:09.552392 301038 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0829 18:26:09.553535 301038 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml
I0829 18:26:09.553552 301038 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (434001 bytes)
I0829 18:26:09.553619 301038 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-313736
I0829 18:26:09.557662 301038 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0829 18:26:09.557686 301038 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I0829 18:26:09.557748 301038 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-313736
I0829 18:26:09.567002 301038 host.go:66] Checking if "addons-313736" exists ...
I0829 18:26:09.575139 301038 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0829 18:26:09.600452 301038 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0829 18:26:09.600760 301038 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0829 18:26:09.600774 301038 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0829 18:26:09.600835 301038 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-313736
I0829 18:26:09.605147 301038 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0829 18:26:09.605216 301038 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0829 18:26:09.605316 301038 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-313736
I0829 18:26:09.614841 301038 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19531-294887/.minikube/machines/addons-313736/id_rsa Username:docker}
I0829 18:26:09.632226 301038 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19531-294887/.minikube/machines/addons-313736/id_rsa Username:docker}
I0829 18:26:09.667588 301038 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19531-294887/.minikube/machines/addons-313736/id_rsa Username:docker}
I0829 18:26:09.684791 301038 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19531-294887/.minikube/machines/addons-313736/id_rsa Username:docker}
I0829 18:26:09.692018 301038 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0829 18:26:09.695037 301038 out.go:177] - Using image docker.io/busybox:stable
I0829 18:26:09.700184 301038 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0829 18:26:09.700208 301038 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0829 18:26:09.700285 301038 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-313736
I0829 18:26:09.730186 301038 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19531-294887/.minikube/machines/addons-313736/id_rsa Username:docker}
I0829 18:26:09.731182 301038 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19531-294887/.minikube/machines/addons-313736/id_rsa Username:docker}
I0829 18:26:09.741123 301038 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19531-294887/.minikube/machines/addons-313736/id_rsa Username:docker}
I0829 18:26:09.747318 301038 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19531-294887/.minikube/machines/addons-313736/id_rsa Username:docker}
I0829 18:26:09.773005 301038 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19531-294887/.minikube/machines/addons-313736/id_rsa Username:docker}
I0829 18:26:09.773706 301038 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19531-294887/.minikube/machines/addons-313736/id_rsa Username:docker}
I0829 18:26:09.791432 301038 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0829 18:26:09.799759 301038 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19531-294887/.minikube/machines/addons-313736/id_rsa Username:docker}
I0829 18:26:09.809774 301038 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19531-294887/.minikube/machines/addons-313736/id_rsa Username:docker}
W0829 18:26:09.814246 301038 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0829 18:26:09.814276 301038 retry.go:31] will retry after 127.9386ms: ssh: handshake failed: EOF
I0829 18:26:09.836863 301038 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19531-294887/.minikube/machines/addons-313736/id_rsa Username:docker}
I0829 18:26:10.415675 301038 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
I0829 18:26:10.415752 301038 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0829 18:26:10.534596 301038 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I0829 18:26:10.534674 301038 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I0829 18:26:10.558713 301038 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0829 18:26:10.558778 301038 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0829 18:26:10.621182 301038 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0829 18:26:10.650728 301038 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0829 18:26:10.659262 301038 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0829 18:26:10.668703 301038 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0829 18:26:10.668777 301038 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0829 18:26:10.676820 301038 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0829 18:26:10.704544 301038 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0829 18:26:10.704621 301038 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0829 18:26:10.708059 301038 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
I0829 18:26:10.708125 301038 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0829 18:26:10.708984 301038 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
I0829 18:26:10.709041 301038 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0829 18:26:10.748311 301038 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0829 18:26:10.761976 301038 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
I0829 18:26:10.768673 301038 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
I0829 18:26:10.768747 301038 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0829 18:26:10.769046 301038 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0829 18:26:10.769085 301038 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0829 18:26:10.775725 301038 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0829 18:26:10.777023 301038 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
I0829 18:26:10.777075 301038 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0829 18:26:10.782758 301038 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0829 18:26:10.782826 301038 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0829 18:26:10.787505 301038 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0829 18:26:10.812180 301038 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
I0829 18:26:10.812253 301038 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I0829 18:26:10.921896 301038 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0829 18:26:10.921979 301038 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0829 18:26:10.932565 301038 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0829 18:26:10.932649 301038 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0829 18:26:11.000175 301038 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
I0829 18:26:11.000255 301038 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0829 18:26:11.030403 301038 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0829 18:26:11.045551 301038 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0829 18:26:11.045629 301038 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0829 18:26:11.051734 301038 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (1.584538163s)
I0829 18:26:11.051852 301038 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I0829 18:26:11.051817 301038 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (1.260362457s)
I0829 18:26:11.052858 301038 node_ready.go:35] waiting up to 6m0s for node "addons-313736" to be "Ready" ...
I0829 18:26:11.058368 301038 node_ready.go:49] node "addons-313736" has status "Ready":"True"
I0829 18:26:11.058398 301038 node_ready.go:38] duration metric: took 5.468715ms for node "addons-313736" to be "Ready" ...
I0829 18:26:11.058413 301038 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0829 18:26:11.082022 301038 pod_ready.go:79] waiting up to 6m0s for pod "coredns-6f6b679f8f-97lvt" in "kube-system" namespace to be "Ready" ...
I0829 18:26:11.184112 301038 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I0829 18:26:11.184144 301038 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I0829 18:26:11.235625 301038 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0829 18:26:11.235688 301038 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0829 18:26:11.363417 301038 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0829 18:26:11.373038 301038 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0829 18:26:11.373068 301038 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0829 18:26:11.382214 301038 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0829 18:26:11.382244 301038 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0829 18:26:11.545543 301038 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0829 18:26:11.545569 301038 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0829 18:26:11.558400 301038 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-313736" context rescaled to 1 replicas
I0829 18:26:11.591604 301038 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I0829 18:26:11.591629 301038 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I0829 18:26:11.626666 301038 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0829 18:26:11.631628 301038 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0829 18:26:11.631657 301038 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0829 18:26:11.982344 301038 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I0829 18:26:11.982371 301038 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I0829 18:26:12.061752 301038 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0829 18:26:12.109828 301038 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0829 18:26:12.109851 301038 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0829 18:26:12.406032 301038 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
I0829 18:26:12.406101 301038 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I0829 18:26:12.450645 301038 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
I0829 18:26:12.450723 301038 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
I0829 18:26:12.567637 301038 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I0829 18:26:12.607175 301038 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0829 18:26:12.607250 301038 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0829 18:26:12.718400 301038 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0829 18:26:12.718470 301038 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0829 18:26:12.945195 301038 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0829 18:26:12.945272 301038 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0829 18:26:13.089242 301038 pod_ready.go:103] pod "coredns-6f6b679f8f-97lvt" in "kube-system" namespace has status "Ready":"False"
I0829 18:26:13.385154 301038 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0829 18:26:13.385232 301038 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0829 18:26:13.731610 301038 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0829 18:26:14.024642 301038 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (3.403356446s)
I0829 18:26:14.024751 301038 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (3.373947553s)
I0829 18:26:14.024829 301038 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (3.365498673s)
I0829 18:26:15.090076 301038 pod_ready.go:103] pod "coredns-6f6b679f8f-97lvt" in "kube-system" namespace has status "Ready":"False"
I0829 18:26:15.135128 301038 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (4.458207656s)
I0829 18:26:15.135413 301038 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (4.387031842s)
I0829 18:26:16.780288 301038 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0829 18:26:16.780415 301038 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-313736
I0829 18:26:16.805670 301038 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19531-294887/.minikube/machines/addons-313736/id_rsa Username:docker}
I0829 18:26:17.107128 301038 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0829 18:26:17.251159 301038 addons.go:234] Setting addon gcp-auth=true in "addons-313736"
I0829 18:26:17.251237 301038 host.go:66] Checking if "addons-313736" exists ...
I0829 18:26:17.251718 301038 cli_runner.go:164] Run: docker container inspect addons-313736 --format={{.State.Status}}
I0829 18:26:17.283165 301038 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0829 18:26:17.283224 301038 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-313736
I0829 18:26:17.319799 301038 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19531-294887/.minikube/machines/addons-313736/id_rsa Username:docker}
I0829 18:26:17.589286 301038 pod_ready.go:103] pod "coredns-6f6b679f8f-97lvt" in "kube-system" namespace has status "Ready":"False"
I0829 18:26:19.620771 301038 pod_ready.go:103] pod "coredns-6f6b679f8f-97lvt" in "kube-system" namespace has status "Ready":"False"
I0829 18:26:20.235094 301038 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (9.473038662s)
I0829 18:26:20.235200 301038 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (9.45940329s)
I0829 18:26:20.235322 301038 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (9.447752403s)
I0829 18:26:20.235339 301038 addons.go:475] Verifying addon ingress=true in "addons-313736"
I0829 18:26:20.235558 301038 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (9.205083426s)
I0829 18:26:20.235582 301038 addons.go:475] Verifying addon registry=true in "addons-313736"
I0829 18:26:20.235924 301038 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (8.872444808s)
I0829 18:26:20.236045 301038 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.609349222s)
I0829 18:26:20.236504 301038 addons.go:475] Verifying addon metrics-server=true in "addons-313736"
I0829 18:26:20.236138 301038 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (8.174340436s)
W0829 18:26:20.236533 301038 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0829 18:26:20.236554 301038 retry.go:31] will retry after 249.572565ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0829 18:26:20.236223 301038 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (7.668498013s)
I0829 18:26:20.238451 301038 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-313736 service yakd-dashboard -n yakd-dashboard
I0829 18:26:20.238564 301038 out.go:177] * Verifying ingress addon...
I0829 18:26:20.238592 301038 out.go:177] * Verifying registry addon...
I0829 18:26:20.242606 301038 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0829 18:26:20.243061 301038 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0829 18:26:20.315723 301038 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0829 18:26:20.315753 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:20.320814 301038 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0829 18:26:20.320846 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:20.476300 301038 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (6.744577344s)
I0829 18:26:20.476338 301038 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-313736"
I0829 18:26:20.476585 301038 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (3.193396938s)
I0829 18:26:20.479301 301038 out.go:177] * Verifying csi-hostpath-driver addon...
I0829 18:26:20.479421 301038 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
I0829 18:26:20.482041 301038 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0829 18:26:20.484183 301038 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0829 18:26:20.487148 301038 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0829 18:26:20.487258 301038 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0829 18:26:20.487279 301038 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0829 18:26:20.514685 301038 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0829 18:26:20.514716 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:20.614666 301038 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0829 18:26:20.614689 301038 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0829 18:26:20.669451 301038 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0829 18:26:20.669522 301038 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I0829 18:26:20.755519 301038 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0829 18:26:20.779477 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:20.780195 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:20.987994 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:21.248246 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:21.249256 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:21.495353 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:21.752211 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:21.752357 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:22.009093 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:22.089972 301038 pod_ready.go:103] pod "coredns-6f6b679f8f-97lvt" in "kube-system" namespace has status "Ready":"False"
I0829 18:26:22.205105 301038 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.717915572s)
I0829 18:26:22.205573 301038 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.44996617s)
I0829 18:26:22.211897 301038 addons.go:475] Verifying addon gcp-auth=true in "addons-313736"
I0829 18:26:22.218970 301038 out.go:177] * Verifying gcp-auth addon...
I0829 18:26:22.222456 301038 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0829 18:26:22.226510 301038 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0829 18:26:22.249858 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:22.251698 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:22.488779 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:22.748704 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:22.751129 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:22.988559 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:23.247628 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:23.249016 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:23.487603 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:23.749130 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:23.749256 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:23.987250 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:24.247464 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:24.249704 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:24.489333 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:24.589278 301038 pod_ready.go:103] pod "coredns-6f6b679f8f-97lvt" in "kube-system" namespace has status "Ready":"False"
I0829 18:26:24.752849 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:24.754096 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:24.987199 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:25.248786 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:25.250674 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:25.488186 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:25.588089 301038 pod_ready.go:93] pod "coredns-6f6b679f8f-97lvt" in "kube-system" namespace has status "Ready":"True"
I0829 18:26:25.588126 301038 pod_ready.go:82] duration metric: took 14.506064484s for pod "coredns-6f6b679f8f-97lvt" in "kube-system" namespace to be "Ready" ...
I0829 18:26:25.588136 301038 pod_ready.go:79] waiting up to 6m0s for pod "coredns-6f6b679f8f-lcwnf" in "kube-system" namespace to be "Ready" ...
I0829 18:26:25.589968 301038 pod_ready.go:98] error getting pod "coredns-6f6b679f8f-lcwnf" in "kube-system" namespace (skipping!): pods "coredns-6f6b679f8f-lcwnf" not found
I0829 18:26:25.589991 301038 pod_ready.go:82] duration metric: took 1.847747ms for pod "coredns-6f6b679f8f-lcwnf" in "kube-system" namespace to be "Ready" ...
E0829 18:26:25.590001 301038 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-6f6b679f8f-lcwnf" in "kube-system" namespace (skipping!): pods "coredns-6f6b679f8f-lcwnf" not found
I0829 18:26:25.590018 301038 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-313736" in "kube-system" namespace to be "Ready" ...
I0829 18:26:25.595184 301038 pod_ready.go:93] pod "etcd-addons-313736" in "kube-system" namespace has status "Ready":"True"
I0829 18:26:25.595207 301038 pod_ready.go:82] duration metric: took 5.178976ms for pod "etcd-addons-313736" in "kube-system" namespace to be "Ready" ...
I0829 18:26:25.595219 301038 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-313736" in "kube-system" namespace to be "Ready" ...
I0829 18:26:25.600539 301038 pod_ready.go:93] pod "kube-apiserver-addons-313736" in "kube-system" namespace has status "Ready":"True"
I0829 18:26:25.600561 301038 pod_ready.go:82] duration metric: took 5.335324ms for pod "kube-apiserver-addons-313736" in "kube-system" namespace to be "Ready" ...
I0829 18:26:25.600571 301038 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-313736" in "kube-system" namespace to be "Ready" ...
I0829 18:26:25.606065 301038 pod_ready.go:93] pod "kube-controller-manager-addons-313736" in "kube-system" namespace has status "Ready":"True"
I0829 18:26:25.606088 301038 pod_ready.go:82] duration metric: took 5.509255ms for pod "kube-controller-manager-addons-313736" in "kube-system" namespace to be "Ready" ...
I0829 18:26:25.606098 301038 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-px8n4" in "kube-system" namespace to be "Ready" ...
I0829 18:26:25.749662 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:25.750973 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:25.786082 301038 pod_ready.go:93] pod "kube-proxy-px8n4" in "kube-system" namespace has status "Ready":"True"
I0829 18:26:25.786111 301038 pod_ready.go:82] duration metric: took 180.005716ms for pod "kube-proxy-px8n4" in "kube-system" namespace to be "Ready" ...
I0829 18:26:25.786124 301038 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-313736" in "kube-system" namespace to be "Ready" ...
I0829 18:26:25.991284 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:26.186475 301038 pod_ready.go:93] pod "kube-scheduler-addons-313736" in "kube-system" namespace has status "Ready":"True"
I0829 18:26:26.186501 301038 pod_ready.go:82] duration metric: took 400.340565ms for pod "kube-scheduler-addons-313736" in "kube-system" namespace to be "Ready" ...
I0829 18:26:26.186511 301038 pod_ready.go:39] duration metric: took 15.128055668s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0829 18:26:26.186553 301038 api_server.go:52] waiting for apiserver process to appear ...
I0829 18:26:26.186640 301038 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0829 18:26:26.203456 301038 api_server.go:72] duration metric: took 17.027534585s to wait for apiserver process to appear ...
I0829 18:26:26.203486 301038 api_server.go:88] waiting for apiserver healthz status ...
I0829 18:26:26.203517 301038 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I0829 18:26:26.217685 301038 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I0829 18:26:26.218945 301038 api_server.go:141] control plane version: v1.31.0
I0829 18:26:26.218975 301038 api_server.go:131] duration metric: took 15.480411ms to wait for apiserver health ...
I0829 18:26:26.219018 301038 system_pods.go:43] waiting for kube-system pods to appear ...
I0829 18:26:26.249627 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:26.250442 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:26.393752 301038 system_pods.go:59] 18 kube-system pods found
I0829 18:26:26.393790 301038 system_pods.go:61] "coredns-6f6b679f8f-97lvt" [f494a2a9-8639-4e39-a440-242804994390] Running
I0829 18:26:26.393802 301038 system_pods.go:61] "csi-hostpath-attacher-0" [a67acf19-bf97-43a6-9922-1a8b371f35fd] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0829 18:26:26.393810 301038 system_pods.go:61] "csi-hostpath-resizer-0" [0c9a31d4-410c-4941-9a50-62493bb2be57] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0829 18:26:26.393818 301038 system_pods.go:61] "csi-hostpathplugin-b99dw" [31d9e030-5046-4c9e-b089-74b338f70d82] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0829 18:26:26.393824 301038 system_pods.go:61] "etcd-addons-313736" [6c7bbc3b-5a11-4440-a1db-5b89dcf0af08] Running
I0829 18:26:26.393829 301038 system_pods.go:61] "kindnet-c427g" [ee1f9b6c-0175-4890-af81-057bc49bdb37] Running
I0829 18:26:26.393838 301038 system_pods.go:61] "kube-apiserver-addons-313736" [12336746-b93c-4889-b548-a2f33df7ee03] Running
I0829 18:26:26.393843 301038 system_pods.go:61] "kube-controller-manager-addons-313736" [9ffe808e-aa0e-4645-bdc9-35e52cbad4d9] Running
I0829 18:26:26.393854 301038 system_pods.go:61] "kube-ingress-dns-minikube" [1e0639cc-1469-4aff-bf23-58913af6ee32] Running
I0829 18:26:26.393858 301038 system_pods.go:61] "kube-proxy-px8n4" [5154629c-3f92-424d-9678-7f7110bc7d15] Running
I0829 18:26:26.393863 301038 system_pods.go:61] "kube-scheduler-addons-313736" [96ca05af-6b92-478a-ba24-4bfc8db2ed47] Running
I0829 18:26:26.393868 301038 system_pods.go:61] "metrics-server-8988944d9-brtb2" [79712a49-534c-49ba-8cec-b2e9651cd850] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0829 18:26:26.393880 301038 system_pods.go:61] "nvidia-device-plugin-daemonset-79mkt" [a561e68c-dffc-4185-a1a6-0ed0576036a2] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I0829 18:26:26.393888 301038 system_pods.go:61] "registry-6fb4cdfc84-t5fqg" [a2305139-7335-44c4-82ac-97989aa1b035] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0829 18:26:26.393899 301038 system_pods.go:61] "registry-proxy-zg6cg" [b0fc6f42-5a81-4785-8ec8-c95a9f47b0e4] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0829 18:26:26.393905 301038 system_pods.go:61] "snapshot-controller-56fcc65765-pl6v7" [1a510449-65f7-4726-886e-e5e9f0190d04] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0829 18:26:26.393912 301038 system_pods.go:61] "snapshot-controller-56fcc65765-wwh99" [c224dc01-1155-4841-ad5e-000a56ad51a8] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0829 18:26:26.393925 301038 system_pods.go:61] "storage-provisioner" [8a196325-a162-408e-938b-42c4538259ae] Running
I0829 18:26:26.393933 301038 system_pods.go:74] duration metric: took 174.907463ms to wait for pod list to return data ...
I0829 18:26:26.393941 301038 default_sa.go:34] waiting for default service account to be created ...
I0829 18:26:26.487852 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:26.586194 301038 default_sa.go:45] found service account: "default"
I0829 18:26:26.586233 301038 default_sa.go:55] duration metric: took 192.285376ms for default service account to be created ...
I0829 18:26:26.586245 301038 system_pods.go:116] waiting for k8s-apps to be running ...
I0829 18:26:26.748101 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:26.748616 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:26.794222 301038 system_pods.go:86] 18 kube-system pods found
I0829 18:26:26.794259 301038 system_pods.go:89] "coredns-6f6b679f8f-97lvt" [f494a2a9-8639-4e39-a440-242804994390] Running
I0829 18:26:26.794270 301038 system_pods.go:89] "csi-hostpath-attacher-0" [a67acf19-bf97-43a6-9922-1a8b371f35fd] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0829 18:26:26.794278 301038 system_pods.go:89] "csi-hostpath-resizer-0" [0c9a31d4-410c-4941-9a50-62493bb2be57] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0829 18:26:26.794286 301038 system_pods.go:89] "csi-hostpathplugin-b99dw" [31d9e030-5046-4c9e-b089-74b338f70d82] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0829 18:26:26.794290 301038 system_pods.go:89] "etcd-addons-313736" [6c7bbc3b-5a11-4440-a1db-5b89dcf0af08] Running
I0829 18:26:26.794295 301038 system_pods.go:89] "kindnet-c427g" [ee1f9b6c-0175-4890-af81-057bc49bdb37] Running
I0829 18:26:26.794299 301038 system_pods.go:89] "kube-apiserver-addons-313736" [12336746-b93c-4889-b548-a2f33df7ee03] Running
I0829 18:26:26.794304 301038 system_pods.go:89] "kube-controller-manager-addons-313736" [9ffe808e-aa0e-4645-bdc9-35e52cbad4d9] Running
I0829 18:26:26.794309 301038 system_pods.go:89] "kube-ingress-dns-minikube" [1e0639cc-1469-4aff-bf23-58913af6ee32] Running
I0829 18:26:26.794313 301038 system_pods.go:89] "kube-proxy-px8n4" [5154629c-3f92-424d-9678-7f7110bc7d15] Running
I0829 18:26:26.794317 301038 system_pods.go:89] "kube-scheduler-addons-313736" [96ca05af-6b92-478a-ba24-4bfc8db2ed47] Running
I0829 18:26:26.794322 301038 system_pods.go:89] "metrics-server-8988944d9-brtb2" [79712a49-534c-49ba-8cec-b2e9651cd850] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0829 18:26:26.794330 301038 system_pods.go:89] "nvidia-device-plugin-daemonset-79mkt" [a561e68c-dffc-4185-a1a6-0ed0576036a2] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I0829 18:26:26.794336 301038 system_pods.go:89] "registry-6fb4cdfc84-t5fqg" [a2305139-7335-44c4-82ac-97989aa1b035] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0829 18:26:26.794342 301038 system_pods.go:89] "registry-proxy-zg6cg" [b0fc6f42-5a81-4785-8ec8-c95a9f47b0e4] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0829 18:26:26.794348 301038 system_pods.go:89] "snapshot-controller-56fcc65765-pl6v7" [1a510449-65f7-4726-886e-e5e9f0190d04] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0829 18:26:26.794355 301038 system_pods.go:89] "snapshot-controller-56fcc65765-wwh99" [c224dc01-1155-4841-ad5e-000a56ad51a8] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0829 18:26:26.794358 301038 system_pods.go:89] "storage-provisioner" [8a196325-a162-408e-938b-42c4538259ae] Running
I0829 18:26:26.794366 301038 system_pods.go:126] duration metric: took 208.114479ms to wait for k8s-apps to be running ...
I0829 18:26:26.794381 301038 system_svc.go:44] waiting for kubelet service to be running ....
I0829 18:26:26.794439 301038 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0829 18:26:26.808088 301038 system_svc.go:56] duration metric: took 13.696622ms WaitForService to wait for kubelet
I0829 18:26:26.808125 301038 kubeadm.go:582] duration metric: took 17.632207226s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0829 18:26:26.808147 301038 node_conditions.go:102] verifying NodePressure condition ...
I0829 18:26:26.987031 301038 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0829 18:26:26.987064 301038 node_conditions.go:123] node cpu capacity is 2
I0829 18:26:26.987088 301038 node_conditions.go:105] duration metric: took 178.935246ms to run NodePressure ...
I0829 18:26:26.987102 301038 start.go:241] waiting for startup goroutines ...
I0829 18:26:26.987907 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:27.248486 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:27.249230 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:27.487641 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:27.763086 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:27.764308 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:27.989494 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:28.249773 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:28.251564 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:28.487263 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:28.749408 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:28.750938 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:28.987983 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:29.249459 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:29.256258 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:29.487751 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:29.748625 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:29.750091 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:29.987716 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:30.249009 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:30.250952 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:30.487385 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:30.748085 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:30.749622 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:30.987632 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:31.247434 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:31.248829 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:31.487219 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:31.748279 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:31.750156 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:31.993503 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:32.249155 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:32.249883 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:32.488000 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:32.747568 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:32.747776 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:32.988269 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:33.247270 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:33.248284 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:33.487546 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:33.828003 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:33.829323 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:33.988474 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:34.248028 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:34.249596 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:34.488326 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:34.749505 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:34.750418 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:34.987908 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:35.248057 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:35.248719 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:35.488011 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:35.747319 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:35.748242 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:35.987078 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:36.252133 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:36.253862 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:36.500863 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:36.749338 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:36.750559 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:36.987299 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:37.246386 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:37.247334 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:37.487031 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:37.748354 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:37.748871 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:37.987702 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:38.250320 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:38.251238 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:38.488363 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:38.747286 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:38.748212 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:38.987398 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:39.248466 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:39.251404 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:39.488077 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:39.830769 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:39.833050 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:39.987537 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:40.254458 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:40.255826 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:40.488243 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:40.748445 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:40.750975 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:40.987125 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:41.262942 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:41.263891 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:41.488035 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:41.750421 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:41.751062 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:41.990156 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:42.259170 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:42.261298 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:42.491405 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:42.750346 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:42.752260 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:42.988270 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:43.248127 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:43.248700 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:43.487536 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:43.747481 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:43.748520 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:43.987569 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:44.247758 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:44.248413 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:44.487647 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:44.747173 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:44.747971 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:44.987992 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:45.250895 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:45.254149 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0829 18:26:45.488643 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:45.747370 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:45.747897 301038 kapi.go:107] duration metric: took 25.504835595s to wait for kubernetes.io/minikube-addons=registry ...
I0829 18:26:45.989087 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:46.246956 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:46.488218 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:46.747541 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:46.987919 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:47.247543 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:47.487138 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:47.747419 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:47.987593 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:48.328280 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:48.493998 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:48.747183 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:48.987280 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:49.251686 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:49.487329 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:49.747637 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:49.988135 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:50.247164 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:50.492012 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:50.747420 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:50.987845 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:51.247629 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:51.492655 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:51.747634 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:51.987568 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:52.247501 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:52.487420 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:52.747643 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:52.987997 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:53.247974 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:53.487406 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:53.747082 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:53.987023 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:54.247215 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:54.486726 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:54.747758 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:54.987286 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:55.247289 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:55.487736 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:55.746886 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:55.987728 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:56.247120 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:56.486884 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:56.747043 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:56.987798 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:57.247731 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:57.487794 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:57.748664 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:57.988162 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:58.247126 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:58.491019 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:58.747420 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:58.986911 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:59.246930 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:59.486522 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:26:59.748398 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:26:59.987534 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:00.280091 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:00.487077 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:00.831452 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:00.987364 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:01.246448 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:01.486714 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:01.751885 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:01.988032 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:02.247764 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:02.487878 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:02.746878 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:02.987344 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:03.247068 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:03.486703 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:03.746761 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:03.988563 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:04.328936 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:04.486617 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:04.747095 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:04.986509 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:05.247467 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:05.487860 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:05.746715 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:05.987844 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:06.247713 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:06.487188 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:06.748124 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:06.987220 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:07.247850 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:07.487342 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:07.747803 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:07.988236 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:08.247148 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:08.487483 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:08.747321 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:08.987165 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:09.246645 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:09.487389 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:09.747419 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:09.987508 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:10.247230 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:10.488321 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:10.748040 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:10.987606 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:11.247023 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:11.487301 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:11.747677 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:11.988136 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:12.247264 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:12.486923 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:12.747707 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:12.987779 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:13.247523 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:13.487715 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:13.747612 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:13.987780 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:14.328098 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:14.487729 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:14.746926 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:14.987476 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:15.247465 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:15.488997 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:15.747155 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:15.991801 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:16.247395 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:16.486872 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0829 18:27:16.746637 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:16.988011 301038 kapi.go:107] duration metric: took 56.505970296s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0829 18:27:17.247152 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:17.747433 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:18.247184 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:18.747112 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:19.247044 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:19.746895 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:20.247726 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:20.747572 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:21.248220 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:21.747242 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:22.328455 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:22.746866 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:23.247082 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:23.747189 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:24.246767 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:24.747393 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:25.246251 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:25.747843 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:26.246889 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:26.747339 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:27.246467 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:27.747922 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:28.330006 301038 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0829 18:27:28.751375 301038 kapi.go:107] duration metric: took 1m8.508765568s to wait for app.kubernetes.io/name=ingress-nginx ...
I0829 18:27:44.226211 301038 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0829 18:27:44.226238 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:44.735504 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:45.231321 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:45.726237 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:46.226583 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:46.726368 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:47.226328 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:47.726413 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:48.226012 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:48.725703 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:49.225708 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:49.726742 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:50.226435 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:50.725716 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:51.225829 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:51.726729 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:52.226425 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:52.726543 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:53.226442 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:53.725571 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:54.226677 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:54.726614 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:55.226060 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:55.727286 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:56.226969 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:56.726035 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:57.226493 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:57.726248 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:58.225881 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:58.726107 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:59.226518 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:27:59.726788 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:00.236832 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:00.727070 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:01.229650 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:01.726057 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:02.225960 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:02.726299 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:03.226219 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:03.729746 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:04.226016 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:04.726823 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:05.225768 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:05.725721 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:06.225948 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:06.726660 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:07.226463 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:07.726382 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:08.225507 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:08.726296 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:09.226178 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:09.726378 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:10.225720 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:10.727805 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:11.226558 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:11.726870 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:12.226350 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:12.726394 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:13.226202 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:13.726840 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:14.226323 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:14.726345 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:15.226822 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:15.726548 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:16.227285 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:16.726319 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:17.226067 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:17.726080 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:18.226196 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:18.726240 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:19.226557 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:19.726205 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:20.226409 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:20.725880 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:21.225859 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:21.727345 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:22.226166 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:22.726678 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:23.225868 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:23.726611 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:24.226065 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:24.725918 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:25.226409 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:25.726702 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:26.226904 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:26.726392 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:27.226802 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:27.726282 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:28.226964 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:28.726111 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:29.225950 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:29.726060 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:30.227494 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:30.726322 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:31.227780 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:31.726351 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:32.226020 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:32.725868 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:33.227025 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:33.725838 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:34.225756 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:34.726824 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:35.226535 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:35.726037 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:36.226522 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:36.726694 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:37.226732 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:37.726227 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:38.225730 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:38.726480 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:39.226212 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:39.726335 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:40.226369 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:40.726064 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:41.226754 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:41.726027 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:42.226805 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:42.726668 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:43.226064 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:43.726668 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:44.225855 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:44.726373 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:45.227131 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:45.726018 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:46.226315 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:46.726940 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:47.226628 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:47.726588 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:48.226202 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:48.726311 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:49.225801 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:49.726624 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:50.226185 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:50.726324 301038 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0829 18:28:51.226309 301038 kapi.go:107] duration metric: took 2m29.00385192s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0829 18:28:51.228543 301038 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-313736 cluster.
I0829 18:28:51.230757 301038 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0829 18:28:51.232983 301038 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0829 18:28:51.235583 301038 out.go:177] * Enabled addons: ingress-dns, cloud-spanner, default-storageclass, nvidia-device-plugin, storage-provisioner-rancher, volcano, storage-provisioner, metrics-server, inspektor-gadget, yakd, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth
I0829 18:28:51.237690 301038 addons.go:510] duration metric: took 2m42.061362469s for enable addons: enabled=[ingress-dns cloud-spanner default-storageclass nvidia-device-plugin storage-provisioner-rancher volcano storage-provisioner metrics-server inspektor-gadget yakd volumesnapshots registry csi-hostpath-driver ingress gcp-auth]
I0829 18:28:51.237750 301038 start.go:246] waiting for cluster config update ...
I0829 18:28:51.237782 301038 start.go:255] writing updated cluster config ...
I0829 18:28:51.238117 301038 ssh_runner.go:195] Run: rm -f paused
I0829 18:28:51.616306 301038 start.go:600] kubectl: 1.31.0, cluster: 1.31.0 (minor skew: 0)
I0829 18:28:51.619177 301038 out.go:177] * Done! kubectl is now configured to use "addons-313736" cluster and "default" namespace by default
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
e38deb1afbe62 e2d3313f65753 2 minutes ago Exited gadget 5 658f77358b7f4 gadget-prw5j
35f60bb89ffeb 6ef582f3ec844 3 minutes ago Running gcp-auth 0 80a86b55154cd gcp-auth-89d5ffd79-l9fdx
e65755ce23136 8b46b1cd48760 4 minutes ago Running admission 0 f364b5b9864a0 volcano-admission-77d7d48b68-cqpjm
5c2aa6b0423d4 289a818c8d9c5 4 minutes ago Running controller 0 604328d388078 ingress-nginx-controller-bc57996ff-ldxzl
3eed84150d80b ee6d597e62dc8 4 minutes ago Running csi-snapshotter 0 7afb444e2d199 csi-hostpathplugin-b99dw
2ccfff19b45d1 642ded511e141 4 minutes ago Running csi-provisioner 0 7afb444e2d199 csi-hostpathplugin-b99dw
886f75063bb08 922312104da8a 4 minutes ago Running liveness-probe 0 7afb444e2d199 csi-hostpathplugin-b99dw
dbf17fee3fabd 420193b27261a 4 minutes ago Exited patch 2 b58dcd3157b49 ingress-nginx-admission-patch-ttxpv
9638f2a0f553c 08f6b2990811a 4 minutes ago Running hostpath 0 7afb444e2d199 csi-hostpathplugin-b99dw
d5816eabf363a 0107d56dbc0be 5 minutes ago Running node-driver-registrar 0 7afb444e2d199 csi-hostpathplugin-b99dw
8225b37a8d162 420193b27261a 5 minutes ago Exited create 0 cd07d2ad6922b ingress-nginx-admission-create-g99hw
eb0b529c1a666 9a80d518f102c 5 minutes ago Running csi-attacher 0 2e8b593b524d8 csi-hostpath-attacher-0
4091f5b0b27b2 487fa743e1e22 5 minutes ago Running csi-resizer 0 82462f6e0a4e0 csi-hostpath-resizer-0
652651f01b8a7 1505f556b3a7b 5 minutes ago Running volcano-controllers 0 b8d9a22d6113b volcano-controllers-56675bb4d5-sxb4b
4812e6611b631 d9c7ad4c226bf 5 minutes ago Running volcano-scheduler 0 fa49ee00f528d volcano-scheduler-576bc46687-wh65j
3a5323b8efc4d 1461903ec4fe9 5 minutes ago Running csi-external-health-monitor-controller 0 7afb444e2d199 csi-hostpathplugin-b99dw
f9f7a656903dc 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 2832421c7ba1b snapshot-controller-56fcc65765-wwh99
e7f4ac8628bac 77bdba588b953 5 minutes ago Running yakd 0 bbce5b2ea2632 yakd-dashboard-67d98fc6b-82mq4
051e1bb822f12 8be4bcf8ec607 5 minutes ago Running cloud-spanner-emulator 0 7189b889d7c94 cloud-spanner-emulator-769b77f747-zt9vp
c1b07da740727 6fed88f43b276 5 minutes ago Running registry 0 ab1c3b43ea1b1 registry-6fb4cdfc84-t5fqg
062ab71897642 7ce2150c8929b 5 minutes ago Running local-path-provisioner 0 15a36d4964a33 local-path-provisioner-86d989889c-s77rc
68ac8705c7211 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 937b7f666f67c snapshot-controller-56fcc65765-pl6v7
1289155ea164a 95dccb4df54ab 5 minutes ago Running metrics-server 0 51102003c8348 metrics-server-8988944d9-brtb2
195fd7b00650a 3410e1561990a 5 minutes ago Running registry-proxy 0 3ad10a61e8a75 registry-proxy-zg6cg
fc228edf670c7 a9bac31a5be8d 5 minutes ago Running nvidia-device-plugin-ctr 0 b2b01c0298c91 nvidia-device-plugin-daemonset-79mkt
d0eb4940a89d4 2437cf7621777 5 minutes ago Running coredns 0 4f405ef4e9cff coredns-6f6b679f8f-97lvt
66a57b33b1464 35508c2f890c4 5 minutes ago Running minikube-ingress-dns 0 6a43dc2fc0ca6 kube-ingress-dns-minikube
b49cdd4d50daf ba04bb24b9575 5 minutes ago Running storage-provisioner 0 9e48710c81128 storage-provisioner
96e14bf21ee6e 6a23fa8fd2b78 5 minutes ago Running kindnet-cni 0 30052596a661e kindnet-c427g
fd6c29e1575a6 71d55d66fd4ee 6 minutes ago Running kube-proxy 0 a262d61c5ced7 kube-proxy-px8n4
39ab06cc61bd0 fcb0683e6bdbd 6 minutes ago Running kube-controller-manager 0 1034913f85b0a kube-controller-manager-addons-313736
480e8cc1a8f21 fbbbd428abb4d 6 minutes ago Running kube-scheduler 0 45081c3deaab2 kube-scheduler-addons-313736
52fdd346b93a0 27e3830e14027 6 minutes ago Running etcd 0 fdaad85b2fd06 etcd-addons-313736
d7d101f12d251 cd0f0ae0ec9e0 6 minutes ago Running kube-apiserver 0 a627805c9a86a kube-apiserver-addons-313736
==> containerd <==
Aug 29 18:29:04 addons-313736 containerd[814]: time="2024-08-29T18:29:04.074944194Z" level=info msg="RemovePodSandbox \"f2fb470e5992719d1eee2d0805f24cd44b75b25fd347fa489438e645ec1d75b5\" returns successfully"
Aug 29 18:29:46 addons-313736 containerd[814]: time="2024-08-29T18:29:46.960466512Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.31.0@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc\""
Aug 29 18:29:47 addons-313736 containerd[814]: time="2024-08-29T18:29:47.099315475Z" level=info msg="ImageUpdate event name:\"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}"
Aug 29 18:29:47 addons-313736 containerd[814]: time="2024-08-29T18:29:47.101182701Z" level=info msg="stop pulling image ghcr.io/inspektor-gadget/inspektor-gadget@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc: active requests=0, bytes read=89"
Aug 29 18:29:47 addons-313736 containerd[814]: time="2024-08-29T18:29:47.105125308Z" level=info msg="Pulled image \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.31.0@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc\" with image id \"sha256:e2d3313f65753f82428cf312f6e4b9237983de19680bde57ca1c0935cadbe630\", repo tag \"\", repo digest \"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc\", size \"69907666\" in 144.598776ms"
Aug 29 18:29:47 addons-313736 containerd[814]: time="2024-08-29T18:29:47.105179527Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.31.0@sha256:6b2f7ac9fe6f547cfa541d9217f03da0d0c4615b561d5455a23d0edbbd607ecc\" returns image reference \"sha256:e2d3313f65753f82428cf312f6e4b9237983de19680bde57ca1c0935cadbe630\""
Aug 29 18:29:47 addons-313736 containerd[814]: time="2024-08-29T18:29:47.107325735Z" level=info msg="CreateContainer within sandbox \"658f77358b7f4b565ef6c55f028ae4ea532be387ab3cc39f1cd9702b0e25c18f\" for container &ContainerMetadata{Name:gadget,Attempt:5,}"
Aug 29 18:29:47 addons-313736 containerd[814]: time="2024-08-29T18:29:47.129535213Z" level=info msg="CreateContainer within sandbox \"658f77358b7f4b565ef6c55f028ae4ea532be387ab3cc39f1cd9702b0e25c18f\" for &ContainerMetadata{Name:gadget,Attempt:5,} returns container id \"e38deb1afbe62a078aa23c5f287af1d0c4d6ce292319ba71ba4348e0c7385242\""
Aug 29 18:29:47 addons-313736 containerd[814]: time="2024-08-29T18:29:47.130359505Z" level=info msg="StartContainer for \"e38deb1afbe62a078aa23c5f287af1d0c4d6ce292319ba71ba4348e0c7385242\""
Aug 29 18:29:47 addons-313736 containerd[814]: time="2024-08-29T18:29:47.189244427Z" level=info msg="StartContainer for \"e38deb1afbe62a078aa23c5f287af1d0c4d6ce292319ba71ba4348e0c7385242\" returns successfully"
Aug 29 18:29:48 addons-313736 containerd[814]: time="2024-08-29T18:29:48.545569712Z" level=info msg="shim disconnected" id=e38deb1afbe62a078aa23c5f287af1d0c4d6ce292319ba71ba4348e0c7385242 namespace=k8s.io
Aug 29 18:29:48 addons-313736 containerd[814]: time="2024-08-29T18:29:48.545629149Z" level=warning msg="cleaning up after shim disconnected" id=e38deb1afbe62a078aa23c5f287af1d0c4d6ce292319ba71ba4348e0c7385242 namespace=k8s.io
Aug 29 18:29:48 addons-313736 containerd[814]: time="2024-08-29T18:29:48.545641777Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Aug 29 18:29:49 addons-313736 containerd[814]: time="2024-08-29T18:29:49.158703418Z" level=info msg="RemoveContainer for \"844e0be583e0d3130aff8de4527b46b5bed10453432dc8b2947b7183452ebc70\""
Aug 29 18:29:49 addons-313736 containerd[814]: time="2024-08-29T18:29:49.166310266Z" level=info msg="RemoveContainer for \"844e0be583e0d3130aff8de4527b46b5bed10453432dc8b2947b7183452ebc70\" returns successfully"
Aug 29 18:30:04 addons-313736 containerd[814]: time="2024-08-29T18:30:04.079794261Z" level=info msg="RemoveContainer for \"69f87e160ad98d1a6c9ef1f899038f601646c029150693d0d986f426a7421e64\""
Aug 29 18:30:04 addons-313736 containerd[814]: time="2024-08-29T18:30:04.087108024Z" level=info msg="RemoveContainer for \"69f87e160ad98d1a6c9ef1f899038f601646c029150693d0d986f426a7421e64\" returns successfully"
Aug 29 18:30:04 addons-313736 containerd[814]: time="2024-08-29T18:30:04.089050014Z" level=info msg="StopPodSandbox for \"31c33e1f823e9408a008c69f320292dff318981278def68f8b5c912f73bd221b\""
Aug 29 18:30:04 addons-313736 containerd[814]: time="2024-08-29T18:30:04.097727497Z" level=info msg="TearDown network for sandbox \"31c33e1f823e9408a008c69f320292dff318981278def68f8b5c912f73bd221b\" successfully"
Aug 29 18:30:04 addons-313736 containerd[814]: time="2024-08-29T18:30:04.097775841Z" level=info msg="StopPodSandbox for \"31c33e1f823e9408a008c69f320292dff318981278def68f8b5c912f73bd221b\" returns successfully"
Aug 29 18:30:04 addons-313736 containerd[814]: time="2024-08-29T18:30:04.098426555Z" level=info msg="RemovePodSandbox for \"31c33e1f823e9408a008c69f320292dff318981278def68f8b5c912f73bd221b\""
Aug 29 18:30:04 addons-313736 containerd[814]: time="2024-08-29T18:30:04.098483884Z" level=info msg="Forcibly stopping sandbox \"31c33e1f823e9408a008c69f320292dff318981278def68f8b5c912f73bd221b\""
Aug 29 18:30:04 addons-313736 containerd[814]: time="2024-08-29T18:30:04.106198153Z" level=info msg="TearDown network for sandbox \"31c33e1f823e9408a008c69f320292dff318981278def68f8b5c912f73bd221b\" successfully"
Aug 29 18:30:04 addons-313736 containerd[814]: time="2024-08-29T18:30:04.113213167Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"31c33e1f823e9408a008c69f320292dff318981278def68f8b5c912f73bd221b\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus."
Aug 29 18:30:04 addons-313736 containerd[814]: time="2024-08-29T18:30:04.113341274Z" level=info msg="RemovePodSandbox \"31c33e1f823e9408a008c69f320292dff318981278def68f8b5c912f73bd221b\" returns successfully"
==> coredns [d0eb4940a89d47402364660ed926fa0635e8493b7a73f54ee90901f06bcc43d2] <==
[INFO] 10.244.0.4:53607 - 13671 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000060274s
[INFO] 10.244.0.4:45030 - 47685 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001532843s
[INFO] 10.244.0.4:45030 - 10311 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001701606s
[INFO] 10.244.0.4:58285 - 8418 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000136393s
[INFO] 10.244.0.4:58285 - 40173 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.00016434s
[INFO] 10.244.0.4:50757 - 55554 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000095023s
[INFO] 10.244.0.4:50757 - 33286 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000068028s
[INFO] 10.244.0.4:60517 - 55928 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000069013s
[INFO] 10.244.0.4:60517 - 18811 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000121148s
[INFO] 10.244.0.4:37001 - 53279 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000093595s
[INFO] 10.244.0.4:37001 - 32785 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.00003799s
[INFO] 10.244.0.4:32931 - 14729 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001562693s
[INFO] 10.244.0.4:32931 - 28303 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002354051s
[INFO] 10.244.0.4:60607 - 46367 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000111696s
[INFO] 10.244.0.4:60607 - 44545 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000049025s
[INFO] 10.244.0.24:49612 - 41340 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.004355372s
[INFO] 10.244.0.24:52057 - 43512 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.004493308s
[INFO] 10.244.0.24:55508 - 9797 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000149522s
[INFO] 10.244.0.24:60159 - 56369 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000140168s
[INFO] 10.244.0.24:55429 - 10368 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000123306s
[INFO] 10.244.0.24:39212 - 41562 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000104246s
[INFO] 10.244.0.24:40523 - 31610 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002425887s
[INFO] 10.244.0.24:41253 - 14902 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002235028s
[INFO] 10.244.0.24:48192 - 25359 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.004407401s
[INFO] 10.244.0.24:33371 - 53568 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 648 0.005350544s
==> describe nodes <==
Name: addons-313736
Roles: control-plane
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=addons-313736
kubernetes.io/os=linux
minikube.k8s.io/commit=95341f0b655cea8be5ebfc6bf112c8367dc08d33
minikube.k8s.io/name=addons-313736
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_08_29T18_26_04_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-313736
Annotations: csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-313736"}
kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Thu, 29 Aug 2024 18:26:01 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-313736
AcquireTime: <unset>
RenewTime: Thu, 29 Aug 2024 18:32:01 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Thu, 29 Aug 2024 18:29:08 +0000 Thu, 29 Aug 2024 18:25:57 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Thu, 29 Aug 2024 18:29:08 +0000 Thu, 29 Aug 2024 18:25:57 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Thu, 29 Aug 2024 18:29:08 +0000 Thu, 29 Aug 2024 18:25:57 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Thu, 29 Aug 2024 18:29:08 +0000 Thu, 29 Aug 2024 18:26:01 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-313736
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022296Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022296Ki
pods: 110
System Info:
Machine ID: 263fec9301ac4dd78da75a089cec312a
System UUID: f00f421e-3769-4115-a753-80d24e5ea399
Boot ID: e02afb51-111a-4769-91d4-ae8dc8b3a6de
Kernel Version: 5.15.0-1068-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.20
Kubelet Version: v1.31.0
Kube-Proxy Version:
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (27 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default cloud-spanner-emulator-769b77f747-zt9vp 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
gadget gadget-prw5j 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m54s
gcp-auth gcp-auth-89d5ffd79-l9fdx 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m27s
ingress-nginx ingress-nginx-controller-bc57996ff-ldxzl 100m (5%) 0 (0%) 90Mi (1%) 0 (0%) 5m53s
kube-system coredns-6f6b679f8f-97lvt 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 6m1s
kube-system csi-hostpath-attacher-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m51s
kube-system csi-hostpath-resizer-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m50s
kube-system csi-hostpathplugin-b99dw 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m50s
kube-system etcd-addons-313736 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 6m6s
kube-system kindnet-c427g 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 6m2s
kube-system kube-apiserver-addons-313736 250m (12%) 0 (0%) 0 (0%) 0 (0%) 6m6s
kube-system kube-controller-manager-addons-313736 200m (10%) 0 (0%) 0 (0%) 0 (0%) 6m6s
kube-system kube-ingress-dns-minikube 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
kube-system kube-proxy-px8n4 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m2s
kube-system kube-scheduler-addons-313736 100m (5%) 0 (0%) 0 (0%) 0 (0%) 6m6s
kube-system metrics-server-8988944d9-brtb2 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 5m55s
kube-system nvidia-device-plugin-daemonset-79mkt 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
kube-system registry-6fb4cdfc84-t5fqg 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
kube-system registry-proxy-zg6cg 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
kube-system snapshot-controller-56fcc65765-pl6v7 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m54s
kube-system snapshot-controller-56fcc65765-wwh99 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m54s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
local-path-storage local-path-provisioner-86d989889c-s77rc 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
volcano-system volcano-admission-77d7d48b68-cqpjm 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
volcano-system volcano-controllers-56675bb4d5-sxb4b 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m51s
volcano-system volcano-scheduler-576bc46687-wh65j 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m51s
yakd-dashboard yakd-dashboard-67d98fc6b-82mq4 0 (0%) 0 (0%) 128Mi (1%) 256Mi (3%) 5m55s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 1050m (52%) 100m (5%)
memory 638Mi (8%) 476Mi (6%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 6m kube-proxy
Normal NodeAllocatableEnforced 6m14s kubelet Updated Node Allocatable limit across pods
Warning CgroupV1 6m14s kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeHasSufficientMemory 6m14s (x8 over 6m14s) kubelet Node addons-313736 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m14s (x7 over 6m14s) kubelet Node addons-313736 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m14s (x7 over 6m14s) kubelet Node addons-313736 status is now: NodeHasSufficientPID
Normal Starting 6m14s kubelet Starting kubelet.
Normal Starting 6m7s kubelet Starting kubelet.
Warning CgroupV1 6m7s kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeAllocatableEnforced 6m6s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 6m6s kubelet Node addons-313736 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m6s kubelet Node addons-313736 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m6s kubelet Node addons-313736 status is now: NodeHasSufficientPID
Normal RegisteredNode 6m2s node-controller Node addons-313736 event: Registered Node addons-313736 in Controller
==> dmesg <==
[Aug29 16:17] ACPI: SRAT not present
[ +0.000000] ACPI: SRAT not present
[ +0.000000] SPI driver altr_a10sr has no spi_device_id for altr,a10sr
[ +0.015503] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[ +0.442504] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
[ +0.053969] systemd[1]: /lib/systemd/system/cloud-init-local.service:15: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
[ +0.002644] systemd[1]: /lib/systemd/system/cloud-init.service:19: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
[ +0.015982] systemd[1]: /lib/systemd/system/cloud-init.target:15: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
[ +0.004590] systemd[1]: /lib/systemd/system/cloud-final.service:9: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
[ +0.003517] systemd[1]: /lib/systemd/system/cloud-config.service:8: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
[ +0.630561] ena 0000:00:05.0: LLQ is not supported Fallback to host mode policy.
[ +6.637158] kauditd_printk_skb: 36 callbacks suppressed
[Aug29 17:29] hrtimer: interrupt took 9917922 ns
[Aug29 17:57] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
==> etcd [52fdd346b93a026e9610c998227663f66e4903855eeb25b622fb9da1bd5bead8] <==
{"level":"info","ts":"2024-08-29T18:25:57.457568Z","caller":"embed/etcd.go:728","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
{"level":"info","ts":"2024-08-29T18:25:57.457993Z","caller":"embed/etcd.go:279","msg":"now serving peer/client/metrics","local-member-id":"aec36adc501070cc","initial-advertise-peer-urls":["https://192.168.49.2:2380"],"listen-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.49.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
{"level":"info","ts":"2024-08-29T18:25:57.458075Z","caller":"embed/etcd.go:870","msg":"serving metrics","address":"http://127.0.0.1:2381"}
{"level":"info","ts":"2024-08-29T18:25:57.458588Z","caller":"embed/etcd.go:599","msg":"serving peer traffic","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-08-29T18:25:57.462015Z","caller":"embed/etcd.go:571","msg":"cmux::serve","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-08-29T18:25:57.461969Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
{"level":"info","ts":"2024-08-29T18:25:57.462286Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
{"level":"info","ts":"2024-08-29T18:25:57.471021Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
{"level":"info","ts":"2024-08-29T18:25:57.471237Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
{"level":"info","ts":"2024-08-29T18:25:57.471338Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-08-29T18:25:57.471424Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
{"level":"info","ts":"2024-08-29T18:25:57.471473Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-08-29T18:25:57.479158Z","caller":"etcdserver/server.go:2629","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-08-29T18:25:57.487165Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-313736 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
{"level":"info","ts":"2024-08-29T18:25:57.488029Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-08-29T18:25:57.488389Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-08-29T18:25:57.491201Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-08-29T18:25:57.493331Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
{"level":"info","ts":"2024-08-29T18:25:57.495955Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-08-29T18:25:57.496059Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
{"level":"info","ts":"2024-08-29T18:25:57.504382Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-08-29T18:25:57.492198Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-08-29T18:25:57.504230Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-08-29T18:25:57.504587Z","caller":"etcdserver/server.go:2653","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2024-08-29T18:25:57.507585Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
==> gcp-auth [35f60bb89ffeb65846ba4641b788d11513491c4b59c8aedc5c7ce9f145054c12] <==
2024/08/29 18:28:50 GCP Auth Webhook started!
2024/08/29 18:29:08 Ready to marshal response ...
2024/08/29 18:29:08 Ready to write response ...
2024/08/29 18:29:08 Ready to marshal response ...
2024/08/29 18:29:08 Ready to write response ...
==> kernel <==
18:32:10 up 2:14, 0 users, load average: 0.06, 0.90, 1.65
Linux addons-313736 5.15.0-1068-aws #74~20.04.1-Ubuntu SMP Tue Aug 6 19:45:17 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [96e14bf21ee6e8f609581392c2fab4833e615bc5e667b877d3248b0d0fe9a0f8] <==
I0829 18:30:02.920734 1 main.go:299] handling current node
I0829 18:30:12.912182 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0829 18:30:12.912241 1 main.go:299] handling current node
I0829 18:30:22.913678 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0829 18:30:22.913712 1 main.go:299] handling current node
I0829 18:30:32.921212 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0829 18:30:32.921298 1 main.go:299] handling current node
I0829 18:30:42.919100 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0829 18:30:42.919137 1 main.go:299] handling current node
I0829 18:30:52.918373 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0829 18:30:52.918409 1 main.go:299] handling current node
I0829 18:31:02.913659 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0829 18:31:02.913695 1 main.go:299] handling current node
I0829 18:31:12.912665 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0829 18:31:12.912700 1 main.go:299] handling current node
I0829 18:31:22.915696 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0829 18:31:22.915794 1 main.go:299] handling current node
I0829 18:31:32.915176 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0829 18:31:32.915225 1 main.go:299] handling current node
I0829 18:31:42.911848 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0829 18:31:42.911964 1 main.go:299] handling current node
I0829 18:31:52.917986 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0829 18:31:52.918021 1 main.go:299] handling current node
I0829 18:32:02.913704 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0829 18:32:02.913739 1 main.go:299] handling current node
==> kube-apiserver [d7d101f12d25143f4aa0ee252ea334f2abe1530bb4b458ba536c6c0040ece55c] <==
W0829 18:27:23.794615 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.136.75:443: connect: connection refused
W0829 18:27:24.864298 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.136.75:443: connect: connection refused
W0829 18:27:24.999802 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.104.238.202:443: connect: connection refused
E0829 18:27:24.999842 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.104.238.202:443: connect: connection refused" logger="UnhandledError"
W0829 18:27:25.006021 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.104.136.75:443: connect: connection refused
W0829 18:27:25.082007 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.104.238.202:443: connect: connection refused
E0829 18:27:25.082045 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.104.238.202:443: connect: connection refused" logger="UnhandledError"
W0829 18:27:25.083689 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.104.136.75:443: connect: connection refused
W0829 18:27:25.967132 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.136.75:443: connect: connection refused
W0829 18:27:27.040180 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.136.75:443: connect: connection refused
W0829 18:27:28.134900 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.136.75:443: connect: connection refused
W0829 18:27:29.235768 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.136.75:443: connect: connection refused
W0829 18:27:30.300379 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.136.75:443: connect: connection refused
W0829 18:27:31.354290 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.136.75:443: connect: connection refused
W0829 18:27:32.379390 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.136.75:443: connect: connection refused
W0829 18:27:33.387332 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.136.75:443: connect: connection refused
W0829 18:27:34.412992 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.104.136.75:443: connect: connection refused
W0829 18:27:43.963186 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.104.238.202:443: connect: connection refused
E0829 18:27:43.963227 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.104.238.202:443: connect: connection refused" logger="UnhandledError"
W0829 18:28:25.018575 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.104.238.202:443: connect: connection refused
E0829 18:28:25.018612 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.104.238.202:443: connect: connection refused" logger="UnhandledError"
W0829 18:28:25.091426 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.104.238.202:443: connect: connection refused
E0829 18:28:25.091467 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.104.238.202:443: connect: connection refused" logger="UnhandledError"
I0829 18:29:08.164997 1 controller.go:615] quota admission added evaluator for: jobs.batch.volcano.sh
I0829 18:29:08.200794 1 controller.go:615] quota admission added evaluator for: podgroups.scheduling.volcano.sh
==> kube-controller-manager [39ab06cc61bd0a3079ec5889377f94e64e11cdd776b274d19a2cb98a0a541d7f] <==
I0829 18:28:25.048219 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0829 18:28:25.054551 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0829 18:28:25.071716 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0829 18:28:25.102346 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0829 18:28:25.115034 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0829 18:28:25.118227 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0829 18:28:25.131205 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0829 18:28:25.892202 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0829 18:28:25.907332 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0829 18:28:27.052129 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0829 18:28:27.077416 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0829 18:28:28.059875 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0829 18:28:28.070059 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0829 18:28:28.077441 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0829 18:28:28.084485 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0829 18:28:28.096597 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0829 18:28:28.101000 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0829 18:28:50.987205 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="14.708016ms"
I0829 18:28:50.987483 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="239.769µs"
I0829 18:28:58.026870 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0829 18:28:58.031057 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0829 18:28:58.076553 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0829 18:28:58.081448 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0829 18:29:07.872607 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="volcano-system/volcano-admission-init" delay="0s"
I0829 18:29:08.391258 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-313736"
==> kube-proxy [fd6c29e1575a6e95cae62ae9293385338bac9914a6d43a5508574caa1790ca8e] <==
I0829 18:26:10.070149 1 server_linux.go:66] "Using iptables proxy"
I0829 18:26:10.190319 1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
E0829 18:26:10.190483 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I0829 18:26:10.234913 1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I0829 18:26:10.235506 1 server_linux.go:169] "Using iptables Proxier"
I0829 18:26:10.239222 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I0829 18:26:10.239709 1 server.go:483] "Version info" version="v1.31.0"
I0829 18:26:10.239727 1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0829 18:26:10.257812 1 config.go:197] "Starting service config controller"
I0829 18:26:10.257851 1 shared_informer.go:313] Waiting for caches to sync for service config
I0829 18:26:10.257878 1 config.go:104] "Starting endpoint slice config controller"
I0829 18:26:10.257883 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0829 18:26:10.259304 1 config.go:326] "Starting node config controller"
I0829 18:26:10.259342 1 shared_informer.go:313] Waiting for caches to sync for node config
I0829 18:26:10.359504 1 shared_informer.go:320] Caches are synced for node config
I0829 18:26:10.359543 1 shared_informer.go:320] Caches are synced for service config
I0829 18:26:10.359598 1 shared_informer.go:320] Caches are synced for endpoint slice config
==> kube-scheduler [480e8cc1a8f21bc4f6b3dfbc0e43eb002c354bf6fecd8637ec8dd013fae683f5] <==
W0829 18:26:01.216496 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0829 18:26:01.216515 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0829 18:26:01.216686 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0829 18:26:01.216818 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0829 18:26:01.220770 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0829 18:26:01.221137 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0829 18:26:01.225053 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0829 18:26:01.225167 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0829 18:26:01.226373 1 reflector.go:561] runtime/asm_arm64.s:1222: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0829 18:26:01.226429 1 reflector.go:158] "Unhandled Error" err="runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"
W0829 18:26:02.068648 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0829 18:26:02.068874 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0829 18:26:02.107720 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0829 18:26:02.107761 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0829 18:26:02.150376 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0829 18:26:02.150583 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0829 18:26:02.282055 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0829 18:26:02.282210 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0829 18:26:02.314438 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
E0829 18:26:02.314486 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0829 18:26:02.333168 1 reflector.go:561] runtime/asm_arm64.s:1222: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0829 18:26:02.333457 1 reflector.go:158] "Unhandled Error" err="runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"
W0829 18:26:02.406538 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0829 18:26:02.406807 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
I0829 18:26:04.311791 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Aug 29 18:30:03 addons-313736 kubelet[1478]: E0829 18:30:03.961526 1478 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-prw5j_gadget(4e6d54d9-f641-4930-a9bc-fee007384e50)\"" pod="gadget/gadget-prw5j" podUID="4e6d54d9-f641-4930-a9bc-fee007384e50"
Aug 29 18:30:04 addons-313736 kubelet[1478]: I0829 18:30:04.077783 1478 scope.go:117] "RemoveContainer" containerID="69f87e160ad98d1a6c9ef1f899038f601646c029150693d0d986f426a7421e64"
Aug 29 18:30:13 addons-313736 kubelet[1478]: I0829 18:30:13.960580 1478 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-79mkt" secret="" err="secret \"gcp-auth\" not found"
Aug 29 18:30:14 addons-313736 kubelet[1478]: I0829 18:30:14.961427 1478 scope.go:117] "RemoveContainer" containerID="e38deb1afbe62a078aa23c5f287af1d0c4d6ce292319ba71ba4348e0c7385242"
Aug 29 18:30:14 addons-313736 kubelet[1478]: E0829 18:30:14.961631 1478 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-prw5j_gadget(4e6d54d9-f641-4930-a9bc-fee007384e50)\"" pod="gadget/gadget-prw5j" podUID="4e6d54d9-f641-4930-a9bc-fee007384e50"
Aug 29 18:30:28 addons-313736 kubelet[1478]: I0829 18:30:28.959621 1478 scope.go:117] "RemoveContainer" containerID="e38deb1afbe62a078aa23c5f287af1d0c4d6ce292319ba71ba4348e0c7385242"
Aug 29 18:30:28 addons-313736 kubelet[1478]: E0829 18:30:28.959827 1478 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-prw5j_gadget(4e6d54d9-f641-4930-a9bc-fee007384e50)\"" pod="gadget/gadget-prw5j" podUID="4e6d54d9-f641-4930-a9bc-fee007384e50"
Aug 29 18:30:40 addons-313736 kubelet[1478]: I0829 18:30:40.959810 1478 scope.go:117] "RemoveContainer" containerID="e38deb1afbe62a078aa23c5f287af1d0c4d6ce292319ba71ba4348e0c7385242"
Aug 29 18:30:40 addons-313736 kubelet[1478]: E0829 18:30:40.960484 1478 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-prw5j_gadget(4e6d54d9-f641-4930-a9bc-fee007384e50)\"" pod="gadget/gadget-prw5j" podUID="4e6d54d9-f641-4930-a9bc-fee007384e50"
Aug 29 18:30:53 addons-313736 kubelet[1478]: I0829 18:30:53.960806 1478 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-6fb4cdfc84-t5fqg" secret="" err="secret \"gcp-auth\" not found"
Aug 29 18:30:55 addons-313736 kubelet[1478]: I0829 18:30:55.959763 1478 scope.go:117] "RemoveContainer" containerID="e38deb1afbe62a078aa23c5f287af1d0c4d6ce292319ba71ba4348e0c7385242"
Aug 29 18:30:55 addons-313736 kubelet[1478]: E0829 18:30:55.960419 1478 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-prw5j_gadget(4e6d54d9-f641-4930-a9bc-fee007384e50)\"" pod="gadget/gadget-prw5j" podUID="4e6d54d9-f641-4930-a9bc-fee007384e50"
Aug 29 18:31:07 addons-313736 kubelet[1478]: I0829 18:31:07.959715 1478 scope.go:117] "RemoveContainer" containerID="e38deb1afbe62a078aa23c5f287af1d0c4d6ce292319ba71ba4348e0c7385242"
Aug 29 18:31:07 addons-313736 kubelet[1478]: E0829 18:31:07.960400 1478 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-prw5j_gadget(4e6d54d9-f641-4930-a9bc-fee007384e50)\"" pod="gadget/gadget-prw5j" podUID="4e6d54d9-f641-4930-a9bc-fee007384e50"
Aug 29 18:31:16 addons-313736 kubelet[1478]: I0829 18:31:16.959486 1478 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-zg6cg" secret="" err="secret \"gcp-auth\" not found"
Aug 29 18:31:22 addons-313736 kubelet[1478]: I0829 18:31:22.959950 1478 scope.go:117] "RemoveContainer" containerID="e38deb1afbe62a078aa23c5f287af1d0c4d6ce292319ba71ba4348e0c7385242"
Aug 29 18:31:22 addons-313736 kubelet[1478]: E0829 18:31:22.960146 1478 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-prw5j_gadget(4e6d54d9-f641-4930-a9bc-fee007384e50)\"" pod="gadget/gadget-prw5j" podUID="4e6d54d9-f641-4930-a9bc-fee007384e50"
Aug 29 18:31:35 addons-313736 kubelet[1478]: I0829 18:31:35.959728 1478 scope.go:117] "RemoveContainer" containerID="e38deb1afbe62a078aa23c5f287af1d0c4d6ce292319ba71ba4348e0c7385242"
Aug 29 18:31:35 addons-313736 kubelet[1478]: E0829 18:31:35.960406 1478 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-prw5j_gadget(4e6d54d9-f641-4930-a9bc-fee007384e50)\"" pod="gadget/gadget-prw5j" podUID="4e6d54d9-f641-4930-a9bc-fee007384e50"
Aug 29 18:31:35 addons-313736 kubelet[1478]: I0829 18:31:35.961062 1478 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-79mkt" secret="" err="secret \"gcp-auth\" not found"
Aug 29 18:31:48 addons-313736 kubelet[1478]: I0829 18:31:48.959315 1478 scope.go:117] "RemoveContainer" containerID="e38deb1afbe62a078aa23c5f287af1d0c4d6ce292319ba71ba4348e0c7385242"
Aug 29 18:31:48 addons-313736 kubelet[1478]: E0829 18:31:48.959537 1478 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-prw5j_gadget(4e6d54d9-f641-4930-a9bc-fee007384e50)\"" pod="gadget/gadget-prw5j" podUID="4e6d54d9-f641-4930-a9bc-fee007384e50"
Aug 29 18:31:59 addons-313736 kubelet[1478]: I0829 18:31:59.959673 1478 scope.go:117] "RemoveContainer" containerID="e38deb1afbe62a078aa23c5f287af1d0c4d6ce292319ba71ba4348e0c7385242"
Aug 29 18:31:59 addons-313736 kubelet[1478]: E0829 18:31:59.960297 1478 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-prw5j_gadget(4e6d54d9-f641-4930-a9bc-fee007384e50)\"" pod="gadget/gadget-prw5j" podUID="4e6d54d9-f641-4930-a9bc-fee007384e50"
Aug 29 18:32:09 addons-313736 kubelet[1478]: I0829 18:32:09.961069 1478 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-6fb4cdfc84-t5fqg" secret="" err="secret \"gcp-auth\" not found"
==> storage-provisioner [b49cdd4d50dafadcbcde333efc3ca6a85cd11d05cf2017ee611deb49ca156f2d] <==
I0829 18:26:15.424720 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0829 18:26:15.452197 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0829 18:26:15.452251 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0829 18:26:15.461592 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0829 18:26:15.464422 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-313736_a56240c1-815e-41f6-9d80-173860d8b366!
I0829 18:26:15.464507 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"c8542d27-815b-4f83-9382-a7b92c0d659f", APIVersion:"v1", ResourceVersion:"579", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-313736_a56240c1-815e-41f6-9d80-173860d8b366 became leader
I0829 18:26:15.566150 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-313736_a56240c1-815e-41f6-9d80-173860d8b366!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-313736 -n addons-313736
helpers_test.go:261: (dbg) Run: kubectl --context addons-313736 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: ingress-nginx-admission-create-g99hw ingress-nginx-admission-patch-ttxpv test-job-nginx-0
helpers_test.go:274: ======> post-mortem[TestAddons/serial/Volcano]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-313736 describe pod ingress-nginx-admission-create-g99hw ingress-nginx-admission-patch-ttxpv test-job-nginx-0
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-313736 describe pod ingress-nginx-admission-create-g99hw ingress-nginx-admission-patch-ttxpv test-job-nginx-0: exit status 1 (85.14241ms)
** stderr **
Error from server (NotFound): pods "ingress-nginx-admission-create-g99hw" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-ttxpv" not found
Error from server (NotFound): pods "test-job-nginx-0" not found
** /stderr **
helpers_test.go:279: kubectl --context addons-313736 describe pod ingress-nginx-admission-create-g99hw ingress-nginx-admission-patch-ttxpv test-job-nginx-0: exit status 1
--- FAIL: TestAddons/serial/Volcano (199.96s)